00010000:00010000:3.0:1789429254.670573:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f31d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b1f3 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429254.670589:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f31d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b1f3 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429254.670628:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f31d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b1f3 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429254.670644:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648199296:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429254.670723:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e02408d80 going to sleep for 11 seconds 00000001:00080000:3.0:1789429254.677830:0:20996:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969536 is committed 00000100:00100000:3.0:1789429254.691699:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429254.821102:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648199680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789429255.396454:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429257.443386:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429257.496849:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634752512 00000100:00100000:3.0:1789429257.496858:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634752512 00000100:00100000:3.0:1789429257.496984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:3.0:1789429257.496997:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:12e09781-3d24-4c67-9972-bb781900e20d+34:2368:x1876351634752512:12345-192.168.203.39@tcp:63:ll_sa.0 00010000:00010000:3.0:1789429257.497038:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429257.497061:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f32b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b201 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497114:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f332 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497127:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f332 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497139:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f332 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497170:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f339 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d909c4a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497179:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d909c4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497185:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d909c4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497419:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f332 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497427:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f332 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497434:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f332 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497440:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429257.497444:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f332 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497451:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f332 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497462:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:3.0:1789429257.497637:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429257.497645:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f332 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497652:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f332 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497664:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f339 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d909c4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497671:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f339 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d909c4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497676:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f339 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d909c4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497681:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429257.497685:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f339 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d909c4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497691:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f339 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d909c4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497699:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d909c4a (ffff946f04fb8c00) 00010000:00010000:3.0:1789429257.497702:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429257.497705:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f339 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d909c4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497711:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f339 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d909c4a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497740:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f32b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b201 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497756:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:3.0:1789429257.497758:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789429257.497762:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f32b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b201 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429257.497773:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc -2) 00000100:00100000:3.0:1789429259.035969:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 664 00000100:00100000:3.0:1789429259.035983:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2368:x1876351634753152:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429259.036037:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2368:x1876351634753152:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 58us (2923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429259.039356:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 664 00000100:00100000:3.0:1789429259.428106:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648200320:0@lo:400:kworker.0 00000100:00100000:3.0:1789429259.428147:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429259.428262:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429259.428269:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648200192:0@lo:400:kworker.0 00000100:00100000:3.0:1789429259.428597:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429259.428630:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648200320:0@lo:400:kworker.0 00000100:00100000:3.0:1789429259.429095:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648199936:0@lo:400:kworker.0 00010000:00010000:3.0:1789429259.491364:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429261.539366:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429263.552516:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634753536 00000100:00100000:3.0:1789429263.552526:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634753536 00000100:00100000:3.0:1789429263.552641:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21015 00000100:00100000:3.0:1789429263.552653:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+34:33347:x1876351634753536:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429263.552674:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429263.552697:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f340 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b208 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.552756:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f347 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.552770:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.552782:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429263.552816:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429263.552820:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429263.552840:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f347 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.552875:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f340 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b208 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.552893:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f347 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b208 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.552902:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:3.0:1789429263.552905:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429263.552908:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429263.552972:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+35:33347:x1876351634753536:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 323us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429263.552980:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21015 00010000:00010000:3.0:1789429263.588721:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429263.603592:0:15669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648200960:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429263.603626:0:15669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd9000/0xb4c3dad72635f378 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.607995:0:15669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd9000/0xb4c3dad72635f378 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.608005:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd9000/0xb4c3dad72635f378 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429263.608023:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x67:0x0]: returning size 0 00000100:00100000:3.0:1789429263.679885:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429263.680390:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21020 00000100:00100000:3.0:1789429263.680405:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+40:33348:x1876351634755072:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:3.0:1789429263.680434:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429263.680462:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f39b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b22b expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680549:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f3a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680568:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f3a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680584:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f3a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680602:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f3a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680615:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680622:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680738:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad72635f3b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680747:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad72635f3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680754:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad72635f3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429263.680795:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x67:0x0]: returning size 0 00000004:00200000:3.0:1789429263.680799:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429263.680821:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad72635f3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680833:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad72635f3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680841:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f3a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680847:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f3a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680855:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f3a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680864:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429263.680869:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f3a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680877:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f3a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680889:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04cf6600) 00010000:00010000:3.0:1789429263.680892:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429263.680897:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f3a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680903:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f3a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680917:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680922:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f3a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680928:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680933:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429263.680935:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680939:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f3a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680949:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ec7601 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429263.680951:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429263.680954:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f3a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.680975:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f3a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.681722:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f39b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b22b expref: 42 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.681746:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad72635f3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b22b expref: 41 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.681757:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff946f04cf6700) 00010000:00010000:3.0:1789429263.681760:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429263.681764:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5200, rc 0) 00000100:00100000:3.0:1789429263.695420:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634755456 00000100:00100000:3.0:1789429263.695437:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634755456 00000100:00100000:3.0:1789429263.711599:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634755840 00000100:00100000:3.0:1789429263.711612:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634755840 00000100:00100000:3.0:1789429263.711686:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21022 00000100:00100000:3.0:1789429263.711699:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+42:33348:x1876351634755840:12345-192.168.203.39@tcp:36:cp.0 00010000:00010000:3.0:1789429263.712112:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f3d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.712134:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429263.712153:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789429263.712286:0:15700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977041 00000004:00010000:3.0:1789429263.712324:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d25234a2 reply state 00000000f456719a transno 4294977042 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f3d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429263.712334:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789429263.712458:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+45:33348:x1876351634755840:12345-192.168.203.39@tcp:36:cp.0 Request processed in 760us (1107us total) trans 4294977042 rc 0/0 00000100:00100000:3.0:1789429263.712466:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21022 00000020:00080000:3.0:1789429263.712472:0:15700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789429263.717508:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429263.732484:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429263.736614:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429263.816957:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634756992 00000100:00100000:3.0:1789429263.816967:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634756992 00000100:00100000:3.0:1789429263.817086:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634757120 00000100:00100000:3.0:1789429263.817091:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634757120 00000100:00100000:3.0:1789429263.819068:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634757248 00000100:00100000:3.0:1789429263.819075:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634757248 00002000:00100000:3.0:1789429263.819180:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x27:0x0] (0->320) req@ffff946f34499880 x1876351634757248/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:754/0 lens 816/0 e 0 to 0 dl 1789429274 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429263.819191:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499880 with x1876351634757248 ext(0->320) 00002000:00010000:3.0:1789429263.819809:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34499880 00000100:00100000:3.0:1789429263.819844:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11270 00000100:00100000:3.0:1789429263.819856:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+13:2370:x1876351634757248:12345-192.168.203.39@tcp:4:fsx.0 00000100:00100000:3.0:1789429263.821190:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+15:2370:x1876351634757248:12345-192.168.203.39@tcp:4:fsx.0 Request processed in 1336us (2192us total) trans 4294969238 rc 0/0 00000100:00100000:3.0:1789429263.821222:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11270 00002000:00100000:3.0:1789429263.821232:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x27:0x0] (0->320) req@ffff946f34499880 x1876351634757248/t4294969238(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:754/0 lens 816/448 e 0 to 0 dl 1789429274 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429263.821240:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499880 with x1876351634757248 ext(0->320) 00002000:00010000:3.0:1789429263.821244:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34499880 00000100:00100000:3.0:1789429263.822872:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1789429263.824280:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429263.825515:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634757504 00000100:00100000:3.0:1789429263.825523:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634757504 00002000:00100000:3.0:1789429263.825574:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x28:0x0] (0->320) req@ffff946f34498000 x1876351634757504/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:754/0 lens 816/0 e 0 to 0 dl 1789429274 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429263.825584:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34498000 with x1876351634757504 ext(0->320) 00002000:00010000:3.0:1789429263.825590:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34498000 00000100:00100000:3.0:1789429263.825623:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11272 00000100:00100000:3.0:1789429263.825633:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+15:2369:x1876351634757504:12345-192.168.203.39@tcp:4:fsx.0 00000100:00100000:3.0:1789429263.826422:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+17:2369:x1876351634757504:12345-192.168.203.39@tcp:4:fsx.0 Request processed in 788us (1051us total) trans 4294969239 rc 0/0 00000100:00100000:3.0:1789429263.826431:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11272 00002000:00100000:3.0:1789429263.826438:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x28:0x0] (0->320) req@ffff946f34498000 x1876351634757504/t4294969239(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:754/0 lens 816/448 e 0 to 0 dl 1789429274 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429263.826446:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34498000 with x1876351634757504 ext(0->320) 00002000:00010000:3.0:1789429263.826450:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34498000 00000001:00080000:3.0:1789429264.123723:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969236 is committed 00000001:00080000:3.0:1789429264.123748:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969237 is committed 00000001:00080000:3.0:1789429264.123762:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969239 is committed 00000100:00100000:3.0:1789429264.149646:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634758272 00000100:00100000:3.0:1789429264.149656:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634758272 00000100:00100000:3.0:1789429264.149715:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 668 00000100:00100000:3.0:1789429264.149724:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+45:2370:x1876351634758272:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429264.149806:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+45:2370:x1876351634758272:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 83us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.149815:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 668 00000100:00100000:3.0:1789429264.153417:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634758528 00000100:00100000:3.0:1789429264.153427:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634758528 00000100:00100000:3.0:1789429264.153470:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634758784 00000100:00100000:3.0:1789429264.153473:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634758784 00000100:00100000:3.0:1789429264.153499:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634758400 00000100:00100000:3.0:1789429264.153502:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634758400 00000100:00100000:3.0:1789429264.153519:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634758912 00000100:00100000:3.0:1789429264.153521:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634758912 00000100:00100000:3.0:1789429264.153537:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 720 00000100:00100000:3.0:1789429264.153545:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351634758528:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429264.153615:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351634758528:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.153622:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 720 00000100:00100000:3.0:1789429264.153638:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 721 00000100:00100000:3.0:1789429264.153645:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351634758784:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429264.153668:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351634758784:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.153674:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 721 00000100:00100000:3.0:1789429264.153685:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 722 00000100:00100000:3.0:1789429264.153691:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351634758400:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429264.153713:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351634758400:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.153719:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 722 00000100:00100000:3.0:1789429264.153729:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 723 00000100:00100000:3.0:1789429264.153735:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351634758912:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429264.153756:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351634758912:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.153761:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 723 00000100:00100000:3.0:1789429264.153778:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634758656 00000100:00100000:3.0:1789429264.153782:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634758656 00000100:00100000:3.0:1789429264.153815:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 669 00000100:00100000:3.0:1789429264.153822:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351634758656:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429264.153850:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351634758656:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.153857:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 669 00000100:00080000:3.0:1789429264.153881:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429264.547561:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648201600:0@lo:400:kworker.0 00000100:00100000:3.0:1789429264.548917:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429264.548967:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648202112:0@lo:400:kworker.0 00000100:00100000:3.0:1789429264.548993:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429264.549047:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648201600 00000100:00100000:3.0:1789429264.549055:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648201600 00000100:00100000:3.0:1789429264.549099:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1789429264.549107:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648201600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429264.549170:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648201600:12345-0@lo:400:kworker.0 Request processed in 64us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.549178:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1789429264.549227:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648202112 00000100:00100000:3.0:1789429264.549231:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648202112 00000100:00100000:3.0:1789429264.549267:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1789429264.549293:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648202112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429264.549327:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648202112:12345-0@lo:400:kworker.0 Request processed in 54us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.549333:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00080000:3.0:1789429264.549355:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429264.549382:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648201600:0@lo:400:kworker.0 00000100:00100000:3.0:1789429264.549394:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648202112:0@lo:400:kworker.0 00000100:00100000:3.0:1789429264.552753:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648201728 00000100:00100000:3.0:1789429264.552765:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648201728 00000100:00100000:3.0:1789429264.552829:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1789429264.552839:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648201728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429264.552897:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648201728:12345-0@lo:400:kworker.0 Request processed in 59us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.552904:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1789429264.552937:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648202240 00000100:00100000:3.0:1789429264.552941:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648202240 00000100:00100000:3.0:1789429264.552976:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:3.0:1789429264.552982:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648202240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429264.553014:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648202240:12345-0@lo:400:kworker.0 Request processed in 33us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.553021:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00080000:3.0:1789429264.553039:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429264.553770:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648201984 00000100:00100000:3.0:1789429264.553775:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648201984 00000100:00100000:3.0:1789429264.553814:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1789429264.553821:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648201984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429264.553863:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648201984:12345-0@lo:400:kworker.0 Request processed in 43us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.553869:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1789429264.553898:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648201984:0@lo:400:kworker.0 00000100:00100000:3.0:1789429264.708542:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634759168 00000100:00100000:3.0:1789429264.708556:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634759168 00000100:00100000:3.0:1789429264.708618:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21024 00000100:00100000:3.0:1789429264.708627:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+45:33366:x1876351634759168:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1789429264.708646:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429264.708648:0:15669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789429264.708682:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72635f394 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b224 expref: 45 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.708698:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04cf6600) 00010000:00010000:3.0:1789429264.708709:0:15669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00020000:3.0:1789429264.708718:0:15669:0:(ldlm_resource.c:1633:ldlm_resource_get()) cfs_fail_timeout id 30a sleeping for 2000ms 00000100:00100000:3.0:1789429264.732976:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429264.733000:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634759552 00000100:00100000:3.0:1789429264.733004:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634759552 00000100:00100000:3.0:1789429264.733029:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21027 00000100:00100000:3.0:1789429264.733037:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+45:33365:x1876351634759552:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:3.0:1789429264.733047:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429264.733057:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f40b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b263 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.733090:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f412 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.734948:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.734974:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429264.735015:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429264.735022:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429264.735044:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.735069:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f40b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b263 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.735092:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b263 expref: 46 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.735106:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429264.735109:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429264.736352:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4600, rc 0) 00000100:00100000:3.0:1789429264.736404:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+46:33365:x1876351634759552:12345-192.168.203.39@tcp:101:ls.0 Request processed in 3366us (3427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.736410:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21027 00000100:00100000:3.0:1789429264.767012:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634760192 00000100:00100000:3.0:1789429264.767022:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634760192 00000100:00100000:3.0:1789429264.767072:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21029 00000100:00100000:3.0:1789429264.767081:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33367:x1876351634760192:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:3.0:1789429264.767104:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429264.767135:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f43c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b271 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767196:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f443 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767232:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767244:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767265:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f44a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767273:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f44a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767280:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f44a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767381:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f451 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767390:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767401:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429264.767434:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x67:0x0]: returning size 1048576 00000004:00200000:3.0:1789429264.767437:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429264.767457:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767468:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767476:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767482:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f443 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767489:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f443 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767494:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429264.767498:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f443 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767506:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f443 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767517:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429264.767520:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429264.767524:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f443 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767534:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767546:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f44a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767551:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f44a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767556:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f44a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767560:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429264.767563:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f44a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767569:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f44a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767576:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42ec7601 (ffff946f04fb8200) 00010000:00010000:3.0:1789429264.767578:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429264.767581:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f44a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767587:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f44a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42ec7601 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767615:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f43c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b271 expref: 16 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767634:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b271 expref: 15 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.767641:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff946f04cf6700) 00010000:00010000:3.0:1789429264.767643:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429264.767645:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4600, rc 0) 00000100:00100000:3.0:1789429264.768085:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33367:x1876351634760192:12345-192.168.203.39@tcp:101:ls.0 Request processed in 1003us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.768094:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21029 00000100:00100000:3.0:1789429264.778770:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634760448 00000100:00100000:3.0:1789429264.778780:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634760448 00000100:00100000:3.0:1789429264.778843:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21030 00000100:00100000:3.0:1789429264.778854:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33367:x1876351634760448:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:3.0:1789429264.778873:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429264.778893:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72635f45f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b27f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.778957:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f466 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.778972:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.778984:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429264.779018:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429264.779022:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429264.779043:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.779070:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72635f45f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b27f expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.779087:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f466 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b27f expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429264.779095:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429264.779097:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429264.779101:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:3.0:1789429264.779170:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33367:x1876351634760448:12345-192.168.203.39@tcp:101:ls.0 Request processed in 318us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429264.779177:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21030 00000100:00100000:3.0:1789429264.832318:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429264.842019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634761088 00000100:00100000:3.0:1789429264.842030:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634761088 00000100:00100000:3.0:1789429264.842097:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 225 00000100:00100000:3.0:1789429264.842119:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33368:x1876351634761088:12345-192.168.203.39@tcp:35:awk.0 00000100:00100000:3.0:1789429264.842489:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33368:x1876351634761088:12345-192.168.203.39@tcp:35:awk.0 Request processed in 382us (1169us total) trans 4294977045 rc 0/0 00000100:00100000:3.0:1789429264.842498:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 225 00010000:00010000:3.0:1789429265.639985:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:3.0:1789429266.812264:0:15669:0:(ldlm_resource.c:1633:ldlm_resource_get()) cfs_fail_timeout id 30a awake 00010000:00010000:3.0:1789429266.820610:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72635f47b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b24e expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.822153:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f482 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.822178:0:15669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f466 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b27f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.822189:0:15669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f482 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.822242:0:15669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f466 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b27f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.822259:0:15669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5800/0xb4c3dad72635f466 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b27f expref: 14 pid: 5840 timeout: 1064 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429266.822283:0:15669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b4e2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648203136:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429266.822594:0:15669:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d6c00 going to sleep for 11 seconds 00000100:00080000:3.0:1789429266.827982:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789429266.828422:0:15669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f482 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.828429:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f482 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.829921:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f489 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.829941:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f489 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.829953:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f489 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789429266.830758:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x29:0x0], index 1: 0 00010000:00010000:3.0:1789429266.830984:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f490 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x68:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.830996:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.831003:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.831037:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f482 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.831044:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f482 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.831051:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f482 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.831057:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429266.831061:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f482 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.831068:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f482 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.831079:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429266.831082:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429266.831087:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f482 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.831092:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f482 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429266.831105:0:15669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003ab89245 reply state 000000005eefc004 transno 4294977046 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72635f489 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94573c07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429266.831113:0:15669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789429266.834760:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72635f47b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b24e expref: 39 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.834938:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b24e expref: 38 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.834948:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x68:0x0].0x0 (ffff946f04fb8200) 00010000:00010000:3.0:1789429266.834950:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429266.834953:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5400, rc 0) 00000100:00100000:3.0:1789429266.835090:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+39:33366:x1876351634759168:12345-192.168.203.39@tcp:101:bash.0 Request processed in 2126462us (2128133us total) trans 4294977046 rc 0/0 00000100:00100000:3.0:1789429266.835108:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21024 00000100:00080000:3.0:1789429266.844755:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429266.852721:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634761472 00000100:00100000:3.0:1789429266.852731:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634761472 00000100:00100000:3.0:1789429266.852806:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5193 00000100:00100000:3.0:1789429266.852817:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351634761472:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:3.0:1789429266.852836:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429266.852854:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d42bc775/0xb4c3dad72635f4ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b29b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.852883:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789429266.852887:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429266.852895:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d42bc775/0xb4c3dad72635f4ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b29b expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.852912:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d42bc775/0xb4c3dad72635f4ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b29b expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.852925:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4a00, rc 0) 00000100:00100000:3.0:1789429266.852988:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351634761472:12345-192.168.203.39@tcp:101:ls.0 Request processed in 174us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429266.852995:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5193 00000100:00100000:3.0:1789429266.862859:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634761600 00000100:00100000:3.0:1789429266.862870:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634761600 00000100:00100000:3.0:1789429266.862929:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21032 00000100:00100000:3.0:1789429266.862940:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+39:33365:x1876351634761600:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:3.0:1789429266.862961:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429266.862984:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f4c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b2a2 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.863047:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad72635f4c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.863060:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad72635f4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.863075:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad72635f4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429266.863399:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429266.863403:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429266.863425:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad72635f4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.863559:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f4c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2a2 expref: 41 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.863649:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad72635f4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2a2 expref: 40 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.863660:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429266.863663:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429266.863667:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5200, rc 0) 00000100:00100000:3.0:1789429266.863725:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+40:33365:x1876351634761600:12345-192.168.203.39@tcp:101:ls.0 Request processed in 787us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429266.863732:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21032 00000100:00100000:3.0:1789429266.871806:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634761856 00000100:00100000:3.0:1789429266.871812:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634761856 00000100:00100000:3.0:1789429266.895640:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634762112 00000100:00100000:3.0:1789429266.895648:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634762112 00010000:00010000:3.0:1789429266.895681:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f4cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2a9 expref: 8 pid: 6680 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429266.895720:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5657 00000100:00100000:3.0:1789429266.895730:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634762112:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429266.895744:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429266.895768:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f4cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2a9 expref: 8 pid: 6680 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.895781:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f4cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2a9 expref: 8 pid: 6680 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.895802:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f4cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2a9 expref: 8 pid: 6680 timeout: 1064 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.895816:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429266.895820:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429266.895828:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a8a05c90/0xb4c3dad72635f4d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2b0 expref: 6 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.895838:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8a05c90/0xb4c3dad72635f4d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2b0 expref: 6 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.895871:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a8a05c90/0xb4c3dad72635f4d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2b0 expref: 6 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429266.895885:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b4e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648203392:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429266.895932:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429266.905620:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b4e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648203392:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429266.905648:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429266.905705:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351634762112:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9975us (10566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429266.905716:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5657 00000100:00100000:3.0:1789429266.944075:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634762496 00000100:00100000:3.0:1789429266.944085:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634762496 00000100:00100000:3.0:1789429266.944149:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21033 00000100:00100000:3.0:1789429266.944159:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33369:x1876351634762496:12345-192.168.203.39@tcp:101:diff.0 00010000:00010000:3.0:1789429266.944182:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429266.944228:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f4dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b2b7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.944340:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f4e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.944354:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.944364:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429266.944398:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429266.944401:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429266.944423:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f4e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.944457:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f4dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2b7 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.944473:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2b7 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429266.944481:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429266.944484:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429266.944488:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429266.944548:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33369:x1876351634762496:12345-192.168.203.39@tcp:101:diff.0 Request processed in 389us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429266.944554:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21033 00010000:00010000:3.0:1789429267.683347:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429269.269439:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634763648 00000100:00100000:3.0:1789429269.269450:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634763648 00000100:00100000:3.0:1789429269.269526:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 673 00000100:00100000:3.0:1789429269.269539:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+43:2370:x1876351634763648:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429269.269620:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+43:2370:x1876351634763648:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 84us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429269.269628:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 673 00000100:00100000:3.0:1789429269.271870:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634763776 00000100:00100000:3.0:1789429269.271882:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634763776 00000100:00100000:3.0:1789429269.271952:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 726 00000100:00100000:3.0:1789429269.271966:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f11190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351634763776:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429269.272025:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f11190c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351634763776:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 63us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429269.272033:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 726 00000100:00080000:3.0:1789429269.272196:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429269.276973:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429269.276981:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429269.276985:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429269.670273:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648203520:0@lo:400:kworker.0 00000100:00100000:3.0:1789429269.670348:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429269.671070:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789429269.671080:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648203648:0@lo:400:kworker.0 00000100:00100000:3.0:1789429269.671121:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429269.671172:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648203648 00000100:00100000:3.0:1789429269.671180:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648203648 00000100:00100000:3.0:1789429269.671264:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1789429269.671273:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648203648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429269.671325:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648203648:12345-0@lo:400:kworker.0 Request processed in 53us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429269.671332:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:3.0:1789429269.671371:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648203648:0@lo:400:kworker.0 00010000:00010000:3.0:1789429269.732306:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429270.179843:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05472300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648204288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429270.180706:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648204416 00000100:00100000:3.0:1789429270.180712:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648204416 00000100:00100000:3.0:1789429270.180761:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789429270.180769:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648204416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429270.180790:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 325255168 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1789429270.180828:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648204416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429270.180835:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00010000:3.0:1789429271.779381:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789429273.141457:0:21446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 18: mmap sanity check =========================================================================================== 19:41:12 (1789429272) 00000100:00100000:3.0:1789429273.311782:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.318382:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634764672 00000100:00100000:3.0:1789429273.318390:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634764672 00010000:00010000:3.0:1789429273.318441:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f4e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2b7 expref: 15 pid: 5840 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.318479:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5658 00000100:00100000:3.0:1789429273.318489:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634764672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429273.318503:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429273.318509:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f4e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2b7 expref: 15 pid: 5840 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.318521:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f4e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2b7 expref: 15 pid: 5840 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.318585:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f4e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2b7 expref: 15 pid: 5840 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.318611:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429273.318616:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652c00/0xb4c3dad72635f51c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.318626:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652c00/0xb4c3dad72635f51c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.318635:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652c00/0xb4c3dad72635f51c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.318658:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429273.318706:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351634764672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 219us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429273.318715:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5658 00000100:00100000:3.0:1789429273.335391:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1789429273.335432:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad72635f523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.335445:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad72635f523 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.335452:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad72635f523 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.335855:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429273.335861:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad72635f523 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.335869:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad72635f523 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.335882:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcf1d5a2f (ffff946f120fd600) 00010000:00010000:3.0:1789429273.335884:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429273.335889:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad72635f523 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.335894:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad72635f523 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.388434:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.391743:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.400755:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634765568 00000100:00100000:3.0:1789429273.400766:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634765568 00000100:00100000:3.0:1789429273.400823:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21039 00000100:00100000:3.0:1789429273.400833:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634765568:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429273.400853:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429273.400856:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789429273.400882:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd9400/0xb4c3dad72635f546 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2da expref: 42 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.400900:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051efe00) 00010000:00010000:3.0:1789429273.400910:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429273.400924:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad72635f562 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b2e8 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.401034:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f569 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.401047:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f569 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.401067:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4200/0xb4c3dad72635f569 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.401082:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f570 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.401090:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f570 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.401097:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72635f570 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.422630:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72635f585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.422646:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72635f585 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.422654:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72635f585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.422716:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429273.422723:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72635f585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.422731:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72635f585 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.422746:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a:0x0].0x0 (ffff946f04cf6600) 00010000:00010000:3.0:1789429273.422749:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429273.422754:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72635f585 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.422761:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72635f585 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.505024:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634766592 00000100:00100000:3.0:1789429273.505035:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634766592 00002000:00100000:3.0:1789429273.505096:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2a:0x0] (8192->12287) req@ffff946e10309c00 x1876351634766592/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:9/0 lens 488/0 e 0 to 0 dl 1789429284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429273.505108:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10309c00 with x1876351634766592 ext(8192->12287) 00002000:00010000:3.0:1789429273.505114:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e10309c00 00000100:00100000:3.0:1789429273.505148:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11278 00000100:00100000:3.0:1789429273.505157:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+8:2369:x1876351634766592:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429273.512121:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.529137:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1789429273.541438:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789429273.541445:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad72635f5d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.541452:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad200 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:3.0:1789429273.541455:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad72635f5d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.541463:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad72635f5d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.541472:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a:0x0].0x0 (ffff946f120fd600) 00010000:00010000:3.0:1789429273.541474:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789429273.541477:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad72635f5d9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.541482:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad72635f5d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.541495:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429273.541497:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429273.541499:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429273.545435:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.548853:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.553522:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1789429273.558001:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72635f611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.558017:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72635f611 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.558025:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72635f611 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.558032:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429273.558036:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72635f611 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.558054:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72635f611 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.558070:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8635a1a7 (ffff946f120fd300) 00010000:00010000:3.0:1789429273.558073:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429273.558078:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72635f611 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.558084:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72635f611 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.560613:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.566586:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.572813:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.586378:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.595931:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.599643:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1789429273.601850:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789429273.601858:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad72635f681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.601866:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0800 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:3.0:1789429273.601870:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad72635f681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.601879:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad72635f681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.601890:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b:0x0].0x0 (ffff946f2076a300) 00010000:00010000:3.0:1789429273.601893:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789429273.601896:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad72635f681 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.601901:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad72635f681 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.601917:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429273.601918:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429273.601920:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429273.605801:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1200/0xb4c3dad72635f673 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.605820:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1200/0xb4c3dad72635f673 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.605827:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1200/0xb4c3dad72635f673 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.605833:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429273.605838:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1200/0xb4c3dad72635f673 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.605846:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1200/0xb4c3dad72635f673 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.605867:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8635a1a7 (ffff946f2076a900) 00010000:00010000:3.0:1789429273.605870:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429273.605875:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1200/0xb4c3dad72635f673 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.605882:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1200/0xb4c3dad72635f673 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.607670:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.625005:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.631024:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.642662:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.656856:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.664707:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634771200 00000100:00100000:3.0:1789429273.664718:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634771200 00002000:00100000:3.0:1789429273.664764:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (0->4095) req@ffff946f340ce300 x1876351634771200/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:9/0 lens 488/0 e 0 to 0 dl 1789429284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429273.664774:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340ce300 with x1876351634771200 ext(0->4095) 00002000:00010000:3.0:1789429273.664780:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f340ce300 00000100:00100000:3.0:1789429273.664815:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11283 00000100:00100000:3.0:1789429273.664824:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+10:2368:x1876351634771200:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429273.665050:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+10:2368:x1876351634771200:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 220us (487us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429273.665057:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11283 00002000:00100000:3.0:1789429273.665064:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (0->4095) req@ffff946f340ce300 x1876351634771200/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:9/0 lens 488/4536 e 0 to 0 dl 1789429284 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429273.665079:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340ce300 with x1876351634771200 ext(0->4095) 00002000:00010000:3.0:1789429273.665083:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f340ce300 00000100:00100000:3.0:1789429273.670453:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634771328 00000100:00100000:3.0:1789429273.670464:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634771328 00000100:00100000:3.0:1789429273.670807:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21058 00000100:00100000:3.0:1789429273.670819:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634771328:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429273.670842:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429273.670865:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad72635f6e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b35f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.671018:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.671029:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.671037:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429273.671070:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429273.671074:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429273.671096:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.671121:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad72635f6e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b35f expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.671139:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b35f expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.671148:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429273.671151:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429273.671154:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5000, rc 0) 00000100:00100000:3.0:1789429273.671263:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634771328:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 446us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429273.671271:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21058 00000100:00100000:3.0:1789429273.707655:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.727352:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.739816:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.743462:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.749134:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.754180:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.754825:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.775499:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.780386:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.783821:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634774272 00000100:00100000:3.0:1789429273.783831:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634774272 00010000:00010000:3.0:1789429273.783871:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f722 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b37b expref: 15 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.783912:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5660 00000100:00100000:3.0:1789429273.783922:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634774272:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429273.783938:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429273.783962:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f722 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b37b expref: 15 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.783980:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b37b expref: 15 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.784003:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f722 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [69632->18446744073709551615] (req 69632->73727) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b37b expref: 15 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.784021:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789429273.784025:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789429273.784034:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c15f3247/0xb4c3dad72635f729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [69632->81919] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b382 expref: 6 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.784052:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c15f3247/0xb4c3dad72635f729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [69632->81919] (req 69632->73727) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b382 expref: 6 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.784061:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789429273.784064:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789429273.784069:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b389 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.784077:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b389 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.784112:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b389 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.784132:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b605180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648205312:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429273.784496:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c15f3247/0xb4c3dad72635f729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [69632->81919] (req 69632->73727) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b382 expref: 6 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.784507:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b604000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648205440:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429273.784535:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429273.789974:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b605180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648205312:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429273.789988:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b604000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648205440:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429273.790010:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429273.790130:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351634774272:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6207us (6410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429273.790140:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5660 00000100:00100000:3.0:1789429273.797684:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648205568:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429273.797719:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f737 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b390 expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.797739:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd8400, rc 0) 00000100:00100000:3.0:1789429273.797794:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634774528:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2681us (2831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429273.797801:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5205 00000100:00100000:3.0:1789429273.804649:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634774912 00000100:00100000:3.0:1789429273.804658:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634774912 00002000:00100000:3.0:1789429273.804702:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f3f17a680 x1876351634774912/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:9/0 lens 488/0 e 0 to 0 dl 1789429284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429273.804713:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17a680 with x1876351634774912 ext(81920->118783) 00010000:00010000:3.0:1789429273.804721:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f737 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b390 expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.804737:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f737 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b390 expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429273.804745:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f17a680 00000100:00100000:3.0:1789429273.804776:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1104 00000100:00100000:3.0:1789429273.804785:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634774912:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429273.811074:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.823753:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.824825:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634775552 00000100:00100000:3.0:1789429273.824831:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634775552 00000100:00100000:3.0:1789429273.824869:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5208 00000100:00100000:3.0:1789429273.824876:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:33927:x1876351634775552:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429273.824888:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429273.824901:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f74c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b3a5 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.824919:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b39e expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.824931:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 0) 00010000:00010000:3.0:1789429273.824934:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 0) 00010000:00010000:3.0:1789429273.824938:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f74c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3a5 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.824956:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f745 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b39e expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.824966:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f745 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b39e expref: 7 pid: 8085 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.824976:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648206336:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429273.825003:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00010000:00010000:3.0:1789429273.827377:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429273.833752:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648206336:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429273.833780:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f74c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3a5 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.838985:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429273.843856:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634775808 00000100:00100000:3.0:1789429273.843865:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634775808 00000100:00100000:3.0:1789429273.843948:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5209 00000100:00100000:3.0:1789429273.843957:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:33938:x1876351634775808:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429273.843972:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429273.843991:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635f753 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b3ac expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.844022:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f74c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3a5 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.844044:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 0) 00010000:00010000:3.0:1789429273.844050:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 0) 00010000:00010000:3.0:1789429273.844056:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635f753 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ac expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.844088:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f74c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3a5 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.844111:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f74c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3a5 expref: 13 pid: 6681 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.844126:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648206592:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429273.844187:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00010000:00010000:3.0:1789429273.854828:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f74c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3a5 expref: 14 pid: 6681 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.854850:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648206592:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429273.854876:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635f753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ac expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.854896:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429273.854955:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634775808:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10999us (11243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429273.854964:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5209 00000100:00100000:3.0:1789429273.860143:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634776064 00000100:00100000:3.0:1789429273.860153:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634776064 00000100:00100000:3.0:1789429273.860232:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5210 00000100:00100000:3.0:1789429273.860243:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:33927:x1876351634776064:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429273.860262:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429273.860282:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b3b3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.860313:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635f753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ac expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.860323:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 0) 00010000:00010000:3.0:1789429273.860327:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 0) 00010000:00010000:3.0:1789429273.860342:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.860376:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635f753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ac expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.860390:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635f753 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ac expref: 7 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.860405:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648206848:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429273.860475:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429273.865911:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648206848:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429273.865947:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.865968:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429273.866025:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634776064:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5784us (5973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429273.866886:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5210 00000100:00100000:3.0:1789429273.867574:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634776192 00000100:00100000:3.0:1789429273.867582:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634776192 00002000:00100000:3.0:1789429273.867622:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f1c1a1180 x1876351634776192/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:9/0 lens 488/0 e 0 to 0 dl 1789429284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429273.867632:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a1180 with x1876351634776192 ext(81920->118783) 00010000:00010000:3.0:1789429273.867642:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635f753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ac expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.867658:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635f753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ac expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429273.867666:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a1180 00000100:00100000:3.0:1789429273.867694:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1106 00000100:00100000:3.0:1789429273.867704:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634776192:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429273.873961:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634776192:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6248us (6550us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429273.873975:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1106 00002000:00100000:3.0:1789429273.873988:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f1c1a1180 x1876351634776192/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:9/0 lens 488/440 e 0 to 0 dl 1789429284 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429273.873998:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a1180 with x1876351634776192 ext(81920->118783) 00010000:00010000:3.0:1789429273.874007:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635f753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ac expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.874026:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635f753 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ac expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429273.874592:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a1180 00010000:00010000:1.0:1789429273.877651:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429273.877666:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f761 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b3ba expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.877690:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.877700:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 0) 00010000:00010000:1.0:1789429273.877705:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 0) 00010000:00010000:1.0:1789429273.877710:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f761 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ba expref: 9 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.877734:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.877748:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 13 pid: 6682 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429273.877758:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648207104:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429273.877806:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429273.884790:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648207104:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429273.884828:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f761 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ba expref: 8 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.884849:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:1.0:1789429273.884917:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634776320:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7282us (8292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429273.884930:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5211 00000100:00100000:1.0:1789429273.885468:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634776576 00000100:00100000:1.0:1789429273.885478:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634776576 00002000:00100000:1.0:1789429273.885519:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f1c1a1f80 x1876351634776576/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:9/0 lens 488/0 e 0 to 0 dl 1789429284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429273.885530:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a1f80 with x1876351634776576 ext(81920->86015) 00010000:00010000:1.0:1789429273.885538:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 14 pid: 6682 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.885553:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 14 pid: 6682 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429273.885570:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a1f80 00000100:00100000:1.0:1789429273.885608:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1107 00000100:00100000:1.0:1789429273.885618:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351634776576:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429273.887838:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351634776576:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 2213us (2457us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429273.887850:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1107 00002000:00100000:1.0:1789429273.887860:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f1c1a1f80 x1876351634776576/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:9/0 lens 488/4536 e 0 to 0 dl 1789429284 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429273.887871:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a1f80 with x1876351634776576 ext(81920->86015) 00010000:00010000:1.0:1789429273.887882:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 14 pid: 6682 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.887909:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 14 pid: 6682 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429273.887917:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a1f80 00000100:00100000:1.0:1789429273.893044:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634776832 00000100:00100000:1.0:1789429273.893053:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634776832 00010000:00010000:1.0:1789429273.893082:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 15 pid: 6682 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429273.893265:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5667 00000100:00100000:1.0:1789429273.893275:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634776832:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429273.893288:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429273.893309:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 15 pid: 6682 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.893323:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 15 pid: 6682 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.893345:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f75a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3b3 expref: 15 pid: 6682 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.893360:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 0) 00010000:00010000:1.0:1789429273.893363:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 0) 00010000:00010000:1.0:1789429273.893371:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ba expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.893381:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ba expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.893412:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ba expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.893426:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ba expref: 7 pid: 8085 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429273.893440:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648207360:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429273.893503:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429273.898073:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648207360:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429273.898109:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429273.898172:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351634776832:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4897us (6551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429273.898185:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5667 00000100:00100000:1.0:1789429273.898851:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634776960 00000100:00100000:1.0:1789429273.898860:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634776960 00010000:00010000:1.0:1789429273.898902:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ba expref: 8 pid: 8085 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429273.898973:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5668 00000100:00100000:1.0:1789429273.898992:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634776960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429273.899013:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429273.899050:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ba expref: 8 pid: 8085 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.899075:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ba expref: 8 pid: 8085 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.899259:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f761 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3ba expref: 8 pid: 8085 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.899292:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 0) 00010000:00010000:1.0:1789429273.899299:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 0) 00010000:00010000:1.0:1789429273.899312:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635f768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c1 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.899326:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635f768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c1 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.899369:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635f768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c1 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429273.899390:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648207488:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429273.899466:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429273.903128:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648207488:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429273.903154:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429273.903256:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351634776960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4271us (4762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429273.903267:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5668 00000100:00100000:3.0:1789429273.910735:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.915541:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648207616:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429273.915571:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f76f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c8 expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.915587:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd8000, rc 0) 00000100:00100000:3.0:1789429273.915645:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634777088:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4679us (4919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429273.915653:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5213 00000100:00100000:1.0:1789429273.923580:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634777344 00000100:00100000:1.0:1789429273.923590:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634777344 00000100:00100000:1.0:1789429273.923654:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5214 00000100:00100000:1.0:1789429273.923664:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:33927:x1876351634777344:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429273.923684:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429273.923703:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f776 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b3cf expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.923733:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 0) 00010000:00010000:1.0:1789429273.923742:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f76f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c8 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.923749:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 0) 00010000:00010000:1.0:1789429273.923754:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f776 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3cf expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.923791:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f76f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c8 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.923805:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f776 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3cf expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.923817:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:1.0:1789429273.923872:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634777344:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 210us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429273.923879:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5214 00010000:00010000:1.0:1789429273.928511:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635f768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c1 expref: 15 pid: 6681 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429273.928557:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5669 00000100:00100000:1.0:1789429273.928566:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+15:2368:x1876351634777472:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429273.928582:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429273.928604:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635f768 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c1 expref: 15 pid: 6681 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.928618:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635f768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c1 expref: 15 pid: 6681 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.928640:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635f768 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c1 expref: 15 pid: 6681 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.928657:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 0) 00010000:00010000:1.0:1789429273.928662:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 0) 00010000:00010000:1.0:1789429273.928671:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f76f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c8 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.928682:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f76f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c8 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.928718:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f76f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c8 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.928731:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f76f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c8 expref: 7 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429273.928744:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648207872:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429273.929608:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429273.937249:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429273.937322:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634777600 00000100:00100000:3.0:1789429273.937329:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634777600 00002000:00100000:3.0:1789429273.937371:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f2f097100 x1876351634777600/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:9/0 lens 488/0 e 0 to 0 dl 1789429284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429273.937381:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f097100 with x1876351634777600 ext(81920->118783) 00010000:00010000:3.0:1789429273.937390:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f76f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c8 expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.937405:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f76f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c8 expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429273.937413:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f097100 00000100:00100000:3.0:1789429273.937439:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1109 00000100:00100000:3.0:1789429273.937448:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634777600:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429273.943590:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634777600:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6133us (6340us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429273.943603:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1109 00002000:00100000:3.0:1789429273.943614:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f2f097100 x1876351634777600/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:9/0 lens 488/440 e 0 to 0 dl 1789429284 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429273.943625:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f097100 with x1876351634777600 ext(81920->118783) 00010000:00010000:3.0:1789429273.943636:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f76f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c8 expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.943654:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f76f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3c8 expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429273.943667:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f097100 00000100:00100000:1.0:1789429273.947435:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429273.947544:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1789429273.971150:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f776 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3cf expref: 14 pid: 6682 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429273.971168:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648208128:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429273.971193:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f77d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3d6 expref: 8 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.971585:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd8400, rc 0) 00000100:00100000:1.0:1789429273.971794:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634777728:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 20494us (24366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429273.971805:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5215 00000100:00100000:3.0:1789429273.980239:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429273.980357:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634778112 00000100:00100000:1.0:1789429273.980371:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634778112 00000100:00100000:1.0:1789429273.980461:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5216 00000100:00100000:1.0:1789429273.980473:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:33927:x1876351634778112:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429273.980500:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429273.980525:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f784 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b3dd expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.980571:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f77d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3d6 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.980582:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 0) 00010000:00010000:1.0:1789429273.980587:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 0) 00010000:00010000:1.0:1789429273.980593:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f784 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3dd expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.980636:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f77d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3d6 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.980651:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f77d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3d6 expref: 7 pid: 8085 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429273.980668:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648208384:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429273.983009:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429273.986938:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634778240 00000100:00100000:3.0:1789429273.986951:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634778240 00010000:00010000:3.0:1789429273.987002:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f77d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3d6 expref: 8 pid: 8085 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.987057:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5672 00000100:00100000:3.0:1789429273.987067:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634778240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429273.987092:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429273.987418:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f77d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3d6 expref: 8 pid: 8085 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.987435:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f77d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3d6 expref: 8 pid: 8085 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.987467:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 0) 00010000:00010000:3.0:1789429273.987473:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 0) 00010000:00010000:3.0:1789429273.987483:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3dd expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.987494:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3dd expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429273.987551:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3dd expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429273.987568:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b604000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648208512:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429273.987671:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00010000:00010000:1.0:1789429273.988900:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f77d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3d6 expref: 8 pid: 8085 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429273.988928:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648208384:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429273.988966:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3dd expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429273.988985:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429273.989362:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:33927:x1876351634778112:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8889us (9161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429273.989372:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5216 00000100:00100000:1.0:1789429273.995105:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634778496 00000100:00100000:1.0:1789429273.995115:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634778496 00002000:00100000:1.0:1789429273.995181:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f3f179880 x1876351634778496/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:9/0 lens 488/0 e 0 to 0 dl 1789429284 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429273.995195:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179880 with x1876351634778496 ext(81920->86015) 00002000:00010000:1.0:1789429273.995297:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f179880 00000100:00100000:1.0:1789429273.995376:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11295 00000100:00100000:1.0:1789429273.995387:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+14:2370:x1876351634778496:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429273.995642:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+14:2370:x1876351634778496:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 257us (814us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429273.995651:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11295 00002000:00100000:1.0:1789429273.995659:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f3f179880 x1876351634778496/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:9/0 lens 488/4536 e 0 to 0 dl 1789429284 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429273.995668:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179880 with x1876351634778496 ext(81920->86015) 00002000:00010000:1.0:1789429273.995672:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f179880 00000100:00100000:3.0:1789429273.995978:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b604000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648208512:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429273.996006:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429273.996036:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2370:x1876351634778240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8969us (9557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429273.996304:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5672 00000100:00100000:1.0:1789429274.000509:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634778624 00000100:00100000:1.0:1789429274.000521:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634778624 00002000:00100000:1.0:1789429274.001121:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f3f178700 x1876351634778624/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 4584/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.001141:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f178700 with x1876351634778624 ext(81920->86015) 00010000:00010000:1.0:1789429274.001153:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3dd expref: 14 pid: 6681 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.001173:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3dd expref: 14 pid: 6681 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.001182:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f178700 00000100:00100000:1.0:1789429274.001270:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1110 00000100:00100000:1.0:1789429274.001283:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+14:2368:x1876351634778624:12345-192.168.203.39@tcp:4:kworker.0 00000100:00100000:1.0:1789429274.001767:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+16:2368:x1876351634778624:12345-192.168.203.39@tcp:4:kworker.0 Request processed in 485us (1420us total) trans 4294969544 rc 0/0 00000100:00100000:1.0:1789429274.001776:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1110 00002000:00100000:1.0:1789429274.001784:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f3f178700 x1876351634778624/t4294969544(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 4584/448 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 0/0 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.001792:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f178700 with x1876351634778624 ext(81920->86015) 00010000:00010000:1.0:1789429274.001799:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3dd expref: 16 pid: 6681 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.001812:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f784 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3dd expref: 16 pid: 6681 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.001820:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f178700 00000100:00100000:3.0:1789429274.002113:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.007436:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.012809:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.012900:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634779008 00000100:00100000:1.0:1789429274.012912:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634779008 00002000:00100000:1.0:1789429274.012981:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f29d57800 x1876351634779008/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.012994:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d57800 with x1876351634779008 ext(81920->118783) 00010000:00010000:1.0:1789429274.013006:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f78b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3e4 expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.013025:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f78b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3e4 expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.013044:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d57800 00000100:00100000:1.0:1789429274.013086:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1111 00000100:00100000:1.0:1789429274.013096:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634779008:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429274.019754:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634779008:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6641us (6944us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429274.019771:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1111 00002000:00100000:1.0:1789429274.019788:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f29d57800 x1876351634779008/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/440 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.019800:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d57800 with x1876351634779008 ext(81920->118783) 00010000:00010000:1.0:1789429274.019812:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f78b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3e4 expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.019832:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f78b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3e4 expref: 8 pid: 20745 timeout: 1071 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.019842:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d57800 00000100:00100000:3.0:1789429274.022589:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.022706:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634779136 00000100:00100000:1.0:1789429274.022723:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634779136 00000100:00100000:1.0:1789429274.022807:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5219 00000100:00100000:1.0:1789429274.022820:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634779136:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429274.022845:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429274.022872:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f799 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b3f2 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.022913:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(21 0) 00010000:00010000:1.0:1789429274.022923:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f792 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3eb expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.022931:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 21) 00010000:00010000:1.0:1789429274.022942:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f799 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f2 expref: 9 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.023188:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f792 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3eb expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.023253:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f799 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f2 expref: 9 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.023270:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:1.0:1789429274.023352:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634779136:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 535us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.023360:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5219 00000100:00100000:3.0:1789429274.025607:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.033841:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648209152:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.033875:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.033947:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634779264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8137us (8351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.033961:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5674 00000100:00100000:1.0:1789429274.035033:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634779392 00000100:00100000:1.0:1789429274.035461:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634779392 00010000:00010000:1.0:1789429274.035518:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3eb expref: 16 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.035826:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5675 00000100:00100000:1.0:1789429274.035839:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634779392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429274.035858:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429274.035893:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f792 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3eb expref: 16 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.035910:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f792 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3eb expref: 16 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.035942:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f792 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3eb expref: 16 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.035965:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 21) 00010000:00010000:1.0:1789429274.035971:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 21) 00010000:00010000:1.0:1789429274.035983:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f2 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.035995:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f2 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.036052:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f2 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.036070:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648209280:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429274.036191:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.045361:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648209280:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.045389:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.045446:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634779392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9610us (11769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.045458:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5675 00000100:00100000:3.0:1789429274.049085:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634779648 00000100:00100000:3.0:1789429274.049098:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634779648 00010000:00010000:3.0:1789429274.049150:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f799 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f2 expref: 8 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.049272:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5676 00000100:00100000:3.0:1789429274.049286:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634779648:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429274.049305:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429274.049335:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f799 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f2 expref: 8 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.049352:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f799 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f2 expref: 8 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.049385:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 21) 00010000:00010000:3.0:1789429274.049391:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 21) 00010000:00010000:3.0:1789429274.049401:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f7a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f9 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.049414:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f7a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f9 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.049475:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f7a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f9 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.049492:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648209536:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429274.049594:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.053313:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634779776 00000100:00100000:3.0:1789429274.053326:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634779776 00000100:00100000:3.0:1789429274.053399:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5221 00000100:00100000:3.0:1789429274.053411:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634779776:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.053433:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429274.053470:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f7a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b400 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.053520:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f7a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f9 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.053531:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 21) 00010000:00010000:3.0:1789429274.053536:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 21) 00010000:00010000:3.0:1789429274.053542:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f7a7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b400 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.053587:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f7a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f9 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.053604:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f7a0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b3f9 expref: 15 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.053621:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648209664:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429274.053745:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.056246:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648209664:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429274.056292:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f7a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b400 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.056319:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429274.056396:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634779776:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2986us (3264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.056406:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5221 00000100:00100000:1.0:1789429274.059365:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648209536:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.059396:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.059458:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634779648:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10175us (10498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.059468:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5676 00000100:00100000:1.0:1789429274.063971:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634780032 00000100:00100000:1.0:1789429274.063985:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634780032 00000100:00100000:1.0:1789429274.064073:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5222 00000100:00100000:1.0:1789429274.064085:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634780032:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429274.064114:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429274.064137:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635f7ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b407 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.064176:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 21) 00010000:00010000:1.0:1789429274.064187:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f7a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b400 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.064194:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 21) 00010000:00010000:1.0:1789429274.064533:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635f7ae lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b407 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.064591:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f7a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b400 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.064609:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635f7ae lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b407 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.064625:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:1.0:1789429274.064703:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634780032:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 620us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.064710:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5222 00000100:00100000:3.0:1789429274.066337:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634780160 00000100:00100000:3.0:1789429274.066675:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634780160 00000100:00100000:3.0:1789429274.071541:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648209920:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429274.071576:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429274.071649:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+16:2370:x1876351634780160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4700us (7766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.071661:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5677 00000100:00100000:1.0:1789429274.077857:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634780288:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6138us (6427us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429274.077874:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1113 00002000:00100000:1.0:1789429274.077891:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f1c1a0a80 x1876351634780288/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/440 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.077904:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a0a80 with x1876351634780288 ext(81920->118783) 00010000:00010000:1.0:1789429274.077916:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f7a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b400 expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.077939:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f7a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b400 expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.077948:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a0a80 00000100:00100000:3.0:1789429274.084578:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634780416 00000100:00100000:3.0:1789429274.084600:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634780416 00000100:00100000:1.0:1789429274.086690:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634780544 00000100:00100000:1.0:1789429274.086701:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634780544 00010000:00010000:1.0:1789429274.086736:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f7a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b400 expref: 9 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.086774:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5678 00000100:00100000:1.0:1789429274.086783:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2370:x1876351634780544:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429274.086797:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429274.086825:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f7a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b400 expref: 9 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.086840:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f7a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b400 expref: 9 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.086864:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f7a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b400 expref: 9 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.086888:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 21) 00010000:00010000:1.0:1789429274.086892:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 21) 00010000:00010000:1.0:1789429274.086901:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635f7ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b407 expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.086911:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635f7ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b407 expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.086945:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635f7ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b407 expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.086959:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635f7ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b407 expref: 15 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.086974:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648210176:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429274.087282:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.093951:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648210176:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.093984:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.094073:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634780544:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7289us (8660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.094087:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5678 00000100:00100000:1.0:1789429274.094169:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634780672 00000100:00100000:1.0:1789429274.094177:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634780672 00010000:00010000:1.0:1789429274.094260:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635f7ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b407 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.094298:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5679 00000100:00100000:1.0:1789429274.094309:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634780672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429274.094325:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429274.094357:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635f7ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b407 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.094374:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635f7ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b407 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.094408:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635f7ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b407 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.094429:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 21) 00010000:00010000:1.0:1789429274.094434:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 21) 00010000:00010000:1.0:1789429274.094445:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b40e expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.094675:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b40e expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.094723:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b40e expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.094740:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648210304:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429274.094813:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.105886:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648210304:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.105912:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.105944:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634780672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11636us (12149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.105955:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5679 00000100:00100000:1.0:1789429274.110991:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.111088:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634780928 00000100:00100000:3.0:1789429274.111103:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634780928 00010000:00010000:3.0:1789429274.111165:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f7b5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b40e expref: 8 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.111481:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5680 00000100:00100000:3.0:1789429274.111494:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634780928:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429274.111515:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429274.111548:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f7b5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b40e expref: 8 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.111566:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f7b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b40e expref: 8 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.111604:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 21) 00010000:00010000:3.0:1789429274.111610:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 21) 00010000:00010000:3.0:1789429274.111621:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f7bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b415 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.111638:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f7bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b415 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.111692:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f7bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b415 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.111709:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648210560:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429274.111834:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.114644:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648210560:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.114683:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.114752:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634780928:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3260us (3777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.114763:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5680 00000100:00100000:3.0:1789429274.116147:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.116330:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634781056 00000100:00100000:3.0:1789429274.116340:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634781056 00000100:00100000:3.0:1789429274.116398:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5225 00000100:00100000:3.0:1789429274.116410:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:33938:x1876351634781056:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.116433:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429274.116476:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f7c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b41c expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.116521:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f7bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b415 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.116534:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 21) 00010000:00010000:3.0:1789429274.116540:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 21) 00010000:00010000:3.0:1789429274.116546:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f7c3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b41c expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.116601:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f7bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b415 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.116622:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f7bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b415 expref: 15 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.116640:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648210688:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429274.116748:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.121380:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634781184 00000100:00100000:3.0:1789429274.121394:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634781184 00002000:00100000:3.0:1789429274.121530:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f3b320e00 x1876351634781184/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.121544:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320e00 with x1876351634781184 ext(81920->86015) 00010000:00010000:3.0:1789429274.121556:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f7bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b415 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.121576:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f7bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b415 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.121584:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b320e00 00000100:00100000:3.0:1789429274.121628:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1114 00000100:00100000:3.0:1789429274.121642:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634781184:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429274.122032:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634781184:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 392us (898us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429274.122055:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1114 00002000:00100000:3.0:1789429274.122064:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f3b320e00 x1876351634781184/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.122073:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320e00 with x1876351634781184 ext(81920->86015) 00010000:00010000:3.0:1789429274.122080:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f7bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b415 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.122094:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f7bc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b415 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.122102:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b320e00 00000100:00100000:3.0:1789429274.130694:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634781312 00000100:00100000:3.0:1789429274.130712:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634781312 00000100:00100000:3.0:1789429274.130782:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5226 00000100:00100000:3.0:1789429274.130793:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634781312:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.130814:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429274.130838:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f7ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b423 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.130881:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f7c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b41c expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.130891:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 21) 00010000:00010000:3.0:1789429274.130897:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 21) 00010000:00010000:3.0:1789429274.130903:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f7ca lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b423 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.130945:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f7c3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b41c expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.130961:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f7c3 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b41c expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.130976:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648210944:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429274.131234:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f7bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b415 expref: 18 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.131258:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648210688:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429274.131295:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f7c3 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b41c expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.131306:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f7c3 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b41c expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.131319:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:1.0:1789429274.131384:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634781056:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 14975us (15245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.131396:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5225 00000100:00100000:1.0:1789429274.132484:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648210816:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.132511:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.132561:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634781440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4174us (4833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.132572:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5681 00000100:00100000:3.0:1789429274.134634:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.138902:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.140154:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634781568 00000100:00100000:3.0:1789429274.140165:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634781568 00002000:00100000:3.0:1789429274.140319:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f2f096680 x1876351634781568/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.140330:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f096680 with x1876351634781568 ext(81920->118783) 00010000:00010000:3.0:1789429274.140340:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f7c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b41c expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.140358:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f7c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b41c expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.140366:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f096680 00000100:00100000:3.0:1789429274.140392:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1115 00000100:00100000:3.0:1789429274.140403:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634781568:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429274.164299:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634781696 00000100:00100000:3.0:1789429274.164307:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634781696 00000100:00100000:3.0:1789429274.164347:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5227 00000100:00100000:3.0:1789429274.164357:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634781696:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.164373:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429274.164390:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f7d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b42a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.164415:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f7ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b423 expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.164423:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 21) 00010000:00010000:3.0:1789429274.164427:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 21) 00010000:00010000:3.0:1789429274.164431:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f7d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b42a expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.164468:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f7ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b423 expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.164483:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f7ca lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b423 expref: 15 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.164494:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648211200:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429274.164528:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.168482:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648211200:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429274.168538:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f7d1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b42a expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.168573:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429274.168644:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634781696:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4287us (5841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.168655:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5227 00000100:00100000:3.0:1789429274.168861:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.181870:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634782080 00000100:00100000:1.0:1789429274.181884:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634782080 00000100:00100000:1.0:1789429274.181965:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5228 00000100:00100000:1.0:1789429274.181978:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634782080:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429274.182002:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429274.182028:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f7d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b431 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.182080:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b42a expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.182092:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 21) 00010000:00010000:1.0:1789429274.182097:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 21) 00010000:00010000:1.0:1789429274.182103:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f7d8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b431 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.182148:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f7d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b42a expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.182171:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f7d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b42a expref: 7 pid: 6682 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.182187:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b605180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648211456:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429274.182958:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.193881:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634782336 00000100:00100000:3.0:1789429274.193894:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634782336 00000100:00100000:3.0:1789429274.193968:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5229 00000100:00100000:3.0:1789429274.193982:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634782336:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.194008:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429274.194050:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f7df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b438 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.194113:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b431 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.194124:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 21) 00010000:00010000:3.0:1789429274.194129:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 21) 00010000:00010000:3.0:1789429274.194136:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f7df lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b438 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.194183:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f7d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b431 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.194318:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f7d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b431 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.194338:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648211712:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429274.194436:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789429274.195866:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f7d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b42a expref: 9 pid: 6682 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.195897:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b605180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648211456:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429274.195940:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f7d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b431 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.195954:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f7d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b431 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.195969:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1000, rc 0) 00000100:00100000:1.0:1789429274.196053:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634782080:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 14077us (14309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.196064:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5228 00000100:00100000:3.0:1789429274.204191:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634782592 00000100:00100000:3.0:1789429274.204260:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634782592 00000100:00100000:3.0:1789429274.204334:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5230 00000100:00100000:3.0:1789429274.204347:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634782592:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.204371:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429274.204396:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635f7e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b43f expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.204443:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 21) 00010000:00010000:3.0:1789429274.204466:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f7df lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b438 expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.204476:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 21) 00010000:00010000:3.0:1789429274.204483:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635f7e6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b43f expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.204539:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f7df lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b438 expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.204558:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635f7e6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b43f expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.204580:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:3.0:1789429274.204671:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634782592:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 327us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.204679:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5230 00010000:00010000:3.0:1789429274.207541:0:20745:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.39@tcp) returned -22 from blocking AST (req@00000000402c3335 x1876351648211712) - normal race ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f7d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b431 expref: 17 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.207593:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f7d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b431 expref: 17 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.207610:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648211712:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429274.207655:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f7df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b438 expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.207666:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f7df lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b438 expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.207681:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5a00, rc 0) 00000100:00100000:3.0:1789429274.207751:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634782336:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 13772us (14261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.207762:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5229 00000100:00100000:1.0:1789429274.212537:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.223428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.223489:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.223583:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634783104 00000100:00100000:3.0:1789429274.223597:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634783104 00010000:00010000:3.0:1789429274.223654:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f7df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b438 expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.223711:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5686 00000100:00100000:3.0:1789429274.223723:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634783104:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429274.223743:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429274.223772:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f7df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b438 expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.223789:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f7df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b438 expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.223818:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f7df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b438 expref: 8 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.223842:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 21) 00010000:00010000:3.0:1789429274.223847:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 21) 00010000:00010000:3.0:1789429274.223859:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635f7e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b43f expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.223870:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635f7e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b43f expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.223921:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635f7e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b43f expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.223944:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648212096:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429274.224059:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.228309:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648212096:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.228349:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.228427:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2370:x1876351634783104:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4704us (4934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.228440:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5686 00000100:00100000:3.0:1789429274.233901:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634783232 00000100:00100000:3.0:1789429274.233920:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634783232 00000100:00100000:1.0:1789429274.240720:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.245322:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.245412:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634783488 00000100:00100000:3.0:1789429274.245427:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634783488 00010000:00010000:3.0:1789429274.245498:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f7ed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b446 expref: 8 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.245550:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5688 00000100:00100000:3.0:1789429274.245562:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634783488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429274.245580:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429274.245611:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f7ed lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b446 expref: 8 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.245628:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f7ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b446 expref: 8 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.245662:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 21) 00010000:00010000:3.0:1789429274.245668:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 21) 00010000:00010000:3.0:1789429274.245680:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635f7f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b44d expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.245692:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635f7f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b44d expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.245743:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635f7f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b44d expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.245760:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648212608:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429274.245862:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.249351:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648212608:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429274.249387:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429274.249481:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634783488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3919us (4172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.249494:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5688 00000100:00100000:3.0:1789429274.254954:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.255175:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634783744 00000100:00100000:1.0:1789429274.255188:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634783744 00002000:00100000:1.0:1789429274.255289:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f29d56d80 x1876351634783744/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.255302:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56d80 with x1876351634783744 ext(81920->86015) 00010000:00010000:1.0:1789429274.255314:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635f7f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b44d expref: 16 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.255332:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635f7f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b44d expref: 16 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.255342:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d56d80 00000100:00100000:1.0:1789429274.255383:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1118 00000100:00100000:1.0:1789429274.255394:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634783744:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429274.255645:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634783744:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 251us (704us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429274.255654:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1118 00002000:00100000:1.0:1789429274.255661:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f29d56d80 x1876351634783744/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.255677:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56d80 with x1876351634783744 ext(81920->86015) 00010000:00010000:1.0:1789429274.255683:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635f7f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b44d expref: 16 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.255694:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635f7f4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b44d expref: 16 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.255702:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d56d80 00000100:00100000:3.0:1789429274.263723:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.270666:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.286157:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.309827:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.310907:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.310998:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634784384 00000100:00100000:3.0:1789429274.311004:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634784384 00010000:00010000:3.0:1789429274.311033:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f7fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b454 expref: 9 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.311068:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5690 00000100:00100000:3.0:1789429274.311076:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2368:x1876351634784384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429274.311087:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429274.311361:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f7fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b454 expref: 9 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.311382:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f7fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b454 expref: 9 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.311413:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f7fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b454 expref: 9 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.311432:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 21) 00010000:00010000:3.0:1789429274.311436:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 21) 00010000:00010000:3.0:1789429274.311445:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b45b expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.311455:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b45b expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.311488:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b45b expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.311502:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f802 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b45b expref: 15 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.311518:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648213248:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429274.311595:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.314890:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.326985:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000001:00080000:3.0:1789429274.327745:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969240 is committed 00000100:00100000:3.0:1789429274.335732:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.335829:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634784768 00000100:00100000:1.0:1789429274.335839:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634784768 00000100:00100000:1.0:1789429274.335910:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5236 00000100:00100000:1.0:1789429274.335921:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634784768:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429274.335944:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429274.335970:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f810 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b469 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.336017:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022d5d796/0xb4c3dad72635f809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b462 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.336029:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 21) 00010000:00010000:1.0:1789429274.336034:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 21) 00010000:00010000:1.0:1789429274.336040:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f810 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b469 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.336091:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022d5d796/0xb4c3dad72635f809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b462 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.336948:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022d5d796/0xb4c3dad72635f809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b462 expref: 7 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.336980:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648213504:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429274.344789:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.349869:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648213504:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429274.349914:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f810 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b469 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.349941:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1600, rc 0) 00000100:00100000:1.0:1789429274.350024:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634784768:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 14103us (14291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.350035:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5236 00000100:00100000:3.0:1789429274.360904:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.360966:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.371713:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.371847:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634785280 00000100:00100000:1.0:1789429274.371862:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634785280 00002000:00100000:1.0:1789429274.371926:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f29d56680 x1876351634785280/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.371939:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56680 with x1876351634785280 ext(81920->86015) 00010000:00010000:1.0:1789429274.371951:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b469 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.371977:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b469 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.371986:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d56680 00000100:00100000:1.0:1789429274.372142:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1122 00000100:00100000:1.0:1789429274.372155:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634785280:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429274.372509:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634785280:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 354us (811us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429274.372518:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1122 00002000:00100000:1.0:1789429274.372526:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f29d56680 x1876351634785280/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.372535:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56680 with x1876351634785280 ext(81920->86015) 00010000:00010000:1.0:1789429274.372542:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b469 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.372554:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b469 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.372562:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d56680 00000100:00100000:3.0:1789429274.377613:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.378918:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.379026:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634785536 00000100:00100000:1.0:1789429274.379041:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634785536 00010000:00010000:1.0:1789429274.379108:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b469 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.379167:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5693 00000100:00100000:1.0:1789429274.379180:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634785536:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429274.379238:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429274.379284:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f810 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b469 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.379301:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b469 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.379697:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f810 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b469 expref: 16 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.379721:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 21) 00010000:00010000:1.0:1789429274.379726:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 21) 00010000:00010000:1.0:1789429274.379738:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b470 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.379751:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f817 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b470 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.379804:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f817 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b470 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.379820:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648213888:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429274.379935:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.392742:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.392793:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648213888:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.392827:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.393538:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.393607:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.393630:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634786176 00000100:00100000:1.0:1789429274.393634:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634786176 00000100:00100000:1.0:1789429274.393671:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 733 00000100:00100000:1.0:1789429274.393677:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351634786176:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429274.393812:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351634786176:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 134us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.393820:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 733 00000100:00100000:3.0:1789429274.393877:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.394737:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.394812:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.406441:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.416673:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.424596:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.444835:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634786944 00000100:00100000:1.0:1789429274.444849:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634786944 00000100:00100000:1.0:1789429274.444927:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5241 00000100:00100000:1.0:1789429274.444939:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634786944:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429274.444964:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429274.444989:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f833 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b48c expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.445030:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 21) 00010000:00010000:1.0:1789429274.445050:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f82c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b485 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.445058:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 21) 00010000:00010000:1.0:1789429274.445064:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f833 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b48c expref: 9 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.445119:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f82c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b485 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.445136:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f833 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b48c expref: 9 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.445150:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:1.0:1789429274.445274:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634786944:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 337us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.445283:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5241 00000100:00100000:3.0:1789429274.445480:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634787072 00000100:00100000:3.0:1789429274.445485:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634787072 00010000:00010000:3.0:1789429274.445513:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b47e expref: 9 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.445551:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5696 00000100:00100000:3.0:1789429274.445559:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2369:x1876351634787072:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429274.445571:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429274.445601:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f825 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b47e expref: 9 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.445614:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b47e expref: 9 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.445644:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f825 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b47e expref: 9 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.445661:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 21) 00010000:00010000:3.0:1789429274.445665:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 21) 00010000:00010000:3.0:1789429274.445674:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f82c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b485 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.445684:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f82c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b485 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.445727:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f82c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b485 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.445743:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635f82c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b485 expref: 15 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.445759:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648214784:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429274.445833:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.451573:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648214784:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429274.451608:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429274.451663:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2369:x1876351634787072:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6104us (6981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.451674:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5696 00000100:00100000:1.0:1789429274.461004:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.470706:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634787584 00000100:00100000:3.0:1789429274.470719:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634787584 00002000:00100000:3.0:1789429274.470787:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f3b320a80 x1876351634787584/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.470802:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320a80 with x1876351634787584 ext(81920->118783) 00010000:00010000:3.0:1789429274.470813:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f833 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b48c expref: 8 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.470834:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f833 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b48c expref: 8 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.470844:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b320a80 00000100:00100000:3.0:1789429274.470884:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1125 00000100:00100000:3.0:1789429274.470895:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634787584:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429274.477969:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634787584:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7058us (7586us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429274.477986:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1125 00002000:00100000:1.0:1789429274.478005:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f3b320a80 x1876351634787584/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/440 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.478018:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320a80 with x1876351634787584 ext(81920->118783) 00010000:00010000:1.0:1789429274.478032:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b48c expref: 8 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.478065:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b48c expref: 8 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.478082:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b320a80 00000100:00100000:1.0:1789429274.481883:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634787712 00000100:00100000:1.0:1789429274.481897:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634787712 00000100:00100000:1.0:1789429274.481970:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5243 00000100:00100000:1.0:1789429274.481982:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634787712:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429274.482006:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429274.482031:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f841 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b49a expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.482081:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 21) 00010000:00010000:1.0:1789429274.482090:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f83a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b493 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.482098:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 21) 00010000:00010000:1.0:1789429274.482103:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f841 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b49a expref: 9 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.482163:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f83a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b493 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.482178:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f841 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b49a expref: 9 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.482192:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429274.482556:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634787712:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 575us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.482564:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5243 00000100:00100000:1.0:1789429274.486149:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634787840 00000100:00100000:1.0:1789429274.486164:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634787840 00010000:00010000:1.0:1789429274.486470:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635f833 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b48c expref: 9 pid: 13238 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.492096:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.492183:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634787968 00000100:00100000:3.0:1789429274.492196:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634787968 00010000:00010000:3.0:1789429274.492291:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f83a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b493 expref: 16 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.492354:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5699 00000100:00100000:3.0:1789429274.492366:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:2369:x1876351634787968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429274.492385:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429274.492416:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f83a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b493 expref: 16 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.492440:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f83a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b493 expref: 16 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.492486:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 21) 00010000:00010000:3.0:1789429274.492492:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 21) 00010000:00010000:3.0:1789429274.492503:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f841 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b49a expref: 8 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.492515:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b49a expref: 8 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.492571:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635f841 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b49a expref: 8 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.492588:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648215424:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429274.492708:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.496652:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648215424:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429274.496761:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429274.496842:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:2369:x1876351634787968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4476us (4758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.496856:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5699 00000100:00100000:1.0:1789429274.499910:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634787840:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13254us (13959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.499923:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5698 00000100:00100000:3.0:1789429274.513702:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.513760:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.521932:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634788480 00000100:00100000:1.0:1789429274.521941:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634788480 00002000:00100000:1.0:1789429274.521996:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f3b322a00 x1876351634788480/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.522008:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b322a00 with x1876351634788480 ext(81920->86015) 00010000:00010000:1.0:1789429274.522017:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f848 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a1 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.522044:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f848 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a1 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.522053:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b322a00 00000100:00100000:1.0:1789429274.522080:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1126 00000100:00100000:1.0:1789429274.522089:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+16:2370:x1876351634788480:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429274.522361:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+16:2370:x1876351634788480:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 272us (977us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429274.522369:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1126 00002000:00100000:1.0:1789429274.522377:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (81920->86015) req@ffff946f3b322a00 x1876351634788480/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.522386:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b322a00 with x1876351634788480 ext(81920->86015) 00010000:00010000:1.0:1789429274.522391:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f848 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a1 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.522403:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f848 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a1 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.522410:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b322a00 00000100:00100000:3.0:1789429274.523020:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b321180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648215808:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429274.523066:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f84f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a8 expref: 8 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.523084:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd8000, rc 0) 00000100:00100000:3.0:1789429274.523138:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634788352:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8420us (9376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.523146:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5245 00000100:00100000:1.0:1789429274.527342:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.527406:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.527717:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634788736 00000100:00100000:3.0:1789429274.527730:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634788736 00010000:00010000:3.0:1789429274.527787:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f848 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a1 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.527840:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5701 00000100:00100000:3.0:1789429274.527851:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:2369:x1876351634788736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429274.527870:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429274.527900:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f848 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a1 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.527916:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a1 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.527944:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f848 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a1 expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.527965:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 21) 00010000:00010000:3.0:1789429274.527972:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 21) 00010000:00010000:3.0:1789429274.527982:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f84f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a8 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.527992:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f84f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a8 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.528051:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f84f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a8 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.528069:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648215936:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429274.528174:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.534139:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.548142:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.552634:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.552861:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634789120 00000100:00100000:3.0:1789429274.552874:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634789120 00002000:00100000:3.0:1789429274.552939:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (0->118783) req@ffff946f34021180 x1876351634789120/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.552952:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34021180 with x1876351634789120 ext(0->118783) 00010000:00010000:3.0:1789429274.552976:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f84f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a8 expref: 10 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.552995:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f84f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a8 expref: 10 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.553004:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34021180 00000100:00100000:3.0:1789429274.553048:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1129 00000100:00100000:3.0:1789429274.553060:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634789120:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1789429274.565874:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.574019:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2370:x1876351634789120:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 20945us (21385us total) trans 4294969545 rc 0/0 00000100:00100000:3.0:1789429274.574049:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1129 00002000:00100000:3.0:1789429274.574066:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (0->118783) req@ffff946f34021180 x1876351634789120/t4294969545(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/448 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.574078:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34021180 with x1876351634789120 ext(0->118783) 00010000:00010000:3.0:1789429274.574102:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f84f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a8 expref: 11 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.574127:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f84f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a8 expref: 11 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.574136:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34021180 00000100:00100000:3.0:1789429274.579140:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634789376 00000100:00100000:3.0:1789429274.579153:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634789376 00010000:00010000:3.0:1789429274.579435:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f84f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [81920->18446744073709551615] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4a8 expref: 11 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.584774:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b321180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648216192:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429274.584793:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f095c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648216320:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429274.584824:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429274.584897:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351634789376:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5006us (5940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.584914:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5702 00000100:00100000:3.0:1789429274.597098:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634789504 00000100:00100000:3.0:1789429274.597113:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634789504 00002000:00100000:3.0:1789429274.597183:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (118784->122879) req@ffff946f415c4380 x1876351634789504/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.597196:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4380 with x1876351634789504 ext(118784->122879) 00002000:00010000:3.0:1789429274.597532:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f415c4380 00000100:00100000:1.0:1789429274.597685:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11296 00000100:00100000:1.0:1789429274.597713:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634789504:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429274.598052:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634789504:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 345us (1171us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429274.598060:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11296 00002000:00100000:1.0:1789429274.598070:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (118784->122879) req@ffff946f415c4380 x1876351634789504/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.598080:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4380 with x1876351634789504 ext(118784->122879) 00002000:00010000:1.0:1789429274.598085:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f415c4380 00000100:00100000:1.0:1789429274.613754:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.622031:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.622100:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00002000:00100000:1.0:1789429274.622981:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (122880->126975) req@ffff946f34498e00 x1876351634790016/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.622994:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34498e00 with x1876351634790016 ext(122880->126975) 00002000:00010000:1.0:1789429274.623003:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34498e00 00000100:00100000:1.0:1789429274.623045:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634790144 00000100:00100000:1.0:1789429274.623049:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634790144 00002000:00100000:1.0:1789429274.623066:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (94208->98303) req@ffff946f34499500 x1876351634790144/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.623074:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499500 with x1876351634790144 ext(94208->98303) 00002000:00010000:1.0:1789429274.623078:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34499500 00000100:00100000:1.0:1789429274.623109:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11300 00000100:00100000:1.0:1789429274.623120:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634790016:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429274.623464:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11301 00000100:00100000:3.0:1789429274.623477:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+16:2369:x1876351634790144:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429274.623731:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+16:2369:x1876351634790144:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 256us (1628us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429274.623740:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11301 00002000:00100000:3.0:1789429274.623749:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (94208->98303) req@ffff946f34499500 x1876351634790144/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.623759:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499500 with x1876351634790144 ext(94208->98303) 00002000:00010000:3.0:1789429274.623764:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34499500 00000100:00100000:1.0:1789429274.623978:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634790016:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 859us (1962us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429274.623985:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11300 00002000:00100000:1.0:1789429274.623991:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (122880->126975) req@ffff946f34498e00 x1876351634790016/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.623999:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34498e00 with x1876351634790016 ext(122880->126975) 00002000:00010000:1.0:1789429274.624003:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34498e00 00000100:00100000:1.0:1789429274.629810:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634790272 00000100:00100000:1.0:1789429274.629825:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634790272 00002000:00100000:1.0:1789429274.629896:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (98304->102399) req@ffff946f340cc700 x1876351634790272/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.629910:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340cc700 with x1876351634790272 ext(98304->102399) 00002000:00010000:1.0:1789429274.629918:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f340cc700 00000100:00100000:1.0:1789429274.629959:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11302 00000100:00100000:1.0:1789429274.629970:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+16:2368:x1876351634790272:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429274.630274:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+16:2368:x1876351634790272:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 304us (690us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429274.630281:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11302 00002000:00100000:1.0:1789429274.630288:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (98304->102399) req@ffff946f340cc700 x1876351634790272/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.630296:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340cc700 with x1876351634790272 ext(98304->102399) 00002000:00010000:1.0:1789429274.630299:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f340cc700 00000100:00100000:1.0:1789429274.633659:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.640177:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.640604:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634790528 00000100:00100000:1.0:1789429274.640620:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634790528 00002000:00100000:1.0:1789429274.640704:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (102400->106495) req@ffff946f3b321180 x1876351634790528/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.640720:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b321180 with x1876351634790528 ext(102400->106495) 00002000:00010000:1.0:1789429274.640729:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b321180 00000100:00100000:1.0:1789429274.640776:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11304 00000100:00100000:1.0:1789429274.640791:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+16:2369:x1876351634790528:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429274.641723:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+16:2369:x1876351634790528:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 931us (1555us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429274.641736:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11304 00002000:00100000:1.0:1789429274.641746:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (102400->106495) req@ffff946f3b321180 x1876351634790528/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.641757:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b321180 with x1876351634790528 ext(102400->106495) 00002000:00010000:1.0:1789429274.641763:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b321180 00000100:00100000:1.0:1789429274.648072:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11305 00000100:00100000:1.0:1789429274.648093:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634790656:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429274.648533:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634790656:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 447us (1745us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429274.648543:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11305 00002000:00100000:1.0:1789429274.648553:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (131072->135167) req@ffff946f2f095f80 x1876351634790656/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.648564:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095f80 with x1876351634790656 ext(131072->135167) 00002000:00010000:1.0:1789429274.648570:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f095f80 00000100:00100000:3.0:1789429274.649583:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.650290:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634790784 00000100:00100000:1.0:1789429274.650376:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634790784 00002000:00100000:1.0:1789429274.650446:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (106496->110591) req@ffff946f3f1c7480 x1876351634790784/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.650459:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7480 with x1876351634790784 ext(106496->110591) 00002000:00010000:1.0:1789429274.650466:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c7480 00000100:00100000:1.0:1789429274.650505:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11306 00000100:00100000:1.0:1789429274.650515:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:2368:x1876351634790784:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429274.650838:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:2368:x1876351634790784:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 323us (1261us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429274.650847:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11306 00002000:00100000:1.0:1789429274.650854:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (106496->110591) req@ffff946f3f1c7480 x1876351634790784/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.650862:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7480 with x1876351634790784 ext(106496->110591) 00002000:00010000:1.0:1789429274.650866:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c7480 00000100:00100000:3.0:1789429274.656182:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.664181:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634791040 00000100:00100000:1.0:1789429274.665517:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634791040 00000100:00100000:1.0:1789429274.665611:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5248 00000100:00100000:1.0:1789429274.665623:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634791040:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429274.665647:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429274.665673:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b4bd expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.665871:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f85d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4b6 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.665884:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 21) 00010000:00010000:1.0:1789429274.665889:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 21) 00010000:00010000:1.0:1789429274.665894:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.665943:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f85d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4b6 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.665966:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f85d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4b6 expref: 9 pid: 6682 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.665981:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648216448:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429274.666171:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.666432:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.673097:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.678745:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648216448:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429274.678811:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.678839:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429274.678905:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634791040:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 13284us (16603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.678917:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5248 00000100:00100000:1.0:1789429274.683898:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.683947:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.683984:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634791552 00000100:00100000:1.0:1789429274.683996:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634791552 00010000:00010000:1.0:1789429274.684060:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f85d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4b6 expref: 12 pid: 6682 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.684115:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5703 00000100:00100000:1.0:1789429274.684126:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2369:x1876351634791552:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429274.684147:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429274.684174:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1789429274 -> 1789429275 00002000:00010000:1.0:1789429274.684178:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1789429274 -> 1789429275 00010000:00010000:1.0:1789429274.684185:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f85d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4b6 expref: 12 pid: 6682 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.684423:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f85d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4b6 expref: 12 pid: 6682 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.684523:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f85d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4b6 expref: 12 pid: 6682 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.684547:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 21) 00010000:00010000:1.0:1789429274.684553:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 21) 00010000:00010000:1.0:1789429274.684564:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.684575:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.684630:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.684650:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34498700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648216576:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429274.685167:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.686075:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634791424 00000100:00100000:3.0:1789429274.686088:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634791424 00000100:00100000:3.0:1789429274.686160:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5249 00000100:00100000:3.0:1789429274.686172:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:33938:x1876351634791424:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.686234:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429274.686269:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b4c4 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.686305:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.686538:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 21) 00010000:00010000:3.0:1789429274.686543:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 21) 00010000:00010000:3.0:1789429274.686549:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 13 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.686587:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.686603:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 16 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.686617:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648216704:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429274.686770:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.692688:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34498700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648216576:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.692795:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.692876:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:2369:x1876351634791552:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8748us (8924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.692889:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5703 00000100:00100000:3.0:1789429274.693902:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.695862:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634791680 00000100:00100000:1.0:1789429274.695883:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634791680 00002000:00100000:1.0:1789429274.695962:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (118784->155647) req@ffff946f3f1c6a00 x1876351634791680/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.695975:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c6a00 with x1876351634791680 ext(118784->155647) 00010000:00010000:1.0:1789429274.695987:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 17 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.696008:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 17 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.696017:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f1c6a00 00000100:00100000:1.0:1789429274.696433:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1132 00000100:00100000:1.0:1789429274.696447:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634791680:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429274.698886:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648216704:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429274.698936:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 12 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.698969:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5a00, rc 0) 00000100:00100000:3.0:1789429274.699095:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:33938:x1876351634791424:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 12923us (15210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.699107:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5249 00000100:00100000:1.0:1789429274.704087:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634791680:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7626us (10823us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429274.704105:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1132 00002000:00100000:1.0:1789429274.704122:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (118784->155647) req@ffff946f3f1c6a00 x1876351634791680/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/440 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429274.704143:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c6a00 with x1876351634791680 ext(118784->155647) 00010000:00010000:1.0:1789429274.704157:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 17 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.704182:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 17 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429274.704191:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f1c6a00 00000100:00100000:3.0:1789429274.716704:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634791936 00000100:00100000:3.0:1789429274.716718:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634791936 00010000:00010000:3.0:1789429274.716772:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 18 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.716825:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5704 00000100:00100000:3.0:1789429274.716838:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634791936:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429274.716857:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429274.716887:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 18 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.716903:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 18 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.716932:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f864 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [118784->18446744073709551615] (req 118784->122879) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4bd expref: 18 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.716954:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 21) 00010000:00010000:3.0:1789429274.716959:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 21) 00010000:00010000:3.0:1789429274.716970:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [135168->18446744073709551615] (req 135168->139263) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 11 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.716983:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [135168->18446744073709551615] (req 135168->139263) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 11 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.716994:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 21) 00010000:00010000:3.0:1789429274.716998:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 21) 00010000:00010000:3.0:1789429274.717003:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f872 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4cb expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.717012:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4cb expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.717070:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4cb expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.717088:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648216832:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429274.717270:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [135168->18446744073709551615] (req 135168->139263) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 11 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.717282:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648216960:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429274.718118:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.723608:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648216832:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429274.723629:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648216960:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429274.723663:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429274.723756:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634791936:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6918us (7221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.723769:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5704 00000100:00100000:3.0:1789429274.735664:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634792064 00000100:00100000:3.0:1789429274.735678:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634792064 00002000:00100000:3.0:1789429274.735751:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (135168->139263) req@ffff946f2f096d80 x1876351634792064/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.735767:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f096d80 with x1876351634792064 ext(135168->139263) 00002000:00010000:3.0:1789429274.735775:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f096d80 00000100:00100000:3.0:1789429274.735823:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11308 00000100:00100000:3.0:1789429274.735835:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351634792064:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429274.736113:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351634792064:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 279us (642us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429274.736121:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11308 00002000:00100000:3.0:1789429274.736129:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (135168->139263) req@ffff946f2f096d80 x1876351634792064/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.736137:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f096d80 with x1876351634792064 ext(135168->139263) 00002000:00010000:3.0:1789429274.736141:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f096d80 00000100:00100000:3.0:1789429274.740440:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634792192 00000100:00100000:3.0:1789429274.740457:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634792192 00002000:00100000:3.0:1789429274.740534:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (118784->135167) req@ffff946f340cce00 x1876351634792192/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.740548:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340cce00 with x1876351634792192 ext(118784->135167) 00002000:00010000:3.0:1789429274.740557:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f340cce00 00000100:00100000:3.0:1789429274.740605:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11309 00000100:00100000:3.0:1789429274.740616:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2369:x1876351634792192:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429274.741089:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2369:x1876351634792192:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 474us (979us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1789429274.741098:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11309 00002000:00100000:3.0:1789429274.741107:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (118784->135167) req@ffff946f340cce00 x1876351634792192/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/16824 e 0 to 0 dl 1789429285 ref 1 fl Complete:/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.741116:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340cce00 with x1876351634792192 ext(118784->135167) 00002000:00010000:3.0:1789429274.741120:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f340cce00 00000100:00100000:3.0:1789429274.742721:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634792320 00000100:00100000:3.0:1789429274.742731:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634792320 00002000:00100000:3.0:1789429274.742779:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (139264->143359) req@ffff946f2f095880 x1876351634792320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.742792:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095880 with x1876351634792320 ext(139264->143359) 00002000:00010000:3.0:1789429274.742798:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f095880 00000100:00100000:3.0:1789429274.742828:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11310 00000100:00100000:3.0:1789429274.742839:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634792320:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429274.743049:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634792320:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 211us (532us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429274.743057:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11310 00002000:00100000:3.0:1789429274.743064:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (139264->143359) req@ffff946f2f095880 x1876351634792320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.743073:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095880 with x1876351634792320 ext(139264->143359) 00002000:00010000:3.0:1789429274.743077:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f095880 00000100:00100000:3.0:1789429274.749853:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634792576 00000100:00100000:3.0:1789429274.749867:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634792576 00000100:00100000:3.0:1789429274.749937:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5251 00000100:00100000:3.0:1789429274.749949:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634792576:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.749972:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429274.749998:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b4d2 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.750051:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [135168->18446744073709551615] (req 135168->139263) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 11 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.750061:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 21) 00010000:00010000:3.0:1789429274.750067:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 21) 00010000:00010000:3.0:1789429274.750072:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.750114:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [135168->18446744073709551615] (req 135168->139263) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 11 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.750129:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [135168->18446744073709551615] (req 135168->139263) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 11 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.750146:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648217088:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429274.750482:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.754687:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.754800:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648217088:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429274.754846:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.754874:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5200, rc 0) 00000100:00100000:3.0:1789429274.756111:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634792576:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6151us (6326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.756125:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5251 00000100:00100000:1.0:1789429274.764756:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634792960 00000100:00100000:1.0:1789429274.764768:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634792960 00010000:00010000:1.0:1789429274.764820:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [135168->18446744073709551615] (req 135168->139263) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 15 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.764921:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5705 00000100:00100000:1.0:1789429274.764931:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05471c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2369:x1876351634792960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429274.764950:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429274.764980:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [135168->18446744073709551615] (req 135168->139263) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 15 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.764995:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [135168->18446744073709551615] (req 135168->139263) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 15 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.765025:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635f86b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [135168->18446744073709551615] (req 135168->139263) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4c4 expref: 15 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.765058:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 21) 00010000:00010000:1.0:1789429274.765063:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 21) 00010000:00010000:1.0:1789429274.765074:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.765085:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.765096:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 21) 00010000:00010000:1.0:1789429274.765099:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 21) 00010000:00010000:1.0:1789429274.765104:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d9 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.765113:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d9 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.765159:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d9 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.765177:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648217216:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.765838:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.765854:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648217344:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429274.765921:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.771833:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648217216:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429274.771851:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648217344:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.771882:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.771964:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05471c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2369:x1876351634792960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7032us (7386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.771977:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5705 00000100:00100000:3.0:1789429274.778607:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634793216 00000100:00100000:3.0:1789429274.778621:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634793216 00000100:00100000:3.0:1789429274.778699:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5253 00000100:00100000:3.0:1789429274.778712:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634793216:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.778738:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429274.778766:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f887 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b4e0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.778812:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d9 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.778822:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 21) 00010000:00010000:3.0:1789429274.778827:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 21) 00010000:00010000:3.0:1789429274.778833:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f887 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e0 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.778877:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d9 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.778900:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f880 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d9 expref: 13 pid: 6681 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.778918:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648217472:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429274.779050:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.782768:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648217472:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429274.782821:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f887 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e0 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.782848:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429274.782962:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634793216:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4251us (4842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.782972:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5253 00000100:00100000:3.0:1789429274.788105:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648217856:0@lo:400:kworker.0 00000100:00100000:3.0:1789429274.788194:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429274.788282:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429274.788289:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648217984:0@lo:400:kworker.0 00000100:00100000:3.0:1789429274.788330:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429274.788367:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648217856 00000100:00100000:3.0:1789429274.788376:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648217856 00000100:00100000:3.0:1789429274.788444:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1789429274.788454:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648217856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429274.788514:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648217856:12345-0@lo:400:kworker.0 Request processed in 61us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.788523:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1789429274.788568:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648217856:0@lo:400:kworker.0 00000100:00100000:1.0:1789429274.789425:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.790124:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:3.0:1789429274.790135:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648217984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429274.790260:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648217984:12345-0@lo:400:kworker.0 Request processed in 127us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.790267:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1789429274.792272:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648217984:0@lo:400:kworker.0 00000100:00100000:3.0:1789429274.792624:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648217600:0@lo:400:kworker.0 00000100:00100000:3.0:1789429274.792641:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648218112:0@lo:400:kworker.0 00000100:00100000:3.0:1789429274.792655:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648217728:0@lo:400:kworker.0 00000100:00100000:3.0:1789429274.797909:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34498000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648218240:0@lo:400:kworker.0 00000100:00100000:1.0:1789429274.799949:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634793472 00000100:00100000:1.0:1789429274.799961:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634793472 00000100:00100000:1.0:1789429274.800038:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5254 00000100:00100000:1.0:1789429274.800049:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634793472:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429274.800074:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429274.800098:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f88e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b4e7 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.800958:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f887 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e0 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.800975:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 21) 00010000:00010000:1.0:1789429274.800980:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 21) 00010000:00010000:1.0:1789429274.800986:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f88e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e7 expref: 15 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.801042:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f887 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e0 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.801060:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f887 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e0 expref: 18 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.801078:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648218496:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429274.801916:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.805922:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634793600 00000100:00100000:3.0:1789429274.805941:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634793600 00010000:00010000:3.0:1789429274.851550:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429274.854509:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.860885:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634793728 00000100:00100000:3.0:1789429274.860900:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634793728 00000100:00100000:3.0:1789429274.860977:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5255 00000100:00100000:3.0:1789429274.860989:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634793728:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.861014:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429274.861048:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b4ee expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.861098:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f88e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e7 expref: 13 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.861111:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 21) 00010000:00010000:3.0:1789429274.861116:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 21) 00010000:00010000:3.0:1789429274.861123:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4ee expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.861152:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f097b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648218624:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429274.861171:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f88e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e7 expref: 13 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.861181:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429274.861191:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f88e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e7 expref: 13 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.861251:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648218752:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429274.861705:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634793856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6861us (7208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.861716:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5707 00000100:00100000:1.0:1789429274.869718:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634794112 00000100:00100000:1.0:1789429274.869734:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634794112 00010000:00010000:1.0:1789429274.869791:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f88e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e7 expref: 14 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.869845:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5708 00000100:00100000:1.0:1789429274.869857:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2368:x1876351634794112:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429274.869876:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429274.869905:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f88e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e7 expref: 14 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.869929:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f88e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e7 expref: 14 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.869960:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635f88e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4e7 expref: 14 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.869984:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 21) 00010000:00010000:1.0:1789429274.869989:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 21) 00010000:00010000:1.0:1789429274.869999:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4ee expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.870012:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4ee expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.870063:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4ee expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.870082:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648218880:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429274.870191:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.871338:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.871427:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634794240 00000100:00100000:3.0:1789429274.871447:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634794240 00000100:00100000:3.0:1789429274.871506:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5256 00000100:00100000:3.0:1789429274.871517:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634794240:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.871537:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429274.871559:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f89c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b4f5 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.871592:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4ee expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.871603:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 21) 00010000:00010000:3.0:1789429274.871608:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 21) 00010000:00010000:3.0:1789429274.871613:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f89c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4f5 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.871644:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4ee expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.871658:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4ee expref: 18 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.871673:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648219008:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429274.871749:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.874562:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648218880:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.874597:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.874666:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2368:x1876351634794112:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4810us (5284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.874684:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5708 00000100:00100000:3.0:1789429274.876455:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.876554:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634794368 00000100:00100000:1.0:1789429274.876566:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634794368 00010000:00010000:1.0:1789429274.876611:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4ee expref: 19 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.876661:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5709 00000100:00100000:1.0:1789429274.876673:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634794368:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429274.876690:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429274.876721:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4ee expref: 19 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.876736:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4ee expref: 19 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.876767:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f895 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4ee expref: 19 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.876787:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 21) 00010000:00010000:1.0:1789429274.876793:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 21) 00010000:00010000:1.0:1789429274.876804:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f89c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4f5 expref: 13 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.876815:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f89c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4f5 expref: 13 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.876867:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f89c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4f5 expref: 13 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.876883:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648219136:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429274.876983:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.879747:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648219136:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.879784:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.879895:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634794368:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3221us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.879907:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5709 00000100:00100000:3.0:1789429274.894632:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634794624 00000100:00100000:3.0:1789429274.894646:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634794624 00002000:00100000:3.0:1789429274.894722:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f3fbd5500 x1876351634794624/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.894735:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbd5500 with x1876351634794624 ext(143360->147455) 00010000:00010000:3.0:1789429274.894746:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f89c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4f5 expref: 14 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.894765:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f89c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4f5 expref: 14 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.894774:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbd5500 00000100:00100000:3.0:1789429274.894945:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1137 00000100:00100000:3.0:1789429274.894959:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2369:x1876351634794624:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429274.895381:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2369:x1876351634794624:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 423us (920us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429274.895391:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1137 00002000:00100000:3.0:1789429274.895399:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f3fbd5500 x1876351634794624/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.895409:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbd5500 with x1876351634794624 ext(143360->147455) 00010000:00010000:3.0:1789429274.895417:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f89c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4f5 expref: 14 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.895432:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f89c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4f5 expref: 14 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.895440:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbd5500 00000100:00100000:1.0:1789429274.905792:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.905858:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429274.911589:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340ced80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648219392:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429274.911867:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429274.913822:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634795008 00000100:00100000:3.0:1789429274.913835:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634795008 00002000:00100000:3.0:1789429274.913899:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946f340ced80 x1876351634795008/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.913922:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340ced80 with x1876351634795008 ext(143360->180223) 00010000:00010000:3.0:1789429274.913935:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635f8a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4fc expref: 19 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.913961:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635f8a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4fc expref: 19 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.913971:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f340ced80 00000100:00100000:3.0:1789429274.914005:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1138 00000100:00100000:3.0:1789429274.914016:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634795008:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429274.915713:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e10308a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648219520:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429274.915762:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635f8aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b503 expref: 14 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.915789:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac200, rc 0) 00000100:00100000:3.0:1789429274.918246:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634794752:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11579us (12449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.918263:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5258 00000100:00100000:3.0:1789429274.924363:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634795008:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 10332us (10771us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429274.924379:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1138 00002000:00100000:3.0:1789429274.924681:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946f340ced80 x1876351634795008/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:10/0 lens 488/440 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.924694:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340ced80 with x1876351634795008 ext(143360->180223) 00010000:00010000:3.0:1789429274.924708:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635f8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4fc expref: 19 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.924735:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635f8a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4fc expref: 19 pid: 6680 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.924744:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f340ced80 00000100:00100000:1.0:1789429274.927781:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.930126:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.938564:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648219648:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.938582:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.938626:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2369:x1876351634795264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8004us (8521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.938639:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5711 00000100:00100000:1.0:1789429274.939491:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634795392 00000100:00100000:1.0:1789429274.939501:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634795392 00010000:00010000:1.0:1789429274.939550:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635f8aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b503 expref: 14 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.939600:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5712 00000100:00100000:1.0:1789429274.939611:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2369:x1876351634795392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429274.939627:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429274.939658:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635f8aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b503 expref: 14 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.939673:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635f8aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b503 expref: 14 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.939701:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635f8aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b503 expref: 14 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.939719:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 21) 00010000:00010000:1.0:1789429274.939725:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 21) 00010000:00010000:1.0:1789429274.939735:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b50a expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.939748:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f8b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b50a expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.939792:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f8b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b50a expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429274.939816:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648219904:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429274.940351:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429274.945862:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648219904:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.945897:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.945966:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:2369:x1876351634795392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6355us (6618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.945978:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5712 00000100:00100000:3.0:1789429274.953455:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429274.962793:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634795648 00000100:00100000:1.0:1789429274.962807:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634795648 00010000:00010000:1.0:1789429274.962861:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f8b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b50a expref: 19 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.962894:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648220032:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429274.962921:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5713 00000100:00100000:1.0:1789429274.962933:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634795648:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429274.962942:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f8b8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b511 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.962952:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429274.962968:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9a00, rc 0) 00010000:00010000:1.0:1789429274.962984:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f8b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b50a expref: 19 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.963001:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f8b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b50a expref: 19 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.963035:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f8b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b50a expref: 19 pid: 8085 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429274.963058:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 21) 00010000:00010000:1.0:1789429274.963064:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 21) 00000100:00100000:3.0:1789429274.963071:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634795520:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8729us (9628us total) trans 0 rc 0/0 00010000:00010000:1.0:1789429274.963078:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f8b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b511 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.963085:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5260 00010000:00010000:1.0:1789429274.963098:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f8b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b511 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.963113:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634795776 00000100:00100000:3.0:1789429274.963119:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634795776 00000100:00100000:3.0:1789429274.963150:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5261 00010000:00010000:1.0:1789429274.963158:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f8b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b511 expref: 13 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.963160:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634795776:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429274.963183:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789429274.963184:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648220160:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429274.963310:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083180 going to sleep for 11 seconds 00010000:00010000:3.0:1789429274.963572:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f8bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b518 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.963600:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f8b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b511 expref: 13 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.963616:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 21) 00010000:00010000:3.0:1789429274.963620:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 21) 00010000:00010000:3.0:1789429274.963625:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f8bf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b518 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.963653:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f8b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b511 expref: 13 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.963669:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f8b8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b511 expref: 13 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429274.963681:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648220288:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429274.963938:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429274.968804:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648220288:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429274.968856:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f8bf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b518 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.968884:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:1.0:1789429274.968911:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648220160:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.968929:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429274.968962:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634795776:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5802us (6411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.968968:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634795648:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6034us (6495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429274.968978:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5261 00000100:00100000:1.0:1789429274.968983:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5713 00000100:00100000:3.0:1789429274.971039:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634795904 00000100:00100000:3.0:1789429274.971052:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634795904 00002000:00100000:3.0:1789429274.971119:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f3462d500 x1876351634795904/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/0 e 0 to 0 dl 1789429285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.971132:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462d500 with x1876351634795904 ext(143360->147455) 00010000:00010000:3.0:1789429274.971143:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f8b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b511 expref: 14 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.971163:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f8b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b511 expref: 14 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.971172:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3462d500 00000100:00100000:3.0:1789429274.971250:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1139 00000100:00100000:3.0:1789429274.971262:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634795904:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429274.971768:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634795904:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 507us (848us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429274.971778:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1139 00002000:00100000:3.0:1789429274.971786:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f3462d500 x1876351634795904/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:10/0 lens 488/4536 e 0 to 0 dl 1789429285 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429274.971795:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462d500 with x1876351634795904 ext(143360->147455) 00010000:00010000:3.0:1789429274.971802:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f8b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b511 expref: 14 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429274.971817:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f8b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b511 expref: 14 pid: 20745 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429274.971830:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3462d500 00000100:00100000:3.0:1789429274.987906:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634796032 00000100:00100000:3.0:1789429274.987931:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634796032 00000100:00100000:1.0:1789429274.990877:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e10308000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648220416:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429274.990910:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429274.991180:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2368:x1876351634796160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6987us (7233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429274.991192:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5714 00000100:00080000:1.0:1789429275.003906:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429275.009131:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648220544:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429275.009186:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f8c6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b51f expref: 14 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.009258:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9200, rc 0) 00000100:00100000:1.0:1789429275.009304:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634796032:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 19142us (25751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.009312:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5262 00000100:00100000:3.0:1789429275.020407:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.024952:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634796672 00000100:00100000:1.0:1789429275.024963:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634796672 00010000:00010000:1.0:1789429275.025039:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f8c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b51f expref: 14 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.025091:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5716 00000100:00100000:1.0:1789429275.025103:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634796672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429275.025121:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429275.025157:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f8c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b51f expref: 14 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.025174:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f8c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b51f expref: 14 pid: 20986 timeout: 1072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.025247:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=1s v=(54 21) 00010000:00010000:1.0:1789429275.025253:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 21) 00010000:00010000:1.0:1789429275.025263:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635f8cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b526 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.025277:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635f8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b526 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.025322:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635f8cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b526 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.025338:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648220928:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.025417:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.030273:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648220928:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.030310:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.030399:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:2371:x1876351634796672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5298us (5537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.030412:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5716 00000100:00100000:3.0:1789429275.032011:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634796800 00000100:00100000:3.0:1789429275.032317:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634796800 00002000:00100000:1.0:1789429275.032467:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946f3462ed80 x1876351634796800/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.032481:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462ed80 with x1876351634796800 ext(143360->180223) 00002000:00010000:1.0:1789429275.032488:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462ed80 00000100:00100000:1.0:1789429275.032535:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11312 00000100:00100000:1.0:1789429275.032546:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634796800:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.040353:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634796800:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7799us (9675us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429275.040368:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11312 00002000:00100000:1.0:1789429275.040383:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946f3462ed80 x1876351634796800/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.040394:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462ed80 with x1876351634796800 ext(143360->180223) 00010000:00010000:1.0:1789429275.040405:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635f8cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b526 expref: 19 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.040424:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635f8cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b526 expref: 19 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.040432:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3462ed80 00000100:00100000:1.0:1789429275.044482:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.044529:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.045579:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634797056 00000100:00100000:3.0:1789429275.045585:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634797056 00000100:00100000:3.0:1789429275.045628:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5265 00000100:00100000:3.0:1789429275.045637:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634797056:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429275.045654:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429275.045674:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b534 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.045700:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f8d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b52d expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.045709:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 21) 00010000:00010000:3.0:1789429275.045712:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 21) 00010000:00010000:3.0:1789429275.045718:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8db lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b534 expref: 21 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.045742:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f8d4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b52d expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.045757:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f8d4 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b52d expref: 14 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.045770:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648221312:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429275.045826:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.049583:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648221184:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.049625:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.049702:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634797184:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4942us (5169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.049716:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5717 00000100:00100000:3.0:1789429275.050477:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648221312:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429275.050517:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b534 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.050542:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429275.050601:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634797056:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4965us (6134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.050610:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5265 00000100:00100000:3.0:1789429275.053838:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634797312 00000100:00100000:3.0:1789429275.053859:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634797312 00000100:00100000:1.0:1789429275.061685:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.061740:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.061978:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634797568 00000100:00100000:3.0:1789429275.061985:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634797568 00010000:00010000:3.0:1789429275.062014:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f8d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b52d expref: 16 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.062071:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5718 00000100:00100000:3.0:1789429275.062080:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351634797568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429275.062092:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.062123:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f8d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b52d expref: 16 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.062162:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b52d expref: 16 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.065985:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f8d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b52d expref: 15 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.066017:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 21) 00010000:00010000:3.0:1789429275.066023:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 21) 00010000:00010000:3.0:1789429275.066035:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b534 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.066047:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b534 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.066117:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b534 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.066137:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b534 expref: 18 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.066154:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648221568:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429275.066321:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.074776:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1789429275.078630:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b534 expref: 19 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.078666:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648221568:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.078701:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.079132:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648221696:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.079156:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.079246:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634797696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4180us (4482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.079259:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5719 00000100:00100000:3.0:1789429275.093708:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634797952 00000100:00100000:3.0:1789429275.093719:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634797952 00002000:00100000:3.0:1789429275.093778:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946e10308e00 x1876351634797952/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.093793:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10308e00 with x1876351634797952 ext(143360->147455) 00010000:00010000:3.0:1789429275.093806:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f8e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b53b expref: 14 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.093836:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f8e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b53b expref: 14 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.093844:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e10308e00 00000100:00100000:3.0:1789429275.093883:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1142 00000100:00100000:3.0:1789429275.093894:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634797952:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.094116:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634797952:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 223us (701us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429275.094124:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1142 00002000:00100000:3.0:1789429275.094130:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946e10308e00 x1876351634797952/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.094139:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10308e00 with x1876351634797952 ext(143360->147455) 00010000:00010000:3.0:1789429275.094145:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f8e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b53b expref: 14 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.094161:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f8e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b53b expref: 14 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.094169:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e10308e00 00000100:00100000:3.0:1789429275.099930:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634798080 00000100:00100000:3.0:1789429275.099943:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634798080 00000100:00100000:3.0:1789429275.100017:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5268 00000100:00100000:3.0:1789429275.100039:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634798080:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429275.100062:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429275.100086:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b549 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.100125:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(59 21) 00010000:00010000:3.0:1789429275.100136:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f8e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b542 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.100143:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 21) 00010000:00010000:3.0:1789429275.100148:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.100233:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f8e9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b542 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.100252:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.100272:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429275.100796:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634798080:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 766us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.100814:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5268 00000100:00100000:1.0:1789429275.110528:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634798336 00000100:00100000:1.0:1789429275.110541:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634798336 00002000:00100000:1.0:1789429275.110607:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946e10308a80 x1876351634798336/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.110620:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10308a80 with x1876351634798336 ext(143360->180223) 00010000:00010000:1.0:1789429275.110631:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f8e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b542 expref: 19 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.110652:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f8e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b542 expref: 19 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.110662:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e10308a80 00000100:00100000:1.0:1789429275.110708:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1143 00000100:00100000:1.0:1789429275.110729:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634798336:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.113982:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634798336:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3248us (3532us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429275.114000:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1143 00002000:00100000:1.0:1789429275.114017:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946e10308a80 x1876351634798336/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.114030:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10308a80 with x1876351634798336 ext(143360->180223) 00010000:00010000:1.0:1789429275.114043:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f8e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b542 expref: 19 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.114064:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f8e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b542 expref: 19 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.114075:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e10308a80 00000100:00100000:3.0:1789429275.117128:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634798464 00000100:00100000:3.0:1789429275.117139:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634798464 00000100:00100000:3.0:1789429275.117244:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5269 00000100:00100000:3.0:1789429275.117256:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634798464:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429275.117279:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429275.117305:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f8f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b550 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.117358:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 21) 00010000:00010000:3.0:1789429275.117369:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.117378:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 21) 00010000:00010000:3.0:1789429275.117384:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f8f7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b550 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.117436:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.117454:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f8f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b550 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.117469:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429275.117541:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634798464:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 287us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.117548:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5269 00000100:00100000:3.0:1789429275.119163:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.119321:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634798592 00000100:00100000:1.0:1789429275.119333:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634798592 00010000:00010000:1.0:1789429275.119380:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f8e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b542 expref: 20 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.119431:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5721 00000100:00100000:1.0:1789429275.119442:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634798592:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429275.119459:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429275.119488:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f8e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b542 expref: 20 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.119504:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b542 expref: 20 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.119542:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f8e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b542 expref: 20 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.119563:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 21) 00010000:00010000:1.0:1789429275.119568:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 21) 00010000:00010000:1.0:1789429275.119579:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.119590:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.119634:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 13 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.119649:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 13 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.119665:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648222336:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.119765:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.126991:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.127294:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648222336:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.127337:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.127417:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634798592:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7976us (8264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.127431:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5721 00000100:00100000:1.0:1789429275.127474:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634798720 00000100:00100000:1.0:1789429275.127481:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634798720 00010000:00010000:1.0:1789429275.127521:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 14 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.127575:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5722 00000100:00100000:1.0:1789429275.127587:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634798720:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429275.127603:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429275.127636:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 14 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.127658:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 14 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.127689:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635f8f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b549 expref: 14 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.127709:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 21) 00010000:00010000:1.0:1789429275.127713:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 21) 00010000:00010000:1.0:1789429275.127739:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f8f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b550 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.127751:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f8f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b550 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.127794:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f8f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b550 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.127822:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648222464:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.127885:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.130621:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648222464:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.130658:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.130979:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:2371:x1876351634798720:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3391us (3999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.130993:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5722 00000100:00100000:1.0:1789429275.141054:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634798848 00000100:00100000:1.0:1789429275.141075:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634798848 00000100:00100000:3.0:1789429275.141248:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5270 00000100:00100000:3.0:1789429275.141263:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:33938:x1876351634798848:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429275.141286:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429275.141310:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b557 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.141350:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f8f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b550 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.141361:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 21) 00010000:00010000:3.0:1789429275.141366:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 21) 00010000:00010000:3.0:1789429275.141373:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.141425:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f8f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b550 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.141441:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f8f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b550 expref: 18 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.141468:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648222592:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429275.141584:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.143970:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634798976 00000100:00100000:3.0:1789429275.143983:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634798976 00002000:00100000:3.0:1789429275.144055:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946f2f097b80 x1876351634798976/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.144068:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f097b80 with x1876351634798976 ext(143360->180223) 00010000:00010000:3.0:1789429275.144079:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f8f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b550 expref: 19 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.144099:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635f8f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b550 expref: 19 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.144108:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f097b80 00000100:00100000:3.0:1789429275.144139:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1144 00000100:00100000:3.0:1789429275.144151:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634798976:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.152294:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648222592:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429275.152347:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.152374:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429275.152461:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634798848:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11201us (14594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.152472:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5270 00010000:00010000:2.0:1789429275.182338:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.182353:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f905 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b55e expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.182365:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9a00, rc 0) 00000100:00100000:2.0:1789429275.182432:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+21:33927:x1876351634799104:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 249us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.182440:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5271 00010000:00010000:1.0:1789429275.182573:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.182597:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 13 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.182617:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648222848:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.182705:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.188523:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648222848:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.188527:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:2.0:1789429275.188559:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.188641:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634799232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6268us (7769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.188664:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5723 00000100:00100000:3.0:1789429275.189641:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634799360 00000100:00100000:3.0:1789429275.189658:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634799360 00002000:00100000:3.0:1789429275.189729:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f34499180 x1876351634799360/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.189743:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499180 with x1876351634799360 ext(143360->147455) 00010000:00010000:3.0:1789429275.189755:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 14 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.189776:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 14 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.189785:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34499180 00000100:00100000:3.0:1789429275.189825:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1145 00000100:00100000:3.0:1789429275.189837:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634799360:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.190115:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634799360:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 279us (1603us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429275.190125:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1145 00002000:00100000:3.0:1789429275.190134:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f34499180 x1876351634799360/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.190143:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499180 with x1876351634799360 ext(143360->147455) 00010000:00010000:3.0:1789429275.190151:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 14 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.190172:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 14 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.190180:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34499180 00000100:00100000:1.0:1789429275.193992:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.195830:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.196179:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634799616 00000100:00100000:3.0:1789429275.196189:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634799616 00010000:00010000:3.0:1789429275.196287:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 15 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.196336:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5724 00000100:00100000:3.0:1789429275.196347:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2369:x1876351634799616:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429275.196364:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.196395:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 15 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.196410:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 15 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.196440:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f8fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b557 expref: 15 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.196462:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 21) 00010000:00010000:3.0:1789429275.196468:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 21) 00010000:00010000:3.0:1789429275.196478:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b55e expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.196490:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b55e expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.196534:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b55e expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.196551:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b55e expref: 18 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.196566:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648223104:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429275.196672:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.201977:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648223104:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.202010:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429275.202099:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2369:x1876351634799616:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5752us (6273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.202113:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5724 00000100:00100000:2.0:1789429275.206435:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634799744 00000100:00100000:2.0:1789429275.206457:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634799744 00010000:00010000:2.0:1789429275.206518:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b55e expref: 19 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.206568:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5725 00000100:00100000:2.0:1789429275.206579:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2368:x1876351634799744:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429275.206598:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.206626:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f905 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b55e expref: 19 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.206642:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b55e expref: 19 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.206671:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f905 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b55e expref: 19 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.206690:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 21) 00010000:00010000:2.0:1789429275.206695:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 21) 00010000:00010000:2.0:1789429275.206704:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635f90c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b565 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.206716:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635f90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b565 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.206763:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635f90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b565 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.206780:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648223232:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.206900:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.209974:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648223232:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.210011:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.210094:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:2368:x1876351634799744:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3515us (8397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.210108:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5725 00000100:00100000:2.0:1789429275.212903:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634799872 00000100:00100000:2.0:1789429275.212917:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634799872 00000100:00100000:2.0:1789429275.212988:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5273 00000100:00100000:2.0:1789429275.213000:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634799872:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.213022:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.213057:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b56c expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.213099:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635f90c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b565 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.213110:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 21) 00010000:00010000:2.0:1789429275.213115:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 21) 00010000:00010000:2.0:1789429275.213120:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.213163:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635f90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b565 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.213179:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635f90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b565 expref: 13 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.213238:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648223360:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.213415:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.217782:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648223360:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429275.217840:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.217872:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9c00, rc 0) 00000100:00100000:2.0:1789429275.217988:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634799872:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4989us (5197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.217999:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5273 00000100:00100000:1.0:1789429275.225740:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634800000 00000100:00100000:1.0:1789429275.225761:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634800000 00010000:00010000:1.0:1789429275.225822:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635f90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b565 expref: 14 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.225879:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5726 00000100:00100000:1.0:1789429275.225891:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351634800000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429275.225918:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429275.225949:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635f90c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b565 expref: 14 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.225967:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635f90c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b565 expref: 14 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.226003:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635f90c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b565 expref: 14 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.226025:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 21) 00010000:00010000:1.0:1789429275.226090:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 21) 00010000:00010000:1.0:1789429275.226102:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.226114:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.226162:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.226178:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648223488:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.226492:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.226717:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634800128 00000100:00100000:2.0:1789429275.226724:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634800128 00000100:00100000:2.0:1789429275.226772:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5274 00000100:00100000:2.0:1789429275.226780:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634800128:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.226798:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.226816:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b573 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.226839:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.226848:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 21) 00010000:00010000:2.0:1789429275.226852:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 21) 00010000:00010000:2.0:1789429275.226856:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.226882:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.226897:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 18 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.226921:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648223616:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.226958:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.235920:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648223616:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429275.235975:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.236003:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9200, rc 0) 00000100:00100000:2.0:1789429275.236093:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634800128:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9312us (12890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.236105:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5274 00000100:00100000:1.0:1789429275.238103:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648223488:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.238137:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.238248:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351634800000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12358us (15343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.238261:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5726 00000100:00100000:3.0:1789429275.245607:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.246565:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634800256 00000100:00100000:1.0:1789429275.246583:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634800256 00002000:00100000:1.0:1789429275.246714:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946f3f1c7480 x1876351634800256/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.246728:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7480 with x1876351634800256 ext(143360->180223) 00010000:00010000:1.0:1789429275.246740:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 19 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.246762:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 19 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.246773:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f1c7480 00000100:00100000:1.0:1789429275.246817:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1146 00000100:00100000:1.0:1789429275.246829:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634800256:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.252575:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634800256:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5730us (6966us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429275.252592:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1146 00002000:00100000:1.0:1789429275.252609:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946f3f1c7480 x1876351634800256/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.252621:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7480 with x1876351634800256 ext(143360->180223) 00010000:00010000:1.0:1789429275.252634:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 19 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.252655:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 19 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.252664:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f1c7480 00000100:00100000:3.0:1789429275.259951:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.260076:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634800384 00000100:00100000:1.0:1789429275.260091:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634800384 00000100:00100000:1.0:1789429275.260166:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5275 00000100:00100000:1.0:1789429275.260177:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634800384:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429275.260324:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789429275.262762:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634800512 00000100:00100000:3.0:1789429275.262779:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634800512 00010000:00010000:3.0:1789429275.262838:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 20 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.262904:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5727 00000100:00100000:3.0:1789429275.262916:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634800512:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429275.262933:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.262962:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 20 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.262980:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 20 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.263008:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635f913 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b56c expref: 20 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.263030:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 21) 00010000:00010000:3.0:1789429275.263035:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 21) 00010000:00010000:3.0:1789429275.263046:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.263057:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.263106:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.263123:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648223744:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429275.263302:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ede40 going to sleep for 11 seconds 00010000:00010000:2.0:1789429275.263735:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f921 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b57a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.263885:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.263896:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 21) 00010000:00010000:2.0:1789429275.263900:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 21) 00010000:00010000:2.0:1789429275.263906:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f921 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b57a expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.263935:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.263957:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 13 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.263970:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648223872:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.264030:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.271726:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648223744:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.271761:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429275.271847:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634800512:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8928us (10946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.271860:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5727 00000100:00100000:1.0:1789429275.273623:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634800640 00000100:00100000:1.0:1789429275.273639:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634800640 00002000:00100000:1.0:1789429275.273709:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f3b604380 x1876351634800640/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.273723:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b604380 with x1876351634800640 ext(143360->147455) 00010000:00010000:1.0:1789429275.273735:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 14 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.273756:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 14 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.273766:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b604380 00000100:00100000:1.0:1789429275.273813:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1147 00000100:00100000:1.0:1789429275.273825:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2368:x1876351634800640:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.274068:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b604380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2368:x1876351634800640:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 244us (2354us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429275.274076:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1147 00002000:00100000:1.0:1789429275.274084:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f3b604380 x1876351634800640/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.274093:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b604380 with x1876351634800640 ext(143360->147455) 00010000:00010000:1.0:1789429275.274099:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 14 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.274112:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f91a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b573 expref: 14 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.274119:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b604380 00000100:00100000:2.0:1789429275.276003:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648223872:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429275.276046:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f921 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b57a expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.276070:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9a00, rc 0) 00000100:00100000:2.0:1789429275.276504:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634800384:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 16327us (16567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.276515:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5275 00000100:00100000:3.0:1789429275.288434:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.290530:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634800768 00000100:00100000:2.0:1789429275.290546:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634800768 00000100:00100000:2.0:1789429275.290620:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5276 00000100:00100000:2.0:1789429275.290630:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634800768:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.290651:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.290674:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f928 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b581 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.290712:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f921 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b57a expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.290727:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 21) 00010000:00010000:2.0:1789429275.290732:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 21) 00010000:00010000:2.0:1789429275.290737:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f928 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b581 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.290773:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f921 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b57a expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.290790:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f921 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b57a expref: 18 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.290804:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648224128:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.290906:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.298266:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.298716:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648224128:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429275.298760:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f928 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b581 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.298785:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd8400, rc 0) 00000100:00100000:2.0:1789429275.298858:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634800768:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8229us (11119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.298868:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5276 00000004:00080000:3.0:1789429275.303284:0:6898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 973283079651ns, next at 974283075959ns, rc = 0 00000100:00100000:1.0:1789429275.303397:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648224384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429275.303506:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429275.304419:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648224384 00000100:00100000:3.0:1789429275.304432:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648224384 00000100:00100000:3.0:1789429275.304488:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789429275.304499:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648224384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429275.304542:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 325255168 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1789429275.304617:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648224384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.304625:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789429275.309097:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648224384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429275.309819:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634801152 00000100:00100000:2.0:1789429275.309839:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634801152 00000100:00100000:2.0:1789429275.309925:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5277 00000100:00100000:2.0:1789429275.309937:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634801152:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.309961:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.309986:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f92f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b588 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.310029:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b581 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.310046:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 21) 00010000:00010000:2.0:1789429275.310052:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 21) 00010000:00010000:2.0:1789429275.310057:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f92f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b588 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.310097:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b581 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.310112:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f928 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b581 expref: 13 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.310127:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648224512:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.310476:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.310532:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429275.310545:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648224640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429275.310598:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429275.310718:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648224640 00000100:00100000:3.0:1789429275.310786:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648224640 00000100:00100000:3.0:1789429275.310824:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789429275.310831:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648224640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429275.310865:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 846528512 pending 13631488 free 3828350976 avail 3826253824 00000004:00080000:2.0:1789429275.312270:0:8083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 973292066466ns, next at 974292063378ns, rc = 0 00000100:00100000:2.0:1789429275.317909:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648224640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7066us (7299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.317925:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789429275.318005:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648224640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429275.318185:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648224512:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429275.318268:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f92f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b588 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.318572:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9600, rc 0) 00000100:00100000:3.0:1789429275.318659:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634801152:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8724us (11063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.318668:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5277 00000100:00100000:2.0:1789429275.319256:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.320707:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634801408 00000100:00100000:1.0:1789429275.320722:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634801408 00000100:00100000:1.0:1789429275.320809:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5278 00000100:00100000:1.0:1789429275.320824:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634801408:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429275.320843:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429275.320864:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f936 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b58f expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.320898:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f92f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b588 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.320910:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 21) 00010000:00010000:1.0:1789429275.320914:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 21) 00010000:00010000:1.0:1789429275.320919:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f936 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b58f expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.320961:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f92f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b588 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.320975:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f92f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b588 expref: 18 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.320989:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648224896:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429275.321070:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.326769:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648224896:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429275.326770:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b607b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648224768:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.326806:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429275.326817:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f936 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b58f expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.326842:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1000, rc 0) 00000100:00100000:3.0:1789429275.326879:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b605f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634801280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8825us (8977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.326891:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5730 00000100:00100000:2.0:1789429275.329758:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634801408:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8919us (10483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.329776:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5278 00000100:00100000:1.0:1789429275.329815:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.330684:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634801536 00000100:00100000:3.0:1789429275.330699:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634801536 00002000:00100000:3.0:1789429275.330761:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946f34498000 x1876351634801536/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.330773:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34498000 with x1876351634801536 ext(143360->180223) 00010000:00010000:3.0:1789429275.330784:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f92f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b588 expref: 19 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.330804:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f92f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b588 expref: 19 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.330813:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34498000 00000100:00100000:3.0:1789429275.330876:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1148 00000100:00100000:3.0:1789429275.330889:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634801536:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.337829:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634801536:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6927us (8007us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429275.337848:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1148 00002000:00100000:3.0:1789429275.337866:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946f34498000 x1876351634801536/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.337881:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34498000 with x1876351634801536 ext(143360->180223) 00010000:00010000:3.0:1789429275.337894:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f92f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b588 expref: 19 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.337916:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f92f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b588 expref: 19 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.337926:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34498000 00000100:00100000:3.0:1789429275.347076:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634801664 00000100:00100000:3.0:1789429275.347089:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634801664 00000100:00100000:3.0:1789429275.347152:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5279 00000100:00100000:3.0:1789429275.347162:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634801664:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429275.347185:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429275.347241:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b596 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.347300:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 21) 00010000:00010000:3.0:1789429275.347317:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f936 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b58f expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.347326:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 21) 00010000:00010000:3.0:1789429275.347333:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.347385:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f936 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b58f expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.347403:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.347419:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429275.347498:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634801664:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 336us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.347506:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5279 00000100:00100000:1.0:1789429275.353633:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.353702:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648225152:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.353734:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.353804:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634801792:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5450us (5609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.353816:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5731 00000100:00100000:1.0:1789429275.364128:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.365667:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634802048 00000100:00100000:2.0:1789429275.365686:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634802048 00000100:00100000:2.0:1789429275.365758:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5280 00000100:00100000:2.0:1789429275.365770:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634802048:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.365794:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.365820:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b59d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.365861:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(76 21) 00010000:00010000:2.0:1789429275.365870:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.365879:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 21) 00010000:00010000:2.0:1789429275.365886:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.365934:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.365950:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.365964:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9800, rc 0) 00000100:00100000:2.0:1789429275.366044:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634802048:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 276us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.366052:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5280 00000001:00080000:0.0:1789429275.372416:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969547 is committed 00000100:00100000:0.0:1789429275.372534:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.372639:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634802176 00000100:00100000:1.0:1789429275.372651:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634802176 00010000:00010000:1.0:1789429275.372702:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b58f expref: 9 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.372790:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5732 00000100:00100000:1.0:1789429275.372803:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2371:x1876351634802176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429275.372822:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429275.372853:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b58f expref: 9 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.372869:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b58f expref: 9 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.372898:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f936 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b58f expref: 9 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.372918:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 21) 00010000:00010000:1.0:1789429275.372924:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 21) 00010000:00010000:1.0:1789429275.372933:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.372944:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.372993:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.373008:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.373024:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b4e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648225408:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.373143:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.376085:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b4e1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648225408:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.376121:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.376398:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b604a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634802176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3396us (3669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.376414:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5732 00000100:00100000:2.0:1789429275.376943:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.377123:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634802304 00000100:00100000:0.0:1789429275.377134:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634802304 00010000:00010000:0.0:1789429275.377178:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 11 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.377243:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5733 00000100:00100000:0.0:1789429275.377254:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351634802304:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429275.377272:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429275.377417:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 11 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.377434:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 11 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.377467:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635f93d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b596 expref: 11 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.377487:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 21) 00010000:00010000:0.0:1789429275.377493:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 21) 00010000:00010000:0.0:1789429275.377502:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.377515:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.377635:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.377651:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b604000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648225536:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429275.377761:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f012edd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.381817:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b604000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648225536:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.381857:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.381968:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+10:2371:x1876351634802304:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4714us (5025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.381981:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5733 00000100:00100000:1.0:1789429275.390907:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.391279:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634802432 00000100:00100000:3.0:1789429275.391293:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634802432 00000100:00100000:3.0:1789429275.391379:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5281 00000100:00100000:3.0:1789429275.391392:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+10:33927:x1876351634802432:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429275.391416:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429275.391442:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5a4 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.391486:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.391498:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 21) 00010000:00010000:3.0:1789429275.391503:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 21) 00010000:00010000:3.0:1789429275.391510:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 11 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.391555:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.391573:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 7 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.391591:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648225664:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429275.391760:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.394356:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.394653:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634802560 00000100:00100000:0.0:1789429275.394666:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634802560 00002000:00100000:0.0:1789429275.394726:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f054d8700 x1876351634802560/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.394738:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d8700 with x1876351634802560 ext(143360->147455) 00010000:00010000:0.0:1789429275.394749:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 8 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.394768:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 8 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429275.394777:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d8700 00000100:00100000:0.0:1789429275.394818:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1150 00000100:00100000:0.0:1789429275.394828:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634802560:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429275.395085:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634802560:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 258us (742us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429275.395093:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1150 00002000:00100000:0.0:1789429275.395100:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f054d8700 x1876351634802560/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.395109:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d8700 with x1876351634802560 ext(143360->147455) 00010000:00010000:0.0:1789429275.395115:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 8 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.395126:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 8 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429275.395134:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d8700 00000100:00100000:3.0:1789429275.399817:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648225664:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429275.399874:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 11 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.399903:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429275.400313:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+11:33927:x1876351634802432:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8920us (9421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.400324:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5281 00000100:00100000:1.0:1789429275.400701:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.400833:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634802688 00000100:00100000:2.0:1789429275.400843:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634802688 00000100:00100000:2.0:1789429275.400893:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5282 00000100:00100000:2.0:1789429275.400903:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634802688:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.400922:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.400942:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5ab expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.400981:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 21) 00010000:00010000:2.0:1789429275.400990:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 10 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.400998:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 21) 00010000:00010000:2.0:1789429275.401004:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.401049:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 10 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.401064:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.401075:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd8400, rc 0) 00000100:00100000:2.0:1789429275.401753:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634802688:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 847us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.401763:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5282 00000100:00100000:1.0:1789429275.407892:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.408136:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634802816 00000100:00100000:3.0:1789429275.408150:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634802816 00010000:00010000:3.0:1789429275.408434:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 9 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.408526:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5734 00000100:00100000:3.0:1789429275.408538:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2368:x1876351634802816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429275.408558:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.408590:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 9 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.408613:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 9 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.408640:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f944 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b59d expref: 9 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.408659:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 21) 00010000:00010000:3.0:1789429275.408664:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 21) 00010000:00010000:3.0:1789429275.408674:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 10 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.408686:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 10 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.408752:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 10 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.408767:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 10 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.408782:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648225920:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429275.408889:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.423049:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.423106:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.423494:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634803072 00000100:00100000:2.0:1789429275.423505:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634803072 00000100:00100000:1.0:1789429275.423653:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634802944 00000100:00100000:1.0:1789429275.423659:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634802944 00002000:00100000:1.0:1789429275.423703:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x2a:0x0] (0->12) req@ffff946f3b604000 x1876351634802944/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 504/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429275.423715:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b604000 with x1876351634802944 ext(0->12) 00002000:00010000:1.0:1789429275.423721:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3b604000 00000100:00100000:1.0:1789429275.423747:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11313 00000100:00100000:1.0:1789429275.423757:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2369:x1876351634802944:12345-192.168.203.39@tcp:4:diff.0 00000100:00100000:1.0:1789429275.425647:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b604000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2369:x1876351634802944:12345-192.168.203.39@tcp:4:diff.0 Request processed in 1878us (2527us total) trans 4294969241 rc 0/0 00000100:00100000:1.0:1789429275.425662:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11313 00002000:00100000:1.0:1789429275.425674:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x2a:0x0] (0->12) req@ffff946f3b604000 x1876351634802944/t4294969241(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 504/448 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 0/0 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429275.425685:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b604000 with x1876351634802944 ext(0->12) 00002000:00010000:1.0:1789429275.425692:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3b604000 00000100:00100000:2.0:1789429275.426306:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5283 00000100:00100000:2.0:1789429275.426324:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f11191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2369:x1876351634803072:12345-192.168.203.39@tcp:16:kworker.0 00000100:00100000:3.0:1789429275.427557:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648225920:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.427595:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429275.428011:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351634802816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 19472us (20132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.428026:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5734 00000100:00100000:0.0:1789429275.430624:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.432938:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634803200 00000100:00100000:2.0:1789429275.432956:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634803200 00002000:00100000:2.0:1789429275.433025:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946f3b606a00 x1876351634803200/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.433044:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b606a00 with x1876351634803200 ext(143360->180223) 00010000:00010000:2.0:1789429275.433055:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 11 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.433078:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 11 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.433088:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b606a00 00000100:00100000:2.0:1789429275.434256:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1151 00000100:00100000:2.0:1789429275.434274:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351634803200:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429275.441693:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351634803200:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7410us (11066us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429275.441709:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1151 00002000:00100000:2.0:1789429275.441727:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (143360->180223) req@ffff946f3b606a00 x1876351634803200/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.441739:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b606a00 with x1876351634803200 ext(143360->180223) 00010000:00010000:2.0:1789429275.441752:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 11 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.441773:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 11 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.441788:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b606a00 00000100:00100000:0.0:1789429275.448784:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.448832:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.448915:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634803328 00000100:00100000:1.0:1789429275.448930:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634803328 00000100:00100000:1.0:1789429275.449036:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5284 00000100:00100000:1.0:1789429275.449049:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+11:33927:x1876351634803328:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429275.449075:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429275.449101:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5b2 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.449151:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 21) 00010000:00010000:1.0:1789429275.449163:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.449171:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 21) 00010000:00010000:1.0:1789429275.449178:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 12 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.449267:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.449289:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 12 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.449305:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:1.0:1789429275.449381:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:33927:x1876351634803328:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 335us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.449388:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5284 00000100:00100000:3.0:1789429275.449486:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634803456 00000100:00100000:3.0:1789429275.449492:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634803456 00010000:00010000:3.0:1789429275.449518:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 12 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.449545:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5735 00000100:00100000:3.0:1789429275.449551:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b605f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634803456:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429275.449563:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.449589:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 12 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.449601:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 12 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.449624:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f94b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5a4 expref: 12 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.449639:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 21) 00010000:00010000:3.0:1789429275.449643:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 21) 00010000:00010000:3.0:1789429275.449651:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.449668:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.449697:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.449711:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 7 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.449726:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648226176:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429275.449798:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.458377:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.458451:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648226176:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.458482:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.458542:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b605f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351634803456:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8989us (9707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.458556:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5735 00000100:00100000:2.0:1789429275.458587:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634803584 00000100:00100000:2.0:1789429275.458599:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634803584 00010000:00010000:2.0:1789429275.458641:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 8 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.458685:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5736 00000100:00100000:2.0:1789429275.458696:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351634803584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429275.458721:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.458751:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 8 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.458767:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 8 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.458796:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f952 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ab expref: 8 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.458813:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 21) 00010000:00010000:2.0:1789429275.458819:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 21) 00010000:00010000:2.0:1789429275.458829:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 10 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.458841:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 10 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.458887:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 10 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.458904:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648226304:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.458971:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.467955:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.468139:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634803712 00000100:00100000:2.0:1789429275.468154:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634803712 00000100:00100000:2.0:1789429275.468260:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5285 00000100:00100000:2.0:1789429275.468272:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33938:x1876351634803712:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.468294:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.468318:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5b9 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.468360:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 10 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.468371:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 21) 00010000:00010000:2.0:1789429275.468377:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 21) 00010000:00010000:2.0:1789429275.468383:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 9 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.468423:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 10 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.468446:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 10 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.468462:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648226432:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.468577:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223540 going to sleep for 11 seconds 00000001:00080000:0.0:1789429275.470721:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969241 is committed 00000100:00100000:3.0:1789429275.470992:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f11191450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351634803072:12345-192.168.203.39@tcp:16:kworker.0 Request processed in 44664us (47957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.471004:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5283 00000100:00100000:2.0:1789429275.474720:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648226304:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.474763:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.474830:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.474836:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648226432:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.474858:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2368:x1876351634803584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 16160us (16492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.474873:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5736 00010000:00010000:3.0:1789429275.474884:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 9 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.474908:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd8400, rc 0) 00000100:00100000:1.0:1789429275.474949:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634803840 00000100:00100000:1.0:1789429275.474960:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634803840 00000100:00100000:3.0:1789429275.476363:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634803712:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8087us (8418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.476373:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5285 00000100:00100000:3.0:1789429275.476408:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5286 00000100:00100000:3.0:1789429275.476421:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351634803840:12345-192.168.203.39@tcp:16:kworker.0 00000100:00100000:3.0:1789429275.476496:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351634803840:12345-192.168.203.39@tcp:16:kworker.0 Request processed in 79us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.476503:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5286 00000100:00100000:0.0:1789429275.477233:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.477396:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634803968 00000100:00100000:0.0:1789429275.477406:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634803968 00010000:00010000:0.0:1789429275.477449:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 11 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.477490:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5737 00000100:00100000:0.0:1789429275.477500:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351634803968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429275.477517:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429275.477543:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 11 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.477565:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 11 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.477594:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635f959 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b2 expref: 11 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.477619:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 21) 00010000:00010000:0.0:1789429275.477623:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 21) 00010000:00010000:0.0:1789429275.477634:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.477644:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.477690:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.477707:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b604a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648226560:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429275.477798:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f012ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.481488:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b604a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648226560:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429275.481532:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429275.481600:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+10:2370:x1876351634803968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4100us (4404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.481613:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5737 00000100:00100000:0.0:1789429275.485536:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.485597:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.485665:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634804224 00000100:00100000:1.0:1789429275.485678:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634804224 00000100:00100000:1.0:1789429275.485741:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5287 00000100:00100000:1.0:1789429275.485752:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+10:33927:x1876351634804224:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429275.485774:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429275.485796:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5c0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.485838:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.485849:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 21) 00010000:00010000:1.0:1789429275.485854:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 21) 00010000:00010000:1.0:1789429275.485860:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.485899:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.485915:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 7 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.485932:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648226688:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429275.486017:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.486178:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634804096 00000100:00100000:3.0:1789429275.486182:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634804096 00002000:00100000:3.0:1789429275.486246:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f3b604a80 x1876351634804096/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.486257:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b604a80 with x1876351634804096 ext(143360->147455) 00010000:00010000:3.0:1789429275.486264:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 8 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.486277:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 8 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.486285:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b604a80 00000100:00100000:3.0:1789429275.486307:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1152 00000100:00100000:3.0:1789429275.486315:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634804096:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.486525:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634804096:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 210us (1000us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429275.486532:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1152 00002000:00100000:3.0:1789429275.486539:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f3b604a80 x1876351634804096/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.486554:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b604a80 with x1876351634804096 ext(143360->147455) 00010000:00010000:3.0:1789429275.486560:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 8 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.486570:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 8 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.486578:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b604a80 00000100:00100000:1.0:1789429275.495093:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648226688:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429275.495466:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.495496:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1000, rc 0) 00000100:00100000:1.0:1789429275.495569:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+11:33927:x1876351634804224:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9818us (9970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.495580:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5287 00000100:00100000:0.0:1789429275.498895:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.498997:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634804352 00000100:00100000:2.0:1789429275.499010:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634804352 00002000:00100000:2.0:1789429275.499077:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f3b605500 x1876351634804352/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.499092:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b605500 with x1876351634804352 ext(147456->151551) 00010000:00010000:2.0:1789429275.499106:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 8 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.499362:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 8 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.499372:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b605500 00000100:00100000:3.0:1789429275.499694:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1153 00000100:00100000:3.0:1789429275.499714:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634804352:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429275.499920:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.499939:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b605500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634804352:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 229us (1055us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429275.502139:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634804480 00000100:00100000:0.0:1789429275.502157:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634804480 00002000:00100000:0.0:1789429275.502253:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f3b606680 x1876351634804480/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 4584/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.502268:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b606680 with x1876351634804480 ext(143360->147455) 00010000:00010000:0.0:1789429275.502280:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 9 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.502301:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 9 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429275.502311:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b606680 00000100:00100000:3.0:1789429275.502765:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1153 00002000:00100000:3.0:1789429275.502817:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f3b605500 x1876351634804352/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.502829:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b605500 with x1876351634804352 ext(147456->151551) 00010000:00010000:3.0:1789429275.502841:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 9 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.502866:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 9 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.502875:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1154 00002000:00010000:3.0:1789429275.502890:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b605500 00000100:00100000:0.0:1789429275.502899:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2371:x1876351634804480:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1789429275.503820:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634804480:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 924us (3899us total) trans 4294969548 rc 0/0 00000100:00100000:0.0:1789429275.503832:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1154 00002000:00100000:0.0:1789429275.503843:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f3b606680 x1876351634804480/t4294969548(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 4584/448 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.503854:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b606680 with x1876351634804480 ext(143360->147455) 00010000:00010000:0.0:1789429275.503862:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 10 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.503880:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 10 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429275.503888:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b606680 00000100:00100000:2.0:1789429275.506503:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.508046:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634804608 00000100:00100000:0.0:1789429275.508065:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634804608 00000100:00100000:3.0:1789429275.508873:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.509913:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5288 00000100:00100000:0.0:1789429275.509938:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33938:x1876351634804608:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429275.509964:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429275.509990:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5c7 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.510032:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 21) 00010000:00010000:0.0:1789429275.510039:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 21) 00010000:00010000:0.0:1789429275.510045:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.510061:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.510078:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad200, rc 0) 00000100:00100000:1.0:1789429275.510531:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634804736 00000100:00100000:1.0:1789429275.510543:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634804736 00010000:00010000:1.0:1789429275.510581:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 12 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.511473:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5738 00000100:00100000:1.0:1789429275.511492:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351634804736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429275.511511:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429275.511543:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 12 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.511561:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 12 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.511594:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f960 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [143360->18446744073709551615] (req 143360->147455) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5b9 expref: 12 pid: 13238 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.511616:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 21) 00010000:00010000:1.0:1789429275.511621:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 21) 00010000:00010000:1.0:1789429275.511631:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.511643:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.511653:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 21) 00010000:00010000:1.0:1789429275.511656:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 21) 00010000:00010000:1.0:1789429275.511662:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.511671:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.511714:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.511731:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648226816:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429275.516711:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:33938:x1876351634804608:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6766us (10293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.516729:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5288 00010000:00010000:1.0:1789429275.517023:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.517052:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648226944:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.517089:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.523799:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648226816:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.523820:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648226944:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.523854:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.523932:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634804736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12446us (15066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.523945:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5738 00000100:00100000:3.0:1789429275.528485:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.528595:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634804864 00000100:00100000:2.0:1789429275.528607:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634804864 00002000:00100000:2.0:1789429275.528668:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f119c6300 x1876351634804864/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.528681:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c6300 with x1876351634804864 ext(143360->147455) 00002000:00010000:2.0:1789429275.528688:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c6300 00000100:00100000:2.0:1789429275.528751:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11314 00000100:00100000:2.0:1789429275.528761:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351634804864:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429275.528982:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351634804864:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 221us (508us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429275.528990:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11314 00002000:00100000:2.0:1789429275.528996:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f119c6300 x1876351634804864/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.529005:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c6300 with x1876351634804864 ext(143360->147455) 00002000:00010000:2.0:1789429275.529009:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c6300 00000100:00100000:3.0:1789429275.534000:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.536182:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.537601:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634804992 00000100:00100000:2.0:1789429275.537620:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634804992 00000100:00100000:2.0:1789429275.537707:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5289 00000100:00100000:2.0:1789429275.537719:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:33927:x1876351634804992:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.537743:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.537767:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5ce expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.537808:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.537824:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 21) 00010000:00010000:2.0:1789429275.537829:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 21) 00010000:00010000:2.0:1789429275.537835:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.537881:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.537899:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 9 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.537915:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648227072:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.538097:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.538358:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634805120 00000100:00100000:0.0:1789429275.538364:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634805120 00002000:00100000:0.0:1789429275.538699:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f119c7800 x1876351634805120/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.538710:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c7800 with x1876351634805120 ext(147456->151551) 00010000:00010000:0.0:1789429275.538719:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.538734:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429275.538742:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c7800 00000100:00100000:0.0:1789429275.538772:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1155 00000100:00100000:0.0:1789429275.538780:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634805120:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429275.539569:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634805120:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 785us (3395us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429275.539580:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1155 00002000:00100000:0.0:1789429275.539590:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f119c7800 x1876351634805120/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.539600:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c7800 with x1876351634805120 ext(147456->151551) 00010000:00010000:0.0:1789429275.539608:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.539622:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429275.539630:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c7800 00000100:00100000:0.0:1789429275.546632:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.546931:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.547080:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634805376 00000100:00100000:3.0:1789429275.547092:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634805376 00010000:00010000:3.0:1789429275.547145:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.547233:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5739 00000100:00100000:3.0:1789429275.547245:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2369:x1876351634805376:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429275.547264:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.547294:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.547311:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.547345:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 21) 00010000:00010000:3.0:1789429275.547350:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 21) 00010000:00010000:3.0:1789429275.547360:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.547370:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.547420:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.547437:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648227200:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429275.547982:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.548067:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634805248 00000100:00100000:1.0:1789429275.548075:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634805248 00000100:00100000:1.0:1789429275.548129:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5290 00000100:00100000:1.0:1789429275.548138:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:33938:x1876351634805248:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429275.548154:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429275.548171:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5d5 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.548354:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.548363:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 21) 00010000:00010000:1.0:1789429275.548366:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 21) 00010000:00010000:1.0:1789429275.548370:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.548409:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.548425:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.548439:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648227328:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429275.548538:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00010000:00010000:2.0:1789429275.551687:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635f96e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c7 expref: 12 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.551719:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648227072:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429275.551757:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.551769:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.551789:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9800, rc 0) 00000100:00100000:2.0:1789429275.551862:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:33927:x1876351634804992:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 14144us (17876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.551872:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5289 00000100:00100000:3.0:1789429275.551979:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648227200:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.551996:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429275.552021:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2369:x1876351634805376:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4779us (5091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.552289:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5739 00000100:00100000:0.0:1789429275.552702:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648227328:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429275.552735:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.552753:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:0.0:1789429275.552787:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33938:x1876351634805248:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4650us (6169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.552793:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5290 00000100:00100000:0.0:1789429275.557575:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.557667:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634805504 00000100:00100000:3.0:1789429275.557682:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634805504 00002000:00100000:3.0:1789429275.557752:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f1c1a1180 x1876351634805504/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.557765:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a1180 with x1876351634805504 ext(147456->184319) 00010000:00010000:3.0:1789429275.557776:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.557798:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.557807:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a1180 00000100:00100000:3.0:1789429275.557872:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1156 00000100:00100000:3.0:1789429275.557884:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634805504:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.562106:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634805504:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4207us (4533us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429275.562130:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1156 00002000:00100000:3.0:1789429275.562148:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f1c1a1180 x1876351634805504/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.562160:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a1180 with x1876351634805504 ext(147456->184319) 00010000:00010000:3.0:1789429275.562173:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.562236:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.562247:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a1180 00000100:00100000:0.0:1789429275.567482:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.567634:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634805632 00000100:00100000:1.0:1789429275.567648:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634805632 00000100:00100000:1.0:1789429275.567722:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5291 00000100:00100000:1.0:1789429275.567734:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+12:33927:x1876351634805632:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429275.567758:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429275.567781:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5dc expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.567823:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 21) 00010000:00010000:1.0:1789429275.567834:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.567842:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 21) 00010000:00010000:1.0:1789429275.567848:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 13 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.567910:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.567927:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 13 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.567942:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:1.0:1789429275.568017:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+13:33927:x1876351634805632:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 285us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.568034:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5291 00000100:00100000:1.0:1789429275.570900:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.571011:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634805760 00000100:00100000:2.0:1789429275.571023:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634805760 00010000:00010000:2.0:1789429275.571082:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 13 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.571133:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5740 00000100:00100000:2.0:1789429275.571143:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:2370:x1876351634805760:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429275.571160:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.571197:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 13 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.571256:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 13 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.571286:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f975 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ce expref: 13 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.571306:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 21) 00010000:00010000:2.0:1789429275.571311:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 21) 00010000:00010000:2.0:1789429275.571322:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.571333:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.571378:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.571392:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 9 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.571407:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648227584:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.571506:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.575374:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.575520:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648227584:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.575554:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.575620:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634805760:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4476us (4733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.575633:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5740 00000100:00100000:2.0:1789429275.575673:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634805888 00000100:00100000:2.0:1789429275.575681:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634805888 00010000:00010000:2.0:1789429275.575719:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.575761:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5741 00000100:00100000:2.0:1789429275.575770:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634805888:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429275.575790:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.575816:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.575831:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.575859:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f97c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5d5 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.575881:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 21) 00010000:00010000:2.0:1789429275.575885:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 21) 00010000:00010000:2.0:1789429275.575895:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.575906:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.575947:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.575962:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648227712:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.576024:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.579470:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648227712:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.579509:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.579588:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2371:x1876351634805888:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3817us (4225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.579602:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5741 00000100:00100000:0.0:1789429275.586966:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.587081:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634806016 00000100:00100000:3.0:1789429275.587095:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634806016 00000100:00100000:3.0:1789429275.587169:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5292 00000100:00100000:3.0:1789429275.587182:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634806016:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429275.587258:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429275.587284:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5e3 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.587334:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.587350:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 21) 00010000:00010000:3.0:1789429275.587355:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 21) 00010000:00010000:3.0:1789429275.587361:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.587406:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.587424:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 11 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.587440:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648227840:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429275.587538:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.593023:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.593571:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648227840:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429275.593616:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.593644:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429275.593720:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33938:x1876351634806016:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6540us (6770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.593729:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5292 00000100:00100000:1.0:1789429275.595187:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634806144 00000100:00100000:1.0:1789429275.595284:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634806144 00002000:00100000:1.0:1789429275.595359:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f1c1a0700 x1876351634806144/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.595373:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a0700 with x1876351634806144 ext(147456->184319) 00010000:00010000:1.0:1789429275.595384:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 12 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.595403:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 12 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.595412:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a0700 00000100:00100000:1.0:1789429275.595519:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1157 00000100:00100000:1.0:1789429275.595531:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634806144:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.598318:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634806144:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 2772us (5293us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429275.598334:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1157 00002000:00100000:1.0:1789429275.598349:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f1c1a0700 x1876351634806144/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.598363:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a0700 with x1876351634806144 ext(147456->184319) 00010000:00010000:1.0:1789429275.598376:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 12 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.598396:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 12 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.598405:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a0700 00000100:00100000:3.0:1789429275.601009:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.601173:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634806272 00000100:00100000:0.0:1789429275.601186:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634806272 00000100:00100000:0.0:1789429275.601317:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5293 00000100:00100000:0.0:1789429275.601329:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:33927:x1876351634806272:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429275.601353:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429275.601378:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5ea expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.601422:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 21) 00010000:00010000:0.0:1789429275.601432:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.601440:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 21) 00010000:00010000:0.0:1789429275.601446:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 13 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.601498:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.601514:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 13 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.601529:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad600, rc 0) 00000100:00100000:0.0:1789429275.601593:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+13:33927:x1876351634806272:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 266us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.601601:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5293 00000100:00100000:0.0:1789429275.603981:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.604077:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634806400 00000100:00100000:1.0:1789429275.604089:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634806400 00010000:00010000:1.0:1789429275.604134:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 13 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.604178:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5742 00000100:00100000:1.0:1789429275.604188:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+13:2368:x1876351634806400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429275.604263:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429275.604292:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 13 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.604315:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 13 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.604343:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635f983 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5dc expref: 13 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.604363:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 21) 00010000:00010000:1.0:1789429275.604368:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 21) 00010000:00010000:1.0:1789429275.604378:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.604389:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.604434:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.604449:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 9 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.604592:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648228096:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.604768:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.611126:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.611241:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634806528 00000100:00100000:2.0:1789429275.611255:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634806528 00002000:00100000:2.0:1789429275.611324:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f1c1a2d80 x1876351634806528/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.611337:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a2d80 with x1876351634806528 ext(147456->151551) 00010000:00010000:2.0:1789429275.611348:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.611369:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.611377:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a2d80 00000100:00100000:2.0:1789429275.611413:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1158 00000100:00100000:2.0:1789429275.611423:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634806528:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.612069:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648228096:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.612099:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.612527:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634806528:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 1101us (1414us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429275.612538:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1158 00002000:00100000:2.0:1789429275.612550:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f1c1a2d80 x1876351634806528/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.612560:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a2d80 with x1876351634806528 ext(147456->151551) 00010000:00010000:2.0:1789429275.612570:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.612593:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.612600:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a2d80 00000100:00100000:3.0:1789429275.612720:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+12:2368:x1876351634806400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8531us (8748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.612731:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5742 00000100:00100000:1.0:1789429275.617148:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.617243:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.617313:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634806656 00000100:00100000:2.0:1789429275.617328:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634806656 00000100:00100000:2.0:1789429275.617398:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5294 00000100:00100000:2.0:1789429275.617411:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33938:x1876351634806656:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.617436:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.617473:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5f1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.617517:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 21) 00010000:00010000:2.0:1789429275.617527:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 11 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.617534:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 21) 00010000:00010000:2.0:1789429275.617540:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.617593:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 11 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.617610:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.617630:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9800, rc 0) 00000100:00100000:3.0:1789429275.617970:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634806784 00000100:00100000:3.0:1789429275.617976:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634806784 00010000:00010000:3.0:1789429275.618009:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 12 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.618053:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5743 00000100:00100000:3.0:1789429275.618061:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351634806784:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429275.618072:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.618103:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 12 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.618116:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 12 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.618140:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f98a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5e3 expref: 12 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.618157:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 21) 00010000:00010000:3.0:1789429275.618161:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 21) 00010000:00010000:3.0:1789429275.618171:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 11 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.618196:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 11 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.618379:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 11 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.618395:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 11 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.618412:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648228352:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.618773:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:33938:x1876351634806656:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 1362us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.618782:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5294 00000100:00100000:3.0:1789429275.619115:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.623781:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.623884:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634806912 00000100:00100000:0.0:1789429275.623897:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634806912 00010000:00010000:0.0:1789429275.623947:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 12 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.624005:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5744 00000100:00100000:0.0:1789429275.624017:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:2369:x1876351634806912:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789429275.624148:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648228352:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.624179:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429275.624434:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634806784:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6371us (7188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.624443:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5743 00010000:00010000:0.0:1789429275.624669:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429275.624703:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 12 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.624720:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 12 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.624748:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635f991 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ea expref: 12 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.624767:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 21) 00010000:00010000:0.0:1789429275.624772:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 21) 00010000:00010000:0.0:1789429275.624782:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.624793:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.624840:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.624864:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648228480:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429275.624935:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f012ede40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.627990:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648228480:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.628091:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.628382:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:2369:x1876351634806912:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4364us (4613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.628395:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5744 00000100:00100000:0.0:1789429275.635539:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.635677:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634807040 00000100:00100000:3.0:1789429275.635690:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634807040 00000100:00100000:3.0:1789429275.635764:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5295 00000100:00100000:3.0:1789429275.635775:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+11:33927:x1876351634807040:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429275.635799:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429275.635823:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5f8 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.635874:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.635885:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 21) 00010000:00010000:3.0:1789429275.635890:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 21) 00010000:00010000:3.0:1789429275.635896:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 12 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.635938:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.635953:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 9 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.635969:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648228608:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429275.636086:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.643402:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.644276:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648228608:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429275.644325:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 12 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.644355:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:2.0:1789429275.644429:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+12:33927:x1876351634807040:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8655us (8903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.644440:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5295 00000100:00100000:3.0:1789429275.645475:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634807168 00000100:00100000:3.0:1789429275.645491:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634807168 00002000:00100000:3.0:1789429275.645553:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f1c1a0380 x1876351634807168/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.645565:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a0380 with x1876351634807168 ext(147456->151551) 00010000:00010000:3.0:1789429275.645575:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.645598:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.645606:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a0380 00000100:00100000:3.0:1789429275.645707:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1159 00000100:00100000:3.0:1789429275.645725:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634807168:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.645990:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634807168:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 272us (2601us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429275.645998:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1159 00002000:00100000:3.0:1789429275.646010:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f1c1a0380 x1876351634807168/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.646019:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a0380 with x1876351634807168 ext(147456->151551) 00010000:00010000:3.0:1789429275.646025:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.646171:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.646181:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a0380 00000100:00100000:0.0:1789429275.650926:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.651073:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.651244:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634807424 00000100:00100000:2.0:1789429275.651258:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634807424 00010000:00010000:2.0:1789429275.651310:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.651360:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5745 00000100:00100000:2.0:1789429275.651371:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634807424:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429275.651389:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.651420:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.651443:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.651482:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f998 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f1 expref: 10 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.651504:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 21) 00010000:00010000:2.0:1789429275.651508:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 21) 00010000:00010000:2.0:1789429275.651519:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.651529:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.651574:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.651591:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648228736:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.651699:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223540 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.655764:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634807296 00000100:00100000:3.0:1789429275.655787:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634807296 00000100:00100000:0.0:1789429275.656169:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.656288:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634807552 00000100:00100000:3.0:1789429275.656295:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634807552 00002000:00100000:3.0:1789429275.656358:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f29d57800 x1876351634807552/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.656372:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d57800 with x1876351634807552 ext(147456->184319) 00002000:00010000:3.0:1789429275.656379:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29d57800 00000100:00100000:3.0:1789429275.656416:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11315 00000100:00100000:3.0:1789429275.656428:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634807552:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.656850:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648228736:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.656879:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429275.656926:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634807424:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5556us (5852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.656937:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5745 00000100:00100000:2.0:1789429275.661844:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5296 00000100:00100000:2.0:1789429275.661862:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634807296:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.661888:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.661913:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b5ff expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.661954:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 13 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.661966:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 21) 00010000:00010000:2.0:1789429275.661971:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 21) 00010000:00010000:2.0:1789429275.661978:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.662027:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 13 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.662055:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 13 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.662074:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648228864:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.662667:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223540 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.663032:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634807552:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6597us (6861us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429275.663044:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11315 00002000:00100000:2.0:1789429275.663057:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f29d57800 x1876351634807552/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.663067:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d57800 with x1876351634807552 ext(147456->184319) 00010000:00010000:2.0:1789429275.663077:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.663112:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.663120:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d57800 00000100:00100000:2.0:1789429275.665969:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648228864:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429275.666015:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.666048:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9600, rc 0) 00000100:00100000:2.0:1789429275.666120:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33938:x1876351634807296:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4261us (15209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.666131:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5296 00000100:00100000:3.0:1789429275.669425:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.670825:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634807680 00000100:00100000:2.0:1789429275.670844:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634807680 00000100:00100000:2.0:1789429275.670945:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5297 00000100:00100000:2.0:1789429275.670957:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:33927:x1876351634807680:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.670983:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.671011:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b606 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.671064:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 21) 00010000:00010000:2.0:1789429275.671075:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.671088:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 21) 00010000:00010000:2.0:1789429275.671094:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.671155:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.671171:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.671187:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9800, rc 0) 00000100:00100000:2.0:1789429275.671527:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+13:33927:x1876351634807680:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 571us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.671535:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5297 00000100:00100000:0.0:1789429275.673624:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.673711:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634807808 00000100:00100000:3.0:1789429275.673724:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634807808 00010000:00010000:3.0:1789429275.673778:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 13 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.673832:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5746 00000100:00100000:3.0:1789429275.673845:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+13:2370:x1876351634807808:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429275.673863:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.673893:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 13 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.673907:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 13 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.673936:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635f99f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5f8 expref: 13 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.673958:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 21) 00010000:00010000:3.0:1789429275.673964:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 21) 00010000:00010000:3.0:1789429275.673975:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.673985:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.674044:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.674061:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 9 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.674078:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648229120:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429275.674534:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.678328:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.678764:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648229120:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429275.678798:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429275.678876:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634807808:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5033us (5262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.678889:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5746 00000100:00100000:0.0:1789429275.678928:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634807936 00000100:00100000:0.0:1789429275.678936:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634807936 00010000:00010000:0.0:1789429275.678976:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.679912:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5747 00000100:00100000:1.0:1789429275.679931:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634807936:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429275.679952:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429275.679985:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.680002:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.680043:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635f9a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5ff expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.680065:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 21) 00010000:00010000:1.0:1789429275.680070:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 21) 00010000:00010000:1.0:1789429275.680080:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.680091:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.680495:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.680513:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648229248:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.680655:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223540 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.684421:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648229248:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.684455:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.684528:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2371:x1876351634807936:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4602us (6213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.684545:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5747 00000100:00100000:0.0:1789429275.690934:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.691059:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634808064 00000100:00100000:1.0:1789429275.691072:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634808064 00000100:00100000:1.0:1789429275.691158:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5298 00000100:00100000:1.0:1789429275.691171:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634808064:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429275.691251:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429275.691276:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b60d expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.691318:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.691329:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 21) 00010000:00010000:1.0:1789429275.691334:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 21) 00010000:00010000:1.0:1789429275.691340:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.691385:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.691401:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 11 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.691418:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648229376:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429275.691525:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.694990:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.695163:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634808192 00000100:00100000:2.0:1789429275.695176:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634808192 00010000:00010000:2.0:1789429275.695272:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.695321:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5748 00000100:00100000:2.0:1789429275.695332:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634808192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429275.695352:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.695380:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.695395:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.695429:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 21) 00010000:00010000:2.0:1789429275.695434:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 21) 00010000:00010000:2.0:1789429275.695446:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.695458:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.695508:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.695532:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648229504:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.695639:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223540 going to sleep for 11 seconds 00010000:00010000:1.0:1789429275.696622:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b606 expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.696647:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648229376:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429275.696685:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.696699:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429275.696771:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33938:x1876351634808064:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5602us (5848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.696782:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5298 00000100:00100000:2.0:1789429275.701574:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648229504:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.701614:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.701692:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351634808192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6360us (6715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.701705:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5748 00000100:00100000:3.0:1789429275.703247:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.703297:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.703462:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634808320 00000100:00100000:0.0:1789429275.703474:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634808320 00002000:00100000:0.0:1789429275.703541:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f119c4700 x1876351634808320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.703562:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c4700 with x1876351634808320 ext(147456->151551) 00002000:00010000:0.0:1789429275.703569:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c4700 00000100:00100000:0.0:1789429275.703604:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11316 00000100:00100000:0.0:1789429275.703615:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634808320:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429275.703865:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634808320:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 251us (626us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429275.703872:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11316 00002000:00100000:0.0:1789429275.703880:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f119c4700 x1876351634808320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.703888:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c4700 with x1876351634808320 ext(147456->151551) 00002000:00010000:0.0:1789429275.703891:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c4700 00000100:00100000:2.0:1789429275.704778:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634808448 00000100:00100000:2.0:1789429275.704787:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634808448 00000100:00100000:2.0:1789429275.704882:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5299 00000100:00100000:2.0:1789429275.704892:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+11:33927:x1876351634808448:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.704908:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.705125:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b614 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.705166:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.705177:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 21) 00010000:00010000:2.0:1789429275.705182:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 21) 00010000:00010000:2.0:1789429275.705187:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.705432:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.705452:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 9 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.705470:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648229632:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.705577:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f182179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.709522:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.709579:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.709697:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634808704 00000100:00100000:1.0:1789429275.709711:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634808704 00010000:00010000:1.0:1789429275.709761:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 10 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.709816:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5749 00000100:00100000:1.0:1789429275.709827:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634808704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429275.709844:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429275.709872:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 10 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.709893:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 10 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.709925:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 21) 00010000:00010000:1.0:1789429275.709931:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 21) 00010000:00010000:1.0:1789429275.709942:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.709954:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.710001:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.710017:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648229760:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.710138:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.710762:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634808576 00000100:00100000:0.0:1789429275.710771:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634808576 00000100:00100000:0.0:1789429275.710825:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5300 00000100:00100000:0.0:1789429275.710833:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:33938:x1876351634808576:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429275.710850:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429275.710868:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b61b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.710896:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.710904:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 21) 00010000:00010000:0.0:1789429275.710909:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 21) 00010000:00010000:0.0:1789429275.710914:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.710940:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.710953:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.710965:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648229888:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429275.711024:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f012edd80 going to sleep for 11 seconds 00010000:00010000:2.0:1789429275.711954:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635f9b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b60d expref: 12 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.711978:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648229632:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429275.712008:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.712017:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.712039:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd8400, rc 0) 00000100:00100000:2.0:1789429275.712097:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+12:33927:x1876351634808448:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7205us (8798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.712114:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5299 00000100:00100000:2.0:1789429275.721895:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648229760:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.721938:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.722016:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2370:x1876351634808704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12189us (12434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.722038:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5749 00000100:00100000:0.0:1789429275.722299:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648229888:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429275.722331:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.722358:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429275.722386:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33938:x1876351634808576:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11554us (12882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.722395:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5300 00000100:00100000:3.0:1789429275.723727:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.723833:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634808832 00000100:00100000:0.0:1789429275.723844:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634808832 00002000:00100000:0.0:1789429275.723902:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f119c7480 x1876351634808832/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.723916:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c7480 with x1876351634808832 ext(147456->184319) 00010000:00010000:0.0:1789429275.723926:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.723945:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429275.723954:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c7480 00000100:00100000:0.0:1789429275.723990:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1160 00000100:00100000:0.0:1789429275.724001:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634808832:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429275.729899:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634808832:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5881us (6162us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429275.729917:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1160 00002000:00100000:0.0:1789429275.729934:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f119c7480 x1876351634808832/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.729946:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c7480 with x1876351634808832 ext(147456->184319) 00010000:00010000:0.0:1789429275.729960:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.729981:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429275.729990:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c7480 00000100:00100000:1.0:1789429275.733306:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.733346:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.733503:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634809088 00000100:00100000:3.0:1789429275.733517:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634809088 00010000:00010000:3.0:1789429275.733574:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.733628:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5750 00000100:00100000:3.0:1789429275.733641:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634809088:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429275.733660:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.733690:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.733706:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.733736:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635f9bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b614 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.733758:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 21) 00010000:00010000:3.0:1789429275.733764:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 21) 00010000:00010000:3.0:1789429275.733775:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.733786:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.733830:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.733846:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648230016:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429275.733952:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.734408:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634808960 00000100:00100000:0.0:1789429275.734415:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634808960 00000100:00100000:0.0:1789429275.734471:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5301 00000100:00100000:0.0:1789429275.734480:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+12:33927:x1876351634808960:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429275.734497:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429275.734515:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b622 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.734541:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.734549:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 21) 00010000:00010000:0.0:1789429275.734552:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 21) 00010000:00010000:0.0:1789429275.734557:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.734581:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.734595:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 9 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.734606:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648230144:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429275.734648:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f012edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.737961:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648230144:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429275.738013:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.738061:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc 0) 00000100:00100000:0.0:1789429275.738145:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:33927:x1876351634808960:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3665us (4853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.738156:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5301 00000100:00100000:3.0:1789429275.740947:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648230016:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.740989:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429275.741067:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634809088:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7427us (7718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.741081:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5750 00000100:00100000:1.0:1789429275.742962:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.743047:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634809216 00000100:00100000:3.0:1789429275.743058:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634809216 00010000:00010000:3.0:1789429275.743110:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.743157:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5751 00000100:00100000:3.0:1789429275.743168:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634809216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429275.743186:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.743273:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.743288:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.743315:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635f9c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b61b expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.743336:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 21) 00010000:00010000:3.0:1789429275.743341:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 21) 00010000:00010000:3.0:1789429275.743351:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.743369:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.743413:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.743429:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648230272:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429275.743528:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.745999:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648230272:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.746044:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429275.746115:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2370:x1876351634809216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2947us (3161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.746127:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5751 00000100:00100000:1.0:1789429275.752987:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.753111:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634809344 00000100:00100000:2.0:1789429275.753126:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634809344 00000100:00100000:2.0:1789429275.753248:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5302 00000100:00100000:2.0:1789429275.753262:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634809344:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.753286:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.753310:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b629 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.753351:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.753362:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 21) 00010000:00010000:2.0:1789429275.753366:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 21) 00010000:00010000:2.0:1789429275.753373:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.753414:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.753431:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 11 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.753449:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648230400:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.753545:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f182179c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.756305:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648230400:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429275.756352:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.756379:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9a00, rc 0) 00000100:00100000:2.0:1789429275.756456:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33938:x1876351634809344:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3196us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.756467:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5302 00000100:00100000:1.0:1789429275.759151:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.759445:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634809472 00000100:00100000:2.0:1789429275.759460:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634809472 00010000:00010000:2.0:1789429275.759513:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 12 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.759565:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5752 00000100:00100000:2.0:1789429275.759577:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634809472:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429275.759596:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.759626:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 12 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.759643:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 12 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.759673:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635f9c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b622 expref: 12 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.759694:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 21) 00010000:00010000:2.0:1789429275.759701:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 21) 00010000:00010000:2.0:1789429275.759710:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.759722:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.759769:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.759787:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648230528:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.759893:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f182179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.762504:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.762789:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634809600 00000100:00100000:3.0:1789429275.762801:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634809600 00000100:00100000:3.0:1789429275.762874:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5303 00000100:00100000:3.0:1789429275.762885:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:33927:x1876351634809600:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429275.762908:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429275.762932:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b630 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.762971:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.762988:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 21) 00010000:00010000:3.0:1789429275.762993:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 21) 00010000:00010000:3.0:1789429275.762998:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.763400:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.763420:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 9 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.763436:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648230656:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429275.763593:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.767587:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648230528:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.767624:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.767683:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351634809472:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8107us (8544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.767696:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5752 00000100:00100000:1.0:1789429275.767810:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.771260:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648230656:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429275.771314:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.771342:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:0.0:1789429275.771803:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:33927:x1876351634809600:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8917us (9310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.771815:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5303 00000100:00100000:2.0:1789429275.773302:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634809728 00000100:00100000:2.0:1789429275.773320:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634809728 00002000:00100000:2.0:1789429275.773385:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f119d5180 x1876351634809728/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.773398:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d5180 with x1876351634809728 ext(147456->151551) 00010000:00010000:2.0:1789429275.773409:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 10 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.773435:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 10 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.773444:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d5180 00000100:00100000:2.0:1789429275.773475:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1161 00000100:00100000:2.0:1789429275.773487:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634809728:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429275.773749:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634809728:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 263us (5938us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429275.773757:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1161 00002000:00100000:2.0:1789429275.773765:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f119d5180 x1876351634809728/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.773774:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d5180 with x1876351634809728 ext(147456->151551) 00010000:00010000:2.0:1789429275.773781:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 10 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.773793:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 10 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.773801:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d5180 00000100:00100000:0.0:1789429275.777375:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.778777:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.779047:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634809856 00000100:00100000:2.0:1789429275.779062:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634809856 00000100:00100000:3.0:1789429275.779184:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634809984 00000100:00100000:3.0:1789429275.779239:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634809984 00000100:00100000:2.0:1789429275.779245:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5304 00000100:00100000:2.0:1789429275.779258:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:33938:x1876351634809856:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.779280:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429275.779280:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 11 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.779306:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b637 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.779317:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5753 00000100:00100000:3.0:1789429275.779326:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634809984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429275.779338:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.779346:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 21) 00010000:00010000:2.0:1789429275.779357:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.779366:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 21) 00010000:00010000:2.0:1789429275.779493:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.779547:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 12 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.779569:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 12 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.779592:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063aaca2f/0xb4c3dad72635f9d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b629 expref: 12 pid: 20745 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.779610:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(107 21) 00010000:00010000:3.0:1789429275.779613:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(107 21) 00010000:00010000:3.0:1789429275.779622:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.779631:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.779672:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.779687:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 11 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.779703:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648230784:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429275.779815:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edc00 going to sleep for 11 seconds 00010000:00010000:2.0:1789429275.781247:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 11 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.781266:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 11 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.781283:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648230912:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.781416:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f182179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.789284:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.789437:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634810112 00000100:00100000:2.0:1789429275.789451:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634810112 00002000:00100000:2.0:1789429275.789513:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f119d5c00 x1876351634810112/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.789527:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d5c00 with x1876351634810112 ext(147456->184319) 00010000:00010000:2.0:1789429275.789539:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.789560:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.789569:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d5c00 00000100:00100000:2.0:1789429275.789611:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1162 00000100:00100000:2.0:1789429275.789621:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634810112:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.790257:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648230784:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.790287:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429275.790322:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2371:x1876351634809984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10998us (11553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.790333:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5753 00000100:00100000:2.0:1789429275.793117:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648230912:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429275.793165:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.793194:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9200, rc 0) 00000100:00100000:2.0:1789429275.793305:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33938:x1876351634809856:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 14049us (16360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.793316:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5304 00000100:00100000:2.0:1789429275.797532:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634810112:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7894us (8244us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429275.797548:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1162 00002000:00100000:2.0:1789429275.797565:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f119d5c00 x1876351634810112/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.797578:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d5c00 with x1876351634810112 ext(147456->184319) 00010000:00010000:2.0:1789429275.797592:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.797615:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 12 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.797625:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d5c00 00000100:00100000:0.0:1789429275.800999:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.801150:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634810240 00000100:00100000:2.0:1789429275.801163:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634810240 00000100:00100000:2.0:1789429275.801296:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5305 00000100:00100000:2.0:1789429275.801309:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+12:33927:x1876351634810240:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.801335:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.801361:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b63e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.801404:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(107 21) 00010000:00010000:2.0:1789429275.801415:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.801423:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 21) 00010000:00010000:2.0:1789429275.801430:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.801483:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.801501:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.801521:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9800, rc 0) 00000100:00100000:2.0:1789429275.801586:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:33927:x1876351634810240:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 280us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.801594:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5305 00000100:00100000:0.0:1789429275.803568:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.804551:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634810368 00000100:00100000:3.0:1789429275.804566:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634810368 00010000:00010000:2.0:1789429275.804741:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 13 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.804798:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5754 00000100:00100000:2.0:1789429275.804810:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351634810368:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429275.804828:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.804856:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 13 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.804870:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 13 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.804899:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635f9d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b630 expref: 13 pid: 6680 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.804921:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 21) 00010000:00010000:2.0:1789429275.804927:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 21) 00010000:00010000:2.0:1789429275.804937:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.804953:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.805001:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.805015:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 9 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.805161:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648231168:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.805447:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789429275.809089:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.809320:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648231168:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.809352:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.809422:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634810368:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4613us (5864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.809435:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5754 00000100:00100000:2.0:1789429275.809486:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634810496 00000100:00100000:2.0:1789429275.809495:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634810496 00010000:00010000:2.0:1789429275.809532:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.812312:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5755 00000100:00100000:2.0:1789429275.812348:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634810496:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429275.812376:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.812418:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.812442:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.812488:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b637 expref: 10 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.812513:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 21) 00010000:00010000:2.0:1789429275.812518:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 21) 00010000:00010000:2.0:1789429275.812529:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.812540:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.812592:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.812608:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648231296:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.812725:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.827160:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648231296:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.827237:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.827311:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2371:x1876351634810496:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 14982us (18234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.827324:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5755 00000100:00100000:3.0:1789429275.834970:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.835085:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.835166:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634810752 00000100:00100000:0.0:1789429275.835179:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634810752 00002000:00100000:0.0:1789429275.835273:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f119c7b80 x1876351634810752/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.835287:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c7b80 with x1876351634810752 ext(147456->184319) 00002000:00010000:0.0:1789429275.835293:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c7b80 00000100:00100000:0.0:1789429275.835333:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11317 00000100:00100000:0.0:1789429275.835344:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+12:2368:x1876351634810752:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429275.838765:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+12:2368:x1876351634810752:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3409us (3664us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429275.838781:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11317 00002000:00100000:0.0:1789429275.838798:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (147456->184319) req@ffff946f119c7b80 x1876351634810752/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.838810:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c7b80 with x1876351634810752 ext(147456->184319) 00002000:00010000:0.0:1789429275.838819:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c7b80 00000100:00100000:1.0:1789429275.839021:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634810624 00000100:00100000:1.0:1789429275.839038:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634810624 00000100:00100000:1.0:1789429275.839098:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5306 00000100:00100000:1.0:1789429275.839109:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33938:x1876351634810624:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429275.839126:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429275.839149:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f9ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b645 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.839349:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.839363:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 21) 00010000:00010000:1.0:1789429275.839368:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 21) 00010000:00010000:1.0:1789429275.839375:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f9ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b645 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.839418:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.839435:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 11 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.839452:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648231424:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429275.839528:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.853462:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.853492:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.853710:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648231424:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429275.853756:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f9ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b645 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.853785:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1600, rc 0) 00000100:00100000:0.0:1789429275.853858:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33938:x1876351634810624:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 14749us (18901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.853869:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5306 00000100:00100000:2.0:1789429275.854639:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634810880 00000100:00100000:2.0:1789429275.854650:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634810880 00002000:00100000:2.0:1789429275.854709:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (184320->221183) req@ffff946f29d55880 x1876351634810880/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.854722:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d55880 with x1876351634810880 ext(184320->221183) 00010000:00010000:2.0:1789429275.854731:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 12 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.854748:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 12 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.854757:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d55880 00000100:00100000:0.0:1789429275.854766:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634811008 00000100:00100000:0.0:1789429275.854771:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634811008 00000100:00100000:2.0:1789429275.854785:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1163 00002000:00100000:0.0:1789429275.854792:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (81920->184319) req@ffff946f29d54380 x1876351634811008/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1789429275.854794:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351634810880:12345-192.168.203.39@tcp:3:kworker.0 00002000:00100000:0.0:1789429275.854801:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d54380 with x1876351634811008 ext(81920->184319) 00010000:00010000:0.0:1789429275.854817:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 13 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.854833:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 13 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429275.854839:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d54380 00000100:00100000:0.0:1789429275.854859:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1164 00000100:00100000:0.0:1789429275.854865:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351634811008:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429275.863799:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351634810880:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 8991us (10338us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429275.863819:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1163 00002000:00100000:2.0:1789429275.863837:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (184320->221183) req@ffff946f29d55880 x1876351634810880/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.863850:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d55880 with x1876351634810880 ext(184320->221183) 00010000:00010000:2.0:1789429275.863863:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 14 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.863892:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 14 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429275.863901:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d55880 00000001:00080000:0.0:1789429275.869020:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977064 is committed 00000004:00080000:0.0:1789429275.869052:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 34 committed 00000001:00080000:0.0:1789429275.869083:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977066 is committed 00000004:00080000:0.0:1789429275.869090:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 28 committed 00000004:00080000:0.0:1789429275.869114:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 35 committed 00000001:00080000:0.0:1789429275.869121:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977069 is committed 00000001:00080000:0.0:1789429275.869126:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977068 is committed 00000004:00080000:0.0:1789429275.869135:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 29 committed 00000100:00100000:2.0:1789429275.869623:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648231552:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789429275.869708:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429275.869784:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648231552 00000100:00100000:2.0:1789429275.869793:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648231552 00000100:00100000:2.0:1789429275.869849:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5307 00000100:00100000:2.0:1789429275.869859:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648231552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789429275.869894:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:42 count 1 00010000:00010000:2.0:1789429275.869931:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.869958:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c900f78/0xb4c3dad72635f593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2f6 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.869969:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2a:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789429275.869974:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789429275.869979:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.870013:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c900f78/0xb4c3dad72635f593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2f6 expref: 13 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.870033:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c900f78/0xb4c3dad72635f593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2f6 expref: 13 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.870045:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648231680:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429275.870116:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083000 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.871924:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.872182:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634811136 00000100:00100000:2.0:1789429275.872229:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634811136 00000100:00100000:2.0:1789429275.872290:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5308 00000100:00100000:2.0:1789429275.872299:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:33927:x1876351634811136:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429275.872320:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429275.872342:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b64c expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.872379:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 21) 00010000:00010000:2.0:1789429275.872385:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 21) 00010000:00010000:2.0:1789429275.872390:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.872403:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.872419:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9200, rc 0) 00000100:00100000:2.0:1789429275.872472:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634811136:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 173us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.872484:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5308 00000100:00100000:3.0:1789429275.872786:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648231680:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429275.872818:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.873289:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634811008:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 18422us (19793us total) trans 4294969549 rc 0/0 00000100:00100000:0.0:1789429275.873299:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1164 00000100:00100000:1.0:1789429275.873300:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00100000:0.0:1789429275.873310:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (81920->184319) req@ffff946f29d54380 x1876351634811008/t4294969549(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/448 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1789429275.873316:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648231808:0@lo:6:osp-syn-0-0.0 00002000:00100000:0.0:1789429275.873320:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d54380 with x1876351634811008 ext(81920->184319) 00010000:00010000:0.0:1789429275.873332:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 15 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.873352:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 15 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429275.873360:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d54380 00000100:00100000:1.0:1789429275.873368:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429275.876825:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648231808 00000100:00100000:3.0:1789429275.876849:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648231808 00000100:00100000:1.0:1789429275.877191:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.877225:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5309 00000100:00100000:3.0:1789429275.877239:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648231808:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789429275.877254:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00002000:00080000:3.0:1789429275.877282:0:8085:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:44 count 1 00000100:00100000:1.0:1789429275.877283:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634811264 00000100:00100000:1.0:1789429275.877287:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634811264 00010000:00010000:3.0:1789429275.877314:0:8085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.877316:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 15 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.877338:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72635f634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b327 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.877340:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634811392 00000100:00100000:1.0:1789429275.877343:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634811392 00010000:00010000:3.0:1789429275.877349:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2c:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789429275.877353:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789429275.877354:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c900f78/0xb4c3dad72635f593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2f6 expref: 16 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.877359:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.877372:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5756 00000100:00100000:1.0:1789429275.877378:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:2368:x1876351634811264:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429275.877388:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.877398:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72635f634 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b327 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.877408:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1789429275 -> 1789429276 00002000:00010000:1.0:1789429275.877411:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1789429275 -> 1789429276 00010000:00010000:3.0:1789429275.877412:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72635f634 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b327 expref: 7 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.877417:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 16 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.877427:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8085:1876351648231936:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429275.877430:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 16 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.877454:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635f9e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [147456->18446744073709551615] (req 147456->151551) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b63e expref: 16 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.877478:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 21) 00010000:00010000:1.0:1789429275.877481:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 21) 00010000:00010000:1.0:1789429275.877490:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f9ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->184319] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b645 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.877499:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f9ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->184319] (req 147456->151551) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b645 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.877507:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 21) 00010000:00010000:1.0:1789429275.877510:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 21) 00010000:00010000:1.0:1789429275.877514:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.877523:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.877532:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0311f840 going to sleep for 11 seconds 00010000:00010000:1.0:1789429275.877548:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.877560:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648232064:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.877593:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f9ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [147456->184319] (req 147456->151551) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b645 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429275.877596:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5757 00000100:00100000:3.0:1789429275.877603:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:2368:x1876351634811392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789429275.877604:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648232192:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429275.877611:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429275.877616:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c900f78/0xb4c3dad72635f593 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2f6 expref: 15 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.877624:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789429275.877627:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c900f78/0xb4c3dad72635f593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2f6 expref: 15 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.877641:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c900f78/0xb4c3dad72635f593 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2f6 expref: 15 pid: 6682 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.877653:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789429275.877656:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789429275.877660:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.877669:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.877699:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429275.877729:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:2368:x1876351634811392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 125us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429275.877736:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5757 00010000:00010000:3.0:1789429275.877765:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429275.877778:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.877789:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.877799:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.877808:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.877831:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789429275.877849:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789429275.877856:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.877865:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946e0ddd9000 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:3.0:1789429275.877870:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.877880:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.877893:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.877900:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcb513d7/0xb4c3dad72635f9f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.877921:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429275.877922:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429275.877924:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429275.878899:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648231552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9038us (9187us total) trans 4294969550 rc 0/0 00000100:00100000:1.0:1789429275.878910:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5307 00000004:00080000:3.0:1789429275.879371:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f3462c000/2, rc 0, transno 4294969550 00000100:00100000:3.0:1789429275.879380:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648231552:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789429275.882596:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8085:1876351648231936:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429275.882638:0:8085:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.882730:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.882773:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.882955:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648232064:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.882970:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648232192:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.882986:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634811520 00010000:00010000:1.0:1789429275.882989:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.882997:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634811520 00000100:00100000:3.0:1789429275.883135:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634811648 00000100:00100000:3.0:1789429275.883140:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634811648 00002000:00100000:3.0:1789429275.883193:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f29d56300 x1876351634811648/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.883232:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56300 with x1876351634811648 ext(147456->151551) 00002000:00010000:3.0:1789429275.883239:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29d56300 00000100:00100000:3.0:1789429275.883272:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11318 00000100:00100000:3.0:1789429275.883283:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634811648:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.883501:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634811648:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 218us (725us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429275.883509:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11318 00002000:00100000:3.0:1789429275.883517:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (147456->151551) req@ffff946f29d56300 x1876351634811648/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.883533:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56300 with x1876351634811648 ext(147456->151551) 00002000:00010000:3.0:1789429275.883537:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29d56300 00010000:00010000:2.0:1789429275.883629:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72635f634 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b327 expref: 8 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.883664:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5758 00000100:00100000:2.0:1789429275.883672:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634811520:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429275.883684:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.883691:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72635f634 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b327 expref: 8 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.883706:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72635f634 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b327 expref: 8 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.883735:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72635f634 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b327 expref: 8 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.883756:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789429275.883761:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789429275.883767:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.883779:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.883812:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.883842:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351634811520:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 171us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.883849:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5758 00010000:00010000:3.0:1789429275.884329:0:8085:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.884341:0:8085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.884353:0:8085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.884363:0:8085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.884387:0:8085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789429275.884457:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+13:2368:x1876351634811264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7075us (7267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429275.884467:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5756 00000100:00100000:3.0:1789429275.885246:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648231808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8007us (11873us total) trans 4294969242 rc 0/0 00000100:00100000:3.0:1789429275.885257:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5309 00010000:00010000:2.0:1789429275.885365:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789429275.885375:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.885387:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5800 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429275.885393:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.885405:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.885426:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.885434:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad72635fa01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.885467:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429275.885469:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429275.885471:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789429275.885951:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f119d6d80/2, rc 0, transno 4294969242 00000100:00100000:1.0:1789429275.885961:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648231808:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1789429275.886109:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429275.894496:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.894603:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634811776 00000100:00100000:1.0:1789429275.894616:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634811776 00002000:00100000:1.0:1789429275.894681:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (151552->155647) req@ffff946f29d57b80 x1876351634811776/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.894695:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d57b80 with x1876351634811776 ext(151552->155647) 00002000:00010000:1.0:1789429275.894703:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29d57b80 00000100:00100000:1.0:1789429275.894742:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11319 00000100:00100000:1.0:1789429275.894753:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351634811776:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.895046:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351634811776:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 293us (565us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429275.895056:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11319 00002000:00100000:1.0:1789429275.895064:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (151552->155647) req@ffff946f29d57b80 x1876351634811776/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.895073:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d57b80 with x1876351634811776 ext(151552->155647) 00002000:00010000:1.0:1789429275.895077:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29d57b80 00000100:00100000:0.0:1789429275.896612:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.896696:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634811904 00000100:00100000:2.0:1789429275.896706:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634811904 00002000:00100000:2.0:1789429275.896756:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (184320->188415) req@ffff946f29d56d80 x1876351634811904/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.896770:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56d80 with x1876351634811904 ext(184320->188415) 00002000:00010000:2.0:1789429275.896775:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29d56d80 00000100:00100000:2.0:1789429275.896884:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11320 00000100:00100000:2.0:1789429275.896895:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+13:2370:x1876351634811904:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429275.897118:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+13:2370:x1876351634811904:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 224us (514us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429275.897126:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11320 00002000:00100000:2.0:1789429275.897133:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (184320->188415) req@ffff946f29d56d80 x1876351634811904/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.897143:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56d80 with x1876351634811904 ext(184320->188415) 00002000:00010000:2.0:1789429275.897147:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29d56d80 00000100:00100000:2.0:1789429275.901289:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.901498:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634812032 00000100:00100000:0.0:1789429275.901514:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634812032 00002000:00100000:0.0:1789429275.901654:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (155648->159743) req@ffff946f3462fb80 x1876351634812032/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.901668:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462fb80 with x1876351634812032 ext(155648->159743) 00002000:00010000:0.0:1789429275.901676:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462fb80 00000100:00100000:0.0:1789429275.901715:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11321 00000100:00100000:0.0:1789429275.901726:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634812032:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.902443:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.902595:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634812160 00000100:00100000:1.0:1789429275.902603:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634812160 00002000:00100000:1.0:1789429275.902644:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (188416->192511) req@ffff946f119c4e00 x1876351634812160/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.902655:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c4e00 with x1876351634812160 ext(188416->192511) 00002000:00010000:1.0:1789429275.902660:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c4e00 00000100:00100000:1.0:1789429275.902693:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11322 00000100:00100000:1.0:1789429275.902702:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351634812160:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.902934:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351634812160:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 231us (493us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429275.902942:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11322 00002000:00100000:1.0:1789429275.902950:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (188416->192511) req@ffff946f119c4e00 x1876351634812160/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.902959:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c4e00 with x1876351634812160 ext(188416->192511) 00002000:00010000:1.0:1789429275.902963:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c4e00 00000100:00100000:0.0:1789429275.903363:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634812032:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 1634us (2085us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429275.903372:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11321 00002000:00100000:0.0:1789429275.903379:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (155648->159743) req@ffff946f3462fb80 x1876351634812032/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.903387:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462fb80 with x1876351634812032 ext(155648->159743) 00002000:00010000:0.0:1789429275.903391:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462fb80 00000100:00100000:3.0:1789429275.911989:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.912537:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634812288 00000100:00100000:1.0:1789429275.912551:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634812288 00002000:00100000:1.0:1789429275.912625:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (159744->163839) req@ffff946f119c4000 x1876351634812288/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.912639:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c4000 with x1876351634812288 ext(159744->163839) 00002000:00010000:1.0:1789429275.912651:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c4000 00000100:00100000:1.0:1789429275.912681:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11323 00000100:00100000:1.0:1789429275.912693:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351634812288:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.912958:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351634812288:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 267us (984us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429275.912968:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11323 00002000:00100000:1.0:1789429275.912976:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (159744->163839) req@ffff946f119c4000 x1876351634812288/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.912985:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c4000 with x1876351634812288 ext(159744->163839) 00002000:00010000:1.0:1789429275.912988:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c4000 00000100:00100000:3.0:1789429275.913157:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.914514:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634812416 00000100:00100000:1.0:1789429275.914538:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634812416 00002000:00100000:1.0:1789429275.914597:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff946f119c5f80 x1876351634812416/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.914609:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c5f80 with x1876351634812416 ext(192512->196607) 00002000:00010000:1.0:1789429275.914615:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c5f80 00000100:00100000:1.0:1789429275.914714:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11324 00000100:00100000:1.0:1789429275.914726:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+13:2370:x1876351634812416:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.914953:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+13:2370:x1876351634812416:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 228us (1795us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429275.914961:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11324 00002000:00100000:1.0:1789429275.914969:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (192512->196607) req@ffff946f119c5f80 x1876351634812416/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.914978:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c5f80 with x1876351634812416 ext(192512->196607) 00002000:00010000:1.0:1789429275.914982:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c5f80 00000100:00100000:2.0:1789429275.917425:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.921518:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634812544 00000100:00100000:0.0:1789429275.921543:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634812544 00002000:00100000:0.0:1789429275.921622:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (163840->167935) req@ffff946f3462e680 x1876351634812544/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.921637:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462e680 with x1876351634812544 ext(163840->167935) 00002000:00010000:0.0:1789429275.921645:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462e680 00000100:00100000:0.0:1789429275.921698:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11325 00000100:00100000:0.0:1789429275.921711:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2369:x1876351634812544:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429275.921974:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2369:x1876351634812544:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 265us (4561us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429275.921982:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11325 00002000:00100000:0.0:1789429275.921989:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (163840->167935) req@ffff946f3462e680 x1876351634812544/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.921997:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462e680 with x1876351634812544 ext(163840->167935) 00002000:00010000:0.0:1789429275.922000:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462e680 00000100:00100000:2.0:1789429275.924382:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.924520:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634812672 00000100:00100000:1.0:1789429275.924543:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634812672 00002000:00100000:1.0:1789429275.924608:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (196608->200703) req@ffff946f3462e300 x1876351634812672/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.924621:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462e300 with x1876351634812672 ext(196608->200703) 00002000:00010000:1.0:1789429275.924629:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462e300 00000100:00100000:1.0:1789429275.924666:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11326 00000100:00100000:1.0:1789429275.924676:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351634812672:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.924912:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351634812672:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 236us (542us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429275.924924:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11326 00002000:00100000:1.0:1789429275.924932:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (196608->200703) req@ffff946f3462e300 x1876351634812672/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.924941:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462e300 with x1876351634812672 ext(196608->200703) 00002000:00010000:1.0:1789429275.924945:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462e300 00000100:00100000:1.0:1789429275.925247:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.925546:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634812800 00000100:00100000:3.0:1789429275.925553:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634812800 00002000:00100000:3.0:1789429275.925585:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (167936->172031) req@ffff946f119d7100 x1876351634812800/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.925602:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d7100 with x1876351634812800 ext(167936->172031) 00002000:00010000:3.0:1789429275.925606:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119d7100 00000100:00100000:3.0:1789429275.925631:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11327 00000100:00100000:3.0:1789429275.925639:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2369:x1876351634812800:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429275.925781:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2369:x1876351634812800:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 143us (535us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429275.925789:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11327 00002000:00100000:3.0:1789429275.925794:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (167936->172031) req@ffff946f119d7100 x1876351634812800/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.925807:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d7100 with x1876351634812800 ext(167936->172031) 00002000:00010000:3.0:1789429275.925810:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119d7100 00000100:00100000:2.0:1789429275.928610:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.928881:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634812928 00000100:00100000:0.0:1789429275.928893:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634812928 00002000:00100000:0.0:1789429275.928954:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (200704->204799) req@ffff946f3462c700 x1876351634812928/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.928967:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462c700 with x1876351634812928 ext(200704->204799) 00002000:00010000:0.0:1789429275.928973:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462c700 00000100:00100000:0.0:1789429275.929010:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11328 00000100:00100000:0.0:1789429275.929022:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+13:2368:x1876351634812928:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429275.929328:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+13:2368:x1876351634812928:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 306us (729us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429275.929336:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11328 00002000:00100000:0.0:1789429275.929344:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (200704->204799) req@ffff946f3462c700 x1876351634812928/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.929353:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462c700 with x1876351634812928 ext(200704->204799) 00002000:00010000:0.0:1789429275.929357:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462c700 00000100:00100000:2.0:1789429275.933727:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.933865:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634813056 00000100:00100000:1.0:1789429275.933880:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634813056 00002000:00100000:1.0:1789429275.933947:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (172032->176127) req@ffff946f054daa00 x1876351634813056/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.933959:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054daa00 with x1876351634813056 ext(172032->176127) 00002000:00010000:1.0:1789429275.933968:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054daa00 00000100:00100000:1.0:1789429275.934010:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11329 00000100:00100000:1.0:1789429275.934022:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634813056:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.934346:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634813056:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 325us (632us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429275.934356:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11329 00002000:00100000:1.0:1789429275.934364:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (172032->176127) req@ffff946f054daa00 x1876351634813056/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.934374:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054daa00 with x1876351634813056 ext(172032->176127) 00002000:00010000:1.0:1789429275.934378:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054daa00 00000100:00100000:2.0:1789429275.939544:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.939641:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634813184 00000100:00100000:0.0:1789429275.939656:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634813184 00002000:00100000:0.0:1789429275.939720:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (176128->184319) req@ffff946f054d9500 x1876351634813184/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.939732:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d9500 with x1876351634813184 ext(176128->184319) 00002000:00010000:0.0:1789429275.939739:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054d9500 00000100:00100000:0.0:1789429275.939781:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11330 00000100:00100000:0.0:1789429275.939792:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634813184:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429275.940110:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351634813184:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 319us (580us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1789429275.940119:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11330 00002000:00100000:0.0:1789429275.940126:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (176128->184319) req@ffff946f054d9500 x1876351634813184/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/8632 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.940135:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d9500 with x1876351634813184 ext(176128->184319) 00002000:00010000:0.0:1789429275.940139:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054d9500 00000100:00100000:2.0:1789429275.943668:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.943786:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634813312 00000100:00100000:0.0:1789429275.943800:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634813312 00002000:00100000:0.0:1789429275.943868:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff946f054d9f80 x1876351634813312/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.943882:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d9f80 with x1876351634813312 ext(204800->208895) 00002000:00010000:0.0:1789429275.943889:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054d9f80 00000100:00100000:0.0:1789429275.943930:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11331 00000100:00100000:0.0:1789429275.943941:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+13:2369:x1876351634813312:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429275.944319:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+13:2369:x1876351634813312:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 378us (665us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429275.944327:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11331 00002000:00100000:0.0:1789429275.944334:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff946f054d9f80 x1876351634813312/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429275.944344:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d9f80 with x1876351634813312 ext(204800->208895) 00002000:00010000:0.0:1789429275.944348:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054d9f80 00000100:00100000:2.0:1789429275.944450:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.944516:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634813440 00000100:00100000:0.0:1789429275.944522:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634813440 00000100:00100000:0.0:1789429275.944594:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5310 00000100:00100000:0.0:1789429275.944602:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33938:x1876351634813440:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429275.944615:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429275.944638:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635fa08 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b653 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.944675:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.944692:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 21) 00010000:00010000:0.0:1789429275.944697:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 21) 00010000:00010000:0.0:1789429275.944704:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635fa08 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b653 expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.944743:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.944759:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 12 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.944775:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648232320:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429275.944859:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f012ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.947541:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648232320:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429275.947593:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635fa08 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->188415] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b653 expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.947621:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac200, rc 0) 00000100:00100000:0.0:1789429275.947702:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:33938:x1876351634813440:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3099us (3251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.947714:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5310 00000100:00100000:3.0:1789429275.947808:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.947847:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634813568 00000100:00100000:3.0:1789429275.947855:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634813568 00002000:00100000:3.0:1789429275.947909:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (184320->204799) req@ffff946f3fbd4e00 x1876351634813568/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.947921:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbd4e00 with x1876351634813568 ext(184320->204799) 00010000:00010000:3.0:1789429275.947929:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 13 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.947946:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 13 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.947961:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbd4e00 00000100:00100000:3.0:1789429275.947986:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1165 00000100:00100000:3.0:1789429275.947997:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351634813568:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1789429275.949468:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.949614:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634813696 00000100:00100000:0.0:1789429275.949624:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634813696 00000100:00100000:0.0:1789429275.949678:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5311 00000100:00100000:0.0:1789429275.949689:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634813696:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429275.949707:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429275.949730:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b65a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.949767:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 21) 00010000:00010000:0.0:1789429275.949773:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 21) 00010000:00010000:0.0:1789429275.949780:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.949793:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.949809:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:0.0:1789429275.952862:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634813696:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3157us (3385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.952878:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5311 00000100:00100000:3.0:1789429275.956384:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634813568:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 8374us (8563us total) trans 4294969551 rc 0/0 00000100:00100000:3.0:1789429275.956401:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1165 00002000:00100000:3.0:1789429275.956419:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (184320->204799) req@ffff946f3fbd4e00 x1876351634813568/t4294969551(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/448 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.956575:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbd4e00 with x1876351634813568 ext(184320->204799) 00010000:00010000:3.0:1789429275.956589:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 16 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.956612:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 16 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.956622:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbd4e00 00000100:00100000:0.0:1789429275.961026:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429275.961511:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634813824 00000100:00100000:2.0:1789429275.961526:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634813824 00010000:00010000:2.0:1789429275.961646:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 16 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.962150:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5759 00000100:00100000:2.0:1789429275.962176:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+16:2370:x1876351634813824:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429275.962198:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429275.962299:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 16 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.962318:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 16 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.962347:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635f9fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [184320->18446744073709551615] (req 184320->188415) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b64c expref: 16 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.962385:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 21) 00010000:00010000:2.0:1789429275.962391:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 21) 00010000:00010000:2.0:1789429275.962402:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635fa08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [184320->204799] (req 184320->188415) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b653 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.962415:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635fa08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [184320->204799] (req 184320->188415) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b653 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.962427:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 21) 00010000:00010000:2.0:1789429275.962430:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 21) 00010000:00010000:2.0:1789429275.962435:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.962450:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429275.962500:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.962518:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648232448:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.962650:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635fa08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [184320->204799] (req 184320->188415) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b653 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429275.962661:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b605f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648232576:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.962690:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429275.966658:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b605f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648232576:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429275.966681:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648232448:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429275.966714:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429275.966866:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+15:2370:x1876351634813824:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4692us (5853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429275.966880:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5759 00000100:00100000:0.0:1789429275.967647:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.967946:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634813952 00000100:00100000:3.0:1789429275.967958:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634813952 00002000:00100000:3.0:1789429275.968024:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (184320->204799) req@ffff946f3fbcc000 x1876351634813952/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.968050:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcc000 with x1876351634813952 ext(184320->204799) 00002000:00010000:3.0:1789429275.968059:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3fbcc000 00000100:00100000:3.0:1789429275.968106:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11332 00000100:00100000:3.0:1789429275.968118:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2370:x1876351634813952:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429275.972846:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2370:x1876351634813952:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4713us (5185us total) trans 0 rc 20480/20480 00000100:00100000:2.0:1789429275.972862:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11332 00002000:00100000:2.0:1789429275.972880:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (184320->204799) req@ffff946f3fbcc000 x1876351634813952/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:/600/0 rc 20480/20480 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429275.972892:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcc000 with x1876351634813952 ext(184320->204799) 00002000:00010000:2.0:1789429275.972899:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3fbcc000 00000100:00100000:1.0:1789429275.976713:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.976890:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634814080 00000100:00100000:0.0:1789429275.976904:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634814080 00000100:00100000:0.0:1789429275.977011:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5312 00000100:00100000:0.0:1789429275.977032:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:33938:x1876351634814080:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429275.977057:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429275.977081:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b661 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.977123:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.977135:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 21) 00010000:00010000:0.0:1789429275.977141:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 21) 00010000:00010000:0.0:1789429275.977147:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 12 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.977198:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.977278:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 14 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.977295:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648232704:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429275.977397:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f012ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429275.979796:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429275.979892:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634814208 00000100:00100000:1.0:1789429275.979904:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634814208 00002000:00100000:1.0:1789429275.979971:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff946f3fbcdf80 x1876351634814208/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.979984:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcdf80 with x1876351634814208 ext(204800->208895) 00010000:00010000:1.0:1789429275.979996:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 15 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.980015:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 15 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.980024:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcdf80 00000100:00100000:1.0:1789429275.980066:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1166 00000100:00100000:1.0:1789429275.980078:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+15:2369:x1876351634814208:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429275.980538:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+15:2369:x1876351634814208:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 457us (752us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429275.980547:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1166 00002000:00100000:1.0:1789429275.980555:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff946f3fbcdf80 x1876351634814208/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:11/0 lens 488/4536 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429275.980564:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcdf80 with x1876351634814208 ext(204800->208895) 00010000:00010000:1.0:1789429275.980572:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 15 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.980584:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 15 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429275.980597:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcdf80 00000100:00100000:0.0:1789429275.981854:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648232704:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429275.981900:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 12 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.981928:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429275.981993:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:33938:x1876351634814080:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4970us (5294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.982004:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5312 00000100:00100000:3.0:1789429275.984400:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.984533:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634814336 00000100:00100000:0.0:1789429275.984546:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634814336 00000100:00100000:3.0:1789429275.984602:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429275.984817:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5313 00000100:00100000:0.0:1789429275.984829:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634814336:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429275.984854:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429275.984878:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b668 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.984921:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 21) 00010000:00010000:0.0:1789429275.984931:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.984938:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 21) 00010000:00010000:0.0:1789429275.984944:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.985000:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.985017:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429275.985032:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:1.0:1789429275.985152:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634814464 00000100:00100000:1.0:1789429275.985157:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634814464 00000100:00100000:0.0:1789429275.985179:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634814336:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 352us (792us total) trans 0 rc 0/0 00010000:00010000:1.0:1789429275.985183:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 17 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429275.985188:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5313 00000100:00100000:1.0:1789429275.985318:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5760 00000100:00100000:1.0:1789429275.985327:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634814464:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429275.985338:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429275.985366:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 16 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.985381:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 16 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.985405:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b65a expref: 16 pid: 6681 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.985422:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 21) 00010000:00010000:1.0:1789429275.985426:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 21) 00010000:00010000:1.0:1789429275.985436:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.985446:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.985483:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429275.985670:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 11 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429275.985687:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648232960:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429275.985775:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429275.993837:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648232960:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429275.993871:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429275.994263:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634814464:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8934us (9657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429275.994276:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5760 00000100:00100000:2.0:1789429275.995067:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429275.995158:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634814592 00000100:00100000:3.0:1789429275.995171:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634814592 00002000:00100000:3.0:1789429275.995288:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff946f3b605f80 x1876351634814592/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/0 e 0 to 0 dl 1789429286 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429275.995302:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b605f80 with x1876351634814592 ext(204800->241663) 00010000:00010000:3.0:1789429275.995314:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429275.995338:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429275.995348:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b605f80 00000100:00100000:3.0:1789429275.995386:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1167 00000100:00100000:3.0:1789429275.995398:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634814592:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429276.007180:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634814592:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 11774us (12113us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429276.007193:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1167 00002000:00100000:1.0:1789429276.007365:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff946f3b605f80 x1876351634814592/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:11/0 lens 488/440 e 0 to 0 dl 1789429286 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.007378:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b605f80 with x1876351634814592 ext(204800->241663) 00010000:00010000:1.0:1789429276.007461:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.007483:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 12 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.007492:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b605f80 00000100:00100000:3.0:1789429276.010949:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.011382:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.012110:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634814720 00000100:00100000:0.0:1789429276.012125:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634814720 00000100:00100000:0.0:1789429276.012232:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5314 00000100:00100000:0.0:1789429276.012244:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:33938:x1876351634814720:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.012268:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.012291:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b66f expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.012334:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 21) 00010000:00010000:0.0:1789429276.012345:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.012353:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 21) 00010000:00010000:0.0:1789429276.012359:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 13 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.012413:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.012430:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 13 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.012645:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad200, rc 0) 00000100:00100000:0.0:1789429276.012797:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:33938:x1876351634814720:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 554us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.012805:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5314 00000100:00100000:2.0:1789429276.013067:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634814848 00000100:00100000:2.0:1789429276.013074:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634814848 00010000:00010000:2.0:1789429276.013112:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 13 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.013144:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5761 00000100:00100000:2.0:1789429276.013152:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:2370:x1876351634814848:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429276.013164:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429276.013230:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 13 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.013247:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 13 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.013271:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b661 expref: 13 pid: 20986 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.013288:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 21) 00010000:00010000:2.0:1789429276.013293:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 21) 00010000:00010000:2.0:1789429276.013303:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.013318:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.013350:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.013365:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 14 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.013381:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648233216:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429276.013467:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.020193:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.020365:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648233216:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429276.020396:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429276.020486:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351634814848:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7332us (9102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.020501:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5761 00000100:00100000:1.0:1789429276.020961:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634814976 00000100:00100000:1.0:1789429276.020971:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634814976 00010000:00010000:1.0:1789429276.021018:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 15 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.021059:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5762 00000100:00100000:1.0:1789429276.021070:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634814976:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.021086:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.021116:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 15 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.021130:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 15 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.021160:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b668 expref: 15 pid: 8085 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.021182:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 21) 00010000:00010000:1.0:1789429276.021195:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 21) 00010000:00010000:1.0:1789429276.021249:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.021262:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.021311:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.021328:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648233344:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.021428:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.024172:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648233344:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.024252:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.024317:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351634814976:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3246us (4137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.024330:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5762 00000100:00100000:3.0:1789429276.032730:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.032931:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634815104 00000100:00100000:0.0:1789429276.032944:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634815104 00000100:00100000:0.0:1789429276.033079:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5315 00000100:00100000:0.0:1789429276.033092:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:33927:x1876351634815104:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.033116:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.033141:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b676 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.033187:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.033198:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(118 21) 00010000:00010000:0.0:1789429276.033259:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 21) 00010000:00010000:0.0:1789429276.033266:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.033312:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.033335:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 11 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.033353:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648233472:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.033463:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f012ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.038286:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.038518:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634815232 00000100:00100000:0.0:1789429276.038532:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634815232 00002000:00100000:0.0:1789429276.038600:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff946f2f095f80 x1876351634815232/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.038614:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095f80 with x1876351634815232 ext(204800->241663) 00010000:00010000:0.0:1789429276.038625:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 12 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.038646:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 12 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.038655:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f095f80 00000100:00100000:0.0:1789429276.038710:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1168 00000100:00100000:0.0:1789429276.038722:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634815232:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429276.039266:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648233472:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.039307:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.039329:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:2.0:1789429276.039370:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634815104:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6280us (6654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.039382:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5315 00000100:00100000:1.0:1789429276.046352:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634815232:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7613us (8061us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429276.046375:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1168 00002000:00100000:1.0:1789429276.046405:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff946f2f095f80 x1876351634815232/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.046419:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095f80 with x1876351634815232 ext(204800->241663) 00010000:00010000:1.0:1789429276.046433:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 12 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.047142:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 12 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.047157:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f095f80 00000100:00100000:0.0:1789429276.052715:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.053007:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.053370:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634815488 00000100:00100000:2.0:1789429276.053452:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634815488 00000100:00100000:2.0:1789429276.053523:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5316 00000100:00100000:2.0:1789429276.053536:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:33938:x1876351634815488:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.053563:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.053590:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b67d expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.053635:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 21) 00010000:00010000:2.0:1789429276.053645:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.053654:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 21) 00010000:00010000:2.0:1789429276.053659:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 13 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.053714:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.053732:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 13 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.053750:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9600, rc 0) 00000100:00100000:2.0:1789429276.053838:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:33938:x1876351634815488:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 304us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.053846:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5316 00000100:00100000:1.0:1789429276.054172:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634815360 00000100:00100000:1.0:1789429276.054180:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634815360 00010000:00010000:1.0:1789429276.054328:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 13 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.054367:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5763 00000100:00100000:1.0:1789429276.054376:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:2370:x1876351634815360:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.054780:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.054811:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 13 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.054829:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 13 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.054856:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fa24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b66f expref: 13 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.054877:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 21) 00010000:00010000:1.0:1789429276.054883:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 21) 00010000:00010000:1.0:1789429276.054893:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.054905:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.054984:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.055004:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 14 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.055020:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648233728:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.055181:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce900 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.059165:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.059658:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634815616 00000100:00100000:2.0:1789429276.059673:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634815616 00002000:00100000:2.0:1789429276.059750:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff946e1030b800 x1876351634815616/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.059763:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1030b800 with x1876351634815616 ext(204800->208895) 00010000:00010000:2.0:1789429276.059775:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 15 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.059796:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 15 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429276.059806:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e1030b800 00000100:00100000:2.0:1789429276.059887:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1169 00000100:00100000:2.0:1789429276.059898:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634815616:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429276.060234:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634815616:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 335us (1082us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429276.060243:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1169 00002000:00100000:2.0:1789429276.060251:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff946e1030b800 x1876351634815616/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.060260:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1030b800 with x1876351634815616 ext(204800->208895) 00010000:00010000:2.0:1789429276.060267:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 15 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.060285:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 15 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429276.060292:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e1030b800 00000100:00100000:1.0:1789429276.061151:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648233728:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.061320:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.061516:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351634815360:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7139us (8508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.061527:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5763 00000100:00100000:3.0:1789429276.067068:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.067168:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634815744 00000100:00100000:0.0:1789429276.067192:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634815744 00000100:00100000:0.0:1789429276.067303:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5317 00000100:00100000:0.0:1789429276.067315:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634815744:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.067338:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.067361:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b684 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.067402:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 21) 00010000:00010000:0.0:1789429276.067412:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.067420:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 21) 00010000:00010000:0.0:1789429276.067426:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.067480:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.067499:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.067515:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429276.067586:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634815744:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 273us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.067594:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5317 00000100:00100000:3.0:1789429276.068981:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.069092:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634815872 00000100:00100000:0.0:1789429276.069102:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634815872 00010000:00010000:0.0:1789429276.069143:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 16 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.069282:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5764 00000100:00100000:0.0:1789429276.069292:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634815872:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.069309:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.069339:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 16 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.069355:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 16 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.069382:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fa2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b676 expref: 16 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.069400:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 21) 00010000:00010000:0.0:1789429276.069405:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 21) 00010000:00010000:0.0:1789429276.069414:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.069425:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.069463:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.069482:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 11 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.069497:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648233984:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429276.069586:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.077417:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648233984:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.077461:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429276.077554:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634815872:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8262us (8583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.077567:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5764 00000100:00100000:3.0:1789429276.077757:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.078107:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634816000 00000100:00100000:2.0:1789429276.078117:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634816000 00010000:00010000:2.0:1789429276.078160:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 12 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.078241:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5765 00000100:00100000:2.0:1789429276.078251:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634816000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429276.078267:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429276.078294:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 12 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.078309:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 12 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.078337:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b67d expref: 12 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.078356:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 21) 00010000:00010000:2.0:1789429276.078361:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 21) 00010000:00010000:2.0:1789429276.078371:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.078381:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.078433:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.078449:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648234112:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429276.078604:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.091492:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648234112:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429276.091539:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429276.091614:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2371:x1876351634816000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13362us (13856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.091627:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5765 00000100:00100000:3.0:1789429276.093149:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.093309:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634816128 00000100:00100000:2.0:1789429276.093321:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634816128 00000100:00100000:1.0:1789429276.093479:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5318 00000100:00100000:1.0:1789429276.093494:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:33938:x1876351634816128:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.093528:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.093553:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b68b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.093594:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.093604:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 21) 00010000:00010000:1.0:1789429276.093608:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 21) 00010000:00010000:1.0:1789429276.093614:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.093660:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.093688:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 14 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.093706:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648234240:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429276.093800:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce900 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.097769:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.098301:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634816256 00000100:00100000:0.0:1789429276.098317:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634816256 00010000:00010000:0.0:1789429276.098384:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 15 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.098441:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5766 00000100:00100000:0.0:1789429276.098453:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634816256:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.098485:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.098518:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 15 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.098534:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 15 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.098574:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 21) 00010000:00010000:0.0:1789429276.098580:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 21) 00010000:00010000:0.0:1789429276.098591:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.098614:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.098665:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.098695:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648234368:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.098798:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fa39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b684 expref: 15 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.098811:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.098823:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648234240:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429276.098858:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.098870:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:1.0:1789429276.098909:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:33938:x1876351634816128:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5420us (5770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.098919:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5318 00000100:00100000:3.0:1789429276.100633:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.100782:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634816384 00000100:00100000:2.0:1789429276.100791:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634816384 00000100:00100000:0.0:1789429276.100795:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648234368:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.100825:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429276.100863:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5319 00000100:00100000:2.0:1789429276.100876:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634816384:12345-192.168.203.39@tcp:101:mmap_sanity.0 00000100:00100000:0.0:1789429276.100890:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634816256:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2438us (3133us total) trans 0 rc 0/0 00010000:00010000:2.0:1789429276.100897:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789429276.100901:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5766 00010000:00010000:2.0:1789429276.100923:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b692 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.100963:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.100975:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 21) 00010000:00010000:2.0:1789429276.100980:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 21) 00010000:00010000:2.0:1789429276.100986:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.101022:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.101051:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 11 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.101068:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648234496:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429276.101139:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.112185:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648234496:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.112302:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.112333:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9600, rc 0) 00000100:00100000:2.0:1789429276.112415:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634816384:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11541us (11792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.112427:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5319 00000100:00100000:3.0:1789429276.115699:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.115819:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634816512 00000100:00100000:0.0:1789429276.115833:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634816512 00002000:00100000:0.0:1789429276.115894:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff946f3449b480 x1876351634816512/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.115907:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449b480 with x1876351634816512 ext(204800->241663) 00010000:00010000:0.0:1789429276.115918:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 12 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.115942:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 12 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.115952:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3449b480 00000100:00100000:0.0:1789429276.115994:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1170 00000100:00100000:0.0:1789429276.116005:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351634816512:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.124155:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351634816512:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 8133us (8452us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429276.124173:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1170 00002000:00100000:0.0:1789429276.124190:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff946f3449b480 x1876351634816512/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.124236:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449b480 with x1876351634816512 ext(204800->241663) 00010000:00010000:0.0:1789429276.124251:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 12 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.124273:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 12 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.124284:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3449b480 00000100:00100000:3.0:1789429276.126673:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.126803:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634816640 00000100:00100000:2.0:1789429276.126817:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634816640 00000100:00100000:2.0:1789429276.126897:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5320 00000100:00100000:2.0:1789429276.126909:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:33938:x1876351634816640:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.126932:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.126956:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b699 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.126996:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 21) 00010000:00010000:2.0:1789429276.127006:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.127015:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 21) 00010000:00010000:2.0:1789429276.127021:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 13 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.127082:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.127101:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 13 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.127117:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9800, rc 0) 00000100:00100000:2.0:1789429276.127866:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:33938:x1876351634816640:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 954us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.127876:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5320 00000100:00100000:2.0:1789429276.129492:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.129603:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634816768 00000100:00100000:0.0:1789429276.129615:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634816768 00010000:00010000:0.0:1789429276.129662:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 13 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.129716:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5767 00000100:00100000:0.0:1789429276.129728:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:2368:x1876351634816768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.129746:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.129778:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 13 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.129794:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 13 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.129823:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fa40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b68b expref: 13 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.129845:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 21) 00010000:00010000:0.0:1789429276.129850:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 21) 00010000:00010000:0.0:1789429276.129860:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.129871:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.129915:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.129936:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 14 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.129951:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648234752:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429276.130065:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.133865:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.134053:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648234752:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.134086:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429276.134160:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2368:x1876351634816768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4434us (4678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.134172:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5767 00000100:00100000:1.0:1789429276.135229:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634816896 00000100:00100000:1.0:1789429276.135243:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634816896 00002000:00100000:1.0:1789429276.135308:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff946f3449a680 x1876351634816896/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.135329:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449a680 with x1876351634816896 ext(204800->208895) 00010000:00010000:1.0:1789429276.135340:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 15 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.135359:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 15 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.135367:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3449a680 00000100:00100000:1.0:1789429276.135398:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1171 00000100:00100000:1.0:1789429276.135409:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634816896:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429276.135848:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634816896:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 438us (1994us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429276.135856:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1171 00002000:00100000:1.0:1789429276.135864:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff946f3449a680 x1876351634816896/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.135872:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449a680 with x1876351634816896 ext(204800->208895) 00010000:00010000:1.0:1789429276.135878:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 15 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.135889:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 15 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.135896:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3449a680 00000100:00100000:3.0:1789429276.138564:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.138671:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634817024 00000100:00100000:1.0:1789429276.138684:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634817024 00000100:00100000:1.0:1789429276.138755:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5321 00000100:00100000:1.0:1789429276.138767:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634817024:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.138787:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.138810:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6a0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.138849:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 21) 00010000:00010000:1.0:1789429276.138859:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.138867:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 21) 00010000:00010000:1.0:1789429276.138873:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.138923:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.138941:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.138956:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429276.139092:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634817024:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 327us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.139100:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5321 00000100:00100000:0.0:1789429276.141054:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.141294:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634817152 00000100:00100000:1.0:1789429276.141305:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634817152 00010000:00010000:1.0:1789429276.141350:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 16 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.141398:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5768 00000100:00100000:1.0:1789429276.141410:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634817152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.141428:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.141467:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 16 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.141484:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 16 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.141513:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b692 expref: 16 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.141534:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 21) 00010000:00010000:1.0:1789429276.141539:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 21) 00010000:00010000:1.0:1789429276.141550:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.141562:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.141608:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.141626:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 11 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.141642:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648235008:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.141748:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce900 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.146507:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.146615:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648235008:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.146649:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.146769:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634817152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5360us (5724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.146782:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5768 00000100:00100000:1.0:1789429276.146823:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634817280 00000100:00100000:1.0:1789429276.146830:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634817280 00010000:00010000:1.0:1789429276.146867:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 12 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.146914:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5769 00000100:00100000:1.0:1789429276.146924:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634817280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.146940:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.146969:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 12 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.146983:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 12 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.147019:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493a23d3/0xb4c3dad72635fa4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b699 expref: 12 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.147042:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 21) 00010000:00010000:1.0:1789429276.147047:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 21) 00010000:00010000:1.0:1789429276.147057:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.147068:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.147111:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.147128:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648235136:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.147233:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce900 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.149966:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648235136:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.150000:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.150111:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2371:x1876351634817280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3187us (3617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.150123:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5769 00000100:00100000:1.0:1789429276.156691:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.156898:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634817408 00000100:00100000:3.0:1789429276.156923:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634817408 00000100:00100000:3.0:1789429276.156992:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5322 00000100:00100000:3.0:1789429276.157004:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:33938:x1876351634817408:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429276.157028:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429276.157052:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6a7 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.157095:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.157105:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 21) 00010000:00010000:3.0:1789429276.157109:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 21) 00010000:00010000:3.0:1789429276.157114:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.157157:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.157179:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 14 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.157195:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648235264:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429276.157338:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0898c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.159466:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.159466:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648235264:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429276.159506:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.159531:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5a00, rc 0) 00000100:00100000:0.0:1789429276.159675:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634817536 00000100:00100000:0.0:1789429276.159684:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634817536 00010000:00010000:0.0:1789429276.159721:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 15 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.159755:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5770 00000100:00100000:0.0:1789429276.159766:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:2370:x1876351634817536:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.159783:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.159812:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 15 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.159823:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 15 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.159843:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fa55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a0 expref: 15 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.159858:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 21) 00010000:00010000:0.0:1789429276.159861:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 21) 00010000:00010000:0.0:1789429276.159868:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.159876:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.159915:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.159926:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648235392:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.160120:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:33938:x1876351634817408:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3118us (3440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.160126:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5322 00000100:00100000:0.0:1789429276.160355:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.164457:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.164906:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.165048:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648235392:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.165147:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429276.165156:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634817792 00000100:00100000:3.0:1789429276.165167:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634817792 00002000:00100000:3.0:1789429276.165261:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff946f3f2e2d80 x1876351634817792/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.165274:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e2d80 with x1876351634817792 ext(204800->241663) 00002000:00010000:3.0:1789429276.165280:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e2d80 00000100:00100000:1.0:1789429276.165303:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:2370:x1876351634817536:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5535us (5837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.165313:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11333 00000100:00100000:1.0:1789429276.165319:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5770 00000100:00100000:3.0:1789429276.165337:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634817792:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.165343:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634817664 00000100:00100000:0.0:1789429276.165348:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634817664 00000100:00100000:0.0:1789429276.166390:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5323 00000100:00100000:0.0:1789429276.166406:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:33927:x1876351634817664:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.166424:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.166449:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6ae expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.166492:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.166503:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 21) 00010000:00010000:0.0:1789429276.166507:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 21) 00010000:00010000:0.0:1789429276.166513:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.166559:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.166574:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 13 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.166589:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648235520:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.166689:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.170154:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634817792:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4815us (5233us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429276.170172:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11333 00002000:00100000:3.0:1789429276.170222:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (204800->241663) req@ffff946f3f2e2d80 x1876351634817792/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.170235:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e2d80 with x1876351634817792 ext(204800->241663) 00010000:00010000:3.0:1789429276.170249:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 12 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.170270:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 12 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429276.170279:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f2e2d80 00000100:00100000:2.0:1789429276.173298:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648235520:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.173352:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.173381:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad600, rc 0) 00000100:00100000:2.0:1789429276.173456:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634817664:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7055us (9013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.173467:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5323 00000100:00100000:3.0:1789429276.173950:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.174019:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634817920 00000100:00100000:0.0:1789429276.174028:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634817920 00002000:00100000:0.0:1789429276.174084:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (147456->221183) req@ffff946f34499880 x1876351634817920/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.174095:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499880 with x1876351634817920 ext(147456->221183) 00010000:00010000:0.0:1789429276.174111:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 12 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.174134:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 12 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.174143:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34499880 00000100:00100000:0.0:1789429276.174190:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1172 00000100:00100000:0.0:1789429276.174236:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634817920:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1789429276.178654:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.178776:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634818048 00000100:00100000:2.0:1789429276.178791:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634818048 00000100:00100000:1.0:1789429276.178889:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5324 00000100:00100000:1.0:1789429276.178904:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634818048:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.178929:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.178954:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6b5 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.178997:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 21) 00010000:00010000:1.0:1789429276.179004:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 21) 00010000:00010000:1.0:1789429276.179011:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.179027:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.179042:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:1.0:1789429276.179105:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634818048:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 206us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.179113:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5324 00000100:00100000:0.0:1789429276.180077:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634817920:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 5871us (6123us total) trans 4294969552 rc 0/0 00000100:00100000:0.0:1789429276.180090:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1172 00002000:00100000:0.0:1789429276.180104:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (147456->221183) req@ffff946f34499880 x1876351634817920/t4294969552(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/448 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.180116:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499880 with x1876351634817920 ext(147456->221183) 00010000:00010000:0.0:1789429276.180133:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 15 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.180152:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 15 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.180356:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34499880 00000100:00100000:3.0:1789429276.186712:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.187054:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634818176 00000100:00100000:0.0:1789429276.187068:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634818176 00010000:00010000:0.0:1789429276.187119:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 15 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.187306:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5771 00000100:00100000:0.0:1789429276.187318:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634818176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.187338:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.187369:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 15 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.187387:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 15 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.187422:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fa5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [204800->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6a7 expref: 15 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.187444:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 21) 00010000:00010000:0.0:1789429276.187449:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 21) 00010000:00010000:0.0:1789429276.187461:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.187473:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.187483:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 21) 00010000:00010000:0.0:1789429276.187486:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 21) 00010000:00010000:0.0:1789429276.187491:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.187506:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.187547:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.187563:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648235648:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.187660:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.187670:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648235776:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429276.187689:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.193076:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648235648:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429276.193098:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648235776:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.193133:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429276.193445:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351634818176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6127us (6745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.193458:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5771 00000100:00100000:2.0:1789429276.202292:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.202589:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634818304 00000100:00100000:1.0:1789429276.202604:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634818304 00002000:00100000:1.0:1789429276.202673:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff946f3f2e1c00 x1876351634818304/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.202691:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e1c00 with x1876351634818304 ext(204800->208895) 00002000:00010000:1.0:1789429276.202698:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e1c00 00000100:00100000:1.0:1789429276.202740:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11334 00000100:00100000:1.0:1789429276.202752:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+15:2370:x1876351634818304:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429276.203690:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+15:2370:x1876351634818304:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 932us (1405us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429276.203703:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11334 00002000:00100000:1.0:1789429276.203713:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (204800->208895) req@ffff946f3f2e1c00 x1876351634818304/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.203722:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e1c00 with x1876351634818304 ext(204800->208895) 00002000:00010000:1.0:1789429276.203728:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e1c00 00000100:00100000:3.0:1789429276.206512:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.207011:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634818432 00000100:00100000:1.0:1789429276.207150:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634818432 00002000:00100000:1.0:1789429276.207398:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff946f3b4e1180 x1876351634818432/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.207411:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b4e1180 with x1876351634818432 ext(217088->221183) 00002000:00010000:1.0:1789429276.207419:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b4e1180 00000100:00100000:3.0:1789429276.207648:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11335 00000100:00100000:3.0:1789429276.207662:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634818432:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429276.207936:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634818432:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 277us (1436us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429276.207954:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11335 00002000:00100000:3.0:1789429276.207962:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff946f3b4e1180 x1876351634818432/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.207971:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b4e1180 with x1876351634818432 ext(217088->221183) 00002000:00010000:3.0:1789429276.207976:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b4e1180 00000100:00100000:3.0:1789429276.211773:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.211886:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634818560 00000100:00100000:1.0:1789429276.211899:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634818560 00002000:00100000:1.0:1789429276.211981:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff946f3f1c5c00 x1876351634818560/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.211993:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5c00 with x1876351634818560 ext(208896->212991) 00002000:00010000:1.0:1789429276.212002:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c5c00 00000100:00100000:1.0:1789429276.212053:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11336 00000100:00100000:1.0:1789429276.212063:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634818560:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429276.212797:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634818560:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 729us (1033us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429276.212808:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11336 00002000:00100000:1.0:1789429276.212818:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (208896->212991) req@ffff946f3f1c5c00 x1876351634818560/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.212827:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5c00 with x1876351634818560 ext(208896->212991) 00002000:00010000:1.0:1789429276.212831:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c5c00 00000100:00100000:2.0:1789429276.215092:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.216677:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634818688 00000100:00100000:0.0:1789429276.216698:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634818688 00002000:00100000:0.0:1789429276.216773:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff946f3f2e1880 x1876351634818688/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.216796:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e1880 with x1876351634818688 ext(221184->225279) 00002000:00010000:0.0:1789429276.216804:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e1880 00000100:00100000:0.0:1789429276.216896:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11337 00000100:00100000:0.0:1789429276.216909:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634818688:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.217253:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634818688:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 345us (2173us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429276.217262:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11337 00002000:00100000:0.0:1789429276.217270:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff946f3f2e1880 x1876351634818688/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.217279:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e1880 with x1876351634818688 ext(221184->225279) 00002000:00010000:0.0:1789429276.217282:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e1880 00000100:00100000:3.0:1789429276.219279:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.219686:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634818816 00000100:00100000:2.0:1789429276.219699:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634818816 00002000:00100000:2.0:1789429276.219763:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff946f3f1c7800 x1876351634818816/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.219775:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7800 with x1876351634818816 ext(212992->217087) 00002000:00010000:2.0:1789429276.219781:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c7800 00000100:00100000:2.0:1789429276.219858:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11338 00000100:00100000:2.0:1789429276.219869:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634818816:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429276.220312:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634818816:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 443us (1045us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429276.220321:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11338 00002000:00100000:2.0:1789429276.220329:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (212992->217087) req@ffff946f3f1c7800 x1876351634818816/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.220338:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7800 with x1876351634818816 ext(212992->217087) 00002000:00010000:2.0:1789429276.220341:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c7800 00000100:00100000:3.0:1789429276.220882:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.221530:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634818944 00000100:00100000:0.0:1789429276.221540:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634818944 00002000:00100000:0.0:1789429276.221588:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (225280->229375) req@ffff946f3f1c5f80 x1876351634818944/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.221599:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5f80 with x1876351634818944 ext(225280->229375) 00002000:00010000:0.0:1789429276.221604:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c5f80 00000100:00100000:0.0:1789429276.221628:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11339 00000100:00100000:0.0:1789429276.221636:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634818944:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.221821:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634818944:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 185us (941us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429276.221829:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11339 00002000:00100000:0.0:1789429276.221836:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (225280->229375) req@ffff946f3f1c5f80 x1876351634818944/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.221844:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5f80 with x1876351634818944 ext(225280->229375) 00002000:00010000:0.0:1789429276.221848:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c5f80 00000100:00100000:3.0:1789429276.228809:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.229018:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634819072 00000100:00100000:0.0:1789429276.229032:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634819072 00002000:00100000:0.0:1789429276.229103:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff946f3f1c7100 x1876351634819072/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.229117:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7100 with x1876351634819072 ext(229376->233471) 00002000:00010000:0.0:1789429276.229125:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c7100 00000100:00100000:0.0:1789429276.229166:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11340 00000100:00100000:0.0:1789429276.229178:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634819072:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.229803:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.229880:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634819200 00000100:00100000:2.0:1789429276.229886:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634819200 00000100:00100000:2.0:1789429276.229931:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5325 00000100:00100000:2.0:1789429276.229940:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:33927:x1876351634819200:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.229964:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.229991:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6bc expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.230029:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.230039:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 21) 00010000:00010000:2.0:1789429276.230044:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 21) 00010000:00010000:2.0:1789429276.230050:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.230092:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.230109:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 14 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.230131:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648235904:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429276.230495:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.231823:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634819072:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 2635us (3019us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429276.231836:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11340 00002000:00100000:1.0:1789429276.231848:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff946f3f1c7100 x1876351634819072/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.231859:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7100 with x1876351634819072 ext(229376->233471) 00010000:00010000:1.0:1789429276.231868:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 14 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.231888:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 14 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.231896:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f1c7100 00000100:00100000:3.0:1789429276.241013:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.241722:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648235904:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.241838:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.241867:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9600, rc 0) 00000100:00100000:2.0:1789429276.242148:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634819200:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 12005us (12145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.242162:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5325 00000100:00100000:1.0:1789429276.242438:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634819328 00000100:00100000:1.0:1789429276.242448:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634819328 00002000:00100000:1.0:1789429276.242501:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (217088->229375) req@ffff946f3f1c5500 x1876351634819328/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 12776/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.242513:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5500 with x1876351634819328 ext(217088->229375) 00010000:00010000:1.0:1789429276.242522:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 14 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.242540:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 14 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.242549:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f1c5500 00000100:00100000:1.0:1789429276.242581:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1173 00000100:00100000:1.0:1789429276.242592:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351634819328:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1789429276.248745:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634819328:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 6131us (7724us total) trans 4294969553 rc 0/0 00000100:00100000:1.0:1789429276.248766:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1173 00002000:00100000:1.0:1789429276.248786:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (217088->229375) req@ffff946f3f1c5500 x1876351634819328/t4294969553(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 12776/448 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.248799:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5500 with x1876351634819328 ext(217088->229375) 00010000:00010000:1.0:1789429276.248813:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 16 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.248839:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 16 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.248852:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f1c5500 00000100:00100000:3.0:1789429276.252437:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.253511:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634819456 00000100:00100000:1.0:1789429276.253527:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634819456 00000100:00100000:1.0:1789429276.253620:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5326 00000100:00100000:1.0:1789429276.253633:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634819456:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.253657:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.253682:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6c3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.253726:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 21) 00010000:00010000:1.0:1789429276.253731:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 21) 00010000:00010000:1.0:1789429276.253738:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.253752:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.253767:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429276.253853:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634819456:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 222us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.253860:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5326 00000100:00100000:2.0:1789429276.262671:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.262942:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634819584 00000100:00100000:3.0:1789429276.262966:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634819584 00010000:00010000:3.0:1789429276.263019:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 17 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.263073:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5772 00000100:00100000:3.0:1789429276.263084:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351634819584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429276.263105:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429276.263137:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 17 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.263154:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 17 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.263185:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fa6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [217088->18446744073709551615] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6b5 expref: 17 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.263262:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 21) 00010000:00010000:3.0:1789429276.263268:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 21) 00010000:00010000:3.0:1789429276.263278:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.263290:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.263300:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 21) 00010000:00010000:3.0:1789429276.263303:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 21) 00010000:00010000:3.0:1789429276.263307:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.263315:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.267102:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.267151:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648236032:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429276.267362:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.267374:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3407ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648236160:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429276.267403:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f321b5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.271494:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648236032:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429276.272970:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.273083:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634819712 00000100:00100000:3.0:1789429276.273096:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634819712 00002000:00100000:3.0:1789429276.273165:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff946f3407a680 x1876351634819712/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.273178:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407a680 with x1876351634819712 ext(217088->221183) 00002000:00010000:3.0:1789429276.273239:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3407a680 00000100:00100000:3.0:1789429276.273274:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11341 00000100:00100000:3.0:1789429276.273288:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:2369:x1876351634819712:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429276.273568:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:2369:x1876351634819712:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 283us (608us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429276.273576:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11341 00002000:00100000:3.0:1789429276.273584:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (217088->221183) req@ffff946f3407a680 x1876351634819712/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.273592:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407a680 with x1876351634819712 ext(217088->221183) 00002000:00010000:3.0:1789429276.273596:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3407a680 00000100:00100000:0.0:1789429276.278704:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3407ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648236160:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.278744:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429276.278847:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2369:x1876351634819584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 15762us (16189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.278860:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5772 00000100:00100000:2.0:1789429276.283918:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.284137:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634819840 00000100:00100000:3.0:1789429276.284151:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634819840 00002000:00100000:3.0:1789429276.284324:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff946f34079180 x1876351634819840/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.284336:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34079180 with x1876351634819840 ext(221184->225279) 00002000:00010000:3.0:1789429276.284343:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34079180 00000100:00100000:2.0:1789429276.284470:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11342 00000100:00100000:2.0:1789429276.284482:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+16:2370:x1876351634819840:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429276.284742:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+16:2370:x1876351634819840:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 261us (839us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429276.284751:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11342 00002000:00100000:2.0:1789429276.284759:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (221184->225279) req@ffff946f34079180 x1876351634819840/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.284768:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34079180 with x1876351634819840 ext(221184->225279) 00002000:00010000:2.0:1789429276.284772:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34079180 00000100:00100000:2.0:1789429276.290279:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.290457:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634819968 00000100:00100000:1.0:1789429276.290473:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634819968 00002000:00100000:1.0:1789429276.290538:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (225280->229375) req@ffff946f3407b100 x1876351634819968/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.290563:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407b100 with x1876351634819968 ext(225280->229375) 00002000:00010000:1.0:1789429276.290573:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3407b100 00000100:00100000:1.0:1789429276.290611:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11343 00000100:00100000:1.0:1789429276.290622:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+16:2368:x1876351634819968:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429276.290873:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+16:2368:x1876351634819968:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 252us (609us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429276.290881:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11343 00002000:00100000:1.0:1789429276.290888:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (225280->229375) req@ffff946f3407b100 x1876351634819968/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.290899:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407b100 with x1876351634819968 ext(225280->229375) 00002000:00010000:1.0:1789429276.290902:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3407b100 00000100:00100000:1.0:1789429276.294477:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.294576:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634820096 00000100:00100000:3.0:1789429276.294590:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634820096 00002000:00100000:3.0:1789429276.294655:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff946f119d5f80 x1876351634820096/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.294669:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d5f80 with x1876351634820096 ext(229376->233471) 00002000:00010000:3.0:1789429276.294676:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119d5f80 00000100:00100000:3.0:1789429276.294714:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11344 00000100:00100000:3.0:1789429276.294725:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634820096:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429276.294987:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634820096:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 262us (523us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429276.294995:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11344 00002000:00100000:3.0:1789429276.295002:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff946f119d5f80 x1876351634820096/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.295011:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d5f80 with x1876351634820096 ext(229376->233471) 00002000:00010000:3.0:1789429276.295016:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119d5f80 00000100:00100000:3.0:1789429276.295923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.296102:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634820224 00000100:00100000:2.0:1789429276.296111:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634820224 00000100:00100000:2.0:1789429276.296162:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5327 00000100:00100000:2.0:1789429276.296171:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634820224:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.296191:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.296266:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6ca expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.296306:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.296317:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 21) 00010000:00010000:2.0:1789429276.296322:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 21) 00010000:00010000:2.0:1789429276.296328:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.296374:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.296389:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 15 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.296405:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3407b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648236288:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429276.296484:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.300341:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.300486:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634820352 00000100:00100000:3.0:1789429276.300499:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634820352 00002000:00100000:3.0:1789429276.300567:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f34078e00 x1876351634820352/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.300581:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34078e00 with x1876351634820352 ext(233472->237567) 00010000:00010000:3.0:1789429276.300593:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 16 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.300613:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 16 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429276.300622:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34078e00 00000100:00100000:3.0:1789429276.300665:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1174 00000100:00100000:3.0:1789429276.300675:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634820352:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429276.300932:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634820352:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 257us (606us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429276.300940:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1174 00002000:00100000:3.0:1789429276.300948:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f34078e00 x1876351634820352/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.300957:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34078e00 with x1876351634820352 ext(233472->237567) 00010000:00010000:3.0:1789429276.300962:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 16 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.300980:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 16 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429276.300988:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34078e00 00000100:00100000:1.0:1789429276.304330:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.304465:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3407b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648236288:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429276.304511:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.304548:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9c00, rc 0) 00000100:00100000:0.0:1789429276.304629:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634820224:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8457us (8712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.304640:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5327 00000100:00100000:3.0:1789429276.304796:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634820480 00000100:00100000:3.0:1789429276.304806:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634820480 00002000:00100000:3.0:1789429276.304860:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff946f119d6a00 x1876351634820480/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 4584/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.304871:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d6a00 with x1876351634820480 ext(229376->233471) 00010000:00010000:3.0:1789429276.304879:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 16 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.304897:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 16 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429276.304906:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d6a00 00000100:00100000:3.0:1789429276.304943:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1175 00000100:00100000:3.0:1789429276.304954:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634820480:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1789429276.305446:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634820480:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 493us (1131us total) trans 4294969554 rc 0/0 00000100:00100000:3.0:1789429276.305455:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1175 00002000:00100000:3.0:1789429276.305463:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff946f119d6a00 x1876351634820480/t4294969554(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 4584/448 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.305480:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d6a00 with x1876351634820480 ext(229376->233471) 00010000:00010000:3.0:1789429276.305487:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.305501:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429276.305509:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d6a00 00000100:00100000:1.0:1789429276.306898:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.307682:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634820608 00000100:00100000:2.0:1789429276.307696:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634820608 00000100:00100000:2.0:1789429276.307825:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5328 00000100:00100000:2.0:1789429276.307840:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634820608:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.307864:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.307888:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6d1 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.307930:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 21) 00010000:00010000:2.0:1789429276.307936:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 21) 00010000:00010000:2.0:1789429276.307943:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.307957:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.307977:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9200, rc 0) 00000100:00100000:2.0:1789429276.308059:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634820608:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 223us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.308067:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5328 00000100:00100000:1.0:1789429276.308263:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.308292:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634820736 00000100:00100000:1.0:1789429276.308296:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634820736 00010000:00010000:1.0:1789429276.308322:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.308350:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5773 00000100:00100000:1.0:1789429276.308357:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2369:x1876351634820736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.308368:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.308393:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.308407:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.308433:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fa78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [229376->18446744073709551615] (req 229376->233471) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6c3 expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.308450:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 21) 00010000:00010000:1.0:1789429276.308454:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 21) 00010000:00010000:1.0:1789429276.308464:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.308475:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.308484:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 21) 00010000:00010000:1.0:1789429276.308487:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 21) 00010000:00010000:1.0:1789429276.308492:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.308502:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.308541:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.308557:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648236416:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.308650:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.308661:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648236544:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.308688:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.311689:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648236416:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.311708:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648236544:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.311738:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.311807:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2369:x1876351634820736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3449us (3544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.311820:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5773 00000100:00100000:3.0:1789429276.312483:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.312572:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634820864 00000100:00100000:0.0:1789429276.312583:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634820864 00002000:00100000:0.0:1789429276.312643:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff946f054d4700 x1876351634820864/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.312655:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4700 with x1876351634820864 ext(229376->233471) 00002000:00010000:0.0:1789429276.312661:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054d4700 00000100:00100000:0.0:1789429276.312692:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11345 00000100:00100000:0.0:1789429276.312702:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634820864:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.312929:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634820864:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 228us (449us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429276.312936:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11345 00002000:00100000:0.0:1789429276.312943:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff946f054d4700 x1876351634820864/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.312951:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4700 with x1876351634820864 ext(229376->233471) 00002000:00010000:0.0:1789429276.312955:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054d4700 00000100:00100000:2.0:1789429276.317852:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.318283:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634820992 00000100:00100000:0.0:1789429276.318296:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634820992 00000100:00100000:0.0:1789429276.318416:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5329 00000100:00100000:0.0:1789429276.318428:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634820992:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.318452:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.318475:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6d8 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.318518:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.318529:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 21) 00010000:00010000:0.0:1789429276.318534:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 21) 00010000:00010000:0.0:1789429276.318540:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.318584:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.318599:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 17 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.318615:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648236672:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.318721:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.320633:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.320718:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634821120 00000100:00100000:1.0:1789429276.320728:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634821120 00010000:00010000:1.0:1789429276.320773:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.320825:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5774 00000100:00100000:1.0:1789429276.320835:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634821120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.320851:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.320879:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.320899:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.320929:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 21) 00010000:00010000:1.0:1789429276.320934:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 21) 00010000:00010000:1.0:1789429276.320943:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.320953:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.320995:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.321011:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648236800:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.321105:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00010000:00010000:0.0:1789429276.321258:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fa86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d1 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.321277:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648236672:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429276.321307:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.321318:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429276.321346:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634820992:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2922us (3509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.321354:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5329 00000100:00100000:3.0:1789429276.323785:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.323877:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634821248 00000100:00100000:0.0:1789429276.323890:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634821248 00000100:00100000:0.0:1789429276.323963:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5330 00000100:00100000:0.0:1789429276.323976:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634821248:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.323999:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.324029:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6df expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.324071:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.324089:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 21) 00010000:00010000:0.0:1789429276.324094:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 21) 00010000:00010000:0.0:1789429276.324100:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.324143:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.324159:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 17 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.324180:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648236928:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.324319:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.325355:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648236800:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.325383:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.325437:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634821120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4602us (4814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.325448:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5774 00000100:00100000:3.0:1789429276.326688:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.326764:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634821376 00000100:00100000:0.0:1789429276.326777:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634821376 00002000:00100000:0.0:1789429276.326841:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f054d4a80 x1876351634821376/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.326853:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4a80 with x1876351634821376 ext(233472->270335) 00010000:00010000:0.0:1789429276.326864:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.326883:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.326892:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d4a80 00000100:00100000:0.0:1789429276.326926:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1176 00000100:00100000:0.0:1789429276.326938:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634821376:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.329719:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648236928:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429276.329770:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.329799:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429276.329875:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634821248:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5900us (6103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.329887:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5330 00000100:00100000:0.0:1789429276.331502:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634821376:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4556us (4813us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429276.331516:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1176 00002000:00100000:0.0:1789429276.331530:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f054d4a80 x1876351634821376/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.331542:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4a80 with x1876351634821376 ext(233472->270335) 00010000:00010000:0.0:1789429276.331554:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.331575:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.331584:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d4a80 00000100:00100000:3.0:1789429276.336115:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.336287:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634821504 00000100:00100000:0.0:1789429276.336301:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634821504 00000100:00100000:0.0:1789429276.336381:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5331 00000100:00100000:0.0:1789429276.336393:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634821504:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.336415:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.336437:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6e6 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.336478:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 21) 00010000:00010000:0.0:1789429276.336488:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.336497:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 21) 00010000:00010000:0.0:1789429276.336502:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.336551:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.336566:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.336579:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:0.0:1789429276.336783:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634821504:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 390us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.336792:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5331 00000100:00100000:2.0:1789429276.338816:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.338888:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634821632 00000100:00100000:1.0:1789429276.338901:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634821632 00010000:00010000:1.0:1789429276.338953:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.339013:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5775 00000100:00100000:1.0:1789429276.339025:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634821632:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.339044:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.339074:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.339091:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.339119:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fa8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6d8 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.339143:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 21) 00010000:00010000:1.0:1789429276.339148:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 21) 00010000:00010000:1.0:1789429276.339159:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.339171:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.339271:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.339295:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 17 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.339313:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648237184:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.339424:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.343578:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.343787:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648237184:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.343819:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429276.343894:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634821632:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4870us (5092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.343908:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5775 00000100:00100000:3.0:1789429276.345531:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634821760 00000100:00100000:3.0:1789429276.345547:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634821760 00002000:00100000:2.0:1789429276.345780:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f119d5880 x1876351634821760/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.345795:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d5880 with x1876351634821760 ext(233472->237567) 00010000:00010000:2.0:1789429276.345808:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.345828:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429276.345837:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d5880 00000100:00100000:2.0:1789429276.345911:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1177 00000100:00100000:2.0:1789429276.345921:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634821760:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429276.346418:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634821760:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 494us (2850us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429276.346426:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1177 00002000:00100000:2.0:1789429276.346433:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f119d5880 x1876351634821760/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.346448:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d5880 with x1876351634821760 ext(233472->237567) 00010000:00010000:2.0:1789429276.346455:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.346468:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429276.346475:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d5880 00000100:00100000:2.0:1789429276.349969:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.350059:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.350122:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634822016 00000100:00100000:0.0:1789429276.350135:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634822016 00010000:00010000:0.0:1789429276.350192:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.350276:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5776 00000100:00100000:0.0:1789429276.350287:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634822016:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.350306:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.350334:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.350349:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.350377:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fa94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6df expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.350396:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 21) 00010000:00010000:0.0:1789429276.350401:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 21) 00010000:00010000:0.0:1789429276.350415:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.350426:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.350482:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.350505:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648237312:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.350944:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634821888 00000100:00100000:3.0:1789429276.350952:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634821888 00000100:00100000:3.0:1789429276.350994:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5332 00000100:00100000:3.0:1789429276.351002:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634821888:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429276.351032:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429276.351051:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6ed expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.351078:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.351094:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 21) 00010000:00010000:3.0:1789429276.351098:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 21) 00010000:00010000:3.0:1789429276.351102:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.351128:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.351144:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 17 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.351156:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648237440:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.351336:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.355876:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0898c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.361965:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.362004:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634822144 00000100:00100000:0.0:1789429276.362015:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634822144 00010000:00010000:0.0:1789429276.362072:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 18 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.362118:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5777 00000100:00100000:0.0:1789429276.362130:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634822144:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.362150:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.362181:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 18 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.362235:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 18 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.362269:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 21) 00010000:00010000:0.0:1789429276.362274:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 21) 00010000:00010000:0.0:1789429276.362284:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.362295:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.362350:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.362368:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648237568:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429276.362481:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.365598:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648237312:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.365643:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.365812:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634822016:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 15524us (15749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.365826:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5776 00010000:00010000:3.0:1789429276.366469:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fa9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6e6 expref: 18 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.366492:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648237440:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429276.366520:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.366537:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:2.0:1789429276.367878:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.367979:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648237568:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429276.368004:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429276.368074:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634822144:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5946us (6125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.368085:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5777 00000100:00100000:1.0:1789429276.369070:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634822272 00000100:00100000:1.0:1789429276.369083:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634822272 00000100:00100000:1.0:1789429276.369149:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5333 00000100:00100000:1.0:1789429276.369162:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634822272:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.369189:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.369246:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.369283:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.369293:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 21) 00010000:00010000:1.0:1789429276.369299:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 21) 00010000:00010000:1.0:1789429276.369304:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.369344:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.369359:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.369374:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648237696:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429276.369464:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.371034:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634821888:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 20013us (21058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.371046:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5332 00000100:00100000:2.0:1789429276.375904:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.376006:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634822400 00000100:00100000:3.0:1789429276.376019:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634822400 00010000:00010000:3.0:1789429276.376086:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.376141:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5778 00000100:00100000:3.0:1789429276.376152:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634822400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429276.376171:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429276.376257:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.376273:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.376304:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 21) 00010000:00010000:3.0:1789429276.376309:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 21) 00010000:00010000:3.0:1789429276.376318:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.376329:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.376372:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.376389:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648237824:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429276.376894:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0898c840 going to sleep for 11 seconds 00010000:00010000:1.0:1789429276.380845:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635faa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ed expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.380876:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648237696:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429276.380916:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.380933:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:1.0:1789429276.381031:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634822272:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11863us (13155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.381042:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5333 00000100:00100000:1.0:1789429276.381435:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648237824:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.381449:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.381494:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2371:x1876351634822400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5344us (5604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.381504:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5778 00000100:00100000:3.0:1789429276.385240:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.385466:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634822528 00000100:00100000:0.0:1789429276.385481:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634822528 00002000:00100000:0.0:1789429276.385551:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f1c1a9880 x1876351634822528/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.385565:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a9880 with x1876351634822528 ext(233472->270335) 00002000:00010000:0.0:1789429276.385571:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a9880 00000100:00100000:0.0:1789429276.385613:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11346 00000100:00100000:0.0:1789429276.385623:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634822528:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429276.390413:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.390737:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634822656 00000100:00100000:0.0:1789429276.390751:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634822656 00000100:00100000:0.0:1789429276.390825:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5334 00000100:00100000:0.0:1789429276.390838:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634822656:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.390862:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.390886:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b6fb expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.390934:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.390946:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 21) 00010000:00010000:0.0:1789429276.390951:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(143 21) 00010000:00010000:0.0:1789429276.390958:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.391003:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.391020:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.391038:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648237952:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.391142:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.391517:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634822528:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5893us (6332us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429276.391528:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11346 00002000:00100000:2.0:1789429276.391541:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f1c1a9880 x1876351634822528/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.391552:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a9880 with x1876351634822528 ext(233472->270335) 00010000:00010000:2.0:1789429276.391561:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.391575:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429276.391584:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a9880 00000100:00100000:0.0:1789429276.393931:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648237952:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429276.393979:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.394007:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc 0) 00000100:00100000:0.0:1789429276.394083:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634822656:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3247us (3686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.394097:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5334 00000100:00100000:3.0:1789429276.397144:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.397193:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.397245:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634822784 00000100:00100000:0.0:1789429276.397259:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634822784 00000100:00100000:0.0:1789429276.397324:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5335 00000100:00100000:0.0:1789429276.397334:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634822784:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.397358:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.397385:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b702 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.397428:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(143 21) 00010000:00010000:0.0:1789429276.397437:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.397445:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(144 21) 00010000:00010000:0.0:1789429276.397451:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.397513:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.397533:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.397548:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429276.397627:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634822784:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 295us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.397636:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5335 00000100:00100000:1.0:1789429276.397723:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634822912 00000100:00100000:1.0:1789429276.397728:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634822912 00010000:00010000:1.0:1789429276.397755:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.397788:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5779 00000100:00100000:1.0:1789429276.397795:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634822912:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.397805:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.397832:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.397846:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.397870:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635faa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6f4 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.397886:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 21) 00010000:00010000:1.0:1789429276.397890:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 21) 00010000:00010000:1.0:1789429276.397899:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.397910:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.397941:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.397957:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 17 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.397972:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648238208:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.398046:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.400389:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648238208:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.400421:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.400492:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634822912:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2696us (3297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.400505:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5779 00000100:00100000:3.0:1789429276.406923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.407060:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634823040 00000100:00100000:1.0:1789429276.407073:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634823040 00002000:00100000:1.0:1789429276.407144:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c1a8a80 x1876351634823040/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.407157:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a8a80 with x1876351634823040 ext(233472->237567) 00010000:00010000:1.0:1789429276.407167:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.407186:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.407258:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a8a80 00000100:00100000:1.0:1789429276.407295:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1178 00000100:00100000:1.0:1789429276.407306:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634823040:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429276.407554:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634823040:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 248us (647us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429276.407563:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1178 00002000:00100000:1.0:1789429276.407571:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c1a8a80 x1876351634823040/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.407578:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a8a80 with x1876351634823040 ext(233472->237567) 00010000:00010000:1.0:1789429276.407585:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.407596:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.407603:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a8a80 00000100:00100000:3.0:1789429276.411532:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.411649:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634823168 00000100:00100000:2.0:1789429276.411666:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634823168 00000100:00100000:2.0:1789429276.411748:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5336 00000100:00100000:2.0:1789429276.411761:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634823168:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.411789:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.411819:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b709 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.411868:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 21) 00010000:00010000:2.0:1789429276.411879:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.411887:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(146 21) 00010000:00010000:2.0:1789429276.411893:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.411946:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.411964:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.411979:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd8a00, rc 0) 00000100:00100000:2.0:1789429276.412056:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634823168:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 297us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.412065:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5336 00000100:00100000:3.0:1789429276.415423:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.415516:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634823296 00000100:00100000:0.0:1789429276.415530:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634823296 00010000:00010000:0.0:1789429276.415583:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.415633:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5780 00000100:00100000:0.0:1789429276.415644:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2368:x1876351634823296:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.415662:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.415693:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.415709:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.415739:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fab0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6fb expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.415761:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 21) 00010000:00010000:0.0:1789429276.415766:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 21) 00010000:00010000:0.0:1789429276.415776:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.415787:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.415842:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.415857:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 17 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.415874:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648238464:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429276.415980:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.419624:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648238464:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.419664:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429276.419753:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2368:x1876351634823296:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4109us (4341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.419768:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5780 00000100:00100000:3.0:1789429276.420097:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.420410:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634823424 00000100:00100000:0.0:1789429276.420420:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634823424 00010000:00010000:0.0:1789429276.420483:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 18 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.420527:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5781 00000100:00100000:0.0:1789429276.420539:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634823424:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.420556:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.420587:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 18 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.420608:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 18 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.420639:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fab7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b702 expref: 18 pid: 6681 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.420661:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 21) 00010000:00010000:0.0:1789429276.420668:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 21) 00010000:00010000:0.0:1789429276.420680:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.420691:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.420734:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.420752:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648238592:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429276.420831:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.425771:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648238592:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.425810:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429276.425926:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634823424:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5387us (5828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.425943:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5781 00000100:00100000:2.0:1789429276.431162:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.431517:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634823552 00000100:00100000:1.0:1789429276.431532:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634823552 00000100:00100000:1.0:1789429276.431653:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5337 00000100:00100000:1.0:1789429276.431667:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634823552:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.431696:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.431723:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b710 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.431782:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.431794:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 21) 00010000:00010000:1.0:1789429276.431799:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 21) 00010000:00010000:1.0:1789429276.431805:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.431852:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.431870:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 17 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.431891:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648238720:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429276.432031:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.434408:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648238720:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429276.434459:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.434488:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:1.0:1789429276.434563:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634823552:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2899us (3415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.434579:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5337 00000100:00100000:2.0:1789429276.437051:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.437247:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634823680 00000100:00100000:1.0:1789429276.437261:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634823680 00010000:00010000:1.0:1789429276.437314:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.437366:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5782 00000100:00100000:1.0:1789429276.437377:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634823680:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.437396:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.437426:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.437442:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.437474:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d6d22b/0xb4c3dad72635fabe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b709 expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.437499:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 21) 00010000:00010000:1.0:1789429276.437504:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 21) 00010000:00010000:1.0:1789429276.437516:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.437529:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.437586:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.437604:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648238848:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.437886:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.443859:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.443968:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634823808 00000100:00100000:0.0:1789429276.443982:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634823808 00000100:00100000:0.0:1789429276.444070:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5338 00000100:00100000:0.0:1789429276.444084:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634823808:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.444106:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.444131:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b717 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.444172:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.444183:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 21) 00010000:00010000:0.0:1789429276.444188:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 21) 00010000:00010000:0.0:1789429276.444194:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.444287:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.444304:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 17 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.444321:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648238976:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.444419:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.448811:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648238848:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.448850:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.448922:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634823680:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11545us (11884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.448936:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5782 00000100:00100000:3.0:1789429276.455333:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.455605:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648238976:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429276.455649:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.455674:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:1.0:1789429276.455750:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634823808:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11669us (11907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.455758:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5338 00000100:00100000:0.0:1789429276.455958:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634823936 00000100:00100000:0.0:1789429276.455968:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634823936 00002000:00100000:0.0:1789429276.456030:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f1c1a8000 x1876351634823936/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.456041:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a8000 with x1876351634823936 ext(233472->270335) 00010000:00010000:0.0:1789429276.456048:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.456064:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.456082:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a8000 00000100:00100000:0.0:1789429276.456115:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1179 00000100:00100000:0.0:1789429276.456126:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634823936:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.462870:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634823936:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6727us (7535us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429276.462888:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1179 00002000:00100000:0.0:1789429276.462904:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f1c1a8000 x1876351634823936/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.462916:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a8000 with x1876351634823936 ext(233472->270335) 00010000:00010000:0.0:1789429276.462931:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.462953:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.462968:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a8000 00000100:00100000:3.0:1789429276.465484:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.465666:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634824064 00000100:00100000:2.0:1789429276.465679:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634824064 00000100:00100000:2.0:1789429276.465762:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5339 00000100:00100000:2.0:1789429276.465773:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634824064:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.465798:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.465825:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b71e expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.465870:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 21) 00010000:00010000:2.0:1789429276.465880:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.465887:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(150 21) 00010000:00010000:2.0:1789429276.465892:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.465946:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.465963:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.465985:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9200, rc 0) 00000100:00100000:2.0:1789429276.466075:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634824064:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 303us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.466083:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5339 00000100:00100000:3.0:1789429276.468536:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.468810:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634824192 00000100:00100000:1.0:1789429276.468823:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634824192 00010000:00010000:1.0:1789429276.468879:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.468940:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5783 00000100:00100000:1.0:1789429276.468951:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634824192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.468970:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.469000:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.469018:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.469050:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fac5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b710 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.469086:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(151 21) 00010000:00010000:1.0:1789429276.469093:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(151 21) 00010000:00010000:1.0:1789429276.469106:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.469120:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.469176:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.469277:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 17 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.469296:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648239232:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.469410:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.472263:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.472286:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648239232:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.472316:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.472387:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634824192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3437us (3863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.472400:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5783 00000100:00100000:0.0:1789429276.472527:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634824320 00000100:00100000:0.0:1789429276.472537:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634824320 00002000:00100000:0.0:1789429276.472596:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c1a9500 x1876351634824320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.472609:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a9500 with x1876351634824320 ext(233472->237567) 00010000:00010000:0.0:1789429276.472619:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.472637:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.472645:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a9500 00000100:00100000:0.0:1789429276.472677:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1180 00000100:00100000:0.0:1789429276.472696:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634824320:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.472917:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634824320:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 223us (667us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429276.472925:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1180 00002000:00100000:0.0:1789429276.472931:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c1a9500 x1876351634824320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.472940:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a9500 with x1876351634824320 ext(233472->237567) 00010000:00010000:0.0:1789429276.472946:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.472959:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.472966:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a9500 00000100:00100000:3.0:1789429276.476276:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.477126:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634824448 00000100:00100000:0.0:1789429276.477142:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634824448 00000100:00100000:0.0:1789429276.477482:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5340 00000100:00100000:0.0:1789429276.477497:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634824448:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.477521:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.477543:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b725 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.477582:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(151 21) 00010000:00010000:0.0:1789429276.477591:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.477600:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(152 21) 00010000:00010000:0.0:1789429276.477605:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.477658:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.477673:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.477705:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc 0) 00000100:00100000:0.0:1789429276.477782:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634824448:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 289us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.477790:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5340 00000100:00100000:3.0:1789429276.482474:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.482562:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634824576 00000100:00100000:1.0:1789429276.482575:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634824576 00010000:00010000:1.0:1789429276.482630:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.482675:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5784 00000100:00100000:1.0:1789429276.482696:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2369:x1876351634824576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.482716:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.482746:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.482761:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.482796:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635facc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b717 expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.482820:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 21) 00010000:00010000:1.0:1789429276.482825:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 21) 00010000:00010000:1.0:1789429276.482835:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.482847:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.482902:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.482917:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 17 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.482933:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648239488:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.483043:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.486630:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648239488:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.486630:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1789429276.486663:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429276.486738:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634824704 00000100:00100000:1.0:1789429276.486747:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2369:x1876351634824576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4063us (4297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.486748:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634824704 00000100:00100000:1.0:1789429276.486761:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5784 00010000:00010000:0.0:1789429276.486792:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.486833:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5785 00000100:00100000:0.0:1789429276.486844:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634824704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.486861:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.486892:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.486907:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.486940:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fad3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b71e expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.486961:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 21) 00010000:00010000:0.0:1789429276.486966:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 21) 00010000:00010000:0.0:1789429276.486977:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.486990:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.487037:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.487055:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648239616:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429276.487121:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.490060:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648239616:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.490098:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429276.490315:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634824704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3470us (3695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.490329:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5785 00000100:00100000:3.0:1789429276.498714:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.498853:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634824832 00000100:00100000:1.0:1789429276.498866:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634824832 00000100:00100000:1.0:1789429276.498984:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5341 00000100:00100000:1.0:1789429276.498996:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634824832:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.499030:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.499055:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b72c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.499101:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.499113:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 21) 00010000:00010000:1.0:1789429276.499119:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 21) 00010000:00010000:1.0:1789429276.499125:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.499168:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.499390:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 17 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.499411:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648239744:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429276.499679:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.502337:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.505032:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648239744:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429276.505082:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.505116:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:0.0:1789429276.505243:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634824832:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6204us (6499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.505255:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5341 00000100:00100000:1.0:1789429276.505554:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634824960 00000100:00100000:1.0:1789429276.505565:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634824960 00002000:00100000:1.0:1789429276.505702:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c0a9f80 x1876351634824960/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.505714:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a9f80 with x1876351634824960 ext(233472->237567) 00010000:00010000:1.0:1789429276.505723:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.505739:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.505748:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0a9f80 00000100:00100000:1.0:1789429276.505831:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1181 00000100:00100000:1.0:1789429276.505843:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634824960:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429276.506078:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634824960:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 236us (3754us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429276.506086:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1181 00002000:00100000:1.0:1789429276.506093:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c0a9f80 x1876351634824960/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.506101:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a9f80 with x1876351634824960 ext(233472->237567) 00010000:00010000:1.0:1789429276.506107:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.506120:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.506150:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0a9f80 00000100:00100000:3.0:1789429276.510735:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.510788:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.510950:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634825216 00000100:00100000:2.0:1789429276.510967:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634825216 00010000:00010000:2.0:1789429276.511038:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.511097:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5786 00000100:00100000:2.0:1789429276.511109:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2368:x1876351634825216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429276.511130:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429276.511164:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.511180:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.511273:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fada lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b725 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.511298:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 21) 00010000:00010000:2.0:1789429276.511304:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 21) 00010000:00010000:2.0:1789429276.511315:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.511330:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.511383:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.511401:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648239872:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429276.511513:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.512556:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634825088 00000100:00100000:1.0:1789429276.512571:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634825088 00000100:00100000:1.0:1789429276.512638:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5342 00000100:00100000:1.0:1789429276.512648:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634825088:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.512670:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.512766:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b733 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.512810:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.512820:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 21) 00010000:00010000:1.0:1789429276.512825:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 21) 00010000:00010000:1.0:1789429276.512831:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.512865:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.512882:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 17 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.512896:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648240000:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429276.512988:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.515487:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.515527:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648239872:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429276.515560:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429276.515634:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2368:x1876351634825216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4525us (4843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.515647:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5786 00000100:00100000:0.0:1789429276.515689:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634825344 00000100:00100000:0.0:1789429276.515700:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634825344 00002000:00100000:0.0:1789429276.515763:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f1c0a8000 x1876351634825344/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.515775:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a8000 with x1876351634825344 ext(233472->270335) 00010000:00010000:0.0:1789429276.515785:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.515803:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.515811:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0a8000 00000100:00100000:0.0:1789429276.515843:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1182 00000100:00100000:0.0:1789429276.515853:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634825344:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429276.516821:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648240000:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.516855:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.516879:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:2.0:1789429276.516940:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634825088:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4293us (6219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.516949:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5342 00000100:00100000:1.0:1789429276.526944:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634825344:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 11072us (11451us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429276.526961:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1182 00002000:00100000:1.0:1789429276.526978:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f1c0a8000 x1876351634825344/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.526991:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a8000 with x1876351634825344 ext(233472->270335) 00010000:00010000:1.0:1789429276.527005:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.527038:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.527052:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0a8000 00000100:00100000:3.0:1789429276.530929:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.531194:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634825472 00000100:00100000:0.0:1789429276.531264:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634825472 00000100:00100000:0.0:1789429276.531330:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5343 00000100:00100000:0.0:1789429276.531343:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634825472:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.531368:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.531394:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b73a expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.531436:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 21) 00010000:00010000:0.0:1789429276.531447:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.531455:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(156 21) 00010000:00010000:0.0:1789429276.531461:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.531518:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.531539:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.531554:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:0.0:1789429276.531640:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634825472:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 298us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.531648:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5343 00000100:00100000:3.0:1789429276.532169:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.532424:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634825600 00000100:00100000:0.0:1789429276.532433:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634825600 00010000:00010000:0.0:1789429276.532466:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.532507:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5787 00000100:00100000:0.0:1789429276.532516:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634825600:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.532531:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.532561:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.532574:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.532607:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fae1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b72c expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.532627:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 21) 00010000:00010000:0.0:1789429276.532631:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 21) 00010000:00010000:0.0:1789429276.532640:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.532649:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.532692:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.532706:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 17 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.532720:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648240256:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429276.532793:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.536329:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.536375:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634825728 00000100:00100000:1.0:1789429276.536388:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634825728 00010000:00010000:1.0:1789429276.536450:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.536511:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5788 00000100:00100000:1.0:1789429276.536524:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634825728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.536545:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.536576:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.536599:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.536634:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 21) 00010000:00010000:1.0:1789429276.536639:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 21) 00010000:00010000:1.0:1789429276.536649:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.536661:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.536723:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.536742:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648240384:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.536858:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00010000:00010000:0.0:1789429276.538057:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fae8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b733 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.538085:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648240256:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.538113:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.538682:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634825600:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6163us (6511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.538695:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5787 00000100:00100000:1.0:1789429276.539781:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648240384:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.539808:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.539863:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634825728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3342us (3551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.539876:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5788 00000100:00100000:2.0:1789429276.547395:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.547785:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634825856 00000100:00100000:0.0:1789429276.547800:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634825856 00000100:00100000:0.0:1789429276.547888:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5344 00000100:00100000:0.0:1789429276.547900:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634825856:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.547923:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.547950:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b741 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.547994:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.548005:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 21) 00010000:00010000:0.0:1789429276.548010:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 21) 00010000:00010000:0.0:1789429276.548015:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.548398:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.548419:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 17 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.548436:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648240512:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429276.551473:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.556120:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.556333:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634825984 00000100:00100000:1.0:1789429276.556347:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634825984 00002000:00100000:1.0:1789429276.556412:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f1c0ab800 x1876351634825984/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.556425:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0ab800 with x1876351634825984 ext(233472->270335) 00010000:00010000:1.0:1789429276.556437:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.556456:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.556465:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0ab800 00000100:00100000:1.0:1789429276.556504:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1183 00000100:00100000:1.0:1789429276.556516:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634825984:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.563011:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634825984:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6480us (6890us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429276.563041:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1183 00002000:00100000:0.0:1789429276.563059:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f1c0ab800 x1876351634825984/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.563071:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0ab800 with x1876351634825984 ext(233472->270335) 00010000:00010000:0.0:1789429276.563086:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.563108:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.563116:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0ab800 00000100:00100000:3.0:1789429276.566452:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.566568:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.566743:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634826112 00000100:00100000:0.0:1789429276.566757:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634826112 00000100:00100000:0.0:1789429276.566835:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5345 00000100:00100000:0.0:1789429276.566847:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634826112:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.566871:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.566895:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b748 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.566936:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 21) 00010000:00010000:0.0:1789429276.566946:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.566954:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 21) 00010000:00010000:0.0:1789429276.566960:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.567014:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.567040:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.567057:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429276.567128:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634826112:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 282us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.567137:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5345 00000100:00100000:2.0:1789429276.567922:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634826240 00000100:00100000:2.0:1789429276.567934:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634826240 00010000:00010000:2.0:1789429276.567971:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.568005:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5789 00000100:00100000:2.0:1789429276.568015:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634826240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429276.568040:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429276.568070:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.568085:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.568114:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 21) 00010000:00010000:2.0:1789429276.568120:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 21) 00010000:00010000:2.0:1789429276.568130:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.568142:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.568176:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.568469:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.568488:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648240768:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429276.568581:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789429276.569749:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635faef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b73a expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.569774:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648240512:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429276.569814:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.569824:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.569844:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:1.0:1789429276.569914:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634825856:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 22016us (22532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.569924:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5344 00000100:00100000:2.0:1789429276.574168:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.574461:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648240768:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.574495:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.574569:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634826240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6553us (7999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.574582:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5789 00000100:00100000:3.0:1789429276.574799:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634826368 00000100:00100000:3.0:1789429276.574810:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634826368 00002000:00100000:3.0:1789429276.574873:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946e15185180 x1876351634826368/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.574887:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185180 with x1876351634826368 ext(233472->237567) 00010000:00010000:3.0:1789429276.574898:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.574918:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429276.574927:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15185180 00000100:00100000:3.0:1789429276.575010:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1184 00000100:00100000:3.0:1789429276.575026:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634826368:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429276.575310:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634826368:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 289us (1156us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429276.575317:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1184 00002000:00100000:3.0:1789429276.575325:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946e15185180 x1876351634826368/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.575333:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185180 with x1876351634826368 ext(233472->237567) 00010000:00010000:3.0:1789429276.575340:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.575350:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429276.575358:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15185180 00000100:00100000:2.0:1789429276.578860:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.578924:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.578943:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634826496 00000100:00100000:1.0:1789429276.578956:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634826496 00000100:00100000:1.0:1789429276.579038:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5346 00000100:00100000:1.0:1789429276.579050:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634826496:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.579084:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.579111:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b74f expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.579153:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 21) 00010000:00010000:1.0:1789429276.579164:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.579173:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(161 21) 00010000:00010000:1.0:1789429276.579179:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.579282:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.579299:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.579314:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:1.0:1789429276.579385:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634826496:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 337us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.579393:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5346 00000100:00100000:3.0:1789429276.579956:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634826624 00000100:00100000:3.0:1789429276.579965:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634826624 00010000:00010000:3.0:1789429276.579996:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.580080:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5790 00000100:00100000:3.0:1789429276.580090:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634826624:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429276.580102:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429276.580131:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.580145:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.580167:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635faf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b741 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.580184:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 21) 00010000:00010000:3.0:1789429276.580188:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 21) 00010000:00010000:3.0:1789429276.580244:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.580255:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.580291:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.580306:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 17 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.580322:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648241024:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.580525:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0898c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.585889:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648241024:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429276.585924:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429276.586091:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.586107:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634826624:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6018us (7181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.586121:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5790 00000100:00100000:3.0:1789429276.586289:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634826752 00000100:00100000:3.0:1789429276.586297:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634826752 00010000:00010000:3.0:1789429276.586335:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.586381:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5791 00000100:00100000:3.0:1789429276.586392:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2369:x1876351634826752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429276.586408:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429276.586437:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.586459:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.586490:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fafd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b748 expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.586512:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 21) 00010000:00010000:3.0:1789429276.586517:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 21) 00010000:00010000:3.0:1789429276.586526:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.586538:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.586584:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.586602:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648241152:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.586667:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.588917:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648241152:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429276.588951:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429276.589647:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2369:x1876351634826752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3249us (3550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.589666:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5791 00000100:00100000:0.0:1789429276.599191:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.599331:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634826880 00000100:00100000:1.0:1789429276.599345:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634826880 00000100:00100000:1.0:1789429276.599451:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5347 00000100:00100000:1.0:1789429276.599463:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634826880:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.599489:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.599513:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b756 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.599554:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.599564:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 21) 00010000:00010000:1.0:1789429276.599569:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 21) 00010000:00010000:1.0:1789429276.599575:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.599617:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 17 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.599634:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 17 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.599650:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648241280:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429276.599766:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.601343:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.601671:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648241280:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429276.601720:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.601747:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:3.0:1789429276.601813:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634826880:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2351us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.601823:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5347 00000100:00100000:1.0:1789429276.603222:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634827008 00000100:00100000:1.0:1789429276.603239:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634827008 00002000:00100000:1.0:1789429276.603306:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946e15187480 x1876351634827008/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.603320:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15187480 with x1876351634827008 ext(233472->237567) 00010000:00010000:1.0:1789429276.603331:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.603351:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.603360:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15187480 00000100:00100000:1.0:1789429276.603402:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1185 00000100:00100000:1.0:1789429276.603413:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634827008:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429276.603676:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634827008:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 264us (2342us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429276.603695:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1185 00002000:00100000:1.0:1789429276.603703:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946e15187480 x1876351634827008/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.603712:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15187480 with x1876351634827008 ext(233472->237567) 00010000:00010000:1.0:1789429276.603718:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.603730:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.603737:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15187480 00000100:00100000:2.0:1789429276.607978:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.608043:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.608145:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634827136 00000100:00100000:0.0:1789429276.608159:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634827136 00000100:00100000:0.0:1789429276.608282:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5348 00000100:00100000:0.0:1789429276.608296:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634827136:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.608326:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.608352:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b75d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.608395:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 21) 00010000:00010000:0.0:1789429276.608405:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.608420:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 21) 00010000:00010000:0.0:1789429276.608426:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.608481:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.608501:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.608517:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429276.608600:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634827136:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 307us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.608608:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5348 00000100:00100000:1.0:1789429276.609392:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634827264 00000100:00100000:1.0:1789429276.609409:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634827264 00010000:00010000:1.0:1789429276.609447:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.609486:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5792 00000100:00100000:1.0:1789429276.609495:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634827264:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.609510:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.609539:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.609554:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.609587:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b74f expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.609608:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 21) 00010000:00010000:1.0:1789429276.609613:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 21) 00010000:00010000:1.0:1789429276.609624:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.609637:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.609673:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.609700:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 17 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.609716:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648241536:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.609821:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.616461:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648241536:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.616499:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.616577:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634827264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7081us (8531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.616595:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5792 00000100:00100000:0.0:1789429276.618315:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.618417:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634827392 00000100:00100000:2.0:1789429276.618430:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634827392 00002000:00100000:2.0:1789429276.618495:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f3fbcce00 x1876351634827392/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.618510:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcce00 with x1876351634827392 ext(233472->270335) 00010000:00010000:2.0:1789429276.618521:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 18 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.618542:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 18 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429276.618552:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcce00 00000100:00100000:2.0:1789429276.618592:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1186 00000100:00100000:2.0:1789429276.618604:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634827392:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429276.625258:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634827392:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6579us (6877us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429276.625274:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1186 00002000:00100000:2.0:1789429276.625290:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f3fbcce00 x1876351634827392/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.625301:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcce00 with x1876351634827392 ext(233472->270335) 00010000:00010000:2.0:1789429276.625315:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 18 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.625337:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 18 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429276.625346:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcce00 00000100:00100000:3.0:1789429276.628288:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.628407:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634827520 00000100:00100000:1.0:1789429276.628422:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634827520 00000100:00100000:1.0:1789429276.628509:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5349 00000100:00100000:1.0:1789429276.628522:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634827520:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.628550:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.628576:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b764 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.628622:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 21) 00010000:00010000:1.0:1789429276.628634:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.628642:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 21) 00010000:00010000:1.0:1789429276.628647:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.628700:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.628718:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.628735:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:1.0:1789429276.628799:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634827520:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 281us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.628807:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5349 00000100:00100000:0.0:1789429276.631466:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.631561:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634827648 00000100:00100000:1.0:1789429276.631574:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634827648 00010000:00010000:1.0:1789429276.631622:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 19 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.631664:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5793 00000100:00100000:1.0:1789429276.631674:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634827648:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.631694:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.631725:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 19 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.631741:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 19 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.631770:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b756 expref: 19 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.631793:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 21) 00010000:00010000:1.0:1789429276.631798:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 21) 00010000:00010000:1.0:1789429276.631808:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.631819:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.631870:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.631884:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 17 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.631899:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648241792:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.631998:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.635147:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648241792:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.635193:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.637492:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634827648:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5800us (6027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.637510:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5793 00000100:00100000:0.0:1789429276.637775:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.638949:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634827776 00000100:00100000:1.0:1789429276.638968:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634827776 00010000:00010000:1.0:1789429276.639026:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.639092:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5794 00000100:00100000:1.0:1789429276.639103:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634827776:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.639123:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.639154:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.639176:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.639244:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b75d expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.639265:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 21) 00010000:00010000:1.0:1789429276.639271:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 21) 00010000:00010000:1.0:1789429276.639282:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.639294:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.639347:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.639364:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648241920:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.639843:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.642912:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648241920:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.642944:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.643061:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634827776:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3956us (5283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.643078:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5794 00000100:00100000:2.0:1789429276.650831:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.651237:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634827904 00000100:00100000:0.0:1789429276.651251:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634827904 00000100:00100000:0.0:1789429276.651500:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5350 00000100:00100000:0.0:1789429276.651515:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634827904:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.651539:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.651562:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b76b expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.651610:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.651621:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 21) 00010000:00010000:0.0:1789429276.651627:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 21) 00010000:00010000:0.0:1789429276.651632:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.651671:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.651687:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 17 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.651704:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648242048:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.651810:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.655566:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.655663:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634828032 00000100:00100000:1.0:1789429276.655676:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634828032 00002000:00100000:1.0:1789429276.655744:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946e15185c00 x1876351634828032/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.655757:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185c00 with x1876351634828032 ext(233472->270335) 00010000:00010000:1.0:1789429276.655767:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.655786:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.655795:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15185c00 00000100:00100000:1.0:1789429276.655825:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1187 00000100:00100000:1.0:1789429276.655835:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634828032:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429276.659662:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634828032:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3494us (3778us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429276.659685:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1187 00002000:00100000:1.0:1789429276.659702:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946e15185c00 x1876351634828032/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.659715:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185c00 with x1876351634828032 ext(233472->270335) 00010000:00010000:1.0:1789429276.659729:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.659757:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.659767:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15185c00 00000100:00100000:0.0:1789429276.661542:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648242048:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429276.661594:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.661621:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429276.661706:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634827904:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10194us (10893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.661720:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5350 00000100:00100000:3.0:1789429276.662464:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.662934:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634828160 00000100:00100000:1.0:1789429276.662946:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634828160 00000100:00100000:1.0:1789429276.663013:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5351 00000100:00100000:1.0:1789429276.663030:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634828160:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.663053:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.663077:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b772 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.663125:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 21) 00010000:00010000:1.0:1789429276.663135:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.663144:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 21) 00010000:00010000:1.0:1789429276.663150:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.663242:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.663259:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.663279:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:1.0:1789429276.663531:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634828160:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 307us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.663539:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5351 00000100:00100000:3.0:1789429276.664572:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.664748:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634828288 00000100:00100000:1.0:1789429276.664760:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634828288 00010000:00010000:1.0:1789429276.664801:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.664846:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5795 00000100:00100000:1.0:1789429276.664857:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634828288:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.664873:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.664906:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.664921:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.664951:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fb19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b764 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.664976:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 21) 00010000:00010000:1.0:1789429276.664982:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 21) 00010000:00010000:1.0:1789429276.664992:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.665379:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.665430:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.665447:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 17 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.665464:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648242304:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.668854:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.676890:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648242304:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.676890:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1789429276.676929:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.677011:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634828288:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12154us (12444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.677024:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5795 00000100:00100000:0.0:1789429276.677490:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634828416 00000100:00100000:0.0:1789429276.677502:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634828416 00002000:00100000:0.0:1789429276.677562:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c0a8380 x1876351634828416/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.677573:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a8380 with x1876351634828416 ext(233472->237567) 00010000:00010000:0.0:1789429276.677583:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.677603:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.677611:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0a8380 00000100:00100000:0.0:1789429276.677634:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1188 00000100:00100000:0.0:1789429276.677645:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634828416:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.677870:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634828416:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 226us (992us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429276.677878:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1188 00002000:00100000:0.0:1789429276.677886:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c0a8380 x1876351634828416/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.677896:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a8380 with x1876351634828416 ext(233472->237567) 00010000:00010000:0.0:1789429276.677901:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.677917:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.677923:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0a8380 00000100:00100000:3.0:1789429276.681940:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.682060:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.682333:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634828672 00000100:00100000:1.0:1789429276.682347:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634828672 00010000:00010000:1.0:1789429276.682402:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.682468:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5796 00000100:00100000:1.0:1789429276.682480:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634828672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.682506:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.682538:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.682555:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.682585:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fb20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b76b expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.682609:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 21) 00010000:00010000:1.0:1789429276.682615:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 21) 00010000:00010000:1.0:1789429276.682626:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.682638:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.682761:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.682781:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648242432:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.682900:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.684835:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634828544 00000100:00100000:2.0:1789429276.684852:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634828544 00000100:00100000:2.0:1789429276.685002:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5352 00000100:00100000:2.0:1789429276.685016:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634828544:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.685107:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.685133:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b779 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.685175:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.685194:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 21) 00010000:00010000:2.0:1789429276.685227:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 21) 00010000:00010000:2.0:1789429276.685233:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.685275:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.685290:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 17 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.685307:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648242560:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429276.685959:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.692797:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648242432:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.692838:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.692916:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634828672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10436us (10855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.692929:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5796 00000100:00100000:2.0:1789429276.697532:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648242560:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.697587:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.697627:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9200, rc 0) 00000100:00100000:2.0:1789429276.697712:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634828544:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 12698us (15785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.697724:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5352 00000100:00100000:0.0:1789429276.699132:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.699193:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.699315:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634828928 00000100:00100000:2.0:1789429276.699328:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634828928 00000100:00100000:1.0:1789429276.699337:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634828800 00000100:00100000:1.0:1789429276.699344:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634828800 00010000:00010000:1.0:1789429276.699388:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 19 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.699437:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5797 00000100:00100000:1.0:1789429276.699454:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634828800:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.699473:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789429276.699499:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5353 00010000:00010000:1.0:1789429276.699504:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 19 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.699512:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634828928:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.699531:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.699534:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 19 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.699552:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b780 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.699568:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635fb27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b772 expref: 20 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.699580:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 21) 00010000:00010000:2.0:1789429276.699592:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.699600:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 21) 00010000:00010000:2.0:1789429276.699618:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.700798:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 21) 00010000:00010000:1.0:1789429276.700812:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 21) 00010000:00010000:1.0:1789429276.700830:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.700847:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.700914:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.700934:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 17 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.700952:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648242688:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.701379:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538780 going to sleep for 11 seconds 00010000:00010000:2.0:1789429276.708275:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 17 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.708302:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 17 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.708324:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648242816:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.709750:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.710187:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634829056 00000100:00100000:3.0:1789429276.710222:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634829056 00010000:00010000:3.0:1789429276.710275:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.710325:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5798 00000100:00100000:3.0:1789429276.710337:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634829056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429276.710356:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429276.710387:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.710411:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.710442:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 21) 00010000:00010000:3.0:1789429276.710448:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 21) 00010000:00010000:3.0:1789429276.710459:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.710472:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.710517:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.710532:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648242944:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429276.710870:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.711649:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648242688:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.711679:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.712797:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634828800:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13335us (13664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.712814:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5797 00000100:00100000:2.0:1789429276.712986:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00010000:00010000:2.0:1789429276.719384:0:8085:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.39@tcp) returned -22 from blocking AST (req@0000000068b4c45d x1876351648242816) - normal race ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.720142:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b779 expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.721099:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.721234:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634829184 00000100:00100000:3.0:1789429276.721246:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634829184 00000100:00100000:1.0:1789429276.721267:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648242944:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.721293:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429276.721303:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5354 00000100:00100000:3.0:1789429276.721312:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634829184:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429276.721333:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429276.721353:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b787 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.721354:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634829056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11018us (11624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.721363:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5798 00010000:00010000:3.0:1789429276.721389:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.721408:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 21) 00010000:00010000:3.0:1789429276.721416:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 21) 00010000:00010000:3.0:1789429276.721423:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.721433:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648242816:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429276.724443:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.724496:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.724622:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648243072:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.724674:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.724691:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.724707:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd8400, rc 0) 00000100:00100000:0.0:1789429276.724966:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dc300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.725263:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634828928:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 25753us (26076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.725276:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5353 00000100:00100000:0.0:1789429276.729818:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.729996:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634829312 00000100:00100000:1.0:1789429276.730011:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634829312 00002000:00100000:1.0:1789429276.730086:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f3fbcd880 x1876351634829312/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.730171:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcd880 with x1876351634829312 ext(233472->270335) 00010000:00010000:1.0:1789429276.730186:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.730261:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.730271:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcd880 00000100:00100000:1.0:1789429276.730311:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1189 00000100:00100000:1.0:1789429276.730322:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634829312:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429276.730529:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648243072:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.730569:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.730592:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:2.0:1789429276.732132:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634829184:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10805us (11023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.732157:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5354 00000100:00100000:1.0:1789429276.737615:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634829312:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7278us (7794us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429276.737633:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1189 00002000:00100000:1.0:1789429276.737650:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (233472->270335) req@ffff946f3fbcd880 x1876351634829312/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.737663:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcd880 with x1876351634829312 ext(233472->270335) 00010000:00010000:1.0:1789429276.737676:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.737698:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.737707:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcd880 00000100:00100000:3.0:1789429276.740666:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.742313:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.742524:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634829568 00000100:00100000:1.0:1789429276.742537:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634829568 00010000:00010000:1.0:1789429276.742593:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.742658:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5799 00000100:00100000:1.0:1789429276.742670:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634829568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.742691:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.742723:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.742740:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.742773:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b780 expref: 18 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.742797:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 21) 00010000:00010000:1.0:1789429276.742802:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 21) 00010000:00010000:1.0:1789429276.742814:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.742827:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.743003:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.743029:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648243200:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.743336:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.747745:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.747875:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634829440 00000100:00100000:0.0:1789429276.747887:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634829440 00000100:00100000:2.0:1789429276.747972:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634829696 00000100:00100000:2.0:1789429276.747977:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634829696 00002000:00100000:2.0:1789429276.748037:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c0ab100 x1876351634829696/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.748050:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0ab100 with x1876351634829696 ext(233472->237567) 00002000:00010000:2.0:1789429276.748057:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c0ab100 00000100:00100000:2.0:1789429276.748083:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11347 00000100:00100000:2.0:1789429276.748101:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634829696:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429276.748410:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634829696:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 316us (678us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429276.748418:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11347 00002000:00100000:2.0:1789429276.748425:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c0ab100 x1876351634829696/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.748434:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0ab100 with x1876351634829696 ext(233472->237567) 00002000:00010000:2.0:1789429276.748437:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c0ab100 00000100:00100000:1.0:1789429276.749165:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648243200:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.749339:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.749451:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634829568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6783us (7148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.749461:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5799 00000100:00100000:1.0:1789429276.749535:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5355 00000100:00100000:1.0:1789429276.749544:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634829440:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.749561:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.749583:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b78e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.749621:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.749632:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 21) 00010000:00010000:1.0:1789429276.749637:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 21) 00010000:00010000:1.0:1789429276.749642:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.749676:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.749698:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 17 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.749715:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648243328:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429276.752868:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.755791:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.755982:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648243328:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429276.756036:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.756065:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429276.756155:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634829440:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6611us (15500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.756166:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5355 00000100:00100000:0.0:1789429276.757372:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634829824 00000100:00100000:0.0:1789429276.757390:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634829824 00002000:00100000:0.0:1789429276.757458:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f1c1a8380 x1876351634829824/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.757472:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a8380 with x1876351634829824 ext(237568->241663) 00010000:00010000:0.0:1789429276.757483:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.757503:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.757512:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a8380 00000100:00100000:0.0:1789429276.757554:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1190 00000100:00100000:0.0:1789429276.757567:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634829824:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.757827:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634829824:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 261us (2050us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429276.757835:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1190 00002000:00100000:0.0:1789429276.757842:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f1c1a8380 x1876351634829824/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.757851:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a8380 with x1876351634829824 ext(237568->241663) 00010000:00010000:0.0:1789429276.757857:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.757869:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.757876:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1a8380 00000100:00100000:3.0:1789429276.759653:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.759897:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634829952 00000100:00100000:2.0:1789429276.759908:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634829952 00002000:00100000:2.0:1789429276.759965:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c1ab480 x1876351634829952/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 4584/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.759977:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1ab480 with x1876351634829952 ext(233472->237567) 00010000:00010000:2.0:1789429276.759985:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.760004:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429276.760014:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1ab480 00000100:00100000:2.0:1789429276.760055:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1191 00000100:00100000:2.0:1789429276.760065:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634829952:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429276.760582:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634829952:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 517us (939us total) trans 4294969555 rc 0/0 00000100:00100000:2.0:1789429276.760592:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1191 00002000:00100000:2.0:1789429276.760600:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f1c1ab480 x1876351634829952/t4294969555(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 4584/448 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.760610:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1ab480 with x1876351634829952 ext(233472->237567) 00010000:00010000:2.0:1789429276.760617:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.760630:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429276.760638:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1ab480 00000100:00100000:3.0:1789429276.765015:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.765060:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.765151:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634830208 00000100:00100000:1.0:1789429276.765165:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634830208 00010000:00010000:1.0:1789429276.765284:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.765340:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5800 00000100:00100000:1.0:1789429276.765352:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351634830208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.765372:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429276.765401:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1789429276 -> 1789429277 00002000:00010000:1.0:1789429276.765404:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1789429276 -> 1789429277 00010000:00010000:1.0:1789429276.765412:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.765430:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.765637:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fb3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b787 expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.765662:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 21) 00010000:00010000:1.0:1789429276.765667:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 21) 00010000:00010000:1.0:1789429276.765677:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.765688:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.765740:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.765759:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648243456:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.765865:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.766506:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634830080 00000100:00100000:2.0:1789429276.766516:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634830080 00000100:00100000:2.0:1789429276.766578:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5356 00000100:00100000:2.0:1789429276.766587:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634830080:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.766606:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.766627:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b795 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.766663:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.766673:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 21) 00010000:00010000:2.0:1789429276.766677:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 21) 00010000:00010000:2.0:1789429276.766682:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 21 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.766715:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.766731:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 17 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.766745:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648243584:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429276.766817:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.770671:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648243584:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.770725:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 21 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.770755:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9200, rc 0) 00000100:00100000:2.0:1789429276.770836:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634830080:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4248us (5832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.770851:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5356 00000100:00100000:1.0:1789429276.772435:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648243456:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.772478:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.772547:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351634830208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7196us (7484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.772561:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5800 00000100:00100000:0.0:1789429276.775470:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.776256:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634830336 00000100:00100000:2.0:1789429276.776272:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634830336 00010000:00010000:2.0:1789429276.776332:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.776794:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5801 00000100:00100000:3.0:1789429276.776811:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634830336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429276.776832:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429276.776866:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.776886:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.776917:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fb43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [233472->18446744073709551615] (req 233472->237567) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b78e expref: 18 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.776939:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 21) 00010000:00010000:3.0:1789429276.776945:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 21) 00010000:00010000:3.0:1789429276.776955:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.776967:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.777032:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.777051:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648243712:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.777186:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dc300 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.782589:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648243712:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.782626:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.782748:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634830336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5941us (7294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.782762:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5801 00000100:00100000:0.0:1789429276.787305:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.787367:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634830464 00000100:00100000:0.0:1789429276.787380:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634830464 00000100:00100000:0.0:1789429276.787452:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5357 00000100:00100000:0.0:1789429276.787464:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634830464:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.787489:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.787514:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fb51 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b79c expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.787554:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 21) 00010000:00010000:0.0:1789429276.787560:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 21) 00010000:00010000:0.0:1789429276.787571:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fb51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b79c expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.787590:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fb51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b79c expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.787605:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad200, rc 0) 00000100:00100000:0.0:1789429276.787668:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634830464:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 205us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.787675:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5357 00000100:00100000:3.0:1789429276.791946:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.792451:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634830592 00000100:00100000:2.0:1789429276.792465:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634830592 00002000:00100000:2.0:1789429276.792539:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f34020e00 x1876351634830592/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.792552:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34020e00 with x1876351634830592 ext(233472->237567) 00002000:00010000:2.0:1789429276.792560:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34020e00 00000100:00100000:2.0:1789429276.792647:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11348 00000100:00100000:2.0:1789429276.792659:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634830592:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429276.792924:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634830592:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 266us (990us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429276.792933:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11348 00002000:00100000:2.0:1789429276.792941:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f34020e00 x1876351634830592/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.792949:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34020e00 with x1876351634830592 ext(233472->237567) 00002000:00010000:2.0:1789429276.792953:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34020e00 00000100:00100000:3.0:1789429276.796413:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.798756:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634830720 00000100:00100000:0.0:1789429276.798777:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634830720 00000100:00100000:2.0:1789429276.799729:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00002000:00100000:2.0:1789429276.799825:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f34023800 x1876351634830720/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.799847:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34023800 with x1876351634830720 ext(237568->241663) 00002000:00010000:2.0:1789429276.799854:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34023800 00000100:00100000:2.0:1789429276.799898:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11349 00000100:00100000:2.0:1789429276.799909:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634830720:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.800120:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634830848 00000100:00100000:0.0:1789429276.800126:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634830848 00000100:00100000:0.0:1789429276.800162:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5358 00000100:00100000:0.0:1789429276.800169:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634830848:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.800193:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.800242:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7a3 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.800281:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.800293:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 21) 00010000:00010000:0.0:1789429276.800298:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 21) 00010000:00010000:0.0:1789429276.800305:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.800349:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.800366:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 20 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.800382:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648243840:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.800474:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.800729:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634830720:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 821us (4330us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429276.800738:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11349 00002000:00100000:2.0:1789429276.800746:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f34023800 x1876351634830720/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429276.800755:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34023800 with x1876351634830720 ext(237568->241663) 00010000:00010000:2.0:1789429276.800762:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 20 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.800778:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 20 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429276.800786:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34023800 00000100:00100000:3.0:1789429276.804415:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648243840:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429276.804478:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.804505:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:3.0:1789429276.804582:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634830848:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4411us (4861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.804593:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5358 00000100:00100000:0.0:1789429276.807073:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.807122:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.807249:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634831104 00000100:00100000:3.0:1789429276.807262:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634831104 00010000:00010000:3.0:1789429276.807311:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 20 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.807360:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5802 00000100:00100000:3.0:1789429276.807371:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b607100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634831104:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429276.807389:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429276.807417:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 20 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.807432:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 20 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.807468:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b795 expref: 20 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.807489:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 21) 00010000:00010000:3.0:1789429276.807495:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 21) 00010000:00010000:3.0:1789429276.807505:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.807517:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.807565:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.807583:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648243968:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.807683:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.808189:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634830976 00000100:00100000:1.0:1789429276.808237:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634830976 00000100:00100000:1.0:1789429276.808277:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5359 00000100:00100000:1.0:1789429276.808285:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634830976:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.808302:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.808321:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7aa expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.808348:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.808358:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 21) 00010000:00010000:1.0:1789429276.808362:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 21) 00010000:00010000:1.0:1789429276.808366:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 21 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.808392:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.808412:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.808424:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648244096:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429276.808491:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.812104:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648243968:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429276.812141:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429276.812255:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b607100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634831104:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4883us (5130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.812268:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5802 00000100:00100000:1.0:1789429276.812940:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648244096:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429276.812988:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 20 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.813029:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429276.813082:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634830976:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4796us (6021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.813091:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5359 00000100:00100000:0.0:1789429276.816496:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.816832:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634831232 00000100:00100000:3.0:1789429276.816844:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634831232 00002000:00100000:3.0:1789429276.816909:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f3b605180 x1876351634831232/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.816923:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b605180 with x1876351634831232 ext(237568->274431) 00010000:00010000:3.0:1789429276.816934:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.816953:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429276.816967:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b605180 00000100:00100000:3.0:1789429276.817007:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1192 00000100:00100000:3.0:1789429276.817025:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634831232:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429276.822935:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634831232:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5902us (6438us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429276.822952:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1192 00002000:00100000:3.0:1789429276.822969:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f3b605180 x1876351634831232/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.822981:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b605180 with x1876351634831232 ext(237568->274431) 00010000:00010000:3.0:1789429276.822994:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.823029:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429276.823039:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b605180 00000100:00100000:2.0:1789429276.827335:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.827442:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.827608:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634831360 00000100:00100000:1.0:1789429276.827623:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634831360 00000100:00100000:1.0:1789429276.827736:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5360 00000100:00100000:1.0:1789429276.827748:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634831360:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.827772:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.827799:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7b1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.827847:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 21) 00010000:00010000:1.0:1789429276.827857:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.827867:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 21) 00010000:00010000:1.0:1789429276.827873:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.827930:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.827949:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.827965:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429276.828058:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634831360:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 312us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.828067:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5360 00000100:00100000:0.0:1789429276.828870:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634831488 00000100:00100000:0.0:1789429276.828882:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634831488 00010000:00010000:0.0:1789429276.828923:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.828961:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5803 00000100:00100000:0.0:1789429276.828970:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634831488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.828986:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.829015:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.829043:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.829075:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7a3 expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.829096:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 21) 00010000:00010000:0.0:1789429276.829101:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 21) 00010000:00010000:0.0:1789429276.829111:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.829122:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.829162:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.829177:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.830296:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648244352:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429276.830426:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.834041:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648244352:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429276.834082:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429276.834157:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634831488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5185us (6712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.834174:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5803 00000100:00100000:0.0:1789429276.836329:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.836426:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634831616 00000100:00100000:2.0:1789429276.836437:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634831616 00010000:00010000:2.0:1789429276.836500:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 20 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.836549:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5804 00000100:00100000:2.0:1789429276.836559:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634831616:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429276.836578:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429276.836609:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 20 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.836627:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 20 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.836658:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fb5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7aa expref: 20 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.836681:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 21) 00010000:00010000:2.0:1789429276.836687:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 21) 00010000:00010000:2.0:1789429276.836698:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.836709:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.836758:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.836781:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648244480:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429276.836892:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083000 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.839564:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648244480:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429276.839599:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429276.839678:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634831616:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3119us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.839692:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5804 00000100:00100000:0.0:1789429276.850410:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.850628:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634831744 00000100:00100000:3.0:1789429276.850642:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634831744 00000100:00100000:3.0:1789429276.850706:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5361 00000100:00100000:3.0:1789429276.850719:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634831744:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429276.850742:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429276.850764:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7b8 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.850812:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.850824:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 21) 00010000:00010000:3.0:1789429276.850829:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 21) 00010000:00010000:3.0:1789429276.850834:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.850878:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.850894:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.850911:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648244608:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429276.851864:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.854887:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648244608:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.854936:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.854966:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:2.0:1789429276.856109:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634831744:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5383us (5704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.856123:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5361 00000100:00100000:3.0:1789429276.856525:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.856639:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.856954:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634831872 00000100:00100000:1.0:1789429276.856966:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634831872 00010000:00010000:1.0:1789429276.857014:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.857072:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5805 00000100:00100000:1.0:1789429276.857091:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634831872:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.857108:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.857138:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.857158:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.857235:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b1 expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.857259:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 21) 00010000:00010000:1.0:1789429276.857264:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 21) 00010000:00010000:1.0:1789429276.857277:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.857288:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.857339:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.857356:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648244736:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.857451:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.858661:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634832000 00000100:00100000:2.0:1789429276.858675:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634832000 00000100:00100000:2.0:1789429276.858742:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5362 00000100:00100000:2.0:1789429276.858753:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634832000:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.858774:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.858799:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7bf expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.858838:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.858849:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 21) 00010000:00010000:2.0:1789429276.858853:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 21) 00010000:00010000:2.0:1789429276.858859:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.858896:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.858910:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.858924:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648244864:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429276.859014:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0839c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.863876:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648244864:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.863929:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.863960:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd8400, rc 0) 00000100:00100000:2.0:1789429276.867859:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634832000:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9089us (11200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.867881:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5362 00000100:00100000:1.0:1789429276.869669:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648244736:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.869707:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.869880:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634831872:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12788us (13353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.869899:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5805 00000100:00100000:3.0:1789429276.870347:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.871372:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634832128 00000100:00100000:0.0:1789429276.871385:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634832128 00002000:00100000:0.0:1789429276.871449:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f34020380 x1876351634832128/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.871463:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34020380 with x1876351634832128 ext(237568->241663) 00010000:00010000:0.0:1789429276.871473:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.871493:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.871502:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34020380 00000100:00100000:0.0:1789429276.871843:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1193 00000100:00100000:0.0:1789429276.871855:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634832128:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.872138:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34020380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634832128:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 285us (1791us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429276.872146:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1193 00002000:00100000:0.0:1789429276.872154:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f34020380 x1876351634832128/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429276.872163:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34020380 with x1876351634832128 ext(237568->241663) 00010000:00010000:0.0:1789429276.872169:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.872235:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429276.872244:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34020380 00000100:00100000:3.0:1789429276.877343:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.877559:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634832256 00000100:00100000:2.0:1789429276.877572:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634832256 00000100:00100000:2.0:1789429276.877648:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5363 00000100:00100000:2.0:1789429276.877661:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634832256:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.877685:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.877721:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7c6 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.877772:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 21) 00010000:00010000:2.0:1789429276.877783:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.877792:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(182 21) 00010000:00010000:2.0:1789429276.877798:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 21 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.877855:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.877873:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 21 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.877888:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946e0ddd9200, rc 0) 00000100:00100000:2.0:1789429276.877979:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634832256:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 320us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.877994:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5363 00000100:00100000:3.0:1789429276.880134:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.880545:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634832384 00000100:00100000:2.0:1789429276.880558:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634832384 00010000:00010000:2.0:1789429276.880610:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 21 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.880662:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5806 00000100:00100000:2.0:1789429276.880674:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634832384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429276.880695:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429276.880725:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 21 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.880743:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 21 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.880774:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fb6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7b8 expref: 21 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.880797:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 21) 00010000:00010000:2.0:1789429276.880803:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 21) 00010000:00010000:2.0:1789429276.880815:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.880828:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.880887:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.880904:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.880921:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648245120:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429276.881024:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0839c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.885723:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648245120:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.885763:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.885856:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634832384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5182us (5733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.885869:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5806 00000100:00100000:3.0:1789429276.890391:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.890521:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634832512 00000100:00100000:1.0:1789429276.890535:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634832512 00002000:00100000:1.0:1789429276.890607:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f34023480 x1876351634832512/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.890619:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34023480 with x1876351634832512 ext(237568->274431) 00010000:00010000:1.0:1789429276.890629:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.890650:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.890659:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34023480 00000100:00100000:1.0:1789429276.890700:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1194 00000100:00100000:1.0:1789429276.890712:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634832512:12345-192.168.203.39@tcp:3:kworker.0 00010000:00010000:3.0:1789429276.899431:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429276.901675:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634832512:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 10948us (11281us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429276.901691:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1194 00002000:00100000:1.0:1789429276.901709:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f34023480 x1876351634832512/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.901722:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34023480 with x1876351634832512 ext(237568->274431) 00010000:00010000:1.0:1789429276.901736:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.901760:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.901769:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34023480 00000100:00100000:2.0:1789429276.905102:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.905158:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.905367:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634832640 00000100:00100000:1.0:1789429276.905379:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634832640 00000100:00100000:1.0:1789429276.905468:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5364 00000100:00100000:1.0:1789429276.905480:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634832640:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429276.905506:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429276.905531:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7cd expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.905575:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 21) 00010000:00010000:1.0:1789429276.905585:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.905592:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 21) 00010000:00010000:1.0:1789429276.905599:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.905652:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.905671:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.905686:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429276.905764:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634832640:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 286us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.905772:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5364 00000100:00100000:3.0:1789429276.905907:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634832768 00000100:00100000:3.0:1789429276.905913:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634832768 00010000:00010000:3.0:1789429276.905943:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.905976:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5807 00000100:00100000:3.0:1789429276.905984:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+20:2369:x1876351634832768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429276.905995:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429276.906035:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.906049:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.906074:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109e89a3/0xb4c3dad72635fb74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7bf expref: 20 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.906091:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 21) 00010000:00010000:3.0:1789429276.906094:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 21) 00010000:00010000:3.0:1789429276.906103:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.906114:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.906144:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.906165:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 19 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.906501:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648245376:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.906589:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.910778:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648245376:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429276.910815:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429276.910894:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2369:x1876351634832768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4907us (5732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.910907:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5807 00000100:00100000:2.0:1789429276.911995:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.912122:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634832896 00000100:00100000:3.0:1789429276.912132:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634832896 00010000:00010000:3.0:1789429276.912192:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 20 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.912264:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5808 00000100:00100000:3.0:1789429276.912274:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351634832896:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429276.912296:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429276.912326:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 20 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.912340:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 20 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.912375:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea560c3/0xb4c3dad72635fb7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7c6 expref: 20 pid: 6682 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.912396:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 21) 00010000:00010000:3.0:1789429276.912402:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 21) 00010000:00010000:3.0:1789429276.912411:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.912423:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.912470:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.912487:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648245504:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.912592:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.921701:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648245504:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429276.921741:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429276.921849:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2369:x1876351634832896:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9575us (9860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.921863:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5808 00000100:00100000:2.0:1789429276.930333:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.930518:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634833024 00000100:00100000:0.0:1789429276.930531:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634833024 00000100:00100000:0.0:1789429276.930606:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5365 00000100:00100000:0.0:1789429276.930618:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634833024:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.930643:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.930667:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7d4 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.930719:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.930729:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 21) 00010000:00010000:0.0:1789429276.930734:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 21) 00010000:00010000:0.0:1789429276.930740:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.930781:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.930797:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 18 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.930813:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648245632:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.930917:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429276.935741:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.935882:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634833152 00000100:00100000:1.0:1789429276.935895:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634833152 00002000:00100000:1.0:1789429276.935963:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f3fbced80 x1876351634833152/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.935977:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbced80 with x1876351634833152 ext(237568->274431) 00010000:00010000:1.0:1789429276.935989:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.936008:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.936028:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbced80 00000100:00100000:1.0:1789429276.936066:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1195 00000100:00100000:1.0:1789429276.936076:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634833152:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429276.937777:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b607100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648245632:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429276.937826:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.937854:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429276.937926:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634833024:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7309us (7608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429276.937936:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5365 00000100:00100000:1.0:1789429276.942764:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634833152:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6672us (7019us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429276.942785:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1195 00002000:00100000:1.0:1789429276.942801:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f3fbced80 x1876351634833152/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:12/0 lens 488/440 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429276.942813:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbced80 with x1876351634833152 ext(237568->274431) 00010000:00010000:1.0:1789429276.942828:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.942849:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 19 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429276.942858:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbced80 00000100:00100000:2.0:1789429276.945834:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.945943:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634833280 00000100:00100000:3.0:1789429276.945957:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634833280 00000100:00100000:3.0:1789429276.946032:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5366 00000100:00100000:3.0:1789429276.946046:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634833280:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429276.946070:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429276.946095:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7db expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.946138:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 21) 00010000:00010000:3.0:1789429276.946147:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.946155:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(187 21) 00010000:00010000:3.0:1789429276.946162:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.946274:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.946291:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.946307:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429276.946375:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634833280:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 331us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.946383:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5366 00000100:00100000:2.0:1789429276.949045:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.949485:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634833408 00000100:00100000:1.0:1789429276.949498:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634833408 00010000:00010000:1.0:1789429276.949553:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 20 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.949608:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5809 00000100:00100000:1.0:1789429276.949620:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634833408:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.949639:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.949669:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 20 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.949685:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 20 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.949731:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72635fb82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7cd expref: 20 pid: 6680 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.949755:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 21) 00010000:00010000:1.0:1789429276.949760:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 21) 00010000:00010000:1.0:1789429276.949769:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.949781:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.949831:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.949848:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.949863:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648245888:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.949976:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.954668:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.954768:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634833536 00000100:00100000:3.0:1789429276.954781:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634833536 00002000:00100000:3.0:1789429276.954854:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f3b607100 x1876351634833536/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/0 e 0 to 0 dl 1789429287 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.954869:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b607100 with x1876351634833536 ext(237568->241663) 00010000:00010000:3.0:1789429276.954882:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.954904:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429276.954914:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b607100 00000100:00100000:3.0:1789429276.954956:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1196 00000100:00100000:3.0:1789429276.954968:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634833536:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429276.955297:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b607100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634833536:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 329us (645us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429276.955306:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1196 00002000:00100000:3.0:1789429276.955314:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f3b607100 x1876351634833536/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:12/0 lens 488/4536 e 0 to 0 dl 1789429287 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429276.955323:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b607100 with x1876351634833536 ext(237568->241663) 00010000:00010000:3.0:1789429276.955329:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.955341:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429276.955349:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b607100 00000100:00100000:1.0:1789429276.955559:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648245888:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.955585:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.955621:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634833408:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6002us (6599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.955634:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5809 00000100:00100000:0.0:1789429276.959871:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.959925:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429276.960043:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634833792 00000100:00100000:1.0:1789429276.960057:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634833792 00010000:00010000:1.0:1789429276.960111:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.960171:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5810 00000100:00100000:1.0:1789429276.960238:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634833792:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429276.960259:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429276.960291:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.960309:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.960339:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fb89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7d4 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.960361:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 21) 00010000:00010000:1.0:1789429276.960366:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 21) 00010000:00010000:1.0:1789429276.960377:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.960389:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429276.960446:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429276.960752:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648246016:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429276.960864:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.961301:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634833664 00000100:00100000:3.0:1789429276.961309:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634833664 00000100:00100000:3.0:1789429276.961362:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5367 00000100:00100000:3.0:1789429276.961371:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634833664:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429276.961389:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429276.961408:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7e2 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.961440:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.961450:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 21) 00010000:00010000:3.0:1789429276.961465:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 21) 00010000:00010000:3.0:1789429276.961470:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 21 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.961500:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.961517:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 18 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.961529:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648246144:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429276.961588:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dc300 going to sleep for 11 seconds 00000100:00100000:1.0:1789429276.965822:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648246016:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429276.965862:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429276.965937:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634833792:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5755us (6080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429276.965950:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5810 00000100:00100000:3.0:1789429276.966289:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648246144:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429276.966323:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.966351:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:3.0:1789429276.966395:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634833664:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5026us (6469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.966404:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5367 00000100:00100000:0.0:1789429276.972366:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429276.972584:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634833920 00000100:00100000:3.0:1789429276.972597:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634833920 00010000:00010000:3.0:1789429276.972651:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.972741:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5811 00000100:00100000:3.0:1789429276.972754:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2369:x1876351634833920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429276.972774:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429276.972807:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.972823:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.972855:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fb90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7db expref: 19 pid: 20986 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.972878:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 21) 00010000:00010000:3.0:1789429276.972884:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 21) 00010000:00010000:3.0:1789429276.972894:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.972906:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429276.972956:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429276.972975:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648246272:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.973149:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.976380:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648246272:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429276.976418:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429276.976620:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2369:x1876351634833920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3867us (4447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429276.976634:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5811 00000100:00100000:2.0:1789429276.981362:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429276.981468:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634834048 00000100:00100000:0.0:1789429276.981482:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634834048 00000100:00100000:0.0:1789429276.981559:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5368 00000100:00100000:0.0:1789429276.981570:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634834048:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429276.981596:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429276.981621:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7e9 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.981666:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.981683:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 21) 00010000:00010000:0.0:1789429276.981688:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 21) 00010000:00010000:0.0:1789429276.981694:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.981738:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.981756:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 19 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.981772:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648246400:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429276.981876:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429276.986866:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.988533:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648246400:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429276.988596:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.988627:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:2.0:1789429276.988719:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634834048:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7149us (7371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429276.988732:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5368 00000100:00100000:0.0:1789429276.989689:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634834176 00000100:00100000:0.0:1789429276.989702:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634834176 00010000:00010000:0.0:1789429276.989897:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 20 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.989946:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5812 00000100:00100000:0.0:1789429276.989958:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634834176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429276.989977:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429276.990009:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 20 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.990033:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 20 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.990064:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fb97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e2 expref: 20 pid: 13238 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.990084:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 21) 00010000:00010000:0.0:1789429276.990089:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 21) 00010000:00010000:0.0:1789429276.990100:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.990112:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429276.990159:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429276.990176:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648246528:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429276.991468:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429276.991842:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634834304 00000100:00100000:2.0:1789429276.991854:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634834304 00000100:00100000:2.0:1789429276.991928:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5369 00000100:00100000:2.0:1789429276.991940:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634834304:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429276.991962:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429276.991986:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7f0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.992034:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.992046:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 21) 00010000:00010000:2.0:1789429276.992051:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(191 21) 00010000:00010000:2.0:1789429276.992057:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.992096:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429276.992113:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 18 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429276.992128:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648246656:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429276.992580:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429276.992670:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.000873:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648246656:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429277.000990:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.001082:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031200, rc 0) 00000100:00100000:2.0:1789429277.001161:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634834304:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9222us (9700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.001172:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5369 00000100:00100000:2.0:1789429277.006016:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.006297:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634834432 00000100:00100000:1.0:1789429277.006310:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634834432 00002000:00100000:1.0:1789429277.006399:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f415c4700 x1876351634834432/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.006411:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4700 with x1876351634834432 ext(237568->274431) 00010000:00010000:1.0:1789429277.006422:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.006444:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.006454:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c4700 00000100:00100000:1.0:1789429277.006494:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1197 00000100:00100000:1.0:1789429277.006508:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634834432:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.008523:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648246528:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429277.008559:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429277.008641:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634834176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 18684us (21788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.008658:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5812 00000100:00080000:2.0:1789429277.008938:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429277.015509:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634834432:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 8987us (9493us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429277.015526:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1197 00002000:00100000:1.0:1789429277.015541:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f415c4700 x1876351634834432/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.015553:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4700 with x1876351634834432 ext(237568->274431) 00010000:00010000:1.0:1789429277.015567:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.015589:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 19 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.015597:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c4700 00000100:00100000:2.0:1789429277.019529:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.019579:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.019666:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634834688 00000100:00100000:3.0:1789429277.019680:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634834688 00000100:00100000:3.0:1789429277.019754:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5370 00000100:00100000:3.0:1789429277.019766:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634834688:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.019791:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.019815:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7f7 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.019858:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(191 21) 00010000:00010000:3.0:1789429277.019869:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.019876:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(192 21) 00010000:00010000:3.0:1789429277.019883:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 20 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.019936:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.019954:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 20 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.019969:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429277.020054:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634834688:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 289us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.020062:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5370 00000100:00100000:1.0:1789429277.020698:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634834560 00000100:00100000:1.0:1789429277.020708:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634834560 00010000:00010000:1.0:1789429277.020742:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 20 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.020780:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5813 00000100:00100000:1.0:1789429277.020789:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634834560:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.020803:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.020830:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 20 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.020850:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 20 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.020875:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fb9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7e9 expref: 20 pid: 20745 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.020893:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 21) 00010000:00010000:1.0:1789429277.020898:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 21) 00010000:00010000:1.0:1789429277.020908:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.020919:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.020953:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.020969:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 19 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.020986:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648246912:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.021369:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.026401:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.026493:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634834816 00000100:00100000:3.0:1789429277.026507:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634834816 00002000:00100000:3.0:1789429277.026593:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f415c4e00 x1876351634834816/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.026605:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4e00 with x1876351634834816 ext(237568->241663) 00010000:00010000:3.0:1789429277.026617:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 20 pid: 8085 timeout: 1074 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.026637:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.026648:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c4e00 00000100:00100000:3.0:1789429277.026689:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1198 00000100:00100000:3.0:1789429277.026700:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634834816:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429277.026955:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634834816:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 255us (568us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429277.026964:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1198 00002000:00100000:3.0:1789429277.026972:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f415c4e00 x1876351634834816/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.026981:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4e00 with x1876351634834816 ext(237568->241663) 00010000:00010000:3.0:1789429277.026988:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.027001:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.027008:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c4e00 00000100:00080000:2.0:1789429277.027584:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429277.027949:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648246912:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.027982:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.028146:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634834560:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7356us (8630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.028157:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5813 00000100:00100000:0.0:1789429277.031825:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.032011:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.032240:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634835072 00000100:00100000:1.0:1789429277.032255:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634835072 00010000:00010000:1.0:1789429277.032311:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.032370:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5814 00000100:00100000:1.0:1789429277.032382:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634835072:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.032399:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.032429:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.032446:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.032719:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fba5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f0 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.032743:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=1s v=(193 21) 00010000:00010000:1.0:1789429277.032749:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 21) 00010000:00010000:1.0:1789429277.032758:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.032777:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.032829:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.032850:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648247040:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.032952:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.036366:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634834944 00000100:00100000:3.0:1789429277.036387:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634834944 00000100:00100000:1.0:1789429277.037190:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648247040:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.037275:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.037358:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634835072:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4977us (5345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.037370:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5814 00000100:00100000:2.0:1789429277.038890:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5371 00000100:00100000:2.0:1789429277.038907:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634834944:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429277.038934:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429277.038961:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b7fe expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.039010:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.039034:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 21) 00010000:00010000:2.0:1789429277.039039:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 21) 00010000:00010000:2.0:1789429277.039045:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.039116:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.039135:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 18 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.039151:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648247168:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429277.039292:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.043354:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.043497:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634835200 00000100:00100000:3.0:1789429277.043511:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634835200 00010000:00010000:3.0:1789429277.043565:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.043617:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5815 00000100:00100000:3.0:1789429277.043629:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634835200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429277.043648:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429277.043679:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.043696:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.043730:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 21) 00010000:00010000:3.0:1789429277.043735:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 21) 00010000:00010000:3.0:1789429277.043746:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.043758:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.043810:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.043828:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648247296:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429277.043938:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00010000:00010000:2.0:1789429277.044702:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fbac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7f7 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.044724:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648247168:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429277.044757:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.044770:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030400, rc 0) 00000100:00100000:2.0:1789429277.044830:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634834944:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5927us (13020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.044840:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5371 00000100:00100000:3.0:1789429277.049246:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648247296:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.049286:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429277.049358:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634835200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5729us (6017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.049374:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5815 00000100:00100000:0.0:1789429277.051764:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.052090:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634835328 00000100:00100000:2.0:1789429277.052105:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634835328 00000100:00100000:2.0:1789429277.052341:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5372 00000100:00100000:2.0:1789429277.052354:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634835328:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429277.052380:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429277.052406:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b805 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.052454:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.052467:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 21) 00010000:00010000:2.0:1789429277.052473:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 21) 00010000:00010000:2.0:1789429277.052479:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.052521:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.052538:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 19 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.052554:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648247424:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429277.052666:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.055801:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.055903:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634835456 00000100:00100000:1.0:1789429277.055914:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634835456 00010000:00010000:1.0:1789429277.055966:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.056029:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5816 00000100:00100000:1.0:1789429277.056041:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634835456:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.056061:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.056091:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.056114:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.056151:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 21) 00010000:00010000:1.0:1789429277.056157:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 21) 00010000:00010000:1.0:1789429277.056167:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.056345:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.056400:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.056417:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648247552:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.056525:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.059920:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648247552:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.059959:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.060116:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634835456:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4075us (4328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.060129:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5816 00000100:00100000:3.0:1789429277.061306:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.061649:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634835584 00000100:00100000:0.0:1789429277.061659:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634835584 00000100:00100000:0.0:1789429277.061724:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5373 00000100:00100000:0.0:1789429277.061736:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634835584:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.061759:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.061782:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b80c expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.061822:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.061833:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 21) 00010000:00010000:0.0:1789429277.061839:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 21) 00010000:00010000:0.0:1789429277.061845:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.061888:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.061904:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.061921:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648247680:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.062030:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00010000:00010000:2.0:1789429277.063643:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b7fe expref: 21 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.063675:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648247424:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429277.063712:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.063729:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.063743:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031400, rc 0) 00000100:00100000:2.0:1789429277.063816:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634835328:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11465us (12065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.063827:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5372 00000100:00100000:3.0:1789429277.067412:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.067590:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634835712 00000100:00100000:2.0:1789429277.067604:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634835712 00002000:00100000:2.0:1789429277.067674:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946e15185500 x1876351634835712/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.067688:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185500 with x1876351634835712 ext(237568->274431) 00010000:00010000:2.0:1789429277.067699:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.067720:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429277.067730:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15185500 00000100:00100000:2.0:1789429277.067773:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1199 00000100:00100000:2.0:1789429277.067785:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634835712:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429277.071723:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648247680:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429277.071778:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.071806:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:2.0:1789429277.071885:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634835584:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10151us (10585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.071897:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5373 00000100:00100000:2.0:1789429277.074401:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634835712:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6604us (6990us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429277.074417:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1199 00002000:00100000:2.0:1789429277.074432:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946e15185500 x1876351634835712/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.074444:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185500 with x1876351634835712 ext(237568->274431) 00010000:00010000:2.0:1789429277.074457:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.074478:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 19 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429277.074487:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15185500 00000100:00100000:3.0:1789429277.077171:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.077395:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634835840 00000100:00100000:2.0:1789429277.077408:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634835840 00000100:00100000:2.0:1789429277.077487:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5374 00000100:00100000:2.0:1789429277.077500:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634835840:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429277.077524:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429277.077549:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b813 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.077593:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 21) 00010000:00010000:2.0:1789429277.077604:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.077612:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(197 21) 00010000:00010000:2.0:1789429277.077619:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.077674:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.077692:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.077707:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030400, rc 0) 00000100:00100000:2.0:1789429277.077777:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634835840:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 280us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.077785:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5374 00000100:00100000:0.0:1789429277.079999:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.080360:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634835968 00000100:00100000:1.0:1789429277.080372:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634835968 00010000:00010000:1.0:1789429277.080423:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.080660:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5817 00000100:00100000:1.0:1789429277.080673:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634835968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.080694:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.080725:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.080743:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.080773:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b805 expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.080796:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 21) 00010000:00010000:1.0:1789429277.080802:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 21) 00010000:00010000:1.0:1789429277.080813:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.080825:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.080872:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.080894:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 19 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.080912:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648247936:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.081073:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.085566:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648247936:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.085607:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.085741:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634835968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5068us (5754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.085755:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5817 00000100:00100000:0.0:1789429277.086995:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.087120:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634836096 00000100:00100000:2.0:1789429277.087132:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634836096 00002000:00100000:2.0:1789429277.087226:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f119c5c00 x1876351634836096/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.087239:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c5c00 with x1876351634836096 ext(237568->241663) 00010000:00010000:2.0:1789429277.087250:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.087269:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429277.087278:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c5c00 00000100:00100000:2.0:1789429277.087306:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1200 00000100:00100000:2.0:1789429277.087316:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634836096:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429277.087558:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634836096:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 243us (571us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429277.087565:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1200 00002000:00100000:2.0:1789429277.087572:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f119c5c00 x1876351634836096/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.087580:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c5c00 with x1876351634836096 ext(237568->241663) 00010000:00010000:2.0:1789429277.087585:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.087596:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429277.087603:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c5c00 00000100:00100000:1.0:1789429277.092657:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.092814:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.093437:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634836352 00000100:00100000:0.0:1789429277.093452:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634836352 00010000:00010000:0.0:1789429277.093727:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.093785:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5818 00000100:00100000:0.0:1789429277.093797:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634836352:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429277.093816:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429277.093847:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.093866:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.093901:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fbc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b80c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.093927:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 21) 00010000:00010000:0.0:1789429277.093933:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 21) 00010000:00010000:0.0:1789429277.093945:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.093960:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.094015:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.094049:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648248064:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429277.094332:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.094639:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634836224 00000100:00100000:2.0:1789429277.094647:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634836224 00000100:00100000:2.0:1789429277.094700:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5375 00000100:00100000:2.0:1789429277.094710:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634836224:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429277.094727:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429277.094747:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b81a expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.094775:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.094783:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 21) 00010000:00010000:2.0:1789429277.094787:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 21) 00010000:00010000:2.0:1789429277.094792:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 21 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.094820:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.094836:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 18 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.094847:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648248192:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429277.094889:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0839c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.099779:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.099986:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648248192:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.100093:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 21 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.100113:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648248064:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.100125:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031400, rc 0) 00010000:00010000:2.0:1789429277.100147:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.100246:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634836352:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6449us (7431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.102221:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634836224:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7462us (9525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.102239:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5375 00000100:00100000:3.0:1789429277.102302:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634836480 00000100:00100000:3.0:1789429277.102323:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634836480 00010000:00010000:3.0:1789429277.102372:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.104603:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5818 00000100:00100000:3.0:1789429277.104745:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5819 00000100:00100000:3.0:1789429277.104774:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634836480:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429277.104801:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429277.104838:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.104860:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.104893:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fbc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b813 expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.104917:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 21) 00010000:00010000:3.0:1789429277.104922:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 21) 00010000:00010000:3.0:1789429277.104932:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.104945:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.105002:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.105031:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648248320:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429277.105146:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.107810:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648248320:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429277.107854:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429277.107933:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634836480:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3169us (8168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.107945:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5819 00000100:00100000:0.0:1789429277.111562:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.111651:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634836608 00000100:00100000:3.0:1789429277.111664:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634836608 00000100:00100000:3.0:1789429277.111738:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5376 00000100:00100000:3.0:1789429277.111748:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634836608:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.111773:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.111797:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b821 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.111845:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.111856:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 21) 00010000:00010000:3.0:1789429277.111862:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 21) 00010000:00010000:3.0:1789429277.111869:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.111911:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.111927:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 19 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.111944:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648248448:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429277.112052:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.116280:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.116347:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634836736 00000100:00100000:2.0:1789429277.116362:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634836736 00010000:00010000:2.0:1789429277.116422:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.116526:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5820 00000100:00100000:2.0:1789429277.116539:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634836736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.116557:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.116584:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.116592:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648248448:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429277.116618:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.116647:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b81a expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.117965:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.117998:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 21) 00010000:00010000:3.0:1789429277.118004:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 21) 00010000:00010000:3.0:1789429277.118084:0:6682:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.118105:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.118169:0:6682:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.118306:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429277.118327:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648248576:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.118514:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634836736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1972us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.118527:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5820 00000100:00100000:3.0:1789429277.118580:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.126538:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648248576:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.126575:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:3.0:1789429277.126775:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634836608:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 15026us (15225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.126786:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5376 00000100:00100000:1.0:1789429277.127646:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.127753:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634836864 00000100:00100000:2.0:1789429277.127771:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634836864 00000100:00100000:2.0:1789429277.127856:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5377 00000100:00100000:2.0:1789429277.127868:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634836864:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429277.127886:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429277.127905:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b828 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.127938:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.127947:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 21) 00010000:00010000:2.0:1789429277.127951:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 21) 00010000:00010000:2.0:1789429277.127957:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.127991:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.128006:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 18 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.128021:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648248704:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429277.128107:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.133847:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.133971:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634836992 00000100:00100000:2.0:1789429277.133987:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634836992 00002000:00100000:2.0:1789429277.134048:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f119d7800 x1876351634836992/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.134061:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d7800 with x1876351634836992 ext(237568->274431) 00010000:00010000:2.0:1789429277.134071:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.134091:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429277.134099:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d7800 00000100:00100000:2.0:1789429277.134145:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1201 00000100:00100000:2.0:1789429277.134157:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634836992:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.134264:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648248704:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.134314:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.134340:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031400, rc 0) 00000100:00100000:0.0:1789429277.134407:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634836864:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6540us (6764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.134417:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5377 00000100:00100000:2.0:1789429277.140420:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634836992:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6247us (6570us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429277.140437:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1201 00002000:00100000:2.0:1789429277.140454:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f119d7800 x1876351634836992/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.140466:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d7800 with x1876351634836992 ext(237568->274431) 00010000:00010000:2.0:1789429277.140478:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.140499:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429277.140508:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d7800 00000100:00100000:1.0:1789429277.148688:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.148883:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.149305:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634837248 00000100:00100000:2.0:1789429277.149320:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634837248 00010000:00010000:2.0:1789429277.149378:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.149438:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5821 00000100:00100000:2.0:1789429277.149449:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634837248:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.149639:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.149670:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.149688:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.149719:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fbd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b821 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.149740:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 21) 00010000:00010000:2.0:1789429277.149746:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 21) 00010000:00010000:2.0:1789429277.149756:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.149766:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.149814:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.149836:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648248832:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.150040:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.151633:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634837120 00000100:00100000:0.0:1789429277.151648:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634837120 00000100:00100000:0.0:1789429277.151776:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5378 00000100:00100000:0.0:1789429277.151787:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634837120:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.151811:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.151835:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b82f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.151873:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.151885:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 21) 00010000:00010000:0.0:1789429277.151890:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 21) 00010000:00010000:0.0:1789429277.151896:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.151937:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.151952:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 19 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.151967:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648248960:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.152065:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.162971:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.163357:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634837376 00000100:00100000:0.0:1789429277.163371:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634837376 00002000:00100000:0.0:1789429277.163442:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f119d4e00 x1876351634837376/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.163456:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d4e00 with x1876351634837376 ext(237568->241663) 00010000:00010000:0.0:1789429277.163466:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.163487:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.163495:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d4e00 00000100:00100000:0.0:1789429277.163532:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1202 00000100:00100000:0.0:1789429277.163543:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634837376:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.163793:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634837376:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 250us (835us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429277.163802:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1202 00002000:00100000:0.0:1789429277.163811:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f119d4e00 x1876351634837376/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.163820:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d4e00 with x1876351634837376 ext(237568->241663) 00010000:00010000:0.0:1789429277.163826:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.163839:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.163854:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d4e00 00000100:00100000:0.0:1789429277.163922:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648248960:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.163954:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.163975:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429277.164002:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634837120:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 12218us (15332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.164011:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5378 00000100:00100000:3.0:1789429277.167033:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648248832:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.167069:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429277.167163:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634837248:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 17714us (18278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.171522:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5821 00000100:00100000:3.0:1789429277.174817:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.174919:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634837504 00000100:00100000:2.0:1789429277.174932:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634837504 00000100:00100000:2.0:1789429277.175006:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5379 00000100:00100000:2.0:1789429277.175028:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634837504:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429277.175054:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429277.175078:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b836 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.175119:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 21) 00010000:00010000:2.0:1789429277.175128:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.175135:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(203 21) 00010000:00010000:2.0:1789429277.175140:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 21 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.175250:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.175266:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 21 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.175286:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031000, rc 0) 00000100:00100000:2.0:1789429277.175366:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634837504:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 349us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.175373:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5379 00000100:00100000:2.0:1789429277.178126:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.178274:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634837632 00000100:00100000:1.0:1789429277.178288:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634837632 00010000:00010000:1.0:1789429277.178337:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.178403:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5822 00000100:00100000:1.0:1789429277.178417:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2368:x1876351634837632:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.178435:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.178466:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.178484:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.178516:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fbdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b828 expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.178541:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(204 21) 00010000:00010000:1.0:1789429277.178547:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(204 21) 00010000:00010000:1.0:1789429277.178558:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.178569:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.178621:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.178637:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 18 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.178662:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648249216:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.178772:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538480 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.182894:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.182980:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634837760 00000100:00100000:3.0:1789429277.182994:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634837760 00010000:00010000:3.0:1789429277.183062:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.183136:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5823 00000100:00100000:3.0:1789429277.183146:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2368:x1876351634837760:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429277.183167:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429277.183502:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.183521:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.183556:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(204 21) 00010000:00010000:3.0:1789429277.183562:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(204 21) 00010000:00010000:3.0:1789429277.183572:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.183584:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.183632:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.183650:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648249344:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429277.183793:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00010000:00010000:1.0:1789429277.184620:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fbe4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b82f expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.184645:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648249216:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.184682:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.184730:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351634837632:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6316us (6615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.184741:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5822 00000100:00100000:3.0:1789429277.188774:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648249344:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.188810:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429277.188926:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2368:x1876351634837760:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5779us (6045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.188939:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5823 00000100:00100000:2.0:1789429277.194811:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.194939:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634837888 00000100:00100000:3.0:1789429277.194953:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634837888 00000100:00100000:3.0:1789429277.195118:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5380 00000100:00100000:3.0:1789429277.195133:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634837888:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.195158:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.195287:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b83d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.195335:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.195348:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(204 21) 00010000:00010000:3.0:1789429277.195353:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 21) 00010000:00010000:3.0:1789429277.195360:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.195404:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.195435:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 19 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.195459:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648249472:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429277.195570:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.199004:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.199132:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648249472:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.199176:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.199496:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429277.199567:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634837888:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4438us (4770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.199579:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5380 00000100:00100000:2.0:1789429277.200526:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634838016 00000100:00100000:2.0:1789429277.200540:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634838016 00010000:00010000:2.0:1789429277.200591:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.200640:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5824 00000100:00100000:2.0:1789429277.200651:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08229180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634838016:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.200669:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.200699:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.200713:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.200742:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b66b031/0xb4c3dad72635fbeb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b836 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.200762:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 21) 00010000:00010000:2.0:1789429277.200769:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 21) 00010000:00010000:2.0:1789429277.200779:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.200791:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.200840:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.200857:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648249600:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.200960:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.202941:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.206851:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634838144 00000100:00100000:3.0:1789429277.206871:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634838144 00000100:00100000:3.0:1789429277.206951:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5381 00000100:00100000:3.0:1789429277.206964:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634838144:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.206987:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.207012:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b844 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.207329:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.207340:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 21) 00010000:00010000:3.0:1789429277.207346:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 21) 00010000:00010000:3.0:1789429277.207351:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.207395:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.207411:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 18 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.207428:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648249728:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429277.207603:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648249600:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.207625:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429277.207822:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.210152:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08229180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634838016:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9486us (11147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.210172:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5824 00000100:00100000:2.0:1789429277.210357:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.210708:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648249728:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429277.210750:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.210777:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429277.211426:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634838272 00000100:00100000:3.0:1789429277.211439:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634838272 00002000:00100000:3.0:1789429277.211505:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f415c4380 x1876351634838272/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.211517:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4380 with x1876351634838272 ext(237568->274431) 00010000:00010000:3.0:1789429277.211527:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.211545:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.211553:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c4380 00000100:00100000:3.0:1789429277.211608:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1203 00000100:00100000:3.0:1789429277.211619:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634838272:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429277.213321:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634838144:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6343us (10376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.213341:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5381 00000100:00100000:1.0:1789429277.220888:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634838272:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 9252us (10514us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429277.220906:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1203 00002000:00100000:1.0:1789429277.220923:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f415c4380 x1876351634838272/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.220936:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4380 with x1876351634838272 ext(237568->274431) 00010000:00010000:1.0:1789429277.220949:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.220974:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.220984:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c4380 00000100:00100000:3.0:1789429277.224389:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.224673:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.225336:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634838528 00000100:00100000:1.0:1789429277.225353:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634838528 00010000:00010000:1.0:1789429277.225409:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.225476:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5825 00000100:00100000:1.0:1789429277.225489:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634838528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.225512:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.225543:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.225567:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.225600:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fbf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b83d expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.225622:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 21) 00010000:00010000:1.0:1789429277.225628:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 21) 00010000:00010000:1.0:1789429277.225639:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.225650:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.225699:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.225718:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648249856:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.225837:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538480 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.228857:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648249856:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.228895:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.228956:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634838528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3468us (4282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.228972:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5825 00000100:00100000:0.0:1789429277.229901:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634838400 00000100:00100000:0.0:1789429277.229913:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634838400 00000100:00100000:0.0:1789429277.229972:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5382 00000100:00100000:0.0:1789429277.229982:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634838400:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.230005:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.230041:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b84b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.230081:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.230093:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 21) 00010000:00010000:0.0:1789429277.230098:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(207 21) 00010000:00010000:0.0:1789429277.230104:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.230147:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.230163:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 19 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.230190:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648249984:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.230307:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.235012:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.235300:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634838656 00000100:00100000:3.0:1789429277.235315:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634838656 00002000:00100000:3.0:1789429277.235381:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f415c5880 x1876351634838656/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.235395:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c5880 with x1876351634838656 ext(237568->241663) 00010000:00010000:3.0:1789429277.235407:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.235428:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.235438:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c5880 00000100:00100000:3.0:1789429277.235478:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1204 00000100:00100000:3.0:1789429277.235490:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634838656:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429277.235749:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634838656:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 260us (751us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429277.235759:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1204 00002000:00100000:3.0:1789429277.235768:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f415c5880 x1876351634838656/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.235777:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c5880 with x1876351634838656 ext(237568->241663) 00010000:00010000:3.0:1789429277.235783:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.235801:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.235809:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c5880 00000100:00100000:0.0:1789429277.238587:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648249984:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.238640:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.238668:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429277.238751:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634838400:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8768us (14375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.238762:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5382 00000100:00100000:2.0:1789429277.241770:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.241818:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.241919:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634838912 00000100:00100000:1.0:1789429277.241932:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634838912 00010000:00010000:1.0:1789429277.241983:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.242043:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5826 00000100:00100000:1.0:1789429277.242055:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634838912:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.242074:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.242104:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.242120:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.242151:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fbf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b844 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.242174:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(207 21) 00010000:00010000:1.0:1789429277.242179:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(207 21) 00010000:00010000:1.0:1789429277.242264:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.242276:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.242330:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.242349:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648250112:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.242448:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.242837:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634838784 00000100:00100000:3.0:1789429277.242844:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634838784 00000100:00100000:3.0:1789429277.242893:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5383 00000100:00100000:3.0:1789429277.242901:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634838784:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.242918:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.242937:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b852 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.242962:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.242972:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(207 21) 00010000:00010000:3.0:1789429277.242976:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 21) 00010000:00010000:3.0:1789429277.242981:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 21 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.243007:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.243032:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 18 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.243045:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648250240:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429277.243082:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.251653:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.251778:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648250240:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.251824:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 21 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.251855:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:1.0:1789429277.252424:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648250112:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.252444:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429277.252901:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634838784:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9997us (11143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.252913:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5383 00000100:00100000:3.0:1789429277.252980:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634839040 00000100:00100000:3.0:1789429277.252989:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634839040 00010000:00010000:3.0:1789429277.253034:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.253075:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5827 00000100:00100000:3.0:1789429277.253086:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634839040:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429277.253102:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429277.253132:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.253149:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.253221:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b84b expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.253242:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 21) 00010000:00010000:3.0:1789429277.253247:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 21) 00010000:00010000:3.0:1789429277.253257:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.253270:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.253316:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.253334:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648250368:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.253587:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634838912:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11533us (11767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.253597:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5826 00000100:00100000:1.0:1789429277.255227:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.259606:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.259781:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648250368:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.259814:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.259931:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634839040:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6845us (8291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.259944:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5827 00000100:00100000:3.0:1789429277.260048:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634839168 00000100:00100000:3.0:1789429277.260057:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634839168 00000100:00100000:3.0:1789429277.260114:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5384 00000100:00100000:3.0:1789429277.260126:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634839168:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.260149:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.260171:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b859 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.260250:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.260263:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 21) 00010000:00010000:3.0:1789429277.260269:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 21) 00010000:00010000:3.0:1789429277.260275:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.260320:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.260338:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 19 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.260356:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648250496:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429277.260428:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.263616:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648250496:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.263665:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.263694:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429277.263868:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634839168:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3743us (4274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.263879:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5384 00000100:00100000:0.0:1789429277.264626:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.264740:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634839296 00000100:00100000:1.0:1789429277.264750:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634839296 00010000:00010000:1.0:1789429277.264791:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.264832:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5828 00000100:00100000:1.0:1789429277.264842:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634839296:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.264864:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.264892:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.264908:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.264938:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b852 expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.264958:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 21) 00010000:00010000:1.0:1789429277.264962:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 21) 00010000:00010000:1.0:1789429277.264971:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.264983:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.265041:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.265058:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648250624:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.265136:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.270582:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.270618:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.270840:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648250624:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.270876:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.270956:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634839296:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6112us (6332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.270970:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5828 00000100:00100000:0.0:1789429277.271230:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634839552 00000100:00100000:0.0:1789429277.271241:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634839552 00000100:00100000:0.0:1789429277.271305:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5385 00000100:00100000:0.0:1789429277.271317:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634839552:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.271340:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.271366:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b860 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.271407:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.271420:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 21) 00010000:00010000:0.0:1789429277.271426:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(210 21) 00010000:00010000:0.0:1789429277.271432:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.271486:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.271503:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 18 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.271521:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648250752:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.271594:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.271910:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634839424 00000100:00100000:3.0:1789429277.271917:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634839424 00002000:00100000:3.0:1789429277.271965:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f119d5500 x1876351634839424/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.271977:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d5500 with x1876351634839424 ext(237568->274431) 00010000:00010000:3.0:1789429277.271985:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.272002:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.272011:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d5500 00000100:00100000:3.0:1789429277.272052:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1205 00000100:00100000:3.0:1789429277.272060:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634839424:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.277395:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648250752:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.277449:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.277477:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429277.277542:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634839552:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6226us (6921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.277557:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5385 00000100:00100000:3.0:1789429277.277751:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634839424:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5690us (7183us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429277.277762:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1205 00002000:00100000:3.0:1789429277.277775:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f119d5500 x1876351634839424/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.277785:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119d5500 with x1876351634839424 ext(237568->274431) 00010000:00010000:3.0:1789429277.277796:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.277812:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.277827:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119d5500 00000100:00100000:1.0:1789429277.282002:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.282086:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.282250:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634839808 00000100:00100000:0.0:1789429277.282265:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634839808 00000100:00100000:0.0:1789429277.282340:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5386 00000100:00100000:0.0:1789429277.282352:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634839808:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.282376:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.282402:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b867 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.282445:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(210 21) 00010000:00010000:0.0:1789429277.282456:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.282463:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(211 21) 00010000:00010000:0.0:1789429277.282469:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.282524:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.282545:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.282560:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429277.282638:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634839808:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 288us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.282646:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5386 00000100:00100000:2.0:1789429277.283842:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634839680 00000100:00100000:2.0:1789429277.283854:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634839680 00010000:00010000:2.0:1789429277.283897:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 20 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.283948:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5829 00000100:00100000:2.0:1789429277.283959:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634839680:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.283974:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.284004:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 20 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.284030:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 20 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.284058:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b859 expref: 20 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.284079:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(212 21) 00010000:00010000:2.0:1789429277.284084:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(212 21) 00010000:00010000:2.0:1789429277.284094:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.284106:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.284149:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.284171:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 19 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.284187:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648251008:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.284368:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083300 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.288299:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.288474:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648251008:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.288507:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.288582:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634839680:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4624us (6596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.288596:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5829 00000100:00100000:3.0:1789429277.288724:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634839936 00000100:00100000:3.0:1789429277.288734:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634839936 00002000:00100000:3.0:1789429277.288790:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f34078000 x1876351634839936/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.288802:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34078000 with x1876351634839936 ext(237568->241663) 00010000:00010000:3.0:1789429277.288812:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.288830:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.288837:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34078000 00000100:00100000:3.0:1789429277.288860:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1206 00000100:00100000:3.0:1789429277.288870:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634839936:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429277.289097:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634839936:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 227us (815us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429277.289105:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1206 00002000:00100000:3.0:1789429277.289111:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f34078000 x1876351634839936/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.289120:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34078000 with x1876351634839936 ext(237568->241663) 00010000:00010000:3.0:1789429277.289126:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.289140:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.289147:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34078000 00000100:00100000:1.0:1789429277.293531:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.293581:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.293684:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634840064 00000100:00100000:3.0:1789429277.293697:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634840064 00000100:00100000:3.0:1789429277.293768:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5387 00000100:00100000:3.0:1789429277.293779:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634840064:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.293803:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.293828:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b86e expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.293871:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(212 21) 00010000:00010000:3.0:1789429277.293880:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.293888:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(213 21) 00010000:00010000:3.0:1789429277.293895:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 21 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.293946:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.293963:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 21 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.293984:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429277.294055:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634840064:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 278us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.294062:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5387 00000100:00100000:2.0:1789429277.294891:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634840192 00000100:00100000:2.0:1789429277.294903:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634840192 00010000:00010000:2.0:1789429277.294941:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.295030:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5830 00000100:00100000:2.0:1789429277.295041:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634840192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.295055:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.295086:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.295102:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.295136:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b860 expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.295155:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 21) 00010000:00010000:2.0:1789429277.295160:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 21) 00010000:00010000:2.0:1789429277.295169:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.295239:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.295283:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.295298:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 18 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.295315:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648251264:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.295414:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.299788:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648251264:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.299823:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.299895:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634840192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4854us (6311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.299912:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5830 00000100:00100000:0.0:1789429277.303435:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.303684:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634840320 00000100:00100000:1.0:1789429277.303697:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634840320 00010000:00010000:1.0:1789429277.303751:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.303853:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5831 00000100:00100000:1.0:1789429277.303865:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634840320:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.303884:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.303915:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.303932:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.303964:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b867 expref: 19 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.303985:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 21) 00010000:00010000:1.0:1789429277.303990:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 21) 00010000:00010000:1.0:1789429277.304001:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.304030:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.304079:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.304096:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34078380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648251392:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.304298:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.307036:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34078380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648251392:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.307073:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.307150:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634840320:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3287us (3729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.307164:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5831 00000100:00100000:3.0:1789429277.314728:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.314924:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634840448 00000100:00100000:0.0:1789429277.314937:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634840448 00000100:00100000:0.0:1789429277.315075:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5388 00000100:00100000:0.0:1789429277.315089:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634840448:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.315113:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.315136:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b875 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.315182:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.315255:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 21) 00010000:00010000:0.0:1789429277.315260:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(215 21) 00010000:00010000:0.0:1789429277.315267:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.315312:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.315329:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 19 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.315346:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648251520:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.315445:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.318091:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648251520:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.318136:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.318163:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:3.0:1789429277.318304:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634840448:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3217us (3591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.318315:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5388 00000100:00100000:1.0:1789429277.320133:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.321523:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634840576 00000100:00100000:2.0:1789429277.321541:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634840576 00010000:00010000:2.0:1789429277.321606:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.321666:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5832 00000100:00100000:2.0:1789429277.321679:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634840576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.321700:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.321730:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.321747:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.321779:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b86e expref: 20 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.321801:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(215 21) 00010000:00010000:2.0:1789429277.321808:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(215 21) 00010000:00010000:2.0:1789429277.321818:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.321830:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.321880:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.321897:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648251648:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.322013:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.326124:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.326345:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.326424:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634840832 00000100:00100000:3.0:1789429277.326437:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634840832 00002000:00100000:3.0:1789429277.326502:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f415c4000 x1876351634840832/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.326515:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4000 with x1876351634840832 ext(237568->274431) 00002000:00010000:3.0:1789429277.326523:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f415c4000 00000100:00100000:3.0:1789429277.326562:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11350 00000100:00100000:3.0:1789429277.326573:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634840832:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429277.327642:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648251648:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.327675:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.327775:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634840576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6097us (7650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.327788:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5832 00000100:00100000:0.0:1789429277.327933:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634840704 00000100:00100000:0.0:1789429277.327940:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634840704 00000100:00100000:0.0:1789429277.327987:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5389 00000100:00100000:0.0:1789429277.327997:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634840704:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.328024:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.328048:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b87c expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.328087:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 20 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.328099:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(215 21) 00010000:00010000:0.0:1789429277.328104:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 21) 00010000:00010000:0.0:1789429277.328111:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.328153:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 20 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.328170:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 20 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.328218:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648251776:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.328282:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.332962:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648251776:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.333016:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.333058:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:0.0:1789429277.333134:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634840704:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5136us (7022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.333146:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5389 00000100:00100000:0.0:1789429277.337805:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634840832:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 11216us (11443us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429277.337823:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11350 00002000:00100000:0.0:1789429277.337838:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f415c4000 x1876351634840832/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.337849:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4000 with x1876351634840832 ext(237568->274431) 00010000:00010000:0.0:1789429277.337862:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.337883:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.337892:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c4000 00000100:00100000:2.0:1789429277.341355:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.341533:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.341882:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634841088 00000100:00100000:1.0:1789429277.341895:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634841088 00010000:00010000:1.0:1789429277.341951:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.342003:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5833 00000100:00100000:1.0:1789429277.342025:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634841088:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.342046:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.342077:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.342094:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.342125:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fc2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b875 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.342148:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 21) 00010000:00010000:1.0:1789429277.342154:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 21) 00010000:00010000:1.0:1789429277.342164:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.342182:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.342396:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.342416:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3407ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648251904:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.342534:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.345082:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634840960 00000100:00100000:0.0:1789429277.345103:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634840960 00000100:00100000:0.0:1789429277.345357:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5390 00000100:00100000:0.0:1789429277.345371:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634840960:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.345394:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.345419:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b883 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.345473:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.345484:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 21) 00010000:00010000:0.0:1789429277.345489:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(217 21) 00010000:00010000:0.0:1789429277.345495:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.345534:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.345550:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 19 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.345566:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648252032:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.345675:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.348655:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.348961:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648252032:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.349007:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.349046:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc 0) 00000100:00100000:0.0:1789429277.349123:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634840960:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3754us (7784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.349137:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5390 00000100:00100000:3.0:1789429277.350276:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634841216 00000100:00100000:3.0:1789429277.350291:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634841216 00002000:00100000:3.0:1789429277.350359:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f34078380 x1876351634841216/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.350373:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34078380 with x1876351634841216 ext(237568->241663) 00010000:00010000:3.0:1789429277.350382:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.350407:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.350417:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34078380 00000100:00100000:3.0:1789429277.350458:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1207 00000100:00100000:3.0:1789429277.350468:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634841216:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429277.350729:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634841216:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 261us (2086us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429277.350737:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1207 00002000:00100000:3.0:1789429277.350745:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f34078380 x1876351634841216/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.350754:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34078380 with x1876351634841216 ext(237568->241663) 00010000:00010000:3.0:1789429277.350760:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.350773:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.350787:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34078380 00000100:00100000:1.0:1789429277.354135:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.354313:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634841344 00000100:00100000:0.0:1789429277.354327:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634841344 00000100:00100000:0.0:1789429277.354408:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5391 00000100:00100000:0.0:1789429277.354421:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634841344:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.354443:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.354478:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b88a expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.354525:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(217 21) 00010000:00010000:0.0:1789429277.354535:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.354543:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(218 21) 00010000:00010000:0.0:1789429277.354549:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 21 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.354603:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.354620:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 21 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.354634:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429277.354704:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634841344:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 285us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.354712:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5391 00000100:00100000:1.0:1789429277.356583:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.356867:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634841472 00000100:00100000:0.0:1789429277.356877:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634841472 00010000:00010000:0.0:1789429277.356925:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.356970:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5834 00000100:00100000:0.0:1789429277.356983:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634841472:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429277.357002:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429277.357096:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.357114:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.357147:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 21) 00010000:00010000:0.0:1789429277.357153:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 21) 00010000:00010000:0.0:1789429277.357165:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.357420:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.357648:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.357673:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.357690:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648252288:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429277.357836:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00010000:00010000:2.0:1789429277.357963:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fc31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b87c expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.357982:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3407ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648251904:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.358006:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429277.358099:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634841088:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 16085us (16565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.358109:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5833 00000100:00100000:0.0:1789429277.362012:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648252288:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429277.362059:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429277.362133:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634841472:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5152us (5562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.362149:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5834 00000100:00100000:1.0:1789429277.364315:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.364443:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634841600 00000100:00100000:2.0:1789429277.364469:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634841600 00010000:00010000:2.0:1789429277.364526:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.364583:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5835 00000100:00100000:2.0:1789429277.364595:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2368:x1876351634841600:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.364615:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.364647:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.364663:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.364695:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fc38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b883 expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.364716:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 21) 00010000:00010000:2.0:1789429277.364721:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 21) 00010000:00010000:2.0:1789429277.364733:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.364744:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.364794:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.364819:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648252416:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.364938:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.368917:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648252416:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.368952:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.369033:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2368:x1876351634841600:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4438us (4730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.369047:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5835 00000100:00100000:3.0:1789429277.373720:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.373852:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634841728 00000100:00100000:0.0:1789429277.373868:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634841728 00000100:00100000:0.0:1789429277.373951:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5392 00000100:00100000:0.0:1789429277.373964:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634841728:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.373990:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.374028:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b891 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.374075:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.374092:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 21) 00010000:00010000:0.0:1789429277.374097:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(220 21) 00010000:00010000:0.0:1789429277.374103:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.374150:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.374165:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 19 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.374180:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648252544:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.374341:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.377397:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.377514:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634841856 00000100:00100000:2.0:1789429277.377527:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634841856 00010000:00010000:2.0:1789429277.377580:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.377636:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5836 00000100:00100000:2.0:1789429277.377649:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634841856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.377668:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.377696:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.377713:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.377747:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(220 21) 00010000:00010000:2.0:1789429277.377753:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(220 21) 00010000:00010000:2.0:1789429277.377763:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.377775:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.377822:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.377837:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648252672:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.377934:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083300 going to sleep for 11 seconds 00010000:00010000:0.0:1789429277.378555:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b88a expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.378574:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648252544:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.378606:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.378618:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429277.378679:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634841728:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4717us (4972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.378694:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5392 00000100:00100000:1.0:1789429277.381016:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.381111:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634841984 00000100:00100000:0.0:1789429277.381123:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634841984 00000100:00100000:0.0:1789429277.381240:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5393 00000100:00100000:0.0:1789429277.381253:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634841984:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.381274:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.381297:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b898 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.381339:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.381352:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(220 21) 00010000:00010000:0.0:1789429277.381357:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 21) 00010000:00010000:0.0:1789429277.381363:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.381405:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.381422:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 18 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.381437:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648252800:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.381545:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.385566:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648252800:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.385615:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.385643:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:0.0:1789429277.385721:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634841984:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4470us (4716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.385731:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5393 00000100:00100000:2.0:1789429277.386605:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648252672:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.386626:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.386683:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634841856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9037us (9299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.386695:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5836 00000100:00100000:1.0:1789429277.388164:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.389651:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634842112 00000100:00100000:3.0:1789429277.389670:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634842112 00002000:00100000:3.0:1789429277.389743:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f054d5880 x1876351634842112/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.389758:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d5880 with x1876351634842112 ext(237568->274431) 00010000:00010000:3.0:1789429277.389768:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.389792:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.389803:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d5880 00000100:00100000:3.0:1789429277.389852:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1208 00000100:00100000:3.0:1789429277.389864:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634842112:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.397641:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634842112:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7762us (9469us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429277.397658:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1208 00002000:00100000:0.0:1789429277.397675:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f054d5880 x1876351634842112/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.397687:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d5880 with x1876351634842112 ext(237568->274431) 00010000:00010000:0.0:1789429277.397700:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.397723:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.397733:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d5880 00000100:00100000:2.0:1789429277.401893:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.402051:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.402342:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634842368 00000100:00100000:0.0:1789429277.402356:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634842368 00000100:00100000:0.0:1789429277.402432:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5394 00000100:00100000:0.0:1789429277.402444:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634842368:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.402479:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.402505:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b89f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.402546:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 21) 00010000:00010000:0.0:1789429277.402556:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.402563:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(222 21) 00010000:00010000:0.0:1789429277.402569:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.402620:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.402641:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.402658:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429277.402731:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634842368:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 289us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.402739:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5394 00000100:00100000:1.0:1789429277.404151:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634842240 00000100:00100000:1.0:1789429277.404166:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634842240 00010000:00010000:1.0:1789429277.404308:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 20 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.404411:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5837 00000100:00100000:1.0:1789429277.404422:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634842240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.404439:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.404480:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 20 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.404495:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 20 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.404525:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fc46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b891 expref: 20 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.404546:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(223 21) 00010000:00010000:1.0:1789429277.404552:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(223 21) 00010000:00010000:1.0:1789429277.404562:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.404574:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.404628:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.404644:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 19 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.404661:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e10309180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648253056:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.404770:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.408945:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.409251:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634842496 00000100:00100000:0.0:1789429277.409265:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634842496 00002000:00100000:0.0:1789429277.409329:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f34022a00 x1876351634842496/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.409350:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34022a00 with x1876351634842496 ext(237568->241663) 00010000:00010000:0.0:1789429277.409360:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.409381:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.409389:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34022a00 00000100:00100000:0.0:1789429277.409429:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1209 00000100:00100000:0.0:1789429277.409440:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634842496:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.409748:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634842496:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 308us (819us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429277.409757:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1209 00002000:00100000:0.0:1789429277.409765:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f34022a00 x1876351634842496/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.409774:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34022a00 with x1876351634842496 ext(237568->241663) 00010000:00010000:0.0:1789429277.409780:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.409792:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.409800:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34022a00 00000100:00100000:1.0:1789429277.410397:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e10309180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648253056:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.410432:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.410643:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634842240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6221us (8762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.410655:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5837 00000100:00100000:2.0:1789429277.414693:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.414742:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.414858:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634842752 00000100:00100000:0.0:1789429277.414873:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634842752 00010000:00010000:0.0:1789429277.414929:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.414981:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5838 00000100:00100000:0.0:1789429277.414992:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634842752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429277.415010:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429277.415051:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.415067:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.415098:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b898 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.415121:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(223 21) 00010000:00010000:0.0:1789429277.415126:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(223 21) 00010000:00010000:0.0:1789429277.415137:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.415151:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.415274:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.415293:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648253184:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429277.415394:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.415723:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634842624 00000100:00100000:3.0:1789429277.415731:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634842624 00000100:00100000:3.0:1789429277.415786:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5395 00000100:00100000:3.0:1789429277.415794:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634842624:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.415813:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.415831:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8a6 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.415864:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.415873:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(223 21) 00010000:00010000:3.0:1789429277.415876:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 21) 00010000:00010000:3.0:1789429277.415881:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 21 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.415907:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.415920:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 18 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.415930:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648253312:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429277.415981:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.419615:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648253184:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429277.419653:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429277.419735:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634842752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4743us (4989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.419749:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5838 00000100:00100000:3.0:1789429277.420302:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648253312:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.420335:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.420365:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5a00, rc 0) 00000100:00100000:3.0:1789429277.420416:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634842624:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4622us (5740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.420430:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5395 00000100:00100000:2.0:1789429277.424061:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.424158:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634842880 00000100:00100000:1.0:1789429277.424172:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634842880 00010000:00010000:1.0:1789429277.424277:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.424322:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5839 00000100:00100000:1.0:1789429277.424333:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2369:x1876351634842880:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.424353:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.424384:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.424407:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.424439:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fc54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b89f expref: 19 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.424462:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 21) 00010000:00010000:1.0:1789429277.424468:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 21) 00010000:00010000:1.0:1789429277.424478:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.424489:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.424537:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.424556:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e10309180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648253440:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.424659:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.427936:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e10309180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648253440:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.427976:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.428060:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2369:x1876351634842880:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3726us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.428076:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5839 00000100:00100000:0.0:1789429277.436260:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.436424:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634843008 00000100:00100000:3.0:1789429277.436438:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634843008 00000100:00100000:3.0:1789429277.436513:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5396 00000100:00100000:3.0:1789429277.436527:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634843008:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.436556:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.436586:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8ad expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.436634:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.436647:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 21) 00010000:00010000:3.0:1789429277.436652:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(225 21) 00010000:00010000:3.0:1789429277.436658:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.436707:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.436724:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 19 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.436741:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648253568:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429277.436859:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.440491:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.440978:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648253568:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.441036:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.441067:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429277.441144:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634843008:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4618us (4960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.441154:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5396 00000100:00100000:1.0:1789429277.442538:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634843136 00000100:00100000:1.0:1789429277.442557:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634843136 00002000:00100000:1.0:1789429277.442631:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f119c5500 x1876351634843136/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.442646:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c5500 with x1876351634843136 ext(237568->241663) 00010000:00010000:1.0:1789429277.442657:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.442676:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.442685:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c5500 00000100:00100000:1.0:1789429277.442779:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1210 00000100:00100000:1.0:1789429277.442791:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634843136:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429277.443082:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634843136:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 292us (2605us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429277.443090:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1210 00002000:00100000:1.0:1789429277.443098:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f119c5500 x1876351634843136/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.443106:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c5500 with x1876351634843136 ext(237568->241663) 00010000:00010000:1.0:1789429277.443112:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.443123:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.443131:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c5500 00000100:00100000:0.0:1789429277.449895:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.449952:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.450091:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634843264 00000100:00100000:3.0:1789429277.450104:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634843264 00000100:00100000:3.0:1789429277.450172:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5397 00000100:00100000:3.0:1789429277.450184:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634843264:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.450245:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.450272:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8b4 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.450316:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(225 21) 00010000:00010000:3.0:1789429277.450325:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.450333:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 21) 00010000:00010000:3.0:1789429277.450339:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.450392:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.450416:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.450431:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429277.450665:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634843264:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 483us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.450674:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5397 00000100:00100000:3.0:1789429277.452822:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634843392 00000100:00100000:3.0:1789429277.452844:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634843392 00010000:00010000:3.0:1789429277.452899:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 21 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.452989:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5840 00000100:00100000:3.0:1789429277.453001:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634843392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429277.453028:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429277.453087:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 21 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.453106:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 21 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.453142:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8a6 expref: 21 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.453171:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 21) 00010000:00010000:3.0:1789429277.453478:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 21) 00010000:00010000:3.0:1789429277.453491:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.453504:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.453559:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.453575:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 18 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.453591:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648253824:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429277.453711:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.458677:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.458801:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648253824:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.458833:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429277.458914:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634843392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5913us (8959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.458927:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5840 00000100:00100000:1.0:1789429277.460437:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634843520 00000100:00100000:1.0:1789429277.460454:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634843520 00002000:00100000:1.0:1789429277.460524:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f119c4a80 x1876351634843520/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.460540:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c4a80 with x1876351634843520 ext(237568->274431) 00010000:00010000:1.0:1789429277.460551:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.460572:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.460582:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c4a80 00000100:00100000:1.0:1789429277.460613:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1211 00000100:00100000:1.0:1789429277.460624:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634843520:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429277.467543:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634843520:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6903us (8863us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429277.467560:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1211 00002000:00100000:1.0:1789429277.467578:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (237568->274431) req@ffff946f119c4a80 x1876351634843520/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.467592:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c4a80 with x1876351634843520 ext(237568->274431) 00010000:00010000:1.0:1789429277.467606:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.467629:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.467638:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c4a80 00000100:00100000:2.0:1789429277.470920:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.471106:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.471353:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634843776 00000100:00100000:1.0:1789429277.471368:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634843776 00010000:00010000:1.0:1789429277.471420:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.471479:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5841 00000100:00100000:1.0:1789429277.471491:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634843776:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.471509:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.471540:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.471557:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.471590:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fc62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ad expref: 19 pid: 6682 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.471613:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 21) 00010000:00010000:1.0:1789429277.471618:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 21) 00010000:00010000:1.0:1789429277.471628:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.471640:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.471692:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.471710:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e10308000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648253952:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.471814:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.474701:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e10308000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648253952:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.474742:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.474832:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634843776:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3341us (3723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.474848:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5841 00000100:00100000:0.0:1789429277.474972:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634843648 00000100:00100000:0.0:1789429277.474983:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634843648 00000100:00100000:0.0:1789429277.475059:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5398 00000100:00100000:0.0:1789429277.475070:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634843648:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.475092:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.475114:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8bb expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.475154:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.475165:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 21) 00010000:00010000:0.0:1789429277.475171:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 21) 00010000:00010000:0.0:1789429277.475186:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.475254:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.475270:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 19 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.475285:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648254080:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.475352:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.478096:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648254080:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.478148:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.478287:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429277.478444:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634843648:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3373us (7535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.478467:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5398 00000100:00100000:2.0:1789429277.480914:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.481003:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634843904 00000100:00100000:0.0:1789429277.481026:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634843904 00010000:00010000:0.0:1789429277.481077:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.481128:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5842 00000100:00100000:0.0:1789429277.481140:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634843904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429277.481159:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429277.481444:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.481576:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.481608:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fc69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8b4 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.481628:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 21) 00010000:00010000:0.0:1789429277.481632:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 21) 00010000:00010000:0.0:1789429277.481642:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.481654:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.481708:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.481726:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648254208:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429277.481831:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.484570:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648254208:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.484610:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429277.484685:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634843904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3546us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.484698:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5842 00000100:00100000:3.0:1789429277.487054:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.487844:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634844032 00000100:00100000:2.0:1789429277.487859:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634844032 00000100:00100000:2.0:1789429277.487967:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5399 00000100:00100000:2.0:1789429277.487979:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634844032:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429277.488004:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429277.488038:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8c2 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.488083:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.488095:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 21) 00010000:00010000:2.0:1789429277.488100:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(229 21) 00010000:00010000:2.0:1789429277.488106:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.488152:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.488168:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 18 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.488335:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648254336:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429277.488454:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.491814:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.491854:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634844160 00000100:00100000:2.0:1789429277.491864:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634844160 00010000:00010000:2.0:1789429277.491916:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 19 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.491961:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5843 00000100:00100000:2.0:1789429277.491972:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634844160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.491993:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.492029:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 19 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.492048:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 19 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.492084:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(229 21) 00010000:00010000:2.0:1789429277.492090:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(229 21) 00010000:00010000:2.0:1789429277.492100:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.492113:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.492173:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.492223:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648254464:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.492321:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00010000:00010000:1.0:1789429277.492534:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fc70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8bb expref: 19 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.492554:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648254336:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429277.492586:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.492599:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030600, rc 0) 00000100:00100000:1.0:1789429277.492652:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634844032:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4674us (5608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.492662:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5399 00000100:00100000:2.0:1789429277.497290:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.499135:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648254464:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.499319:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.499392:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634844160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7420us (7591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.499406:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5843 00000100:00100000:2.0:1789429277.499481:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.499518:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634844416 00000100:00100000:2.0:1789429277.499527:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634844416 00002000:00100000:2.0:1789429277.499583:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f3f2e0e00 x1876351634844416/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.499595:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e0e00 with x1876351634844416 ext(237568->241663) 00002000:00010000:2.0:1789429277.499601:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e0e00 00000100:00100000:2.0:1789429277.499634:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11351 00000100:00100000:2.0:1789429277.499644:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634844416:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429277.499853:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634844416:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 210us (372us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429277.499861:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11351 00002000:00100000:2.0:1789429277.499869:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f3f2e0e00 x1876351634844416/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.499878:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e0e00 with x1876351634844416 ext(237568->241663) 00002000:00010000:2.0:1789429277.499882:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e0e00 00000100:00100000:0.0:1789429277.500784:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634844288 00000100:00100000:0.0:1789429277.500801:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634844288 00000100:00100000:3.0:1789429277.503574:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5400 00000100:00100000:3.0:1789429277.503589:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634844288:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.503613:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.503638:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8c9 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.503682:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.503694:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(229 21) 00010000:00010000:3.0:1789429277.503699:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 21) 00010000:00010000:3.0:1789429277.503705:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.503747:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.503764:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 19 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.503780:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08229880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648254592:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429277.503889:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.506905:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.507185:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634844544 00000100:00100000:3.0:1789429277.507236:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634844544 00002000:00100000:3.0:1789429277.507304:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (241664->245759) req@ffff946f415c7800 x1876351634844544/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.507319:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c7800 with x1876351634844544 ext(241664->245759) 00010000:00010000:3.0:1789429277.507331:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.507353:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.507361:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c7800 00000100:00100000:3.0:1789429277.507400:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1212 00000100:00100000:3.0:1789429277.507410:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351634844544:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429277.507669:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351634844544:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 259us (777us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429277.507677:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1212 00002000:00100000:3.0:1789429277.507685:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (241664->245759) req@ffff946f415c7800 x1876351634844544/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.507693:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c7800 with x1876351634844544 ext(241664->245759) 00010000:00010000:3.0:1789429277.507700:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.507711:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 20 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.507725:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c7800 00000100:00100000:2.0:1789429277.513093:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.517848:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634844672 00000100:00100000:3.0:1789429277.517873:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634844672 00000100:00100000:3.0:1789429277.517969:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5401 00000100:00100000:3.0:1789429277.517982:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634844672:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.518006:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.518042:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8d0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.518085:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 21) 00010000:00010000:3.0:1789429277.518091:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 21) 00010000:00010000:3.0:1789429277.518098:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.518113:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.518130:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429277.518257:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634844672:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 276us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.518265:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5401 00000100:00100000:0.0:1789429277.518402:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08229880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648254592:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.518437:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.518450:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5a00, rc 0) 00000100:00100000:3.0:1789429277.519950:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.520143:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634844800 00000100:00100000:0.0:1789429277.520154:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634844800 00002000:00100000:0.0:1789429277.520265:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f08229880 x1876351634844800/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 4584/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.520278:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08229880 with x1876351634844800 ext(237568->241663) 00010000:00010000:0.0:1789429277.520288:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 21 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.520308:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 21 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.520316:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f08229880 00000100:00100000:0.0:1789429277.520343:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1213 00000100:00100000:0.0:1789429277.520355:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634844800:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1789429277.520841:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2370:x1876351634844800:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 487us (901us total) trans 4294969556 rc 0/0 00000100:00100000:0.0:1789429277.520850:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1213 00002000:00100000:0.0:1789429277.520858:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f08229880 x1876351634844800/t4294969556(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 4584/448 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.520873:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08229880 with x1876351634844800 ext(237568->241663) 00010000:00010000:0.0:1789429277.520880:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 23 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.520894:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 23 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.520900:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f08229880 00000100:00100000:3.0:1789429277.523337:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634844288:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 19735us (26046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.523357:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5400 00000100:00100000:2.0:1789429277.526603:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.526712:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634844928 00000100:00100000:3.0:1789429277.526726:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634844928 00010000:00010000:3.0:1789429277.526782:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 23 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.526840:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5844 00000100:00100000:3.0:1789429277.526851:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2369:x1876351634844928:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429277.526869:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429277.526900:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 23 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.526917:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 23 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.526946:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fc77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [237568->18446744073709551615] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c2 expref: 23 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.526969:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 21) 00010000:00010000:3.0:1789429277.526975:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 21) 00010000:00010000:3.0:1789429277.526985:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.526997:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.527024:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 21) 00010000:00010000:3.0:1789429277.527028:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 21) 00010000:00010000:3.0:1789429277.527033:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.527041:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.527086:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.527103:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648254720:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.527262:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.527274:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08229180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648254848:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429277.527300:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.531837:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648254720:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429277.531858:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08229180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648254848:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.531888:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429277.531972:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351634844928:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5121us (5383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.531986:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5844 00000100:00100000:2.0:1789429277.534171:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.534419:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634845056 00000100:00100000:3.0:1789429277.534432:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634845056 00002000:00100000:3.0:1789429277.534499:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f054db100 x1876351634845056/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.534513:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054db100 with x1876351634845056 ext(237568->241663) 00002000:00010000:3.0:1789429277.534522:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054db100 00000100:00100000:3.0:1789429277.534561:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11352 00000100:00100000:3.0:1789429277.534572:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2369:x1876351634845056:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429277.534840:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2369:x1876351634845056:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 268us (680us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429277.534849:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11352 00002000:00100000:3.0:1789429277.534856:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f054db100 x1876351634845056/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.534867:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054db100 with x1876351634845056 ext(237568->241663) 00002000:00010000:3.0:1789429277.534870:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054db100 00000100:00100000:2.0:1789429277.537967:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.538094:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634845184 00000100:00100000:0.0:1789429277.538108:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634845184 00000100:00100000:0.0:1789429277.538177:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5402 00000100:00100000:0.0:1789429277.538244:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634845184:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.538270:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.538296:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8d7 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.538339:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.538350:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 21) 00010000:00010000:0.0:1789429277.538355:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(232 21) 00010000:00010000:0.0:1789429277.538360:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.538406:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.538425:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.538443:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648254976:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.538553:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.542506:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.542671:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634845312 00000100:00100000:1.0:1789429277.542685:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634845312 00002000:00100000:1.0:1789429277.542754:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (241664->245759) req@ffff946f054d8e00 x1876351634845312/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.542767:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d8e00 with x1876351634845312 ext(241664->245759) 00010000:00010000:1.0:1789429277.542780:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.542799:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.542808:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d8e00 00000100:00100000:1.0:1789429277.542849:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1214 00000100:00100000:1.0:1789429277.542860:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634845312:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429277.543152:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634845312:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 292us (659us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429277.543161:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1214 00002000:00100000:1.0:1789429277.543169:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (241664->245759) req@ffff946f054d8e00 x1876351634845312/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.543196:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d8e00 with x1876351634845312 ext(241664->245759) 00010000:00010000:1.0:1789429277.543243:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.543256:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.543265:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d8e00 00000100:00100000:0.0:1789429277.543398:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648254976:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.543437:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.543459:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:0.0:1789429277.543503:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634845184:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5316us (5550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.543512:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5402 00000100:00100000:2.0:1789429277.547942:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.548005:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.548110:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634845568 00000100:00100000:0.0:1789429277.548123:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634845568 00010000:00010000:0.0:1789429277.548195:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.548295:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5845 00000100:00100000:0.0:1789429277.548308:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634845568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429277.548328:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429277.548361:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.548384:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.548415:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fc85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d0 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.548438:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(232 21) 00010000:00010000:0.0:1789429277.548444:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(232 21) 00010000:00010000:0.0:1789429277.548455:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.548467:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.548521:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.548539:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648255104:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429277.548645:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.549970:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634845440 00000100:00100000:3.0:1789429277.549984:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634845440 00000100:00100000:0.0:1789429277.550228:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5403 00000100:00100000:0.0:1789429277.550241:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:33938:x1876351634845440:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.550264:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.550287:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8de expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.550326:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.550337:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(232 21) 00010000:00010000:0.0:1789429277.550343:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 21) 00010000:00010000:0.0:1789429277.550348:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.550388:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.550404:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 19 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.550419:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648255232:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.550512:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.555408:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648255232:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.555461:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.555488:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:3.0:1789429277.555565:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:33938:x1876351634845440:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5326us (7558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.555581:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5403 00000100:00100000:0.0:1789429277.556310:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648255104:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429277.556330:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429277.556414:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634845568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8109us (8486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.556425:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5845 00000100:00100000:2.0:1789429277.558172:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.559075:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634845696 00000100:00100000:0.0:1789429277.559088:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634845696 00002000:00100000:0.0:1789429277.559152:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (241664->278527) req@ffff946f3b323100 x1876351634845696/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.559166:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b323100 with x1876351634845696 ext(241664->278527) 00010000:00010000:0.0:1789429277.559262:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.559285:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.559295:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b323100 00000100:00100000:0.0:1789429277.559367:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1215 00000100:00100000:0.0:1789429277.559379:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634845696:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.565605:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634845696:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6211us (7425us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429277.565623:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1215 00002000:00100000:0.0:1789429277.565641:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (241664->278527) req@ffff946f3b323100 x1876351634845696/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.565654:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b323100 with x1876351634845696 ext(241664->278527) 00010000:00010000:0.0:1789429277.565667:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.565691:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.565701:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b323100 00000100:00100000:2.0:1789429277.569098:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.569410:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.569499:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634845952 00000100:00100000:0.0:1789429277.569513:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634845952 00010000:00010000:0.0:1789429277.569564:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.569620:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5846 00000100:00100000:0.0:1789429277.569633:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634845952:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429277.569652:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429277.569681:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.569697:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.569729:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fc8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8d7 expref: 20 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.569753:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 21) 00010000:00010000:0.0:1789429277.569759:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 21) 00010000:00010000:0.0:1789429277.569769:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 21 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.569782:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 21 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.569832:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 21 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.569852:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648255360:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429277.569958:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.570552:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634845824 00000100:00100000:3.0:1789429277.570559:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634845824 00000100:00100000:0.0:1789429277.570928:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5404 00000100:00100000:0.0:1789429277.570939:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634845824:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.570957:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.570979:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8e5 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.571009:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 21 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.571021:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 21) 00010000:00010000:0.0:1789429277.571025:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 21) 00010000:00010000:0.0:1789429277.571031:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.576495:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648255360:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.576537:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.576629:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634845952:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6997us (7218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.576643:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5846 00010000:00010000:0.0:1789429277.576848:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 21 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.576874:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 21 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.576891:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648255488:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.576954:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.579543:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648255488:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.579594:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.579625:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429277.579696:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634845824:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8757us (10677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.579707:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5404 00000100:00100000:0.0:1789429277.582376:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.582470:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634846080 00000100:00100000:1.0:1789429277.582484:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634846080 00010000:00010000:1.0:1789429277.582536:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 22 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.582590:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5847 00000100:00100000:1.0:1789429277.582602:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634846080:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.582624:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.582656:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 22 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.582672:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 22 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.582704:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fc93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8de expref: 22 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.582726:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 21) 00010000:00010000:1.0:1789429277.582732:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 21) 00010000:00010000:1.0:1789429277.582743:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.582756:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.582808:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.582826:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e10308000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648255616:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.582936:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.585809:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.585891:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634846208 00000100:00100000:0.0:1789429277.585905:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634846208 00000100:00100000:0.0:1789429277.585973:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5405 00000100:00100000:0.0:1789429277.585985:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:33938:x1876351634846208:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.586009:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.586046:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8ec expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.586091:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.586103:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 21) 00010000:00010000:0.0:1789429277.586108:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 21) 00010000:00010000:0.0:1789429277.586114:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 23 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.586167:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.586243:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 19 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.586261:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648255744:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.586362:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.589296:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648255744:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.589349:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 23 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.589380:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:0.0:1789429277.589451:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:33938:x1876351634846208:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3466us (3653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.590635:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5405 00000100:00100000:1.0:1789429277.592901:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.592992:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634846336 00000100:00100000:2.0:1789429277.593004:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634846336 00010000:00010000:2.0:1789429277.593059:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.593107:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5848 00000100:00100000:2.0:1789429277.593117:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634846336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.593137:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.593167:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.593252:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.593288:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 21) 00010000:00010000:2.0:1789429277.593293:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 21) 00010000:00010000:2.0:1789429277.593304:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 22 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.593314:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 22 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.593364:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 22 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.593381:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b322d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648255872:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.593479:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00010000:00010000:0.0:1789429277.594523:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fc9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8e5 expref: 20 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.594547:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e10308000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648255616:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429277.594573:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429277.594641:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634846080:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12040us (12276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.594657:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5847 00000100:00100000:2.0:1789429277.598854:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b322d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648255872:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.598894:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.598970:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634846336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5853us (6081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.598983:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5848 00000100:00100000:1.0:1789429277.600718:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.600802:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634846464 00000100:00100000:3.0:1789429277.600814:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634846464 00002000:00100000:3.0:1789429277.600878:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (241664->245759) req@ffff946e10308000 x1876351634846464/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.600891:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10308000 with x1876351634846464 ext(241664->245759) 00002000:00010000:3.0:1789429277.600899:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e10308000 00000100:00100000:3.0:1789429277.600935:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11353 00000100:00100000:3.0:1789429277.600946:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634846464:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429277.601252:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634846464:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 306us (543us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429277.601260:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11353 00002000:00100000:3.0:1789429277.601268:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (241664->245759) req@ffff946e10308000 x1876351634846464/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.601278:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10308000 with x1876351634846464 ext(241664->245759) 00002000:00010000:3.0:1789429277.601281:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e10308000 00000100:00100000:3.0:1789429277.605572:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.605623:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.605751:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634846592 00000100:00100000:0.0:1789429277.605765:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634846592 00002000:00100000:0.0:1789429277.605836:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff946f08229180 x1876351634846592/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.605849:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08229180 with x1876351634846592 ext(245760->249855) 00002000:00010000:0.0:1789429277.605857:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f08229180 00000100:00100000:0.0:1789429277.605899:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11354 00000100:00100000:0.0:1789429277.605910:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351634846592:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.606237:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351634846592:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 281us (633us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429277.606247:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11354 00002000:00100000:0.0:1789429277.606255:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (245760->249855) req@ffff946f08229180 x1876351634846592/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.606264:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08229180 with x1876351634846592 ext(245760->249855) 00002000:00010000:0.0:1789429277.606268:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f08229180 00000100:00100000:2.0:1789429277.606355:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634846720 00000100:00100000:2.0:1789429277.606361:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634846720 00000100:00100000:2.0:1789429277.606406:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5406 00000100:00100000:2.0:1789429277.606415:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634846720:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429277.606428:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429277.606452:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8f3 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.606488:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 21 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.606499:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 21) 00010000:00010000:2.0:1789429277.606504:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(236 21) 00010000:00010000:2.0:1789429277.606511:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.606552:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 21 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.606568:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 21 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.606585:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b322d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648256000:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429277.606661:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.612570:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b322d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648256000:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429277.612621:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.612657:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030000, rc 0) 00000100:00100000:2.0:1789429277.612739:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634846720:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6323us (7114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.612750:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5406 00000100:00100000:3.0:1789429277.614335:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.614502:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634846976 00000100:00100000:2.0:1789429277.614515:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634846976 00002000:00100000:2.0:1789429277.614578:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (241664->249855) req@ffff946f0822a680 x1876351634846976/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 8680/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.614590:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0822a680 with x1876351634846976 ext(241664->249855) 00010000:00010000:2.0:1789429277.614599:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 22 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.614619:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 22 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429277.614628:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f0822a680 00000100:00100000:2.0:1789429277.614664:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1216 00000100:00100000:2.0:1789429277.614675:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634846976:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429277.615280:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2370:x1876351634846976:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 602us (952us total) trans 4294969557 rc 0/0 00000100:00100000:2.0:1789429277.615290:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1216 00002000:00100000:2.0:1789429277.615299:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (241664->249855) req@ffff946f0822a680 x1876351634846976/t4294969557(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 8680/448 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.615314:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0822a680 with x1876351634846976 ext(241664->249855) 00010000:00010000:2.0:1789429277.615321:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 24 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.615336:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 24 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429277.615343:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f0822a680 00000100:00100000:0.0:1789429277.618461:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.618575:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634846848 00000100:00100000:3.0:1789429277.618589:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634846848 00002000:00100000:3.0:1789429277.618659:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (249856->253951) req@ffff946f3462c380 x1876351634846848/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.618680:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462c380 with x1876351634846848 ext(249856->253951) 00010000:00010000:3.0:1789429277.618692:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 24 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.618713:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 24 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.618723:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3462c380 00000100:00100000:3.0:1789429277.618764:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1217 00000100:00100000:3.0:1789429277.618776:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2370:x1876351634846848:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429277.619049:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2370:x1876351634846848:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 274us (603us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429277.619057:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1217 00002000:00100000:3.0:1789429277.619065:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (249856->253951) req@ffff946f3462c380 x1876351634846848/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.619074:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462c380 with x1876351634846848 ext(249856->253951) 00010000:00010000:3.0:1789429277.619080:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 24 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.619091:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 24 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.619099:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3462c380 00000100:00100000:1.0:1789429277.622027:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.622294:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634847104 00000100:00100000:3.0:1789429277.622307:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634847104 00000100:00100000:3.0:1789429277.622383:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5407 00000100:00100000:3.0:1789429277.622395:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:33938:x1876351634847104:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.622417:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.622442:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b8fa expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.622486:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(236 21) 00010000:00010000:3.0:1789429277.622492:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 21) 00010000:00010000:3.0:1789429277.622499:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.622513:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.622529:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429277.622608:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634847104:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 215us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.622617:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5407 00000100:00100000:1.0:1789429277.625524:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.625640:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634847232 00000100:00100000:0.0:1789429277.625652:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634847232 00010000:00010000:0.0:1789429277.625707:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 25 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.625760:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5849 00000100:00100000:0.0:1789429277.625772:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2371:x1876351634847232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429277.625794:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429277.625826:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 25 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.625842:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 25 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.625874:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fca1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [241664->18446744073709551615] (req 241664->245759) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8ec expref: 25 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.625897:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 21) 00010000:00010000:0.0:1789429277.625902:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 21) 00010000:00010000:0.0:1789429277.625912:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.625924:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.625933:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 21) 00010000:00010000:0.0:1789429277.625936:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 21) 00010000:00010000:0.0:1789429277.625941:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 24 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.625950:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 24 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.626007:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 24 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.626037:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648256128:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429277.626158:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.626169:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648256256:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429277.626288:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.630271:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648256128:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.630292:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648256256:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.630323:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.630414:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2371:x1876351634847232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4642us (4902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.630427:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5849 00000100:00100000:3.0:1789429277.631531:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.632382:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634847360 00000100:00100000:0.0:1789429277.632396:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634847360 00002000:00100000:0.0:1789429277.632467:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (241664->249855) req@ffff946f08228700 x1876351634847360/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.632481:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08228700 with x1876351634847360 ext(241664->249855) 00002000:00010000:0.0:1789429277.632488:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f08228700 00000100:00100000:0.0:1789429277.632526:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11355 00000100:00100000:0.0:1789429277.632538:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634847360:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.632827:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634847360:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 290us (1300us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1789429277.632836:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11355 00002000:00100000:0.0:1789429277.632844:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (241664->249855) req@ffff946f08228700 x1876351634847360/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/8632 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.632860:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08228700 with x1876351634847360 ext(241664->249855) 00002000:00010000:0.0:1789429277.632864:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f08228700 00000100:00100000:3.0:1789429277.637091:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.637308:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634847488 00000100:00100000:0.0:1789429277.637323:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634847488 00000100:00100000:0.0:1789429277.637398:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5408 00000100:00100000:0.0:1789429277.637410:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634847488:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.637433:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.637459:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b901 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.637509:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.637520:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 21) 00010000:00010000:0.0:1789429277.637525:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 21) 00010000:00010000:0.0:1789429277.637531:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.637577:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.637598:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 23 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.637615:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648256384:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.637791:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.640546:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.640691:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648256384:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.640739:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.640770:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:0.0:1789429277.640846:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+21:33927:x1876351634847488:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3438us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.640858:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5408 00000100:00100000:1.0:1789429277.641467:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634847616 00000100:00100000:1.0:1789429277.641479:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634847616 00010000:00010000:1.0:1789429277.641525:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 24 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.641572:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5850 00000100:00100000:1.0:1789429277.641583:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2371:x1876351634847616:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.641600:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.641629:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 24 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.641644:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 24 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.641682:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8fa expref: 24 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.641702:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 21) 00010000:00010000:1.0:1789429277.641707:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 21) 00010000:00010000:1.0:1789429277.641716:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.641729:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.641775:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.641793:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648256512:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.641879:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.648585:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648256512:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.648625:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.648700:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2371:x1876351634847616:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7117us (8168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.648712:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5850 00000100:00100000:3.0:1789429277.652501:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.652558:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.652669:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634847744 00000100:00100000:2.0:1789429277.652683:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634847744 00002000:00100000:2.0:1789429277.652751:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (249856->286719) req@ffff946f1c1ab100 x1876351634847744/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.652765:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1ab100 with x1876351634847744 ext(249856->286719) 00002000:00010000:2.0:1789429277.652772:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1ab100 00000100:00100000:2.0:1789429277.652810:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11356 00000100:00100000:2.0:1789429277.652821:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634847744:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.654130:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634847872 00000100:00100000:0.0:1789429277.654146:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634847872 00000100:00100000:0.0:1789429277.654270:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5409 00000100:00100000:0.0:1789429277.654281:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:33938:x1876351634847872:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.654298:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.654321:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fcbd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b908 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.654360:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.654372:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 21) 00010000:00010000:0.0:1789429277.654377:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 21) 00010000:00010000:0.0:1789429277.654383:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fcbd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b908 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.654425:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.654442:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.654459:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648256640:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.654557:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.657421:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634847744:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4584us (4917us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429277.657440:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11356 00002000:00100000:2.0:1789429277.657468:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (249856->286719) req@ffff946f1c1ab100 x1876351634847744/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.657480:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1ab100 with x1876351634847744 ext(249856->286719) 00010000:00010000:2.0:1789429277.657494:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.657518:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 21 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429277.657527:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1ab100 00000100:00100000:3.0:1789429277.663435:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.663699:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648256640:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.663748:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fcbd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b908 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.663781:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc 0) 00000100:00100000:0.0:1789429277.663863:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:33938:x1876351634847872:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9584us (11303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.663875:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5409 00000100:00100000:3.0:1789429277.664472:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.666020:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634848000 00000100:00100000:1.0:1789429277.666039:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634848000 00000100:00100000:0.0:1789429277.666078:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634848128 00000100:00100000:0.0:1789429277.666084:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634848128 00002000:00100000:0.0:1789429277.666145:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (204800->286719) req@ffff946f1c1abb80 x1876351634848128/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.666149:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (286720->323583) req@ffff946f1c1aa300 x1876351634848000/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.666159:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1abb80 with x1876351634848128 ext(204800->286719) 00002000:00100000:1.0:1789429277.666160:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1aa300 with x1876351634848000 ext(286720->323583) 00010000:00010000:1.0:1789429277.666169:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.666261:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.666272:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1aa300 00010000:00010000:0.0:1789429277.666273:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.666283:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 22 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.666298:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1abb80 00000100:00100000:1.0:1789429277.666344:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1218 00000100:00100000:1.0:1789429277.666356:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351634848000:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.666384:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1219 00000100:00100000:0.0:1789429277.666391:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+22:2371:x1876351634848128:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1789429277.675935:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634848128:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 9530us (11450us total) trans 4294969558 rc 0/0 00000100:00100000:1.0:1789429277.675953:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1219 00002000:00100000:1.0:1789429277.675972:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (204800->286719) req@ffff946f1c1abb80 x1876351634848128/t4294969558(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/448 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.675984:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1abb80 with x1876351634848128 ext(204800->286719) 00010000:00010000:1.0:1789429277.676010:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 25 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.676033:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 25 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.676042:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1abb80 00000100:00100000:1.0:1789429277.676755:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351634848000:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 10399us (13331us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429277.676766:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1218 00002000:00100000:1.0:1789429277.676774:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (286720->323583) req@ffff946f1c1aa300 x1876351634848000/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.676783:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1aa300 with x1876351634848000 ext(286720->323583) 00010000:00010000:1.0:1789429277.676790:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 23 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.676803:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 23 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.676811:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c1aa300 00000100:00100000:2.0:1789429277.680089:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.680271:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634848256 00000100:00100000:0.0:1789429277.680285:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634848256 00000100:00100000:0.0:1789429277.680407:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5410 00000100:00100000:0.0:1789429277.680420:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634848256:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.680445:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.680481:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b90f expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.680530:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 21) 00010000:00010000:0.0:1789429277.680536:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 21) 00010000:00010000:0.0:1789429277.680544:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.680559:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.680575:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429277.680649:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+24:33927:x1876351634848256:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 231us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.680657:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5410 00000100:00100000:1.0:1789429277.682618:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.682797:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634848384 00000100:00100000:2.0:1789429277.682809:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634848384 00010000:00010000:2.0:1789429277.682859:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 24 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.682941:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5851 00000100:00100000:2.0:1789429277.682953:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+24:2370:x1876351634848384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.682972:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789429277.682999:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1789429277 -> 1789429278 00002000:00010000:2.0:1789429277.683002:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1789429277 -> 1789429278 00010000:00010000:2.0:1789429277.683010:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 24 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.683036:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 24 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.683064:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fcb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [249856->18446744073709551615] (req 249856->253951) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b901 expref: 24 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.683087:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 21) 00010000:00010000:2.0:1789429277.683093:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 21) 00010000:00010000:2.0:1789429277.683103:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fcbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b908 expref: 23 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.683115:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fcbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b908 expref: 23 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.683126:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 21) 00010000:00010000:2.0:1789429277.683130:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 21) 00010000:00010000:2.0:1789429277.683135:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 23 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.683144:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 23 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.683376:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 23 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.683395:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b320700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648256768:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.683727:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fcbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b908 expref: 23 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.683739:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b320000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648256896:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.683768:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.687868:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.687994:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b320700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648256768:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429277.688011:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b320000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648256896:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429277.688054:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429277.688132:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634848384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5181us (5523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.688145:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5851 00000100:00100000:3.0:1789429277.688521:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634848512 00000100:00100000:3.0:1789429277.688532:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634848512 00002000:00100000:3.0:1789429277.688587:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (249856->253951) req@ffff946f3b320a80 x1876351634848512/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.688598:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320a80 with x1876351634848512 ext(249856->253951) 00002000:00010000:3.0:1789429277.688604:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b320a80 00000100:00100000:3.0:1789429277.688671:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11357 00000100:00100000:3.0:1789429277.688682:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2370:x1876351634848512:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429277.688907:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2370:x1876351634848512:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 226us (1053us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429277.688915:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11357 00002000:00100000:3.0:1789429277.688922:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (249856->253951) req@ffff946f3b320a80 x1876351634848512/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.688931:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320a80 with x1876351634848512 ext(249856->253951) 00002000:00010000:3.0:1789429277.688934:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b320a80 00000100:00100000:0.0:1789429277.694624:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.694748:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634848640 00000100:00100000:1.0:1789429277.694762:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634848640 00002000:00100000:1.0:1789429277.694827:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (253952->258047) req@ffff946f119c4380 x1876351634848640/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.694840:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c4380 with x1876351634848640 ext(253952->258047) 00002000:00010000:1.0:1789429277.694847:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c4380 00000100:00100000:1.0:1789429277.694917:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11358 00000100:00100000:1.0:1789429277.694928:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2370:x1876351634848640:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429277.695430:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2370:x1876351634848640:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 500us (816us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429277.695443:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11358 00002000:00100000:1.0:1789429277.695451:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (253952->258047) req@ffff946f119c4380 x1876351634848640/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.695460:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c4380 with x1876351634848640 ext(253952->258047) 00002000:00010000:1.0:1789429277.695464:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c4380 00000100:00100000:2.0:1789429277.700134:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.700329:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.700475:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634848768 00000100:00100000:0.0:1789429277.700488:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634848768 00002000:00100000:0.0:1789429277.700555:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (258048->262143) req@ffff946f3b322a00 x1876351634848768/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.700568:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b322a00 with x1876351634848768 ext(258048->262143) 00002000:00010000:0.0:1789429277.700576:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b322a00 00000100:00100000:0.0:1789429277.700613:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634848896 00000100:00100000:0.0:1789429277.700617:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634848896 00002000:00100000:0.0:1789429277.700636:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (286720->290815) req@ffff946f3b321180 x1876351634848896/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.700645:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b321180 with x1876351634848896 ext(286720->290815) 00002000:00010000:0.0:1789429277.700648:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b321180 00000100:00100000:0.0:1789429277.700677:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11359 00000100:00100000:0.0:1789429277.700688:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2371:x1876351634848768:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.700950:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2371:x1876351634848768:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 262us (830us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429277.700959:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11359 00002000:00100000:0.0:1789429277.700966:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (258048->262143) req@ffff946f3b322a00 x1876351634848768/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.700975:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b322a00 with x1876351634848768 ext(258048->262143) 00002000:00010000:0.0:1789429277.700979:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b322a00 00000100:00100000:0.0:1789429277.700999:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11360 00000100:00100000:0.0:1789429277.701007:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351634848896:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.701096:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351634848896:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 89us (766us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429277.701103:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11360 00002000:00100000:0.0:1789429277.701109:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (286720->290815) req@ffff946f3b321180 x1876351634848896/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.701117:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b321180 with x1876351634848896 ext(286720->290815) 00002000:00010000:0.0:1789429277.701120:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b321180 00000100:00100000:0.0:1789429277.706302:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.706354:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.706440:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634849024 00000100:00100000:2.0:1789429277.706453:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634849024 00002000:00100000:2.0:1789429277.706519:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (262144->266239) req@ffff946f119c6a00 x1876351634849024/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.706533:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c6a00 with x1876351634849024 ext(262144->266239) 00002000:00010000:2.0:1789429277.706540:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c6a00 00000100:00100000:2.0:1789429277.706574:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634849152 00000100:00100000:2.0:1789429277.706577:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634849152 00002000:00100000:2.0:1789429277.706594:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff946f2f096680 x1876351634849152/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.706602:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f096680 with x1876351634849152 ext(290816->294911) 00002000:00010000:2.0:1789429277.706606:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f096680 00000100:00100000:2.0:1789429277.706625:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11361 00000100:00100000:2.0:1789429277.706636:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2370:x1876351634849024:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429277.706895:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2370:x1876351634849024:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 258us (605us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429277.706904:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11361 00002000:00100000:2.0:1789429277.706911:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (262144->266239) req@ffff946f119c6a00 x1876351634849024/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.706919:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c6a00 with x1876351634849024 ext(262144->266239) 00002000:00010000:2.0:1789429277.706923:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c6a00 00000100:00100000:2.0:1789429277.706943:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11362 00000100:00100000:2.0:1789429277.706949:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634849152:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429277.707037:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634849152:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 87us (681us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429277.707044:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11362 00002000:00100000:2.0:1789429277.707050:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (290816->294911) req@ffff946f2f096680 x1876351634849152/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.707058:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f096680 with x1876351634849152 ext(290816->294911) 00002000:00010000:2.0:1789429277.707061:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f096680 00000100:00100000:0.0:1789429277.712644:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.712691:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.712794:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634849280 00000100:00100000:2.0:1789429277.712807:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634849280 00002000:00100000:2.0:1789429277.712875:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff946f2f095c00 x1876351634849280/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.712890:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095c00 with x1876351634849280 ext(266240->270335) 00002000:00010000:2.0:1789429277.712897:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f095c00 00000100:00100000:2.0:1789429277.712984:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634849408 00000100:00100000:2.0:1789429277.712989:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634849408 00002000:00100000:2.0:1789429277.713008:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (294912->299007) req@ffff946f1c1a1f80 x1876351634849408/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.713027:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a1f80 with x1876351634849408 ext(294912->299007) 00002000:00010000:2.0:1789429277.713031:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a1f80 00000100:00100000:1.0:1789429277.713165:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11363 00000100:00100000:1.0:1789429277.713217:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2369:x1876351634849280:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429277.713485:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2369:x1876351634849280:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 308us (856us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429277.713493:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11363 00002000:00100000:1.0:1789429277.713501:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (266240->270335) req@ffff946f2f095c00 x1876351634849280/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.713511:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095c00 with x1876351634849280 ext(266240->270335) 00002000:00010000:1.0:1789429277.713514:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f095c00 00000100:00100000:1.0:1789429277.713536:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11364 00000100:00100000:1.0:1789429277.713544:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634849408:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429277.713619:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634849408:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 75us (927us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429277.713626:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11364 00002000:00100000:1.0:1789429277.713632:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (294912->299007) req@ffff946f1c1a1f80 x1876351634849408/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.713648:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a1f80 with x1876351634849408 ext(294912->299007) 00002000:00010000:1.0:1789429277.713652:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a1f80 00000100:00100000:2.0:1789429277.718608:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.718659:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.718893:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634849536 00000100:00100000:3.0:1789429277.718907:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634849536 00002000:00100000:3.0:1789429277.718974:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (299008->303103) req@ffff946f3b320000 x1876351634849536/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.718988:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320000 with x1876351634849536 ext(299008->303103) 00002000:00010000:3.0:1789429277.718995:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b320000 00000100:00100000:0.0:1789429277.719417:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634849664 00000100:00100000:0.0:1789429277.719424:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634849664 00002000:00100000:0.0:1789429277.719453:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff946f3b320700 x1876351634849664/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.719463:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320700 with x1876351634849664 ext(270336->274431) 00002000:00010000:0.0:1789429277.719467:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b320700 00000100:00100000:0.0:1789429277.719500:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11365 00000100:00100000:0.0:1789429277.719512:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634849536:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.719772:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634849536:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 261us (1177us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429277.719781:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11365 00002000:00100000:0.0:1789429277.719788:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (299008->303103) req@ffff946f3b320000 x1876351634849536/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.719798:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320000 with x1876351634849536 ext(299008->303103) 00002000:00010000:0.0:1789429277.719801:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b320000 00000100:00100000:0.0:1789429277.719823:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11366 00000100:00100000:0.0:1789429277.719831:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2369:x1876351634849664:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.719909:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2369:x1876351634849664:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 78us (1249us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429277.719917:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11366 00002000:00100000:0.0:1789429277.719923:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (270336->274431) req@ffff946f3b320700 x1876351634849664/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.719931:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320700 with x1876351634849664 ext(270336->274431) 00002000:00010000:0.0:1789429277.719935:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b320700 00000100:00100000:0.0:1789429277.725665:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.725761:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.725910:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634849792 00000100:00100000:2.0:1789429277.725923:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634849792 00002000:00100000:2.0:1789429277.725986:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff946f1c1a0a80 x1876351634849792/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.725999:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a0a80 with x1876351634849792 ext(303104->307199) 00002000:00010000:2.0:1789429277.726006:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a0a80 00000100:00100000:2.0:1789429277.726050:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634849920 00000100:00100000:2.0:1789429277.726054:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634849920 00002000:00100000:2.0:1789429277.726072:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff946f1c1a2300 x1876351634849920/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.726081:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a2300 with x1876351634849920 ext(274432->278527) 00002000:00010000:2.0:1789429277.726085:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a2300 00000100:00100000:2.0:1789429277.726228:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11367 00000100:00100000:2.0:1789429277.726240:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634849792:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429277.726486:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634849792:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 247us (834us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429277.726494:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11367 00002000:00100000:2.0:1789429277.726501:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (303104->307199) req@ffff946f1c1a0a80 x1876351634849792/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.726510:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a0a80 with x1876351634849792 ext(303104->307199) 00002000:00010000:2.0:1789429277.726514:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a0a80 00000100:00100000:2.0:1789429277.726536:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11368 00000100:00100000:2.0:1789429277.726543:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2368:x1876351634849920:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429277.726641:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2368:x1876351634849920:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 97us (878us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429277.726648:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11368 00002000:00100000:2.0:1789429277.726653:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (274432->278527) req@ffff946f1c1a2300 x1876351634849920/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.726660:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a2300 with x1876351634849920 ext(274432->278527) 00002000:00010000:2.0:1789429277.726663:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a2300 00000100:00100000:0.0:1789429277.733525:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.733607:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.733752:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634850048 00000100:00100000:2.0:1789429277.733766:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634850048 00002000:00100000:2.0:1789429277.733831:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff946f1c1a1880 x1876351634850048/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.733844:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a1880 with x1876351634850048 ext(307200->311295) 00002000:00010000:2.0:1789429277.733851:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a1880 00000100:00100000:2.0:1789429277.733883:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634850176 00000100:00100000:2.0:1789429277.733886:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634850176 00002000:00100000:2.0:1789429277.733903:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (278528->286719) req@ffff946f1c1a3480 x1876351634850176/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.733911:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a3480 with x1876351634850176 ext(278528->286719) 00002000:00010000:2.0:1789429277.733915:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a3480 00000100:00100000:2.0:1789429277.733983:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11369 00000100:00100000:2.0:1789429277.733993:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634850048:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429277.734311:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634850048:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 317us (800us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429277.734320:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11369 00002000:00100000:2.0:1789429277.734327:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (307200->311295) req@ffff946f1c1a1880 x1876351634850048/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.734336:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a1880 with x1876351634850048 ext(307200->311295) 00002000:00010000:2.0:1789429277.734340:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a1880 00000100:00100000:2.0:1789429277.734360:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11370 00000100:00100000:2.0:1789429277.734368:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2368:x1876351634850176:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429277.734471:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2368:x1876351634850176:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 103us (862us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1789429277.734479:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11370 00002000:00100000:2.0:1789429277.734485:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (278528->286719) req@ffff946f1c1a3480 x1876351634850176/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/8632 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.734492:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a3480 with x1876351634850176 ext(278528->286719) 00002000:00010000:2.0:1789429277.734496:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a3480 00000100:00100000:2.0:1789429277.740358:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.741170:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.741334:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634850432 00000100:00100000:2.0:1789429277.741347:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634850432 00000100:00100000:2.0:1789429277.741424:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5411 00000100:00100000:2.0:1789429277.741435:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:33938:x1876351634850432:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429277.741465:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429277.741492:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fccb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b916 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.741535:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.741547:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 21) 00010000:00010000:2.0:1789429277.741552:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(241 21) 00010000:00010000:2.0:1789429277.741558:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fccb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b916 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.741607:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.741623:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 22 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.741640:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648257024:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429277.741758:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.744239:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648257024:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.744282:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fccb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->290815] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b916 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.744315:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030600, rc 0) 00000100:00100000:3.0:1789429277.744379:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634850432:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2945us (3214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.744390:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5411 00000100:00100000:0.0:1789429277.746377:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.746615:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634850304 00000100:00100000:1.0:1789429277.746629:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634850304 00002000:00100000:1.0:1789429277.746692:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f3b323480 x1876351634850304/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.746705:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b323480 with x1876351634850304 ext(311296->315391) 00010000:00010000:1.0:1789429277.746717:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 23 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.746735:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 23 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.746744:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b323480 00000100:00100000:2.0:1789429277.746781:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634850560 00000100:00100000:2.0:1789429277.746786:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634850560 00002000:00100000:2.0:1789429277.746811:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (286720->311295) req@ffff946f34499c00 x1876351634850560/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.746820:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499c00 with x1876351634850560 ext(286720->311295) 00010000:00010000:2.0:1789429277.746827:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 24 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.746838:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 24 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429277.746845:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34499c00 00000100:00100000:2.0:1789429277.746918:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1220 00000100:00100000:2.0:1789429277.746929:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+24:2370:x1876351634850304:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429277.747225:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+24:2370:x1876351634850304:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 296us (6879us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429277.747233:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1220 00002000:00100000:2.0:1789429277.747242:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f3b323480 x1876351634850304/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429277.747250:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b323480 with x1876351634850304 ext(311296->315391) 00010000:00010000:2.0:1789429277.747256:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 24 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.747268:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 24 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429277.747276:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b323480 00000100:00100000:2.0:1789429277.747298:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1221 00000100:00100000:2.0:1789429277.747305:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634850560:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429277.751838:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.752261:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634850688 00000100:00100000:1.0:1789429277.752275:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634850688 00000100:00100000:1.0:1789429277.752350:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5412 00000100:00100000:1.0:1789429277.752362:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634850688:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429277.752385:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429277.752409:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b91d expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.752453:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(241 21) 00010000:00010000:1.0:1789429277.752459:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 21) 00010000:00010000:1.0:1789429277.752468:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.752483:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.752499:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429277.752560:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634850688:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 201us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.752568:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5412 00000100:00100000:3.0:1789429277.753442:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+26:2370:x1876351634850560:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 6132us (7072us total) trans 4294969559 rc 0/0 00000100:00100000:3.0:1789429277.753455:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1221 00002000:00100000:3.0:1789429277.753468:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (286720->311295) req@ffff946f34499c00 x1876351634850560/t4294969559(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/448 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.753479:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499c00 with x1876351634850560 ext(286720->311295) 00010000:00010000:3.0:1789429277.753489:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 26 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.753506:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 26 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.753515:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34499c00 00000100:00100000:1.0:1789429277.758950:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.759051:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634850816 00000100:00100000:3.0:1789429277.759065:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634850816 00010000:00010000:3.0:1789429277.759117:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 26 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.759238:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5852 00000100:00100000:3.0:1789429277.759250:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+26:2369:x1876351634850816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429277.759271:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429277.759303:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 26 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.759320:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 26 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.759352:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fcc4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [286720->18446744073709551615] (req 286720->290815) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b90f expref: 26 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.759376:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 21) 00010000:00010000:3.0:1789429277.759381:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 21) 00010000:00010000:3.0:1789429277.759392:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fccb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [286720->311295] (req 286720->290815) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b916 expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.759404:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fccb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [286720->311295] (req 286720->290815) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b916 expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.759414:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 21) 00010000:00010000:3.0:1789429277.759418:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 21) 00010000:00010000:3.0:1789429277.759423:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.759431:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.759498:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.759517:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b607b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648257152:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.759637:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fccb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [286720->311295] (req 286720->290815) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b916 expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.759649:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648257280:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429277.759676:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.763600:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b607b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648257152:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429277.763621:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648257280:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.763653:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429277.763725:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+25:2369:x1876351634850816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4476us (4788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.763739:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5852 00000100:00100000:2.0:1789429277.765630:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.766034:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634850944 00000100:00100000:0.0:1789429277.766050:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634850944 00002000:00100000:0.0:1789429277.766120:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (286720->311295) req@ffff946f3f178700 x1876351634850944/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.766133:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f178700 with x1876351634850944 ext(286720->311295) 00002000:00010000:0.0:1789429277.766141:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f178700 00000100:00100000:2.0:1789429277.766351:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11371 00000100:00100000:2.0:1789429277.766365:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2371:x1876351634850944:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429277.771234:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2371:x1876351634850944:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4810us (5552us total) trans 0 rc 24576/24576 00000100:00100000:1.0:1789429277.771251:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11371 00002000:00100000:1.0:1789429277.771270:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (286720->311295) req@ffff946f3f178700 x1876351634850944/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:/600/0 rc 24576/24576 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.771283:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f178700 with x1876351634850944 ext(286720->311295) 00002000:00010000:1.0:1789429277.771291:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f178700 00000100:00100000:0.0:1789429277.776415:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.776510:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634851072 00000100:00100000:3.0:1789429277.776525:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634851072 00000100:00100000:3.0:1789429277.776601:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5413 00000100:00100000:3.0:1789429277.776612:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634851072:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.776640:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.776667:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b924 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.776718:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.776731:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 21) 00010000:00010000:3.0:1789429277.776736:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 21) 00010000:00010000:3.0:1789429277.776742:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.776787:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.776803:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 24 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.776821:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648257408:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429277.776931:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.781359:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648257408:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.781409:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.781437:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:3.0:1789429277.781531:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634851072:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4920us (5129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.781547:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5413 00000100:00100000:2.0:1789429277.783702:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.783815:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634851200 00000100:00100000:1.0:1789429277.783828:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634851200 00010000:00010000:1.0:1789429277.783880:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 25 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.783932:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5853 00000100:00100000:1.0:1789429277.783943:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634851200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.783966:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.783997:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 25 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.784130:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 25 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.784165:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fcd2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b91d expref: 25 pid: 8085 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.784307:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 21) 00010000:00010000:1.0:1789429277.784314:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 21) 00010000:00010000:1.0:1789429277.784326:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 25 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.784339:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 25 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.784391:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 25 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.784409:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648257536:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429277.784685:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.787174:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.790761:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634851328 00000100:00100000:1.0:1789429277.790782:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634851328 00000100:00100000:1.0:1789429277.790878:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5414 00000100:00100000:1.0:1789429277.790892:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634851328:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429277.790918:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429277.790944:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b92b expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.790989:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 25 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.791002:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 21) 00010000:00010000:1.0:1789429277.791007:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 21) 00010000:00010000:1.0:1789429277.791076:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.791123:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 25 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.791139:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 25 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.791157:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648257664:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429277.791299:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.793841:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648257536:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429277.793883:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429277.793957:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634851200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10013us (10264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.793970:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5853 00000100:00100000:2.0:1789429277.795647:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.795826:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648257664:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.795871:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.795899:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:0.0:1789429277.795964:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634851328:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5074us (8804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.795975:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5414 00000100:00100000:1.0:1789429277.797762:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634851456 00000100:00100000:1.0:1789429277.797778:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634851456 00002000:00100000:0.0:1789429277.797953:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f3f179f80 x1876351634851456/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.797968:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179f80 with x1876351634851456 ext(311296->348159) 00010000:00010000:0.0:1789429277.797978:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 26 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.798003:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 26 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.798077:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f179f80 00000100:00100000:0.0:1789429277.798156:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1222 00000100:00100000:0.0:1789429277.798168:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634851456:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.804129:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634851456:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5945us (8476us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429277.804146:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1222 00002000:00100000:0.0:1789429277.804165:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f3f179f80 x1876351634851456/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.804196:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179f80 with x1876351634851456 ext(311296->348159) 00010000:00010000:0.0:1789429277.804250:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 26 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.804273:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 26 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.804283:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f179f80 00000100:00100000:0.0:1789429277.808388:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.808488:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.808657:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634851584 00000100:00100000:3.0:1789429277.808672:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634851584 00000100:00100000:3.0:1789429277.808790:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5415 00000100:00100000:3.0:1789429277.808804:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634851584:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.808830:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.808858:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b932 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.808906:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 21) 00010000:00010000:3.0:1789429277.808916:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.808925:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(245 21) 00010000:00010000:3.0:1789429277.808931:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.808987:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.809004:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.809033:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429277.809109:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634851584:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 308us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.809118:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5415 00000100:00100000:1.0:1789429277.809158:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634851712 00000100:00100000:1.0:1789429277.809163:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634851712 00010000:00010000:1.0:1789429277.809234:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 27 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.809265:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5854 00000100:00100000:1.0:1789429277.809273:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634851712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.809285:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.809314:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 27 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.809328:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 27 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.809352:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fcd9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b924 expref: 27 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.809368:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 21) 00010000:00010000:1.0:1789429277.809372:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 21) 00010000:00010000:1.0:1789429277.809380:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.809391:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.809419:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.809439:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 24 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.809468:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648257920:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.809537:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.814685:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.814774:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634851840 00000100:00100000:0.0:1789429277.814786:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634851840 00002000:00100000:0.0:1789429277.814857:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f3f17b100 x1876351634851840/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.814871:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17b100 with x1876351634851840 ext(311296->315391) 00010000:00010000:0.0:1789429277.814883:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.814904:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.814914:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f17b100 00000100:00100000:0.0:1789429277.814959:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1223 00000100:00100000:0.0:1789429277.814971:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634851840:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429277.815286:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634851840:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 316us (616us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429277.815296:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1223 00002000:00100000:0.0:1789429277.815306:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f3f17b100 x1876351634851840/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.815316:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17b100 with x1876351634851840 ext(311296->315391) 00010000:00010000:0.0:1789429277.815323:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.815334:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.815347:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f17b100 00000100:00100000:3.0:1789429277.818488:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.818571:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.819179:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634852096 00000100:00100000:0.0:1789429277.819245:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634852096 00010000:00010000:0.0:1789429277.819301:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.819347:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5855 00000100:00100000:0.0:1789429277.819359:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634852096:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429277.819379:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429277.819411:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.819427:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.819477:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 21) 00010000:00010000:0.0:1789429277.819483:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 21) 00010000:00010000:0.0:1789429277.819494:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.819506:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.819556:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.819575:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34498e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648258048:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429277.819680:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.819707:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634851968 00000100:00100000:0.0:1789429277.819712:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634851968 00000100:00100000:0.0:1789429277.819746:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5416 00000100:00100000:0.0:1789429277.819754:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634851968:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.819772:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.819789:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b939 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.819812:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.819820:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 21) 00010000:00010000:0.0:1789429277.819824:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 21) 00010000:00010000:0.0:1789429277.819828:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.819853:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.819867:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 26 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.819884:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648258176:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.819914:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed300 going to sleep for 11 seconds 00010000:00010000:1.0:1789429277.822493:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635fce0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b92b expref: 27 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.822525:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648257920:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.822556:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.822634:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634851712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13361us (14144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.822647:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5854 00000100:00100000:1.0:1789429277.824008:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34498e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648258048:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.824050:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.824107:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b607b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634852096:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4749us (5535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.824118:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5855 00000100:00100000:0.0:1789429277.824430:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648258176:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.824471:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.824499:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:0.0:1789429277.824531:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634851968:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4778us (6060us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.824540:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5416 00000100:00100000:3.0:1789429277.829346:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.829541:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634852224 00000100:00100000:1.0:1789429277.829555:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634852224 00010000:00010000:1.0:1789429277.829611:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 26 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.829662:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5856 00000100:00100000:1.0:1789429277.829675:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634852224:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.829694:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.829723:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 26 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.829740:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 26 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.829770:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fce7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b932 expref: 26 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.829790:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 21) 00010000:00010000:1.0:1789429277.829796:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 21) 00010000:00010000:1.0:1789429277.829806:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.829818:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.829869:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.829885:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648258304:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.829986:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.833707:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648258304:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.833742:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.833817:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2371:x1876351634852224:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4143us (4485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.833829:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5856 00000100:00100000:0.0:1789429277.841496:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.841680:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634852352 00000100:00100000:3.0:1789429277.841694:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634852352 00000100:00100000:3.0:1789429277.841771:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5417 00000100:00100000:3.0:1789429277.841785:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634852352:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.841808:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.841831:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b940 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.841875:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.841887:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 21) 00010000:00010000:3.0:1789429277.841892:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(248 21) 00010000:00010000:3.0:1789429277.841898:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.841942:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.841959:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 24 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.841984:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648258432:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429277.842104:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.845907:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.845943:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.846058:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634852480 00000100:00100000:1.0:1789429277.846070:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634852480 00010000:00010000:1.0:1789429277.846122:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 25 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.846172:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5857 00000100:00100000:1.0:1789429277.846232:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634852480:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429277.846253:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429277.846283:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 25 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.846300:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 25 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.846332:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(248 21) 00010000:00010000:1.0:1789429277.846338:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(248 21) 00010000:00010000:1.0:1789429277.846348:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.846359:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.846409:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429277.846425:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648258560:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429277.846526:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.846722:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634852608 00000100:00100000:2.0:1789429277.846727:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634852608 00000100:00100000:2.0:1789429277.846775:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5418 00000100:00100000:2.0:1789429277.846784:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634852608:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429277.846799:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429277.846816:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b947 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.846839:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.846847:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(248 21) 00010000:00010000:2.0:1789429277.846850:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(249 21) 00010000:00010000:2.0:1789429277.846855:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 27 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.846879:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.846894:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.846905:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648258688:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429277.846936:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0839c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789429277.847185:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fcee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b939 expref: 27 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.847254:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648258432:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429277.847282:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.847293:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.847304:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:0.0:1789429277.847338:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634852352:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5557us (5856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.847347:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5417 00000100:00100000:0.0:1789429277.850990:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.851066:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634852736 00000100:00100000:3.0:1789429277.851078:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634852736 00000100:00100000:2.0:1789429277.851117:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648258688:192.168.203.39@tcp:104: 00002000:00100000:3.0:1789429277.851140:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946e10309180 x1876351634852736/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.851152:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10309180 with x1876351634852736 ext(311296->348159) 00010000:00010000:2.0:1789429277.851157:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.851159:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.851177:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.851185:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e10309180 00010000:00010000:2.0:1789429277.851223:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031400, rc 0) 00000100:00100000:3.0:1789429277.851260:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1224 00000100:00100000:3.0:1789429277.851270:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634852736:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429277.851291:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634852608:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4509us (5347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.851299:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5418 00000100:00100000:1.0:1789429277.851553:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648258560:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429277.851568:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429277.858235:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634852480:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12003us (12309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.858256:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5857 00000100:00100000:3.0:1789429277.861030:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634852736:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 9736us (10030us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429277.861049:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1224 00002000:00100000:3.0:1789429277.861066:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946e10309180 x1876351634852736/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.861086:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10309180 with x1876351634852736 ext(311296->348159) 00010000:00010000:3.0:1789429277.861099:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.861121:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 26 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.861131:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e10309180 00000100:00100000:0.0:1789429277.864892:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.865410:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634852864 00000100:00100000:2.0:1789429277.865425:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634852864 00000100:00100000:2.0:1789429277.865512:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5419 00000100:00100000:2.0:1789429277.865526:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634852864:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429277.865550:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429277.865575:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b94e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.865616:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(249 21) 00010000:00010000:2.0:1789429277.865626:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.865636:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 21) 00010000:00010000:2.0:1789429277.865642:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.865694:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.865711:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.865725:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031800, rc 0) 00000100:00100000:2.0:1789429277.865796:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634852864:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 273us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.865804:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5419 00000100:00100000:0.0:1789429277.866062:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.866557:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634852992 00000100:00100000:3.0:1789429277.866565:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634852992 00010000:00010000:3.0:1789429277.866597:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 27 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.866633:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5858 00000100:00100000:3.0:1789429277.866643:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634852992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429277.866655:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429277.866685:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 27 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.866699:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 27 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.866722:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fcf5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b940 expref: 27 pid: 20745 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.866744:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(251 21) 00010000:00010000:3.0:1789429277.866748:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(251 21) 00010000:00010000:3.0:1789429277.866757:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.866768:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.866807:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.866822:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 24 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.866838:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648258944:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429277.866916:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.872967:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.873130:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634853120 00000100:00100000:1.0:1789429277.873144:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634853120 00002000:00100000:1.0:1789429277.873246:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f34022d80 x1876351634853120/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.873260:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34022d80 with x1876351634853120 ext(311296->315391) 00010000:00010000:1.0:1789429277.873272:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.873293:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.873303:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34022d80 00000100:00100000:1.0:1789429277.873345:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1225 00000100:00100000:1.0:1789429277.873358:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634853120:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429277.873681:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634853120:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 323us (726us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429277.873690:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1225 00002000:00100000:1.0:1789429277.873698:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f34022d80 x1876351634853120/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:13/0 lens 488/4536 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429277.873706:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34022d80 with x1876351634853120 ext(311296->315391) 00010000:00010000:1.0:1789429277.873712:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.873724:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429277.873732:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34022d80 00000100:00100000:3.0:1789429277.874449:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648258944:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.874481:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.874618:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634852992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7974us (8554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.874630:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5858 00000100:00100000:0.0:1789429277.886332:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.886432:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.886917:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634853376 00000100:00100000:3.0:1789429277.886932:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634853376 00010000:00010000:3.0:1789429277.886999:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.887057:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5859 00000100:00100000:3.0:1789429277.887070:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2368:x1876351634853376:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429277.887090:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429277.887120:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.887137:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.887167:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fcfc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b947 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.887197:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(251 21) 00010000:00010000:3.0:1789429277.887229:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(251 21) 00010000:00010000:3.0:1789429277.887240:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.887252:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.887316:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.887334:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648259072:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429277.899804:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.899859:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634853248 00000100:00100000:3.0:1789429277.899873:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634853248 00000100:00100000:3.0:1789429277.899963:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5420 00000100:00100000:3.0:1789429277.899975:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634853248:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429277.899998:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429277.900029:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b955 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.900072:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.900084:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(251 21) 00010000:00010000:3.0:1789429277.900089:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 21) 00010000:00010000:3.0:1789429277.900095:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.900138:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.900154:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 25 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.900802:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648259200:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429277.920593:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429277.921291:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648259072:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429277.921329:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429277.922134:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:2368:x1876351634853376:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 35058us (35693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.922152:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5859 00010000:00010000:1.0:1789429277.926944:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429277.927141:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429277.927267:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648259200:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.927323:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.927354:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429277.927430:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634853248:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 27456us (41115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429277.927442:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5420 00000100:00100000:2.0:1789429277.927643:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.936456:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634853504 00000100:00100000:2.0:1789429277.936481:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634853504 00010000:00010000:2.0:1789429277.936556:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 26 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.936634:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5860 00000100:00100000:2.0:1789429277.936649:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634853504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.936672:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.936704:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 26 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.936722:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 26 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.936755:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fd03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b94e expref: 26 pid: 6681 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.936781:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 21) 00010000:00010000:2.0:1789429277.936787:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 21) 00010000:00010000:2.0:1789429277.936798:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.936810:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.936862:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.936881:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648259328:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.937099:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0839c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.944531:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634853632 00000100:00100000:0.0:1789429277.944553:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634853632 00000100:00100000:0.0:1789429277.944646:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5421 00000100:00100000:0.0:1789429277.944657:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634853632:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.944681:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.944706:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b95c expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.944751:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.944763:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 21) 00010000:00010000:0.0:1789429277.944768:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(253 21) 00010000:00010000:0.0:1789429277.944774:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.944826:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.944841:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 24 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.944857:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648259456:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.944985:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.945369:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648259328:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.945391:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.945427:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634853504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8782us (17784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.945439:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5860 00000100:00100000:1.0:1789429277.952543:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648259456:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429277.952598:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429277.952630:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:1.0:1789429277.952717:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634853632:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8060us (25583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429277.952729:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5421 00000100:00100000:0.0:1789429277.957521:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429277.957570:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.957676:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634853760 00000100:00100000:3.0:1789429277.957686:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634853888 00000100:00100000:2.0:1789429277.957692:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634853760 00000100:00100000:3.0:1789429277.957693:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634853888 00010000:00010000:2.0:1789429277.957750:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 26 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429277.957773:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5422 00000100:00100000:3.0:1789429277.957786:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634853888:12345-192.168.203.39@tcp:101:mmap_sanity.0 00000100:00100000:2.0:1789429277.957803:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5861 00010000:00010000:3.0:1789429277.957805:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789429277.957815:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634853760:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429277.957828:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b963 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.957834:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429277.957866:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(253 21) 00010000:00010000:3.0:1789429277.957875:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.957883:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(254 21) 00010000:00010000:3.0:1789429277.957890:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 27 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.960657:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 27 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.960692:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 27 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.960732:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b955 expref: 27 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.960757:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 21) 00010000:00010000:2.0:1789429277.960763:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 21) 00010000:00010000:2.0:1789429277.960774:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.960794:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.960861:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.960881:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 25 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.960899:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648259584:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.961032:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789429277.966635:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 25 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.966662:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 25 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.966686:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648259712:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429277.966865:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429277.967111:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.967223:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648259584:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.967248:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429277.967253:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634854016 00000100:00100000:3.0:1789429277.967264:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634854016 00000100:00100000:2.0:1789429277.967294:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634853760:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9481us (9788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.967316:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5861 00002000:00100000:3.0:1789429277.967323:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f29d56680 x1876351634854016/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/0 e 0 to 0 dl 1789429288 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429277.967337:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56680 with x1876351634854016 ext(311296->348159) 00010000:00010000:3.0:1789429277.967346:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 26 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.967363:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 26 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429277.967372:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d56680 00000100:00100000:3.0:1789429277.967407:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1226 00000100:00100000:3.0:1789429277.967418:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634854016:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429277.972680:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648259712:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429277.972738:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429277.972769:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:0.0:1789429277.972801:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634854016:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5381us (5687us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429277.972803:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634853888:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 15018us (15230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429277.972827:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1226 00000100:00100000:3.0:1789429277.972827:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5422 00002000:00100000:0.0:1789429277.972844:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f29d56680 x1876351634854016/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:13/0 lens 488/440 e 0 to 0 dl 1789429288 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429277.972856:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56680 with x1876351634854016 ext(311296->348159) 00010000:00010000:0.0:1789429277.972868:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 26 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.972888:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 26 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429277.972897:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29d56680 00000100:00100000:1.0:1789429277.982578:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429277.982631:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429277.982732:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634854272 00000100:00100000:2.0:1789429277.982745:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634854272 00010000:00010000:2.0:1789429277.982801:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 26 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.982858:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5862 00000100:00100000:2.0:1789429277.982869:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634854272:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429277.982889:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429277.982938:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 26 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.982956:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 26 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.982986:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635fd11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b95c expref: 26 pid: 13238 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.983008:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 21) 00010000:00010000:2.0:1789429277.983012:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 21) 00010000:00010000:2.0:1789429277.983023:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.983035:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429277.983096:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429277.983114:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648259840:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429277.983284:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429277.983491:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634854144 00000100:00100000:0.0:1789429277.983497:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634854144 00000100:00100000:0.0:1789429277.985128:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5423 00000100:00100000:0.0:1789429277.985152:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634854144:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429277.985177:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429277.985224:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b96a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.985269:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.985281:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 21) 00010000:00010000:0.0:1789429277.985286:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 21) 00010000:00010000:0.0:1789429277.985292:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.985348:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429277.985364:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 24 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429277.985380:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648259968:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429277.985471:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429277.989864:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648259840:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429277.989902:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429277.990059:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634854272:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7190us (7424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429277.990080:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5862 00000100:00100000:0.0:1789429278.001732:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648259968:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429278.001793:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.001825:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad000, rc 0) 00000100:00100000:0.0:1789429278.001907:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634854144:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 16764us (19343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.001919:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5423 00000100:00100000:0.0:1789429278.002961:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.003634:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634854400 00000100:00100000:1.0:1789429278.003647:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634854400 00002000:00100000:1.0:1789429278.003723:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f344ba680 x1876351634854400/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.003735:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344ba680 with x1876351634854400 ext(311296->315391) 00010000:00010000:1.0:1789429278.003745:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.003764:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429278.003773:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344ba680 00000100:00100000:1.0:1789429278.003796:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1227 00000100:00100000:1.0:1789429278.003807:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634854400:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429278.004049:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634854400:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 242us (1093us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429278.004057:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1227 00002000:00100000:1.0:1789429278.004587:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f344ba680 x1876351634854400/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.004597:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344ba680 with x1876351634854400 ext(311296->315391) 00010000:00010000:1.0:1789429278.004605:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.004625:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429278.004633:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344ba680 00000100:00100000:1.0:1789429278.006946:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.006990:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.007104:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634854656 00000100:00100000:0.0:1789429278.007117:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634854656 00010000:00010000:0.0:1789429278.007168:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.007265:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5863 00000100:00100000:0.0:1789429278.007277:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634854656:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.007298:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.007329:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.007345:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.007376:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b963 expref: 25 pid: 20986 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.007398:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 21) 00010000:00010000:0.0:1789429278.007403:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 21) 00010000:00010000:0.0:1789429278.007415:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.007427:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.007477:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.007495:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648260096:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.007599:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.007910:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634854528 00000100:00100000:3.0:1789429278.007917:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634854528 00000100:00100000:3.0:1789429278.007962:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5424 00000100:00100000:3.0:1789429278.007969:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634854528:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.007988:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.008018:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b971 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.008046:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.008064:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 21) 00010000:00010000:3.0:1789429278.008068:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(257 21) 00010000:00010000:3.0:1789429278.008074:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.008100:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.008114:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 25 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.008126:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648260224:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.008161:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.010575:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648260224:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.010618:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.010645:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429278.010721:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634854528:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2750us (3788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.010735:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5424 00000100:00100000:0.0:1789429278.011267:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648260096:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.011289:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.011323:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634854656:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4047us (4330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.011334:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5863 00000100:00100000:1.0:1789429278.012011:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.012143:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634854784 00000100:00100000:3.0:1789429278.012153:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634854784 00010000:00010000:3.0:1789429278.012229:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 26 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.012268:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5864 00000100:00100000:3.0:1789429278.012279:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2368:x1876351634854784:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429278.012295:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429278.012326:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 26 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.012341:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 26 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.012372:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fd1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b96a expref: 26 pid: 6680 timeout: 1075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.012395:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(257 21) 00010000:00010000:3.0:1789429278.012400:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(257 21) 00010000:00010000:3.0:1789429278.012410:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.012464:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.012519:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.012537:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648260352:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429278.012627:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.019078:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648260352:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.019116:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.019252:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2368:x1876351634854784:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6974us (7244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.019268:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5864 00000100:00100000:2.0:1789429278.025433:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.025560:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634854912 00000100:00100000:1.0:1789429278.025575:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634854912 00000100:00100000:1.0:1789429278.025737:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5425 00000100:00100000:1.0:1789429278.025751:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634854912:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429278.025777:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429278.025804:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b978 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.025849:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.025861:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(257 21) 00010000:00010000:1.0:1789429278.025867:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 257) 00010000:00010000:1.0:1789429278.025874:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.025923:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.025944:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 24 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.025961:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648260480:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429278.026091:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.029018:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648260480:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429278.029074:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.029101:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429278.029178:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634854912:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3429us (3761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.029197:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5425 00000100:00100000:2.0:1789429278.032626:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.032878:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.033340:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634855040 00000100:00100000:1.0:1789429278.033356:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634855040 00010000:00010000:1.0:1789429278.033414:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.033461:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5865 00000100:00100000:1.0:1789429278.033472:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634855040:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429278.033492:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429278.033523:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.033545:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.033577:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b971 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.033599:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 257) 00010000:00010000:1.0:1789429278.033605:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 257) 00010000:00010000:1.0:1789429278.033614:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.033625:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.033669:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.033752:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648260608:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429278.033963:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.034104:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634855168 00000100:00100000:3.0:1789429278.034110:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634855168 00000100:00100000:3.0:1789429278.034155:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5426 00000100:00100000:3.0:1789429278.034163:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634855168:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.034180:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.034454:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b97f expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.034484:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.034494:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 257) 00010000:00010000:3.0:1789429278.034497:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 257) 00010000:00010000:3.0:1789429278.034503:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.034530:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.034551:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 25 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.034563:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648260736:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.034608:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696540 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.042646:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648260736:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.042770:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.042800:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429278.042902:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634855168:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8738us (10023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.042913:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5426 00000100:00100000:1.0:1789429278.043018:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648260608:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429278.043032:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429278.043055:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634855040:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9586us (10447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.043079:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5865 00000100:00100000:2.0:1789429278.047636:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.049268:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634855296 00000100:00100000:0.0:1789429278.049287:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634855296 00002000:00100000:0.0:1789429278.049364:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f3f179880 x1876351634855296/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.049377:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179880 with x1876351634855296 ext(311296->348159) 00010000:00010000:0.0:1789429278.049389:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.049411:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.049420:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f179880 00000100:00100000:0.0:1789429278.049706:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1228 00000100:00100000:0.0:1789429278.049721:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634855296:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.062930:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634855296:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 13195us (15292us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429278.062947:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1228 00002000:00100000:0.0:1789429278.062965:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f3f179880 x1876351634855296/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.062977:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179880 with x1876351634855296 ext(311296->348159) 00010000:00010000:0.0:1789429278.062991:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.063077:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.063088:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f179880 00000100:00100000:2.0:1789429278.066886:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.066928:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.067015:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634855552 00000100:00100000:3.0:1789429278.067029:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634855552 00010000:00010000:3.0:1789429278.067076:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.067123:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5866 00000100:00100000:3.0:1789429278.067134:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634855552:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429278.067153:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429278.067327:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.067350:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.067380:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fd2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b978 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.067401:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 257) 00010000:00010000:3.0:1789429278.067407:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 257) 00010000:00010000:3.0:1789429278.067417:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.067429:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.067481:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.067500:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648260864:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429278.067662:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.067837:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634855424 00000100:00100000:0.0:1789429278.067843:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634855424 00000100:00100000:0.0:1789429278.067889:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5427 00000100:00100000:0.0:1789429278.067898:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634855424:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.067914:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.067930:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b986 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.067960:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.067969:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 257) 00010000:00010000:0.0:1789429278.067972:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 257) 00010000:00010000:0.0:1789429278.067976:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.068000:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.068023:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 24 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.068036:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648260992:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429278.068067:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.071590:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.072848:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648260864:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429278.072883:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429278.073008:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634855552:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5874us (6076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.073037:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5866 00000100:00100000:1.0:1789429278.073238:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634855680 00000100:00100000:1.0:1789429278.073248:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634855680 00002000:00100000:1.0:1789429278.073306:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f344b8380 x1876351634855680/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.073319:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b8380 with x1876351634855680 ext(311296->315391) 00010000:00010000:1.0:1789429278.073330:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.073349:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429278.073358:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b8380 00000100:00100000:1.0:1789429278.073386:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1229 00000100:00100000:1.0:1789429278.073397:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634855680:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429278.074486:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648260992:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.074527:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.074553:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:1.0:1789429278.074722:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634855680:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 1323us (3143us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429278.074733:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1229 00002000:00100000:1.0:1789429278.074743:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f344b8380 x1876351634855680/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.074754:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b8380 with x1876351634855680 ext(311296->315391) 00010000:00010000:1.0:1789429278.074763:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.074787:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429278.074794:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b8380 00000100:00100000:3.0:1789429278.076142:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634855424:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8235us (9258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.076154:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5427 00000100:00100000:1.0:1789429278.081828:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.081881:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.081983:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634855936 00000100:00100000:0.0:1789429278.081997:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634855936 00010000:00010000:0.0:1789429278.082059:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.082110:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5867 00000100:00100000:0.0:1789429278.082122:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634855936:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.082145:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.082196:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.082260:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.082292:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b97f expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.082314:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 257) 00010000:00010000:0.0:1789429278.082320:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 257) 00010000:00010000:0.0:1789429278.082330:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.082342:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.082393:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.082411:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648261120:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.082528:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.082850:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634855808 00000100:00100000:3.0:1789429278.082857:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634855808 00000100:00100000:3.0:1789429278.082901:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5428 00000100:00100000:3.0:1789429278.082910:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634855808:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.082926:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.082945:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b98d expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.082974:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.082984:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 257) 00010000:00010000:3.0:1789429278.082988:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 257) 00010000:00010000:3.0:1789429278.082992:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.083030:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.083046:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 25 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.083058:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648261248:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.083168:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.087350:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648261120:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.087387:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.087509:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:2370:x1876351634855936:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5387us (5694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.087521:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5867 00000100:00100000:3.0:1789429278.087798:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648261248:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.087829:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 25 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.087855:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429278.088369:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634855808:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5457us (6484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.088377:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5428 00000100:00100000:2.0:1789429278.088534:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.089606:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634856064 00000100:00100000:3.0:1789429278.089623:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634856064 00010000:00010000:3.0:1789429278.089677:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.089728:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5868 00000100:00100000:3.0:1789429278.089739:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634856064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429278.089761:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429278.089792:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.089807:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.089837:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fd3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b986 expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.089859:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 257) 00010000:00010000:3.0:1789429278.089864:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 257) 00010000:00010000:3.0:1789429278.089875:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.089887:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.089934:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.089952:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648261376:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429278.090194:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696540 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.093052:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648261376:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429278.093086:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429278.093159:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2370:x1876351634856064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3420us (4623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.093180:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5868 00000100:00100000:1.0:1789429278.097919:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.098017:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634856192 00000100:00100000:0.0:1789429278.098031:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634856192 00000100:00100000:0.0:1789429278.098176:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5429 00000100:00100000:0.0:1789429278.098216:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634856192:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.098343:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.098368:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b994 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.098412:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.098424:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 257) 00010000:00010000:0.0:1789429278.098430:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 257) 00010000:00010000:0.0:1789429278.098437:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.098481:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.098497:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 24 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.098513:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648261504:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429278.098657:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.105772:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.105959:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.106021:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634856448 00000100:00100000:3.0:1789429278.106034:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634856448 00000100:00100000:3.0:1789429278.106104:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5430 00000100:00100000:3.0:1789429278.106116:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634856448:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.106140:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.106164:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b99b expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.106265:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634856320 00000100:00100000:1.0:1789429278.106272:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634856320 00010000:00010000:1.0:1789429278.106301:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 27 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.106302:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648261504:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.106303:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 257) 00010000:00010000:3.0:1789429278.106321:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.106331:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 257) 00010000:00010000:3.0:1789429278.106339:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 27 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.106344:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5869 00000100:00100000:1.0:1789429278.106356:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634856320:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.106364:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.106369:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.106384:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00010000:00010000:3.0:1789429278.106397:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.106398:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 27 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.106427:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 27 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.106450:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fd42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b98d expref: 27 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.106452:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 27 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.106454:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634856192:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8266us (8551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.106470:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5429 00010000:00010000:3.0:1789429278.106481:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 257) 00010000:00010000:3.0:1789429278.106486:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 257) 00010000:00010000:3.0:1789429278.106498:0:20986:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.106510:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.113813:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429278.113937:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2370:x1876351634856320:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7571us (8169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.113953:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5869 00010000:00010000:2.0:1789429278.117794:0:20986:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.117833:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 25 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.117859:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648261760:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.117980:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.132756:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648261760:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.132795:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:0.0:1789429278.135948:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634856448:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 29817us (29970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.135948:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.135966:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5430 00000100:00100000:3.0:1789429278.137852:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634856576 00000100:00100000:3.0:1789429278.137870:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634856576 00002000:00100000:3.0:1789429278.137944:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f3f179180 x1876351634856576/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.137958:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179180 with x1876351634856576 ext(311296->348159) 00010000:00010000:3.0:1789429278.137970:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.137997:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429278.138007:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f179180 00000100:00100000:3.0:1789429278.138061:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1230 00000100:00100000:3.0:1789429278.138071:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634856576:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429278.144987:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634856576:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6902us (9030us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429278.145002:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1230 00002000:00100000:3.0:1789429278.145086:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f3f179180 x1876351634856576/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.145106:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179180 with x1876351634856576 ext(311296->348159) 00010000:00010000:3.0:1789429278.145119:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.145139:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 26 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429278.145149:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f179180 00000100:00100000:1.0:1789429278.150149:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.150535:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634856704 00000100:00100000:3.0:1789429278.150549:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634856704 00000100:00100000:3.0:1789429278.150628:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5431 00000100:00100000:3.0:1789429278.150644:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634856704:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.150670:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.150695:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9a2 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.150736:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 257) 00010000:00010000:3.0:1789429278.150748:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.150755:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 257) 00010000:00010000:3.0:1789429278.150762:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.150817:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.150835:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.150852:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429278.150932:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634856704:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 293us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.150940:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5431 00000100:00100000:1.0:1789429278.155156:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.155353:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634856832 00000100:00100000:2.0:1789429278.155369:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634856832 00010000:00010000:2.0:1789429278.155421:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 27 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.155487:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5870 00000100:00100000:2.0:1789429278.155500:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634856832:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.155519:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.155550:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 27 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.155579:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 27 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.155611:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fd49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b994 expref: 27 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.155642:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 257) 00010000:00010000:2.0:1789429278.155647:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 257) 00010000:00010000:2.0:1789429278.155657:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.155669:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.155722:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.155739:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 24 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.155756:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648262016:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.155871:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.159832:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.160066:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648262016:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.160088:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634856960 00000100:00100000:0.0:1789429278.160099:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634856960 00010000:00010000:3.0:1789429278.160101:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1789429278.160167:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f3b607b80 x1876351634856960/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1789429278.160181:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634856832:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4681us (5035us total) trans 0 rc 0/0 00002000:00100000:0.0:1789429278.160230:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b607b80 with x1876351634856960 ext(311296->315391) 00000100:00100000:3.0:1789429278.160238:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5870 00010000:00010000:0.0:1789429278.160244:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.160265:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.160285:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b607b80 00000100:00100000:0.0:1789429278.160316:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1231 00000100:00100000:0.0:1789429278.160327:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634856960:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.160591:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634856960:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 264us (773us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429278.160605:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1231 00002000:00100000:0.0:1789429278.160612:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f3b607b80 x1876351634856960/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.160621:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b607b80 with x1876351634856960 ext(311296->315391) 00010000:00010000:0.0:1789429278.160627:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.160640:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.160647:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b607b80 00000100:00100000:2.0:1789429278.163868:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.164027:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634857088 00000100:00100000:3.0:1789429278.164040:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634857088 00000100:00100000:3.0:1789429278.164301:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5432 00000100:00100000:3.0:1789429278.164315:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634857088:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.164342:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.164369:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9a9 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.164394:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1789429278.164422:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 257) 00000100:00100000:1.0:1789429278.164423:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634857216 00000100:00100000:1.0:1789429278.164430:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634857216 00010000:00010000:3.0:1789429278.164436:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.164453:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 257) 00010000:00010000:3.0:1789429278.164462:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 27 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.164518:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.164536:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 27 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.164553:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429278.164629:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634857088:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 317us (775us total) trans 0 rc 0/0 00010000:00010000:1.0:1789429278.164636:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 27 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.164639:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5432 00000100:00100000:1.0:1789429278.164677:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5871 00000100:00100000:1.0:1789429278.164687:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634857216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429278.164698:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429278.164726:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.164741:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.164765:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fd50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b99b expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.164787:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 257) 00010000:00010000:1.0:1789429278.164791:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 257) 00010000:00010000:1.0:1789429278.164801:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.164812:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.164840:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.164855:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 25 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.164871:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648262272:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429278.164935:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.167681:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340ce300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648262272:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429278.167762:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429278.167876:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634857216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3190us (3482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.167896:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5871 00000100:00100000:3.0:1789429278.168877:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.168937:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634857344 00000100:00100000:2.0:1789429278.168952:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634857344 00010000:00010000:2.0:1789429278.169000:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.169042:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5872 00000100:00100000:2.0:1789429278.169053:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2369:x1876351634857344:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.169070:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.169099:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.169115:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.169144:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a2 expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.169163:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 257) 00010000:00010000:2.0:1789429278.169168:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 257) 00010000:00010000:2.0:1789429278.169178:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.169223:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.169269:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.169286:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b323800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648262400:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.169374:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.173318:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b323800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648262400:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.173354:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.173492:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2369:x1876351634857344:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4438us (4618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.173504:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5872 00000100:00100000:2.0:1789429278.181830:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.182248:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634857472 00000100:00100000:3.0:1789429278.182262:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634857472 00000100:00100000:3.0:1789429278.182340:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5433 00000100:00100000:3.0:1789429278.182353:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634857472:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.182378:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.182403:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9b0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.182447:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.182460:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 257) 00010000:00010000:3.0:1789429278.182464:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 257) 00010000:00010000:3.0:1789429278.182470:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.182516:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.182533:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 24 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.182551:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648262528:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.182649:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.187323:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.187479:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634857600 00000100:00100000:0.0:1789429278.187492:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634857600 00002000:00100000:0.0:1789429278.187554:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f3b321c00 x1876351634857600/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.187568:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b321c00 with x1876351634857600 ext(311296->315391) 00010000:00010000:0.0:1789429278.187579:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.188750:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.188770:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b321c00 00000100:00100000:0.0:1789429278.188826:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1232 00000100:00100000:0.0:1789429278.188844:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634857600:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.189124:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634857600:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 288us (1812us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429278.189132:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1232 00002000:00100000:0.0:1789429278.189141:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f3b321c00 x1876351634857600/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.189150:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b321c00 with x1876351634857600 ext(311296->315391) 00010000:00010000:0.0:1789429278.189157:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.189170:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.189178:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b321c00 00000100:00100000:3.0:1789429278.193683:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648262528:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.193734:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.193763:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429278.193838:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634857472:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11486us (12022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.193850:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5433 00000100:00100000:1.0:1789429278.197364:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.197993:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.198573:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634857856 00000100:00100000:1.0:1789429278.198588:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634857856 00010000:00010000:1.0:1789429278.198652:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.198711:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5873 00000100:00100000:1.0:1789429278.198724:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634857856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429278.198746:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429278.198777:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.198795:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.198825:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9a9 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.198849:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 257) 00010000:00010000:1.0:1789429278.198854:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 257) 00010000:00010000:1.0:1789429278.198865:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.198878:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.198926:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.198949:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648262656:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429278.199290:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.200967:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634857728 00000100:00100000:0.0:1789429278.200987:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634857728 00000100:00100000:0.0:1789429278.201138:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5434 00000100:00100000:0.0:1789429278.201152:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634857728:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.201176:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.201231:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9b7 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.201276:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.201287:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 257) 00010000:00010000:0.0:1789429278.201293:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 257) 00010000:00010000:0.0:1789429278.201300:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.201343:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.201359:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 25 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.201375:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648262784:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429278.201484:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed900 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.204895:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648262656:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429278.204932:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429278.205067:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2370:x1876351634857856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6344us (7074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.205080:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5873 00000100:00100000:0.0:1789429278.212296:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648262784:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429278.212346:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.212374:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429278.212641:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634857728:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11492us (15290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.212653:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5434 00000100:00100000:2.0:1789429278.215176:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.215394:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634857984 00000100:00100000:1.0:1789429278.215476:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634857984 00002000:00100000:1.0:1789429278.215547:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f3b320e00 x1876351634857984/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.215561:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320e00 with x1876351634857984 ext(311296->348159) 00010000:00010000:1.0:1789429278.215572:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 26 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.215593:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 26 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429278.215732:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b320e00 00000100:00100000:2.0:1789429278.215866:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1233 00000100:00100000:2.0:1789429278.216382:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634857984:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429278.235039:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634857984:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 19144us (20263us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429278.235057:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1233 00002000:00100000:2.0:1789429278.235074:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f3b320e00 x1876351634857984/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.235087:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320e00 with x1876351634857984 ext(311296->348159) 00010000:00010000:2.0:1789429278.235100:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 26 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.235122:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 26 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.235133:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b320e00 00000100:00100000:2.0:1789429278.240331:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.240446:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.240548:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634858240 00000100:00100000:0.0:1789429278.240562:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634858240 00000100:00100000:0.0:1789429278.240632:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5435 00000100:00100000:0.0:1789429278.240645:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634858240:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.240669:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.240694:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9be expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.240737:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 257) 00010000:00010000:0.0:1789429278.240747:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.240755:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 257) 00010000:00010000:0.0:1789429278.240761:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.240813:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.240832:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.240847:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429278.240936:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634858240:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 294us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.240944:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5435 00000100:00100000:3.0:1789429278.241427:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634858112 00000100:00100000:3.0:1789429278.241435:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634858112 00010000:00010000:3.0:1789429278.241466:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 27 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.241539:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5874 00000100:00100000:3.0:1789429278.241549:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634858112:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429278.241561:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429278.241587:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 27 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.241601:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 27 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.241625:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b0 expref: 27 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.241642:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 257) 00010000:00010000:3.0:1789429278.241647:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 257) 00010000:00010000:3.0:1789429278.241655:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.241667:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.241699:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.241719:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 24 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.241736:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648263040:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429278.241823:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.247323:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648263040:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.247362:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.247432:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634858112:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5883us (7114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.247446:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5874 00000100:00100000:1.0:1789429278.248717:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.248805:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634858368 00000100:00100000:2.0:1789429278.248817:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634858368 00010000:00010000:2.0:1789429278.248867:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.248946:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5875 00000100:00100000:2.0:1789429278.248957:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2368:x1876351634858368:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.248976:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.249016:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.249034:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.249063:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fd6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9b7 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.249086:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 257) 00010000:00010000:2.0:1789429278.249092:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 257) 00010000:00010000:2.0:1789429278.249102:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.249114:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.249162:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.249237:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648263168:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.249340:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.254145:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648263168:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.254244:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.254318:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+24:2368:x1876351634858368:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5360us (5606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.254332:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5875 00000100:00100000:0.0:1789429278.266698:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.266808:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634858496 00000100:00100000:3.0:1789429278.266823:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634858496 00000100:00100000:3.0:1789429278.266897:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5436 00000100:00100000:3.0:1789429278.266910:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+24:33927:x1876351634858496:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.266934:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.266959:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9c5 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.267004:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.267022:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 257) 00010000:00010000:3.0:1789429278.267027:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 257) 00010000:00010000:3.0:1789429278.267032:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 25 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.267076:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 25 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.267097:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 25 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.267114:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648263296:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.267276:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.268243:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.268320:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634858624 00000100:00100000:2.0:1789429278.268328:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634858624 00002000:00100000:2.0:1789429278.268375:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f340cdc00 x1876351634858624/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.268387:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340cdc00 with x1876351634858624 ext(311296->348159) 00010000:00010000:2.0:1789429278.268394:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.268410:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.268419:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f340cdc00 00000100:00100000:2.0:1789429278.268448:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1234 00000100:00100000:2.0:1789429278.268457:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634858624:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429278.273814:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648263296:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.273863:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 25 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.273894:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429278.273976:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634858496:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7068us (7292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.273986:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5436 00000100:00100000:2.0:1789429278.284406:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634858624:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 15934us (16152us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429278.284426:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1234 00002000:00100000:2.0:1789429278.284443:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f340cdc00 x1876351634858624/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.284454:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340cdc00 with x1876351634858624 ext(311296->348159) 00010000:00010000:2.0:1789429278.284468:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.284489:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.284500:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f340cdc00 00000100:00100000:0.0:1789429278.286967:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.287055:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634858752 00000100:00100000:3.0:1789429278.287068:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634858752 00000100:00100000:3.0:1789429278.287140:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5437 00000100:00100000:3.0:1789429278.287153:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634858752:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.287174:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.287231:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9cc expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.287277:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 257) 00010000:00010000:3.0:1789429278.287288:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.287297:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 257) 00010000:00010000:3.0:1789429278.287303:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.287357:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.287374:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.287389:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429278.287460:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634858752:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 310us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.287468:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5437 00000100:00100000:1.0:1789429278.291055:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.291164:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634858880 00000100:00100000:2.0:1789429278.291177:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634858880 00010000:00010000:2.0:1789429278.291284:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 27 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.291327:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5876 00000100:00100000:2.0:1789429278.291337:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2368:x1876351634858880:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.291355:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.291383:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 27 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.291399:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 27 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.291433:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635fd73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9be expref: 27 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.291454:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 257) 00010000:00010000:2.0:1789429278.291459:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 257) 00010000:00010000:2.0:1789429278.291468:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.291479:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.291536:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.291552:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 24 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.291569:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648263552:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.291909:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.300015:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648263552:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.300384:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.300528:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2368:x1876351634858880:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9189us (9483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.300547:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5876 00000100:00100000:1.0:1789429278.302526:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.303135:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634859008 00000100:00100000:2.0:1789429278.303151:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634859008 00002000:00100000:2.0:1789429278.303353:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f2f509880 x1876351634859008/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.303367:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f509880 with x1876351634859008 ext(311296->315391) 00010000:00010000:2.0:1789429278.303378:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.303398:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.303407:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f509880 00000100:00100000:2.0:1789429278.303439:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1235 00000100:00100000:2.0:1789429278.303451:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634859008:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429278.303719:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634859008:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 269us (1204us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429278.303728:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1235 00002000:00100000:2.0:1789429278.303735:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f2f509880 x1876351634859008/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.303744:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f509880 with x1876351634859008 ext(311296->315391) 00010000:00010000:2.0:1789429278.303751:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.304087:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.304095:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f509880 00000100:00100000:3.0:1789429278.308471:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.308533:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.308651:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634859264 00000100:00100000:1.0:1789429278.308665:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634859264 00010000:00010000:1.0:1789429278.308716:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.308776:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5877 00000100:00100000:1.0:1789429278.308787:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634859264:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429278.308806:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429278.308833:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.308849:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.308880:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635fd7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9c5 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.308902:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 257) 00010000:00010000:1.0:1789429278.308906:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 257) 00010000:00010000:1.0:1789429278.308916:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.308928:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.308974:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.308994:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f509c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648263680:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429278.309105:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.311642:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634859136 00000100:00100000:0.0:1789429278.311661:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634859136 00000100:00100000:0.0:1789429278.311741:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5438 00000100:00100000:0.0:1789429278.311754:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634859136:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.311791:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.312089:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9d3 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.312139:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.312152:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 257) 00010000:00010000:0.0:1789429278.312157:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 257) 00010000:00010000:0.0:1789429278.312163:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.312463:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 25 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.312480:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 25 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.312497:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648263808:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429278.324594:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.325170:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.325291:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.325391:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634859520 00000100:00100000:2.0:1789429278.325403:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634859520 00000100:00100000:2.0:1789429278.325474:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5439 00000100:00100000:2.0:1789429278.325486:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634859520:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429278.325509:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429278.325532:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9da expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.325576:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 257) 00010000:00010000:2.0:1789429278.325586:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.325594:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 257) 00010000:00010000:2.0:1789429278.325600:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 27 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.325657:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.325675:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 27 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.325697:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031400, rc 0) 00000100:00100000:2.0:1789429278.325763:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634859520:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 280us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.325771:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5439 00000100:00100000:2.0:1789429278.325829:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f509c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648263680:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.325846:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.325867:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2370:x1876351634859264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 17083us (17334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.325877:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5877 00000100:00100000:2.0:1789429278.325897:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634859392 00000100:00100000:2.0:1789429278.325901:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634859392 00010000:00010000:2.0:1789429278.325918:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 27 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.325942:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5878 00000100:00100000:2.0:1789429278.325949:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634859392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.325959:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.325987:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 27 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.326001:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 27 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.326024:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 257) 00010000:00010000:2.0:1789429278.326029:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 257) 00010000:00010000:2.0:1789429278.326038:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.326048:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.326074:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.326090:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.326106:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648264064:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.326163:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1789429278.326708:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fd81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9cc expref: 27 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.326728:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648263808:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429278.326753:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.326765:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.326778:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429278.326828:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634859136:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 15077us (18371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.326836:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5438 00000100:00100000:2.0:1789429278.330197:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648264064:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.330366:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.330438:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634859392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4488us (5275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.330451:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5878 00000100:00100000:1.0:1789429278.331398:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.331566:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634859648 00000100:00100000:2.0:1789429278.331575:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634859648 00010000:00010000:2.0:1789429278.331622:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.331671:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5879 00000100:00100000:2.0:1789429278.331683:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2368:x1876351634859648:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.331700:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.331731:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.331747:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.331778:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fd88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9d3 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.331800:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 257) 00010000:00010000:2.0:1789429278.331805:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 257) 00010000:00010000:2.0:1789429278.331815:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 25 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.331828:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 25 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.331874:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 25 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.331890:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648264192:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.331982:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.336993:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.337093:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648264192:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.337137:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.337241:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+24:2368:x1876351634859648:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5558us (5846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.337254:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5879 00000100:00100000:3.0:1789429278.338142:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634859776 00000100:00100000:3.0:1789429278.338155:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634859776 00002000:00100000:3.0:1789429278.338271:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f344bb480 x1876351634859776/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.338284:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344bb480 with x1876351634859776 ext(311296->348159) 00002000:00010000:3.0:1789429278.338291:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f344bb480 00000100:00100000:3.0:1789429278.338378:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11372 00000100:00100000:3.0:1789429278.338389:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634859776:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.345420:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.345713:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634859776:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7322us (8731us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429278.345728:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11372 00002000:00100000:2.0:1789429278.345743:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f344bb480 x1876351634859776/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.345756:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344bb480 with x1876351634859776 ext(311296->348159) 00002000:00010000:2.0:1789429278.345764:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f344bb480 00000100:00100000:3.0:1789429278.346044:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634859904 00000100:00100000:3.0:1789429278.346054:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634859904 00000100:00100000:3.0:1789429278.346113:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5440 00000100:00100000:3.0:1789429278.346123:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+24:33927:x1876351634859904:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.346142:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.346165:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9e1 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.346266:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 25 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.346278:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 257) 00010000:00010000:3.0:1789429278.346283:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 257) 00010000:00010000:3.0:1789429278.346289:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 25 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.346330:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 25 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.346349:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 25 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.346367:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648264320:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.346447:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.351418:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648264320:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.351480:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 25 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.351511:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429278.351590:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634859904:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5466us (6184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.351601:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5440 00000100:00100000:0.0:1789429278.353789:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.354178:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634860032 00000100:00100000:1.0:1789429278.354222:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634860032 00000100:00100000:1.0:1789429278.354297:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5441 00000100:00100000:1.0:1789429278.354310:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634860032:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429278.354334:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429278.354357:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9e8 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.354402:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 257) 00010000:00010000:1.0:1789429278.354412:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.354421:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 257) 00010000:00010000:1.0:1789429278.354428:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.354481:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.354499:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.354520:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429278.354601:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634860032:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 292us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.354611:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5441 00000100:00100000:1.0:1789429278.357382:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.357482:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634860160 00000100:00100000:0.0:1789429278.357496:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634860160 00010000:00010000:0.0:1789429278.357546:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 27 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.357654:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5880 00000100:00100000:0.0:1789429278.357666:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2368:x1876351634860160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.357688:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.357720:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 27 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.357736:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 27 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.357768:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fd8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9da expref: 27 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.357791:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 257) 00010000:00010000:0.0:1789429278.357797:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 257) 00010000:00010000:0.0:1789429278.357807:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.357818:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.357870:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.357885:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 24 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.357901:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648264576:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.358011:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.364935:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.365238:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648264576:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.365275:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.365353:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2368:x1876351634860160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7688us (7983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.365369:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5880 00000100:00100000:3.0:1789429278.365767:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634860288 00000100:00100000:3.0:1789429278.365778:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634860288 00002000:00100000:3.0:1789429278.365839:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f344b9c00 x1876351634860288/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.365852:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b9c00 with x1876351634860288 ext(311296->315391) 00010000:00010000:3.0:1789429278.365863:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.365883:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429278.365893:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b9c00 00000100:00100000:3.0:1789429278.365926:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1236 00000100:00100000:3.0:1789429278.365937:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634860288:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429278.366249:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634860288:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 266us (1280us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429278.366258:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1236 00002000:00100000:3.0:1789429278.366265:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f344b9c00 x1876351634860288/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.366273:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b9c00 with x1876351634860288 ext(311296->315391) 00010000:00010000:3.0:1789429278.366279:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.366291:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429278.366299:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b9c00 00000100:00100000:0.0:1789429278.369528:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.369638:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634860416 00000100:00100000:2.0:1789429278.369652:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634860416 00000100:00100000:2.0:1789429278.369721:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5442 00000100:00100000:2.0:1789429278.369733:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634860416:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429278.369757:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429278.369782:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9ef expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.369826:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 257) 00010000:00010000:2.0:1789429278.369836:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.369845:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 257) 00010000:00010000:2.0:1789429278.369851:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.369902:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.369917:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.369932:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031600, rc 0) 00000100:00100000:2.0:1789429278.370051:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634860416:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 320us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.370059:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5442 00000100:00100000:1.0:1789429278.371800:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.372027:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634860544 00000100:00100000:2.0:1789429278.372037:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634860544 00010000:00010000:2.0:1789429278.372082:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.372139:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5881 00000100:00100000:2.0:1789429278.372150:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+26:2369:x1876351634860544:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.372167:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.372237:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.372255:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.372287:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fd96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e1 expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.372308:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 257) 00010000:00010000:2.0:1789429278.372313:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 257) 00010000:00010000:2.0:1789429278.372323:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.372334:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.372378:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.372392:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 25 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.372407:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648264832:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.372494:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.379473:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.379641:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648264832:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.379679:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.379746:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+25:2369:x1876351634860544:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7597us (7955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.379761:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5881 00000100:00100000:2.0:1789429278.379839:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634860672 00000100:00100000:2.0:1789429278.379848:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634860672 00010000:00010000:2.0:1789429278.379886:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.379937:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5882 00000100:00100000:2.0:1789429278.379948:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634860672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.379965:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.379995:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.380011:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.380046:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fd9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9e8 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.380065:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 257) 00010000:00010000:2.0:1789429278.380071:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 257) 00010000:00010000:2.0:1789429278.382312:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 24 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.382644:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 24 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.382715:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 24 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.382735:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648264960:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.382856:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.387908:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648264960:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.387946:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.388343:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2370:x1876351634860672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8137us (8626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.388372:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5882 00000100:00100000:0.0:1789429278.389331:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.389457:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634860800 00000100:00100000:2.0:1789429278.389468:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634860800 00000100:00100000:2.0:1789429278.389529:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5443 00000100:00100000:2.0:1789429278.389540:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634860800:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429278.389567:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429278.389595:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9f6 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.389642:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 24 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.389660:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 257) 00010000:00010000:2.0:1789429278.389666:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 257) 00010000:00010000:2.0:1789429278.389672:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.389718:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 24 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.389735:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 24 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.389751:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648265088:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429278.389909:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.393700:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648265088:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429278.393751:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.393782:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031400, rc 0) 00000100:00100000:2.0:1789429278.393864:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634860800:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4324us (4539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.393875:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5443 00000100:00100000:1.0:1789429278.403451:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.403570:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634860928 00000100:00100000:2.0:1789429278.403587:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634860928 00010000:00010000:2.0:1789429278.403648:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 25 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.403851:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5883 00000100:00100000:1.0:1789429278.403866:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634860928:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429278.403888:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429278.403920:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 25 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.403939:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 25 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.403970:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fda4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9ef expref: 25 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.403991:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 257) 00010000:00010000:1.0:1789429278.403996:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 257) 00010000:00010000:1.0:1789429278.404015:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.404033:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.404090:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.404107:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f50aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648265216:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429278.405131:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.413731:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.413961:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634861056 00000100:00100000:3.0:1789429278.413974:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634861056 00000100:00100000:3.0:1789429278.414057:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5444 00000100:00100000:3.0:1789429278.414070:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634861056:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.414106:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.414134:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1b9fd expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.414191:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.414255:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 257) 00010000:00010000:3.0:1789429278.414261:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 257) 00010000:00010000:3.0:1789429278.414268:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.414323:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.414341:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.414359:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648265344:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429278.414645:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696540 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.414947:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f50aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648265216:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429278.414969:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429278.414999:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634860928:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11140us (11564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.415016:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5883 00000100:00100000:2.0:1789429278.418836:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.418917:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634861184 00000100:00100000:0.0:1789429278.418931:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634861184 00002000:00100000:0.0:1789429278.418999:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f34023100 x1876351634861184/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.419014:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34023100 with x1876351634861184 ext(311296->348159) 00010000:00010000:0.0:1789429278.419026:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.419049:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.419059:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34023100 00000100:00100000:0.0:1789429278.419153:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1237 00000100:00100000:0.0:1789429278.419165:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634861184:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.425943:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648265344:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429278.427415:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 25 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.427453:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:0.0:1789429278.427557:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634861056:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 13488us (13840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.427569:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5444 00000100:00100000:0.0:1789429278.427963:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634861184:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 8799us (9142us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429278.427972:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1237 00002000:00100000:0.0:1789429278.427984:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f34023100 x1876351634861184/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.427996:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34023100 with x1876351634861184 ext(311296->348159) 00010000:00010000:0.0:1789429278.428005:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.428023:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.428031:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34023100 00000100:00100000:1.0:1789429278.432482:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.432536:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.432633:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634861312 00000100:00100000:3.0:1789429278.432633:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634861440 00000100:00100000:0.0:1789429278.432647:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634861312 00000100:00100000:3.0:1789429278.432647:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634861440 00010000:00010000:3.0:1789429278.432708:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 27 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.432760:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5884 00000100:00100000:3.0:1789429278.432771:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634861440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429278.432788:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429278.432817:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 27 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.432832:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 27 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.432860:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9f6 expref: 27 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.432899:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 257) 00010000:00010000:3.0:1789429278.432905:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 257) 00010000:00010000:3.0:1789429278.432915:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.432926:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.432976:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.432995:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648265472:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429278.433106:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.433393:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5445 00000100:00100000:0.0:1789429278.433405:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634861312:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.433423:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.433441:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba04 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.433467:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.433476:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 257) 00010000:00010000:0.0:1789429278.433481:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 257) 00010000:00010000:0.0:1789429278.433485:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.433662:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.433678:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 24 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.433690:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648265600:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429278.434051:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.438625:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648265472:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.438657:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.438750:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634861440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5979us (6212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.438766:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5884 00000100:00100000:3.0:1789429278.438982:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.439616:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634861568 00000100:00100000:2.0:1789429278.439627:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634861568 00002000:00100000:2.0:1789429278.439684:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946e15184700 x1876351634861568/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.439695:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184700 with x1876351634861568 ext(311296->315391) 00010000:00010000:2.0:1789429278.439705:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.439722:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.439731:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15184700 00000100:00100000:2.0:1789429278.439764:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1238 00000100:00100000:2.0:1789429278.439774:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634861568:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429278.440051:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634861568:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 278us (1070us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429278.440059:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1238 00002000:00100000:2.0:1789429278.440066:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946e15184700 x1876351634861568/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.440074:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184700 with x1876351634861568 ext(311296->315391) 00010000:00010000:2.0:1789429278.440080:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.440091:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.440098:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15184700 00000100:00100000:3.0:1789429278.443325:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.443464:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634861696 00000100:00100000:0.0:1789429278.443476:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634861696 00000100:00100000:0.0:1789429278.443548:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5446 00000100:00100000:0.0:1789429278.443560:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634861696:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.443586:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.443611:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba0b expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.443654:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 257) 00010000:00010000:0.0:1789429278.443664:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.443684:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 257) 00010000:00010000:0.0:1789429278.443691:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.443752:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.443772:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.443788:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:1.0:1789429278.443817:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648265600:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429278.443848:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.443858:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634861696:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 298us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.443866:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5446 00010000:00010000:1.0:1789429278.443870:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:1.0:1789429278.443900:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634861312:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10498us (11445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.443912:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5445 00000100:00100000:3.0:1789429278.447143:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.447450:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634861824 00000100:00100000:2.0:1789429278.447472:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634861824 00010000:00010000:2.0:1789429278.447524:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.447575:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5885 00000100:00100000:2.0:1789429278.447586:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634861824:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.447603:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.447633:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.447649:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.447695:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fdb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b9fd expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.447717:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 257) 00010000:00010000:2.0:1789429278.447723:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 257) 00010000:00010000:2.0:1789429278.447733:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.447744:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.447793:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.447808:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 25 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.447823:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34021180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648265856:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.448129:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.452004:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.452257:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634861952 00000100:00100000:3.0:1789429278.452271:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634861952 00010000:00010000:3.0:1789429278.452323:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.452383:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5886 00000100:00100000:3.0:1789429278.452394:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634861952:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429278.452413:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429278.452447:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.452800:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.452834:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 257) 00010000:00010000:3.0:1789429278.452839:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 257) 00010000:00010000:3.0:1789429278.452849:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.452862:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.452983:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 25 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.453002:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648265984:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429278.453116:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00010000:00010000:1.0:1789429278.453278:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fdb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba04 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.453297:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34021180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648265856:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429278.453321:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429278.453354:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634861824:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5770us (6227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.453364:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5885 00000100:00100000:1.0:1789429278.458938:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648265984:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429278.458973:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429278.459064:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2370:x1876351634861952:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6669us (7074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.459076:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5886 00000100:00100000:2.0:1789429278.464379:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.464619:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634862080 00000100:00100000:0.0:1789429278.464634:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634862080 00000100:00100000:0.0:1789429278.464730:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5447 00000100:00100000:0.0:1789429278.464744:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634862080:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.464771:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.464795:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba12 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.464837:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.464848:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 257) 00010000:00010000:0.0:1789429278.464854:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 257) 00010000:00010000:0.0:1789429278.464859:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.464909:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.464924:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 24 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.464940:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648266112:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429278.465476:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.471376:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.471511:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.471623:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634862208 00000100:00100000:1.0:1789429278.471636:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634862208 00010000:00010000:1.0:1789429278.471703:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 25 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.471755:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5887 00000100:00100000:1.0:1789429278.471768:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634862208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429278.471789:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429278.471819:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 25 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.471842:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 25 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.471889:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 257) 00010000:00010000:1.0:1789429278.471896:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 257) 00010000:00010000:1.0:1789429278.471906:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.471918:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.471966:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.471985:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648266240:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429278.472087:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.472304:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634862336 00000100:00100000:3.0:1789429278.472311:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634862336 00000100:00100000:3.0:1789429278.472357:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5448 00000100:00100000:3.0:1789429278.472366:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634862336:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.472382:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.472403:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba19 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.472432:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.472441:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 257) 00010000:00010000:3.0:1789429278.472444:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 257) 00010000:00010000:3.0:1789429278.472450:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 27 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.472490:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.472504:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.472516:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648266368:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.472552:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.476268:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648266368:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.476318:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 27 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.476350:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429278.476421:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634862336:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4056us (4910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.476435:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5448 00000100:00100000:1.0:1789429278.477255:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648266240:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429278.477274:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429278.477314:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634862208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5549us (5952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.477325:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5887 00010000:00010000:0.0:1789429278.478050:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba0b expref: 25 pid: 13238 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.478072:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648266112:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429278.478104:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.478116:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.478130:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:0.0:1789429278.478195:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634862080:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 13453us (13831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.478241:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5447 00000100:00100000:2.0:1789429278.482569:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.482739:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634862464 00000100:00100000:3.0:1789429278.482753:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634862464 00002000:00100000:3.0:1789429278.482823:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f2f65ca80 x1876351634862464/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.482836:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65ca80 with x1876351634862464 ext(311296->348159) 00010000:00010000:3.0:1789429278.482848:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.482869:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429278.482956:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65ca80 00000100:00100000:3.0:1789429278.483045:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1239 00000100:00100000:3.0:1789429278.483058:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634862464:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429278.488198:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634862464:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5109us (5611us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429278.488250:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1239 00002000:00100000:1.0:1789429278.488268:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f2f65ca80 x1876351634862464/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.488281:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65ca80 with x1876351634862464 ext(311296->348159) 00010000:00010000:1.0:1789429278.488295:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.488316:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429278.488325:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65ca80 00000100:00100000:2.0:1789429278.492291:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.492417:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.492747:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634862720 00000100:00100000:3.0:1789429278.492761:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634862720 00010000:00010000:3.0:1789429278.492816:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.492870:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5888 00000100:00100000:3.0:1789429278.492961:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634862720:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429278.492982:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429278.493014:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.493032:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.493063:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72635fdc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba12 expref: 26 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.493086:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 257) 00010000:00010000:3.0:1789429278.493091:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 257) 00010000:00010000:3.0:1789429278.493102:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.493113:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.493162:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.493179:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648266496:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429278.493350:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.493426:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634862592 00000100:00100000:1.0:1789429278.493434:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634862592 00000100:00100000:1.0:1789429278.493488:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5449 00000100:00100000:1.0:1789429278.493496:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634862592:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429278.493512:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429278.493530:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba20 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.493557:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.493566:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 257) 00010000:00010000:1.0:1789429278.493570:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 257) 00010000:00010000:1.0:1789429278.493576:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.493601:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 24 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.493616:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 24 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.493628:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648266624:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429278.493657:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0133a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.500969:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648266496:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.500969:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648266624:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429278.501011:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429278.501035:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.501068:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429278.501577:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634862720:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8312us (8851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.501595:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5888 00000100:00100000:2.0:1789429278.505658:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634862592:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 12143us (13361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.507150:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5449 00000100:00100000:1.0:1789429278.508108:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.508454:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634862848 00000100:00100000:3.0:1789429278.508469:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634862848 00002000:00100000:3.0:1789429278.508539:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f2f508e00 x1876351634862848/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.508552:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f508e00 with x1876351634862848 ext(311296->315391) 00010000:00010000:3.0:1789429278.508563:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.508584:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429278.508593:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f508e00 00000100:00100000:3.0:1789429278.508637:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1240 00000100:00100000:3.0:1789429278.508647:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634862848:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429278.508990:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634862848:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 341us (886us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429278.508998:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1240 00002000:00100000:3.0:1789429278.509005:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f2f508e00 x1876351634862848/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.509013:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f508e00 with x1876351634862848 ext(311296->315391) 00010000:00010000:3.0:1789429278.509019:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.509031:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 25 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429278.509039:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f508e00 00000100:00100000:1.0:1789429278.514592:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.514713:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634862976 00000100:00100000:2.0:1789429278.514726:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634862976 00000100:00100000:2.0:1789429278.514809:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5450 00000100:00100000:2.0:1789429278.514822:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634862976:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429278.514848:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429278.514875:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba27 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.514921:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 257) 00010000:00010000:2.0:1789429278.514932:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.514940:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 257) 00010000:00010000:2.0:1789429278.514946:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.515017:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.515033:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.515049:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031800, rc 0) 00000100:00100000:2.0:1789429278.515129:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634862976:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 310us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.515137:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5450 00000100:00100000:2.0:1789429278.519304:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.519920:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634863104 00000100:00100000:3.0:1789429278.519935:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634863104 00010000:00010000:0.0:1789429278.520153:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.520358:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5889 00000100:00100000:0.0:1789429278.520372:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2369:x1876351634863104:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.520394:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.520427:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.520443:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.520488:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fdce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba19 expref: 26 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.520510:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 257) 00010000:00010000:0.0:1789429278.520517:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 257) 00010000:00010000:0.0:1789429278.520528:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.520540:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.520591:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.520606:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 25 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.520620:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648266880:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.520889:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.524365:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648266880:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.524403:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.524469:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2369:x1876351634863104:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4099us (5181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.524481:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5889 00000100:00100000:3.0:1789429278.524790:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.526586:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634863232 00000100:00100000:1.0:1789429278.526605:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634863232 00010000:00010000:1.0:1789429278.526679:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.526727:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5890 00000100:00100000:1.0:1789429278.526741:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634863232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429278.526763:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429278.526795:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.526813:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.526844:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fdd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba20 expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.526866:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 257) 00010000:00010000:1.0:1789429278.526872:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 257) 00010000:00010000:1.0:1789429278.526883:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.526895:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.526945:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.526962:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648267008:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429278.527380:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.530523:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648267008:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.530556:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.530634:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2371:x1876351634863232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3895us (5843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.530647:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5890 00000100:00100000:1.0:1789429278.538822:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.539097:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634863360 00000100:00100000:2.0:1789429278.539112:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634863360 00000100:00100000:2.0:1789429278.539347:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5451 00000100:00100000:2.0:1789429278.539361:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634863360:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429278.539385:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429278.539409:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba2e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.539456:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.539467:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 257) 00010000:00010000:2.0:1789429278.539471:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 257) 00010000:00010000:2.0:1789429278.539477:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.539517:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.539532:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 24 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.539547:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648267136:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429278.539654:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.543985:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.544110:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648267136:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429278.544153:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.544241:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031200, rc 0) 00000100:00100000:1.0:1789429278.544317:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634863360:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4959us (5510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.544328:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5451 00000100:00100000:3.0:1789429278.544418:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634863488 00000100:00100000:3.0:1789429278.544427:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634863488 00010000:00010000:3.0:1789429278.544466:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 25 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.544495:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5891 00000100:00100000:3.0:1789429278.544505:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634863488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429278.544522:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429278.544549:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 25 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.544564:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 25 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.544592:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fddc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba27 expref: 25 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.544610:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 257) 00010000:00010000:3.0:1789429278.544614:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 257) 00010000:00010000:3.0:1789429278.544623:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 25 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.544635:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 25 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.544686:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 25 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.544705:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648267264:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429278.544766:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.547293:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.547420:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634863616 00000100:00100000:0.0:1789429278.547431:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634863616 00000100:00100000:0.0:1789429278.547513:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5452 00000100:00100000:0.0:1789429278.547525:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634863616:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.547546:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.547571:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba35 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.547612:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 25 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.547624:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 257) 00010000:00010000:0.0:1789429278.547629:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 257) 00010000:00010000:0.0:1789429278.547636:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.547686:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 25 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.547702:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 25 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.547720:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648267392:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429278.547828:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.552812:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648267392:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429278.552863:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.552892:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429278.552971:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634863616:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5447us (5689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.552982:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5452 00000100:00100000:3.0:1789429278.553591:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648267264:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429278.553609:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429278.553657:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634863488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9152us (9684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.553667:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5891 00000100:00100000:2.0:1789429278.556538:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.556657:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634863744 00000100:00100000:0.0:1789429278.556736:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634863744 00002000:00100000:0.0:1789429278.556806:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f2f65df80 x1876351634863744/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.556820:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65df80 with x1876351634863744 ext(311296->348159) 00010000:00010000:0.0:1789429278.556830:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.556851:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.556860:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65df80 00000100:00100000:0.0:1789429278.556944:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1241 00000100:00100000:0.0:1789429278.556957:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634863744:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.561415:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634863744:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4444us (4875us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429278.561431:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1241 00002000:00100000:0.0:1789429278.561450:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f2f65df80 x1876351634863744/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.561469:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65df80 with x1876351634863744 ext(311296->348159) 00010000:00010000:0.0:1789429278.561482:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.561506:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.561515:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65df80 00000100:00100000:1.0:1789429278.565001:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.565291:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634863872 00000100:00100000:2.0:1789429278.565304:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634863872 00000100:00100000:2.0:1789429278.565381:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5453 00000100:00100000:2.0:1789429278.565393:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634863872:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429278.565417:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429278.565442:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba3c expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.565500:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 257) 00010000:00010000:2.0:1789429278.565510:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.565518:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 257) 00010000:00010000:2.0:1789429278.565526:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.565579:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.565596:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.565612:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031400, rc 0) 00000100:00100000:2.0:1789429278.565814:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634863872:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 422us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.565823:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5453 00000100:00100000:1.0:1789429278.567723:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.567921:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634864000 00000100:00100000:2.0:1789429278.567932:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634864000 00010000:00010000:2.0:1789429278.567984:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 27 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.568045:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5892 00000100:00100000:2.0:1789429278.568056:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634864000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.568073:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.568105:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 27 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.568120:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 27 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.568158:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fde3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba2e expref: 27 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.568286:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 257) 00010000:00010000:2.0:1789429278.568292:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 257) 00010000:00010000:2.0:1789429278.568302:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.568316:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.568362:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.568377:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 24 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.568393:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648267648:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.568492:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.571542:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648267648:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.571579:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.571659:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634864000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3603us (3945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.571686:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5892 00000100:00100000:1.0:1789429278.575953:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.576051:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634864128 00000100:00100000:2.0:1789429278.576067:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634864128 00002000:00100000:2.0:1789429278.576133:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f2f50b100 x1876351634864128/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.576146:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f50b100 with x1876351634864128 ext(311296->315391) 00010000:00010000:2.0:1789429278.576157:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.576195:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.576233:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f50b100 00000100:00100000:2.0:1789429278.576263:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1242 00000100:00100000:2.0:1789429278.576274:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634864128:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429278.576647:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634864128:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 373us (708us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429278.576657:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1242 00002000:00100000:2.0:1789429278.576665:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f2f50b100 x1876351634864128/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.576682:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f50b100 with x1876351634864128 ext(311296->315391) 00010000:00010000:2.0:1789429278.576689:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.576708:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.576716:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f50b100 00000100:00100000:1.0:1789429278.581564:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.581611:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.581712:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634864384 00000100:00100000:3.0:1789429278.581727:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634864384 00010000:00010000:3.0:1789429278.581779:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.581830:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5893 00000100:00100000:3.0:1789429278.581841:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2368:x1876351634864384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429278.581859:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429278.581890:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.581906:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.581937:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fdea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba35 expref: 25 pid: 20986 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.581965:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 257) 00010000:00010000:3.0:1789429278.581971:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 257) 00010000:00010000:3.0:1789429278.581982:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.581995:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.582054:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.582071:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648267776:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429278.582179:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696780 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.582488:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634864256 00000100:00100000:0.0:1789429278.582495:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634864256 00000100:00100000:0.0:1789429278.582539:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5454 00000100:00100000:0.0:1789429278.582548:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634864256:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.582564:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.582583:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba43 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.582607:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.582615:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 257) 00010000:00010000:0.0:1789429278.582618:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 257) 00010000:00010000:0.0:1789429278.582623:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.582647:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.582661:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 25 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.582681:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648267904:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429278.582717:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.585635:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648267904:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429278.585697:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.585725:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:0.0:1789429278.585797:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634864256:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3248us (4247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.585807:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5454 00000100:00100000:3.0:1789429278.585947:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648267776:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429278.585962:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429278.585987:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2368:x1876351634864384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4148us (4375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.585997:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5893 00000100:00100000:1.0:1789429278.589318:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.589434:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634864512 00000100:00100000:3.0:1789429278.589449:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634864512 00010000:00010000:3.0:1789429278.589514:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.589567:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5894 00000100:00100000:3.0:1789429278.589578:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634864512:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429278.589599:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429278.589629:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.589645:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.589688:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fdf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba3c expref: 26 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.589712:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 257) 00010000:00010000:3.0:1789429278.589717:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 257) 00010000:00010000:3.0:1789429278.589727:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 24 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.589739:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 24 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.589786:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 24 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.589803:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648268032:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429278.589910:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.593642:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648268032:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429278.593743:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429278.593870:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2371:x1876351634864512:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4291us (4564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.593883:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5894 00000100:00100000:0.0:1789429278.597131:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.597351:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634864640 00000100:00100000:1.0:1789429278.597364:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634864640 00000100:00100000:1.0:1789429278.597427:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5455 00000100:00100000:1.0:1789429278.597439:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634864640:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429278.597463:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429278.597488:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba4a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.597534:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 24 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.597545:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 257) 00010000:00010000:1.0:1789429278.597550:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 257) 00010000:00010000:1.0:1789429278.597556:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.597604:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 24 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.597621:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 24 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.597637:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648268160:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429278.597906:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.605639:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.605750:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.605792:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634864896 00000100:00100000:1.0:1789429278.605804:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634864896 00000100:00100000:1.0:1789429278.605878:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5456 00000100:00100000:1.0:1789429278.605890:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634864896:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429278.605912:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429278.605936:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba51 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.605980:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 257) 00010000:00010000:1.0:1789429278.605989:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.605997:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 257) 00010000:00010000:1.0:1789429278.606002:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.606065:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.606082:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.606098:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:0.0:1789429278.606291:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634864768 00000100:00100000:0.0:1789429278.606296:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634864768 00010000:00010000:0.0:1789429278.606324:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 27 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.606349:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5895 00000100:00100000:0.0:1789429278.606356:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634864768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.606367:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.606396:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 27 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.606410:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 27 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.606435:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 257) 00010000:00010000:0.0:1789429278.606439:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 257) 00010000:00010000:0.0:1789429278.606449:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.606473:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.606502:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.606517:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.606534:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648268416:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.606602:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.606935:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634864896:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 280us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.606945:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5456 00010000:00010000:3.0:1789429278.607732:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fdf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba43 expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.607758:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648268160:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.607791:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.607804:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.607822:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:3.0:1789429278.607881:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634864640:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10444us (10765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.607889:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5455 00000100:00100000:1.0:1789429278.613120:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.613246:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634865024 00000100:00100000:3.0:1789429278.613259:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634865024 00002000:00100000:3.0:1789429278.613325:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f05473100 x1876351634865024/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.613338:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05473100 with x1876351634865024 ext(311296->348159) 00010000:00010000:3.0:1789429278.613351:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.613376:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429278.613384:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05473100 00000100:00100000:3.0:1789429278.613416:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1243 00000100:00100000:3.0:1789429278.613426:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634865024:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.614629:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648268416:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.614665:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.614831:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634864768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8473us (9203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.614848:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5895 00000100:00100000:2.0:1789429278.618915:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634865024:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5473us (5792us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429278.618932:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1243 00002000:00100000:2.0:1789429278.618949:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (311296->348159) req@ffff946f05473100 x1876351634865024/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.618960:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05473100 with x1876351634865024 ext(311296->348159) 00010000:00010000:2.0:1789429278.618973:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.618996:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.619014:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05473100 00000100:00100000:0.0:1789429278.622273:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.622367:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634865280 00000100:00100000:2.0:1789429278.622381:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634865280 00010000:00010000:2.0:1789429278.622430:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.622471:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5896 00000100:00100000:2.0:1789429278.622482:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634865280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.622502:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.622529:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.622544:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.622573:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fdff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba4a expref: 26 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.622595:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 257) 00010000:00010000:2.0:1789429278.622600:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 257) 00010000:00010000:2.0:1789429278.622611:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.622622:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.622665:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.622692:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648268544:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.622788:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.626680:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.626760:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.626919:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634865408 00000100:00100000:1.0:1789429278.626933:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634865408 00002000:00100000:1.0:1789429278.626996:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f2f509500 x1876351634865408/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.627017:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f509500 with x1876351634865408 ext(311296->315391) 00002000:00010000:1.0:1789429278.627024:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f509500 00000100:00100000:1.0:1789429278.627064:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11373 00000100:00100000:1.0:1789429278.627075:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634865408:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429278.627372:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634865408:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 297us (610us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429278.627380:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11373 00002000:00100000:1.0:1789429278.627388:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f2f509500 x1876351634865408/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.627398:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f509500 with x1876351634865408 ext(311296->315391) 00002000:00010000:1.0:1789429278.627402:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f509500 00000100:00100000:3.0:1789429278.627520:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648268544:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429278.627548:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429278.627586:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2370:x1876351634865280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5105us (5328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.627595:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5896 00000100:00100000:2.0:1789429278.628093:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634865152 00000100:00100000:2.0:1789429278.628101:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634865152 00000100:00100000:2.0:1789429278.628147:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5457 00000100:00100000:2.0:1789429278.628157:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634865152:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429278.628179:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429278.628247:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fe0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba58 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.628285:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.628297:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 257) 00010000:00010000:2.0:1789429278.628303:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 257) 00010000:00010000:2.0:1789429278.628309:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fe0d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba58 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.628350:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.628366:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 24 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.628382:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648268672:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429278.628456:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.633060:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.633684:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648268672:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.633729:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fe0d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba58 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.633758:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031600, rc 0) 00000100:00100000:3.0:1789429278.633840:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634865152:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5683us (7184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.633850:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5457 00000100:00100000:0.0:1789429278.634717:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634865536 00000100:00100000:0.0:1789429278.634729:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634865536 00002000:00100000:0.0:1789429278.634785:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff946f05471c00 x1876351634865536/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.634798:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05471c00 with x1876351634865536 ext(315392->319487) 00010000:00010000:0.0:1789429278.634807:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 25 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.634824:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 25 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.634833:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05471c00 00000100:00100000:0.0:1789429278.634869:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1244 00000100:00100000:0.0:1789429278.634878:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+25:2369:x1876351634865536:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.635141:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+25:2369:x1876351634865536:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 263us (2094us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429278.635148:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1244 00002000:00100000:0.0:1789429278.635156:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff946f05471c00 x1876351634865536/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.635164:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05471c00 with x1876351634865536 ext(315392->319487) 00010000:00010000:0.0:1789429278.635189:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 25 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.635231:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 25 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.635240:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05471c00 00000100:00100000:1.0:1789429278.639503:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.639786:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634865664 00000100:00100000:0.0:1789429278.639798:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634865664 00000100:00100000:0.0:1789429278.639917:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5458 00000100:00100000:0.0:1789429278.639929:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634865664:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.639954:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.639979:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba5f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.640034:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 257) 00010000:00010000:0.0:1789429278.640040:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 257) 00010000:00010000:0.0:1789429278.640047:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.640063:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.640079:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429278.640160:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634865664:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 233us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.640188:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5458 00000100:00100000:3.0:1789429278.642589:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.642767:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634865792 00000100:00100000:2.0:1789429278.642778:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634865792 00002000:00100000:2.0:1789429278.642846:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946e15187800 x1876351634865792/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 4584/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.642866:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15187800 with x1876351634865792 ext(311296->315391) 00010000:00010000:2.0:1789429278.642878:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 26 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.642899:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 26 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.642908:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15187800 00000100:00100000:2.0:1789429278.642949:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1245 00000100:00100000:2.0:1789429278.642960:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634865792:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429278.643496:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:2371:x1876351634865792:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 533us (915us total) trans 4294969560 rc 0/0 00000100:00100000:2.0:1789429278.643506:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1245 00002000:00100000:2.0:1789429278.643516:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946e15187800 x1876351634865792/t4294969560(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 4584/448 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.643525:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15187800 with x1876351634865792 ext(311296->315391) 00010000:00010000:2.0:1789429278.643532:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.643545:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.643553:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15187800 00000100:00100000:2.0:1789429278.646852:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.646947:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634865920 00000100:00100000:3.0:1789429278.646960:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634865920 00010000:00010000:3.0:1789429278.647018:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.647189:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5897 00000100:00100000:0.0:1789429278.647222:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:2369:x1876351634865920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.647243:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789429278.647269:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1789429278 -> 1789429279 00010000:00010000:0.0:1789429278.647279:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.647295:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.647325:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [311296->18446744073709551615] (req 311296->315391) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba51 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.647348:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 257) 00010000:00010000:0.0:1789429278.647354:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 257) 00010000:00010000:0.0:1789429278.647365:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fe0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba58 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.647378:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fe0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba58 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.647388:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 257) 00010000:00010000:0.0:1789429278.647391:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 257) 00010000:00010000:0.0:1789429278.647397:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.647408:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.647468:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.647487:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f509c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648268800:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.647601:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fe0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba58 expref: 25 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.647611:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648268928:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.647635:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.650792:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f509c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648268800:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.650817:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648268928:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.650853:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.650960:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:2369:x1876351634865920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3759us (4121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.650974:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5897 00000100:00100000:3.0:1789429278.662979:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.666389:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634866048 00000100:00100000:0.0:1789429278.666414:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634866048 00002000:00100000:0.0:1789429278.666503:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff946e15184380 x1876351634866048/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.666525:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184380 with x1876351634866048 ext(315392->319487) 00002000:00010000:0.0:1789429278.666532:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15184380 00000100:00100000:0.0:1789429278.666590:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11374 00000100:00100000:0.0:1789429278.666602:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634866048:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.666896:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634866048:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 295us (3932us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429278.666905:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11374 00002000:00100000:0.0:1789429278.666913:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (315392->319487) req@ffff946e15184380 x1876351634866048/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.666920:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184380 with x1876351634866048 ext(315392->319487) 00002000:00010000:0.0:1789429278.666924:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15184380 00000100:00100000:2.0:1789429278.671041:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.671262:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634866176 00000100:00100000:3.0:1789429278.671277:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634866176 00002000:00100000:3.0:1789429278.671349:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f2f65fb80 x1876351634866176/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.671363:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65fb80 with x1876351634866176 ext(311296->315391) 00002000:00010000:3.0:1789429278.671371:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f65fb80 00000100:00100000:3.0:1789429278.671411:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11375 00000100:00100000:3.0:1789429278.671423:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634866176:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429278.672534:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351634866176:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 1105us (1500us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429278.672548:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11375 00002000:00100000:3.0:1789429278.672559:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (311296->315391) req@ffff946f2f65fb80 x1876351634866176/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.672569:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65fb80 with x1876351634866176 ext(311296->315391) 00002000:00010000:3.0:1789429278.672575:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f65fb80 00000100:00100000:2.0:1789429278.676948:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.678366:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.678461:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634866304 00000100:00100000:3.0:1789429278.678475:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634866304 00002000:00100000:3.0:1789429278.678534:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (319488->323583) req@ffff946f2f65ed80 x1876351634866304/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.678548:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65ed80 with x1876351634866304 ext(319488->323583) 00002000:00010000:3.0:1789429278.678556:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f65ed80 00000100:00100000:3.0:1789429278.678593:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11376 00000100:00100000:3.0:1789429278.678604:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:2369:x1876351634866304:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429278.680647:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634866432 00000100:00100000:1.0:1789429278.680665:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634866432 00000100:00100000:1.0:1789429278.680778:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5459 00000100:00100000:1.0:1789429278.680792:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634866432:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429278.680816:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429278.680843:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad72635fe1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba66 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.680888:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.680900:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 257) 00000100:00100000:2.0:1789429278.681288:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:2369:x1876351634866304:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 2683us (2928us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429278.681300:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11376 00002000:00100000:2.0:1789429278.681313:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (319488->323583) req@ffff946f2f65ed80 x1876351634866304/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.681324:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65ed80 with x1876351634866304 ext(319488->323583) 00010000:00010000:2.0:1789429278.681333:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x40000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.681344:0:6686:0:(ldlm_lockd.c:595:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x40000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.681353:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65ed80 00010000:00010000:1.0:1789429278.681790:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 257) 00010000:00010000:1.0:1789429278.681801:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad72635fe1b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba66 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.681851:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.681869:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 26 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.681890:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01276a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648269056:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429278.681978:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.686085:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01276a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648269056:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429278.686154:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad72635fe1b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->319487] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba66 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.686191:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0800, rc 0) 00000100:00100000:1.0:1789429278.686303:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634866432:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5513us (9366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.686313:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5459 00000100:00100000:2.0:1789429278.688264:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.689446:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634866560 00000100:00100000:1.0:1789429278.689465:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634866560 00002000:00100000:1.0:1789429278.689548:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (315392->323583) req@ffff946f2f65c000 x1876351634866560/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 8680/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.689562:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65c000 with x1876351634866560 ext(315392->323583) 00010000:00010000:1.0:1789429278.689573:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 27 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.689595:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 27 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429278.689605:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65c000 00000100:00100000:1.0:1789429278.689652:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1246 00000100:00100000:1.0:1789429278.689665:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634866560:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429278.689766:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.690279:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634866688 00000100:00100000:0.0:1789429278.690286:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634866688 00002000:00100000:0.0:1789429278.690315:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f2f65f800 x1876351634866688/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.690324:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65f800 with x1876351634866688 ext(323584->327679) 00010000:00010000:0.0:1789429278.690331:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 30 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.690345:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 30 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.690353:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65f800 00000100:00100000:0.0:1789429278.690385:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1247 00000100:00100000:0.0:1789429278.690393:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+30:2368:x1876351634866688:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.690562:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+30:2368:x1876351634866688:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 168us (796us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429278.690571:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1247 00002000:00100000:0.0:1789429278.690579:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f2f65f800 x1876351634866688/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.690593:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65f800 with x1876351634866688 ext(323584->327679) 00010000:00010000:0.0:1789429278.690599:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 30 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.690612:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 30 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.690619:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65f800 00000100:00100000:1.0:1789429278.694362:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634866560:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 4678us (6090us total) trans 4294969561 rc 0/0 00000100:00100000:1.0:1789429278.694383:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1246 00002000:00100000:1.0:1789429278.694411:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (315392->323583) req@ffff946f2f65c000 x1876351634866560/t4294969561(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 8680/448 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.694423:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65c000 with x1876351634866560 ext(315392->323583) 00010000:00010000:1.0:1789429278.694438:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 29 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.694465:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 29 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429278.694474:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65c000 00000100:00100000:2.0:1789429278.700282:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.703471:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634866816 00000100:00100000:1.0:1789429278.703498:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634866816 00000100:00100000:1.0:1789429278.703608:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5460 00000100:00100000:1.0:1789429278.703623:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634866816:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429278.703650:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429278.703679:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba6d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.703726:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 257) 00010000:00010000:1.0:1789429278.703732:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 257) 00010000:00010000:1.0:1789429278.703739:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.703755:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.703772:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429278.703869:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634866816:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 249us (3862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.703877:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5460 00000100:00100000:3.0:1789429278.704505:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.709459:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634866944 00000100:00100000:0.0:1789429278.709482:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634866944 00010000:00010000:0.0:1789429278.709555:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 30 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.709618:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5898 00000100:00100000:0.0:1789429278.709630:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+30:2368:x1876351634866944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.709651:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789429278.709680:0:11354:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1789429278 -> 1789429279 00010000:00010000:0.0:1789429278.709689:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 30 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.709709:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 30 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.709742:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [315392->18446744073709551615] (req 315392->319487) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba5f expref: 30 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.709765:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 257) 00010000:00010000:0.0:1789429278.709771:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 257) 00010000:00010000:0.0:1789429278.709782:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad72635fe1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba66 expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.709793:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad72635fe1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba66 expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.709804:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 257) 00010000:00010000:0.0:1789429278.709807:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 257) 00010000:00010000:0.0:1789429278.709812:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 29 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.709820:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 29 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.709867:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 29 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.709891:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648269184:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.710012:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad72635fe1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba66 expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.710024:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648269312:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.710049:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.715910:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648269184:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.715933:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648269312:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.715973:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.716072:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:2368:x1876351634866944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6442us (11567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.716087:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5898 00000100:00100000:1.0:1789429278.718865:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.718959:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634867072 00000100:00100000:3.0:1789429278.718972:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634867072 00002000:00100000:3.0:1789429278.719054:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (315392->323583) req@ffff946e01276a00 x1876351634867072/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.719067:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01276a00 with x1876351634867072 ext(315392->323583) 00002000:00010000:3.0:1789429278.719075:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e01276a00 00000100:00100000:0.0:1789429278.719329:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11377 00000100:00100000:0.0:1789429278.719347:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634867072:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.719652:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634867072:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 310us (799us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1789429278.719661:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11377 00002000:00100000:0.0:1789429278.719669:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (315392->323583) req@ffff946e01276a00 x1876351634867072/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/8632 e 0 to 0 dl 1789429289 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.719679:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01276a00 with x1876351634867072 ext(315392->323583) 00002000:00010000:0.0:1789429278.719683:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e01276a00 00000100:00100000:3.0:1789429278.729680:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.729796:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634867200 00000100:00100000:2.0:1789429278.729811:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634867200 00000100:00100000:2.0:1789429278.729892:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5461 00000100:00100000:2.0:1789429278.729908:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634867200:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429278.729932:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429278.729957:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba74 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.730000:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.730018:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 257) 00010000:00010000:2.0:1789429278.730023:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 257) 00010000:00010000:2.0:1789429278.730029:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.730070:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.730085:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 28 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.730102:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648269440:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429278.730266:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.740709:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.740866:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634867328 00000100:00100000:0.0:1789429278.740878:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634867328 00002000:00100000:0.0:1789429278.740949:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946e01276680 x1876351634867328/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.740963:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01276680 with x1876351634867328 ext(323584->327679) 00010000:00010000:0.0:1789429278.740974:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.740996:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.741006:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01276680 00000100:00100000:0.0:1789429278.741060:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1248 00000100:00100000:0.0:1789429278.741071:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634867328:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.741393:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634867328:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 322us (696us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429278.741402:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1248 00002000:00100000:0.0:1789429278.741410:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946e01276680 x1876351634867328/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.741418:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01276680 with x1876351634867328 ext(323584->327679) 00010000:00010000:0.0:1789429278.741425:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.741437:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.741446:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01276680 00000100:00100000:2.0:1789429278.742423:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648269440:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429278.742464:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.742487:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031200, rc 0) 00000100:00100000:2.0:1789429278.742545:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634867200:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 12643us (12879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.742558:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5461 00000100:00100000:1.0:1789429278.745759:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.745952:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634867456 00000100:00100000:0.0:1789429278.745967:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634867456 00000100:00100000:0.0:1789429278.746046:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5462 00000100:00100000:0.0:1789429278.746058:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634867456:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.746081:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.746105:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba7b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.746842:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1789429278.746926:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 257) 00010000:00010000:1.0:1789429278.746940:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.746949:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 257) 00010000:00010000:1.0:1789429278.746955:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.747017:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.747036:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.747058:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:1.0:1789429278.747309:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634867456:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 1251us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.747320:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5462 00000100:00100000:0.0:1789429278.747755:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634867584 00000100:00100000:0.0:1789429278.747764:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634867584 00010000:00010000:0.0:1789429278.747800:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 30 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.747840:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5899 00000100:00100000:0.0:1789429278.747850:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634867584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.747862:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.747889:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 30 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.747904:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 30 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.747931:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba6d expref: 30 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.747953:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 257) 00010000:00010000:0.0:1789429278.747957:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 257) 00010000:00010000:0.0:1789429278.747966:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.747976:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.748020:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.748034:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 27 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.748050:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648269696:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.748590:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.751977:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648269696:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.752028:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.752102:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634867584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4251us (5260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.752122:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5899 00000100:00100000:3.0:1789429278.752801:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.752945:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634867712 00000100:00100000:2.0:1789429278.752954:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634867712 00002000:00100000:2.0:1789429278.753024:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f3fbcdc00 x1876351634867712/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.753036:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcdc00 with x1876351634867712 ext(323584->360447) 00010000:00010000:2.0:1789429278.753047:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.753068:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.753077:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcdc00 00000100:00100000:2.0:1789429278.753532:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1249 00000100:00100000:2.0:1789429278.753548:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634867712:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429278.765952:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634867712:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 12391us (13137us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429278.765969:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1249 00002000:00100000:2.0:1789429278.765986:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f3fbcdc00 x1876351634867712/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.765999:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcdc00 with x1876351634867712 ext(323584->360447) 00010000:00010000:2.0:1789429278.766019:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.766049:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.766059:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcdc00 00000100:00100000:3.0:1789429278.772440:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.773277:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.773726:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634867968 00000100:00100000:2.0:1789429278.773741:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634867968 00010000:00010000:2.0:1789429278.773796:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.773851:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5900 00000100:00100000:2.0:1789429278.773864:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634867968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.773884:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.773913:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.773931:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.773962:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb10459/0xb4c3dad72635fe29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba74 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.773985:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 257) 00010000:00010000:2.0:1789429278.773990:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 257) 00010000:00010000:2.0:1789429278.774000:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.774026:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.774076:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.774094:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648269824:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.774448:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.775519:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634867840 00000100:00100000:1.0:1789429278.775534:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634867840 00000100:00100000:1.0:1789429278.775609:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5463 00000100:00100000:1.0:1789429278.775620:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634867840:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429278.775641:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429278.775667:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba82 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.775706:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.775717:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 257) 00010000:00010000:1.0:1789429278.775721:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 257) 00010000:00010000:1.0:1789429278.775727:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 29 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.775766:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.775782:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 28 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.775798:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01276300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648269952:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429278.775890:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.776979:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648269824:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.777017:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.777074:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634867968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3211us (3800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.777085:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5900 00000100:00100000:2.0:1789429278.786424:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.786562:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634868096 00000100:00100000:0.0:1789429278.786574:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634868096 00010000:00010000:0.0:1789429278.786625:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 29 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.786674:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5901 00000100:00100000:0.0:1789429278.786683:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2368:x1876351634868096:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.786702:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.786731:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 29 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.786748:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 29 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.786780:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 257) 00010000:00010000:0.0:1789429278.786785:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 257) 00010000:00010000:0.0:1789429278.786795:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.786806:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.786851:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.786868:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648270080:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.786968:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00010000:00010000:1.0:1789429278.787916:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fe30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba7b expref: 29 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.787941:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01276300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648269952:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429278.787972:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.787987:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429278.788052:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634867840:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 12435us (15629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.788062:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5463 00000100:00100000:2.0:1789429278.798808:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.799759:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634868224 00000100:00100000:3.0:1789429278.799777:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634868224 00000100:00100000:3.0:1789429278.799925:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5464 00000100:00100000:3.0:1789429278.799938:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634868224:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.799965:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.799993:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba89 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.800054:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.800066:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 257) 00010000:00010000:3.0:1789429278.800072:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 257) 00010000:00010000:3.0:1789429278.800078:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.800135:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.800151:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 27 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.800177:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648270208:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.800347:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.804096:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648270080:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.804159:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.804280:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2368:x1876351634868096:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 17595us (17866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.804295:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5901 00000100:00100000:3.0:1789429278.808567:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648270208:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.808618:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 29 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.808645:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429278.808724:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634868224:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8788us (9931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.808735:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5464 00000100:00100000:2.0:1789429278.814391:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.814753:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634868352 00000100:00100000:0.0:1789429278.814768:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634868352 00002000:00100000:0.0:1789429278.814836:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f05422a00 x1876351634868352/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.814850:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05422a00 with x1876351634868352 ext(323584->360447) 00010000:00010000:0.0:1789429278.814861:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.814884:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.814894:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05422a00 00000100:00100000:0.0:1789429278.814931:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1250 00000100:00100000:0.0:1789429278.814943:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634868352:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429278.827032:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634868352:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 12064us (12628us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429278.827051:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1250 00002000:00100000:0.0:1789429278.827070:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f05422a00 x1876351634868352/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.827083:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05422a00 with x1876351634868352 ext(323584->360447) 00010000:00010000:0.0:1789429278.827098:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.827134:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.827145:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05422a00 00000100:00100000:2.0:1789429278.834883:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.834940:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.835055:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634868608 00000100:00100000:0.0:1789429278.835069:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634868608 00010000:00010000:0.0:1789429278.835139:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.835254:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5902 00000100:00100000:0.0:1789429278.835267:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634868608:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.835287:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.835320:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.835338:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.835369:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72635fe37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba82 expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.835393:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 257) 00010000:00010000:0.0:1789429278.835399:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 257) 00010000:00010000:0.0:1789429278.835411:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.835424:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.835476:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.835495:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648270336:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.835608:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.835676:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634868480 00000100:00100000:3.0:1789429278.835682:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634868480 00000100:00100000:3.0:1789429278.835724:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5465 00000100:00100000:3.0:1789429278.835732:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634868480:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.835750:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.835769:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba90 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.835793:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.835801:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 257) 00010000:00010000:3.0:1789429278.835805:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 257) 00010000:00010000:3.0:1789429278.835810:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.835834:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.835849:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 28 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.835861:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648270464:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.835890:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.849781:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.849916:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648270336:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.849951:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.850039:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634868608:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 14774us (15096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.850053:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5902 00000100:00100000:1.0:1789429278.850429:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634868736 00000100:00100000:1.0:1789429278.850439:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634868736 00002000:00100000:1.0:1789429278.850498:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f05421180 x1876351634868736/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.850511:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05421180 with x1876351634868736 ext(323584->327679) 00010000:00010000:1.0:1789429278.850521:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.850541:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429278.850557:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05421180 00000100:00100000:1.0:1789429278.850597:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1251 00000100:00100000:1.0:1789429278.850608:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634868736:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429278.850868:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634868736:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 260us (1101us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429278.850876:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1251 00002000:00100000:1.0:1789429278.850883:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f05421180 x1876351634868736/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429278.850891:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05421180 with x1876351634868736 ext(323584->327679) 00010000:00010000:1.0:1789429278.850898:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.850910:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429278.850917:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05421180 00000100:00100000:3.0:1789429278.851533:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648270464:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.851569:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.851591:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429278.851627:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634868480:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 15896us (16758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.851640:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5465 00000100:00100000:2.0:1789429278.860954:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.861000:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.861324:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634868864 00000100:00100000:1.0:1789429278.861337:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634868864 00000100:00100000:1.0:1789429278.861408:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5466 00000100:00100000:1.0:1789429278.861418:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634868864:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429278.861442:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429278.861464:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba97 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.861511:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 257) 00010000:00010000:1.0:1789429278.861521:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.861529:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 257) 00010000:00010000:1.0:1789429278.861535:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.861585:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.861599:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.861614:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:1.0:1789429278.861686:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634868864:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 269us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.861693:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5466 00000100:00100000:2.0:1789429278.862292:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634868992 00000100:00100000:2.0:1789429278.862300:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634868992 00010000:00010000:2.0:1789429278.862329:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 30 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.862363:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5903 00000100:00100000:2.0:1789429278.862371:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634868992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.862382:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.862407:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 30 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.862421:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 30 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.862444:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba89 expref: 30 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.862460:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 257) 00010000:00010000:2.0:1789429278.862465:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 257) 00010000:00010000:2.0:1789429278.862473:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.862483:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.862509:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.862530:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 27 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.862545:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05423800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648270720:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.862628:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.869876:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05423800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648270720:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.869914:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.869999:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634868992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7627us (8996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.870013:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5903 00000100:00100000:0.0:1789429278.870431:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.871367:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634869120 00000100:00100000:2.0:1789429278.871380:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634869120 00010000:00010000:2.0:1789429278.871427:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.871468:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5904 00000100:00100000:2.0:1789429278.871478:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2369:x1876351634869120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429278.871499:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429278.871532:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.871549:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.871586:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba90 expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.871611:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 257) 00010000:00010000:2.0:1789429278.871616:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 257) 00010000:00010000:2.0:1789429278.871627:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.871640:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.871683:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.871696:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05423800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648270848:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429278.871782:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.875187:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05423800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648270848:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429278.875245:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429278.875330:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2369:x1876351634869120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3851us (4899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.875344:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5904 00000100:00100000:1.0:1789429278.878476:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.878586:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634869248 00000100:00100000:3.0:1789429278.878600:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634869248 00000100:00100000:3.0:1789429278.878674:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5467 00000100:00100000:3.0:1789429278.878685:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634869248:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.878707:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.878732:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ba9e expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.878772:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.878783:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 257) 00010000:00010000:3.0:1789429278.878788:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 257) 00010000:00010000:3.0:1789429278.878793:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.878837:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.878852:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 28 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.878868:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648270976:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.878977:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.885420:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648270976:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.885468:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.885497:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429278.885575:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634869248:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6890us (7123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.885585:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5467 00000100:00100000:0.0:1789429278.886787:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.887891:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634869376 00000100:00100000:1.0:1789429278.887908:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634869376 00010000:00010000:1.0:1789429278.887976:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 29 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.888292:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5905 00000100:00100000:1.0:1789429278.888306:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634869376:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429278.888328:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429278.888357:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 29 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.888374:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 29 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.888405:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635fe4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba97 expref: 29 pid: 6680 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.888430:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 257) 00010000:00010000:1.0:1789429278.888436:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 257) 00010000:00010000:1.0:1789429278.888447:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.888459:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429278.888507:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429278.888524:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01275880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648271104:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429278.888645:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.893584:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.893821:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01275880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648271104:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.893852:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.893926:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:2371:x1876351634869376:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5622us (7149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.893940:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5905 00000100:00100000:3.0:1789429278.894252:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634869504 00000100:00100000:3.0:1789429278.894263:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634869504 00000100:00100000:3.0:1789429278.894326:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5468 00000100:00100000:3.0:1789429278.894337:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634869504:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.894359:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.894385:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1baa5 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.894426:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.894438:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 257) 00010000:00010000:3.0:1789429278.894443:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 257) 00010000:00010000:3.0:1789429278.894449:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 29 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.894489:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.894513:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 27 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.894529:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648271232:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.894597:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.896411:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.899969:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634869632 00000100:00100000:0.0:1789429278.899990:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634869632 00002000:00100000:0.0:1789429278.900079:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f3fbcd500 x1876351634869632/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.900092:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcd500 with x1876351634869632 ext(323584->360447) 00010000:00010000:0.0:1789429278.900104:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.900127:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.900135:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcd500 00000100:00100000:0.0:1789429278.900191:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1252 00000100:00100000:0.0:1789429278.900217:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634869632:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429278.905883:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648271232:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.905933:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 29 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.905963:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429278.906052:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634869504:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11716us (12482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.906650:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5468 00000100:00100000:0.0:1789429278.907403:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634869632:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7196us (10999us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429278.907416:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1252 00002000:00100000:0.0:1789429278.907429:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f3fbcd500 x1876351634869632/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429278.907441:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcd500 with x1876351634869632 ext(323584->360447) 00010000:00010000:0.0:1789429278.907452:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.907472:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429278.907482:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcd500 00000100:00100000:1.0:1789429278.922745:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.922807:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.922934:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634869760 00000100:00100000:3.0:1789429278.922949:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634869760 00000100:00100000:3.0:1789429278.923033:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5469 00000100:00100000:3.0:1789429278.923047:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634869760:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.923077:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.923118:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1baac expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.923122:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634869888 00000100:00100000:0.0:1789429278.923127:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634869888 00010000:00010000:0.0:1789429278.923153:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 30 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.923163:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 257) 00010000:00010000:3.0:1789429278.923192:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.923193:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5906 00010000:00010000:3.0:1789429278.923218:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(59 257) 00010000:00010000:3.0:1789429278.923225:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.923229:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2368:x1876351634869888:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.923241:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.923267:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 30 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.923279:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.923282:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 30 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.923305:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635fe53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba9e expref: 30 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.923451:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.923467:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 257) 00010000:00010000:3.0:1789429278.923471:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 257) 00010000:00010000:3.0:1789429278.923480:0:6681:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.923491:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.923518:0:6681:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.923533:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 28 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.923555:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648271488:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429278.923706:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.929135:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.929504:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648271488:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429278.929537:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429278.929612:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634869760:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6568us (6882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429278.929623:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5469 00000100:00100000:2.0:1789429278.930232:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634870016 00000100:00100000:2.0:1789429278.930244:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634870016 00002000:00100000:2.0:1789429278.930305:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946e01277b80 x1876351634870016/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.930317:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01277b80 with x1876351634870016 ext(323584->327679) 00010000:00010000:2.0:1789429278.930328:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.930348:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.930357:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01277b80 00000100:00100000:2.0:1789429278.930392:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1253 00000100:00100000:2.0:1789429278.930403:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634870016:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429278.930635:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634870016:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 232us (1514us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429278.930642:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1253 00002000:00100000:2.0:1789429278.930648:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946e01277b80 x1876351634870016/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.930657:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01277b80 with x1876351634870016 ext(323584->327679) 00010000:00010000:2.0:1789429278.930663:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.930675:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.930683:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01277b80 00010000:00010000:0.0:1789429278.931309:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.931361:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2368:x1876351634869888:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8158us (8550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.931372:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5906 00000100:00100000:1.0:1789429278.942374:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.942884:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634870144 00000100:00100000:0.0:1789429278.942899:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634870144 00000100:00100000:0.0:1789429278.942980:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5470 00000100:00100000:0.0:1789429278.942992:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c14d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634870144:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429278.943017:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429278.943044:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bab3 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.943089:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 257) 00010000:00010000:0.0:1789429278.943098:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.943105:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 257) 00010000:00010000:0.0:1789429278.943120:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.943192:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.943236:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.943252:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429278.943336:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c14d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634870144:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 345us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.943343:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5470 00000100:00100000:3.0:1789429278.944082:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1789429278.947452:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429278.950063:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634870272 00000100:00100000:0.0:1789429278.950084:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634870272 00010000:00010000:0.0:1789429278.950164:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 30 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.950281:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5907 00000100:00100000:0.0:1789429278.950294:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351634870272:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.950316:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.950347:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 30 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.950365:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 30 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.950397:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635fe5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baa5 expref: 30 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.950417:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 257) 00010000:00010000:0.0:1789429278.950421:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 257) 00010000:00010000:0.0:1789429278.950429:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.950438:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.950487:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.950503:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 27 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.950535:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648271744:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.950668:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429278.960982:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.961267:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648271744:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.961306:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.961377:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634870272:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11084us (17296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.961390:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5907 00000100:00100000:0.0:1789429278.961430:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634870400 00000100:00100000:0.0:1789429278.961438:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634870400 00010000:00010000:0.0:1789429278.961476:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.961516:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5908 00000100:00100000:0.0:1789429278.961537:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634870400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.961556:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.961586:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.961602:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.961634:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72635fe61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baac expref: 28 pid: 6681 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.961662:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 257) 00010000:00010000:0.0:1789429278.961667:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 257) 00010000:00010000:0.0:1789429278.961677:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.961689:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.961733:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.961750:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648271872:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.961814:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.968817:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648271872:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429278.968858:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429278.968941:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634870400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7405us (7975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429278.968956:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5908 00000100:00100000:1.0:1789429278.971659:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.974445:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634870528 00000100:00100000:3.0:1789429278.974468:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634870528 00000100:00100000:3.0:1789429278.974566:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5471 00000100:00100000:3.0:1789429278.974578:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634870528:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429278.974602:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429278.974629:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1baba expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.974673:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.974684:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 257) 00010000:00010000:3.0:1789429278.974689:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 257) 00010000:00010000:3.0:1789429278.974696:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.974742:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.974758:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 28 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429278.974775:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648272000:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429278.974897:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:1.0:1789429278.982259:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429278.982422:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634870656 00000100:00100000:2.0:1789429278.982435:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634870656 00002000:00100000:2.0:1789429278.982506:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946e01274700 x1876351634870656/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429278.982520:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01274700 with x1876351634870656 ext(323584->327679) 00010000:00010000:2.0:1789429278.982532:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.982557:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.982567:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01274700 00000100:00100000:2.0:1789429278.982607:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1254 00000100:00100000:2.0:1789429278.982619:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634870656:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429278.982743:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648272000:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429278.982781:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.982805:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:2.0:1789429278.982874:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634870656:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 255us (672us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429278.982883:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1254 00002000:00100000:2.0:1789429278.982892:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946e01274700 x1876351634870656/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:14/0 lens 488/4536 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1789429278.982898:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634870528:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8318us (11249us total) trans 0 rc 0/0 00002000:00100000:2.0:1789429278.982910:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01274700 with x1876351634870656 ext(323584->327679) 00000100:00100000:3.0:1789429278.982915:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5471 00010000:00010000:2.0:1789429278.982918:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.982932:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429278.982940:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01274700 00000100:00100000:1.0:1789429278.986141:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429278.986466:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429278.986741:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634870912 00000100:00100000:0.0:1789429278.986758:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634870912 00010000:00010000:0.0:1789429278.986818:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.986872:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5909 00000100:00100000:0.0:1789429278.986885:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634870912:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429278.986903:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429278.986934:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.986952:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.986985:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bab3 expref: 29 pid: 6682 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.987020:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 257) 00010000:00010000:0.0:1789429278.987026:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 257) 00010000:00010000:0.0:1789429278.987037:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.987050:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429278.987100:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429278.987118:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648272128:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429278.987298:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429278.987420:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634870784 00000100:00100000:2.0:1789429278.987428:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634870784 00000100:00100000:2.0:1789429278.987469:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5472 00000100:00100000:2.0:1789429278.987478:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634870784:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429278.987495:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429278.987513:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bac1 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.987537:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.987545:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 257) 00010000:00010000:2.0:1789429278.987549:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 257) 00010000:00010000:2.0:1789429278.987553:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.987578:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.987592:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 27 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429278.987604:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05423800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648272256:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429278.987636:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429278.996305:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429278.996584:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634871040 00000100:00100000:3.0:1789429278.996598:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634871040 00002000:00100000:3.0:1789429278.996667:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f344b9500 x1876351634871040/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/0 e 0 to 0 dl 1789429289 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429278.996680:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b9500 with x1876351634871040 ext(323584->360447) 00010000:00010000:3.0:1789429278.996692:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429278.996721:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429278.996730:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b9500 00000100:00100000:3.0:1789429278.996773:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1255 00000100:00100000:3.0:1789429278.996785:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634871040:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429278.997332:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648272128:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429278.997360:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429278.997399:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351634870912:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10516us (10932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429278.997409:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5909 00000100:00100000:2.0:1789429278.998845:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05423800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648272256:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429278.998888:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 29 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429278.998917:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030400, rc 0) 00000100:00100000:2.0:1789429278.998990:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634870784:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11512us (12858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429278.999001:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5472 00000100:00100000:3.0:1789429279.010749:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634871040:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 13948us (14442us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429279.010769:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1255 00002000:00100000:3.0:1789429279.010788:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f344b9500 x1876351634871040/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:14/0 lens 488/440 e 0 to 0 dl 1789429289 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.010801:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b9500 with x1876351634871040 ext(323584->360447) 00010000:00010000:3.0:1789429279.010815:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.010841:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.010852:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b9500 00000100:00100000:0.0:1789429279.015466:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.015517:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.015710:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634871296 00000100:00100000:1.0:1789429279.015724:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634871296 00010000:00010000:1.0:1789429279.015796:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.015843:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5910 00000100:00100000:1.0:1789429279.015855:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2369:x1876351634871296:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429279.015874:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429279.015905:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.015920:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.015955:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad72635fe6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baba expref: 28 pid: 8085 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.015978:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 257) 00010000:00010000:1.0:1789429279.015984:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 257) 00010000:00010000:1.0:1789429279.015995:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789429279.016103:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789429279.016141:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.016352:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634871168 00000100:00100000:3.0:1789429279.016358:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634871168 00000100:00100000:3.0:1789429279.016396:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5473 00000100:00100000:3.0:1789429279.016404:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634871168:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429279.016421:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429279.016440:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bac8 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.016464:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.016474:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 257) 00010000:00010000:3.0:1789429279.016478:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 257) 00010000:00010000:3.0:1789429279.016483:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.016508:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.016616:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.016646:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 28 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.016664:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648272512:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429279.016772:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.019261:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648272512:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429279.025368:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 28 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.025411:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01274e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648272384:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429279.025574:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00010000:00010000:0.0:1789429279.031519:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.031557:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:0.0:1789429279.031643:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634871168:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 15237us (16189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.031654:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5473 00000100:00100000:1.0:1789429279.031661:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.031701:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634871424 00000100:00100000:1.0:1789429279.031711:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634871424 00010000:00010000:1.0:1789429279.031769:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.031781:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01274e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648272384:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429279.031807:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5911 00010000:00010000:3.0:1789429279.031807:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429279.031816:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2369:x1876351634871424:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789429279.031830:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2369:x1876351634871296:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 15979us (16313us total) trans 0 rc 0/0 00010000:00010000:1.0:1789429279.031833:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789429279.031836:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5910 00010000:00010000:1.0:1789429279.031862:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.031876:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.031908:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd6c7af4/0xb4c3dad72635fe76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac1 expref: 29 pid: 20745 timeout: 1076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.031925:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=1s v=(65 257) 00010000:00010000:1.0:1789429279.031930:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 257) 00010000:00010000:1.0:1789429279.031941:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.031952:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.031992:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.032015:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01277800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648272640:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429279.032075:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00080000:0.0:1789429279.032736:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429279.034550:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01277800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648272640:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429279.034587:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.034804:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:2369:x1876351634871424:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2985us (3139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.034818:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5911 00000100:00100000:2.0:1789429279.040900:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.041113:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634871552 00000100:00100000:1.0:1789429279.041126:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634871552 00000100:00100000:1.0:1789429279.041237:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5474 00000100:00100000:1.0:1789429279.041249:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634871552:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429279.041273:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.041299:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bacf expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.041344:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.041357:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 257) 00010000:00010000:1.0:1789429279.041362:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 257) 00010000:00010000:1.0:1789429279.041368:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.041411:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.041427:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 27 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.041445:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01277800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648272768:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429279.041548:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.048920:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.049260:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634871680 00000100:00100000:2.0:1789429279.049274:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634871680 00010000:00010000:2.0:1789429279.049330:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.049378:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5912 00000100:00100000:2.0:1789429279.049390:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634871680:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.049410:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.049439:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.049477:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.049513:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 257) 00010000:00010000:2.0:1789429279.049526:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 257) 00010000:00010000:2.0:1789429279.049538:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.049550:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.049601:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.049618:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05422d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648272896:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.049735:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789429279.050291:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635fe7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bac8 expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.050314:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01277800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648272768:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.050348:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.050361:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:0.0:1789429279.050404:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634871552:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9157us (9520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.050415:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5474 00000100:00100000:1.0:1789429279.050607:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.050790:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634871808 00000100:00100000:3.0:1789429279.050797:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634871808 00000100:00100000:3.0:1789429279.050850:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5475 00000100:00100000:3.0:1789429279.050860:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634871808:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429279.050879:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429279.050897:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bad6 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.050926:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.050937:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 257) 00010000:00010000:3.0:1789429279.050941:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 257) 00010000:00010000:3.0:1789429279.050946:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 29 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.050978:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.050994:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.051008:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648273024:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429279.051078:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.059616:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648273024:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429279.059717:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 29 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.059748:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429279.059830:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634871808:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8971us (9223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.059841:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5475 00000100:00100000:0.0:1789429279.060094:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.060125:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634871936 00000100:00100000:0.0:1789429279.060134:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634871936 00002000:00100000:0.0:1789429279.060227:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f344b8e00 x1876351634871936/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.060238:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b8e00 with x1876351634871936 ext(323584->327679) 00010000:00010000:0.0:1789429279.060246:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.060264:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.060273:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b8e00 00000100:00100000:0.0:1789429279.060299:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1256 00000100:00100000:0.0:1789429279.060311:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634871936:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429279.060551:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634871936:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 242us (458us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429279.060558:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1256 00002000:00100000:0.0:1789429279.060565:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f344b8e00 x1876351634871936/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.060574:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b8e00 with x1876351634871936 ext(323584->327679) 00010000:00010000:0.0:1789429279.060580:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.060590:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.060603:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b8e00 00000100:00100000:3.0:1789429279.060752:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05422d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648272896:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.060988:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.061034:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634871680:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11646us (12130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.061044:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5912 00000100:00100000:1.0:1789429279.065730:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.065945:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.066066:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634872192 00000100:00100000:3.0:1789429279.066080:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634872192 00010000:00010000:3.0:1789429279.066140:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.066250:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5913 00000100:00100000:3.0:1789429279.066263:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634872192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.066283:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.066316:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.066333:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.066365:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fe84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bacf expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.066388:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 257) 00010000:00010000:3.0:1789429279.066394:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 257) 00010000:00010000:3.0:1789429279.066404:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.066417:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.066468:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.066486:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648273152:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.066601:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.067470:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634872064 00000100:00100000:2.0:1789429279.067482:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634872064 00000100:00100000:2.0:1789429279.067637:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5476 00000100:00100000:2.0:1789429279.067648:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634872064:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429279.067668:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429279.067688:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1badd expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.067726:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.067737:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 257) 00010000:00010000:2.0:1789429279.067742:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 257) 00010000:00010000:2.0:1789429279.067747:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.067781:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.067797:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 27 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.067810:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05423480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648273280:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429279.067889:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.069503:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648273152:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.069552:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.069747:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351634872192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3484us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.069760:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5913 00000100:00100000:2.0:1789429279.071733:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05423480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648273280:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429279.071781:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 29 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.071809:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031800, rc 0) 00000100:00100000:2.0:1789429279.071871:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634872064:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4225us (6158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.071886:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5476 00000100:00100000:1.0:1789429279.074419:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.074538:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634872320 00000100:00100000:0.0:1789429279.074551:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634872320 00002000:00100000:0.0:1789429279.074619:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946e15a52680 x1876351634872320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.074633:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a52680 with x1876351634872320 ext(323584->360447) 00010000:00010000:0.0:1789429279.074645:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.074664:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.074673:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a52680 00000100:00100000:0.0:1789429279.074715:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1257 00000100:00100000:0.0:1789429279.074727:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634872320:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429279.078668:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634872320:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3925us (4246us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429279.078685:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1257 00002000:00100000:2.0:1789429279.078701:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946e15a52680 x1876351634872320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.078715:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a52680 with x1876351634872320 ext(323584->360447) 00010000:00010000:2.0:1789429279.078727:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.078750:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.078760:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a52680 00000100:00100000:0.0:1789429279.088281:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.088401:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.088501:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634872576 00000100:00100000:1.0:1789429279.088516:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634872576 00010000:00010000:1.0:1789429279.088573:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.088630:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5914 00000100:00100000:1.0:1789429279.088643:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2369:x1876351634872576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429279.088665:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429279.088697:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.088714:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.088746:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fe8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bad6 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.088774:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 257) 00010000:00010000:1.0:1789429279.088779:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 257) 00010000:00010000:1.0:1789429279.088789:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.088802:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.088848:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.088864:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648273408:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429279.088972:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.089447:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634872448 00000100:00100000:3.0:1789429279.089455:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634872448 00000100:00100000:0.0:1789429279.089619:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5477 00000100:00100000:0.0:1789429279.089628:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634872448:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.089645:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.089664:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bae4 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.089702:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.089711:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 257) 00010000:00010000:0.0:1789429279.089716:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 257) 00010000:00010000:0.0:1789429279.089721:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.089752:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.089768:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 28 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.089780:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648273536:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.089843:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.092977:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648273408:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429279.093024:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429279.093093:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2369:x1876351634872576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4451us (4690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.093105:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5914 00000100:00100000:2.0:1789429279.093363:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648273536:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429279.093397:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.093426:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:2.0:1789429279.093457:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634872448:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3830us (5194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.093465:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5477 00000100:00100000:3.0:1789429279.095054:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.095363:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634872704 00000100:00100000:0.0:1789429279.095375:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634872704 00010000:00010000:0.0:1789429279.095427:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.095484:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5915 00000100:00100000:0.0:1789429279.095495:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634872704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.095514:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.095546:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.095561:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.095591:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000445ff87b/0xb4c3dad72635fe92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1badd expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.095614:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 257) 00010000:00010000:0.0:1789429279.095619:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 257) 00010000:00010000:0.0:1789429279.095629:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.095640:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.095688:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.095705:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648273664:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.095888:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.098967:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648273664:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.099019:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.099120:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:2371:x1876351634872704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3624us (4074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.099133:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5915 00000100:00100000:1.0:1789429279.105464:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.105870:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634872832 00000100:00100000:0.0:1789429279.105884:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634872832 00000100:00100000:0.0:1789429279.106012:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5478 00000100:00100000:0.0:1789429279.106030:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634872832:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.106056:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.106081:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1baeb expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.106127:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.106138:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 257) 00010000:00010000:0.0:1789429279.106143:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 257) 00010000:00010000:0.0:1789429279.106148:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.106247:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.106264:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 27 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.106281:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648273792:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.106387:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.110608:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648273792:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.110664:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.110693:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429279.110854:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634872832:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4825us (5405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.110865:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5478 00000100:00100000:2.0:1789429279.113517:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.113805:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.113919:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634873088 00000100:00100000:1.0:1789429279.113931:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634873088 00000100:00100000:1.0:1789429279.114014:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5479 00000100:00100000:1.0:1789429279.114026:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634873088:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429279.114053:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.114077:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1baf2 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.114121:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 257) 00010000:00010000:1.0:1789429279.114131:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.114138:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 257) 00010000:00010000:1.0:1789429279.114144:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 29 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.114365:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.114386:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 29 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.114401:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429279.114473:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634873088:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 450us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.114481:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5479 00000100:00100000:0.0:1789429279.114848:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634872960 00000100:00100000:0.0:1789429279.114857:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634872960 00010000:00010000:0.0:1789429279.114894:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.114932:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5916 00000100:00100000:0.0:1789429279.114940:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634872960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.114955:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.114986:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.117278:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.117337:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fe99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bae4 expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.117359:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 257) 00010000:00010000:0.0:1789429279.117365:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 257) 00010000:00010000:0.0:1789429279.117375:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.117387:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.117457:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.117479:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.117498:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648274048:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.117615:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.122021:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.122106:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634873216 00000100:00100000:3.0:1789429279.122120:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634873216 00002000:00100000:3.0:1789429279.122238:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946e15a51f80 x1876351634873216/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.122259:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51f80 with x1876351634873216 ext(323584->327679) 00010000:00010000:3.0:1789429279.122271:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.122293:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.122303:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51f80 00000100:00100000:3.0:1789429279.122340:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1258 00000100:00100000:3.0:1789429279.122353:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634873216:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429279.122640:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634873216:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 289us (638us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429279.122649:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1258 00002000:00100000:3.0:1789429279.122657:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946e15a51f80 x1876351634873216/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.122666:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51f80 with x1876351634873216 ext(323584->327679) 00010000:00010000:3.0:1789429279.122671:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.122683:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.122690:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51f80 00000100:00100000:0.0:1789429279.123614:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648274048:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.123650:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.123752:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634872960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8812us (10249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.123764:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5916 00000100:00100000:1.0:1789429279.129587:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.129641:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.129712:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634873344 00000100:00100000:0.0:1789429279.129727:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634873344 00000100:00100000:0.0:1789429279.129803:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5480 00000100:00100000:0.0:1789429279.129814:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634873344:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.129840:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.129867:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1baf9 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.129916:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 257) 00010000:00010000:0.0:1789429279.129927:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.129941:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 257) 00010000:00010000:0.0:1789429279.129948:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.130014:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.130033:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.130047:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429279.130129:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634873344:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 316us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.130136:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5480 00000100:00100000:3.0:1789429279.131044:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634873472 00000100:00100000:3.0:1789429279.131055:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634873472 00010000:00010000:3.0:1789429279.131093:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.131133:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5917 00000100:00100000:3.0:1789429279.131142:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634873472:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.131155:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.131401:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.131417:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.131444:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635fea0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baeb expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.131617:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 257) 00010000:00010000:3.0:1789429279.131622:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 257) 00010000:00010000:3.0:1789429279.131634:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.131645:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.131691:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.131708:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 27 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.131724:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648274304:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.131926:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.136632:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.136730:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634873600 00000100:00100000:0.0:1789429279.136745:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634873600 00002000:00100000:0.0:1789429279.136814:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f05422300 x1876351634873600/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.136828:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05422300 with x1876351634873600 ext(323584->360447) 00010000:00010000:0.0:1789429279.136840:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.136860:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.136874:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05422300 00000100:00100000:0.0:1789429279.136919:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1259 00000100:00100000:0.0:1789429279.136931:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634873600:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429279.137633:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648274304:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.137668:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.137719:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634873472:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6577us (8076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.137730:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5917 00000100:00100000:0.0:1789429279.144016:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634873600:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7059us (7372us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429279.144034:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1259 00002000:00100000:0.0:1789429279.144052:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f05422300 x1876351634873600/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.144064:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05422300 with x1876351634873600 ext(323584->360447) 00010000:00010000:0.0:1789429279.144078:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.144101:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.144111:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05422300 00000100:00100000:2.0:1789429279.147403:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.147566:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.147661:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634873856 00000100:00100000:1.0:1789429279.147676:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634873856 00010000:00010000:1.0:1789429279.147731:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.147784:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5918 00000100:00100000:1.0:1789429279.147796:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2368:x1876351634873856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429279.147817:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429279.147846:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.147863:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.147894:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635fea7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf2 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.147915:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 257) 00010000:00010000:1.0:1789429279.147920:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 257) 00010000:00010000:1.0:1789429279.147930:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.147943:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.147985:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.148112:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a51880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648274432:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429279.148296:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.148445:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634873728 00000100:00100000:0.0:1789429279.148450:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634873728 00000100:00100000:0.0:1789429279.150523:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5481 00000100:00100000:0.0:1789429279.150543:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634873728:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.150568:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.150596:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb00 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.150648:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.150660:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 257) 00010000:00010000:0.0:1789429279.150666:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 257) 00010000:00010000:0.0:1789429279.150672:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.150713:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.150728:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 28 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.150745:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648274560:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.150851:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f321b5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.154298:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a51880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648274432:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.154337:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.154410:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2368:x1876351634873856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6615us (6842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.154422:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5918 00000100:00100000:2.0:1789429279.155480:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.155594:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648274560:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.155640:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.155671:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429279.155739:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634873728:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5202us (8350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.155749:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5481 00000100:00100000:3.0:1789429279.155818:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634873984 00000100:00100000:3.0:1789429279.155828:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634873984 00010000:00010000:3.0:1789429279.155869:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.155902:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5919 00000100:00100000:3.0:1789429279.155911:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634873984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.155928:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.155958:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.155972:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.156023:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635feae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1baf9 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.156041:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 257) 00010000:00010000:3.0:1789429279.156047:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 257) 00010000:00010000:3.0:1789429279.156058:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.156071:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.156113:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.156131:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648274688:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.156266:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.159691:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648274688:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.159729:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.159801:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:2370:x1876351634873984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3889us (4329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.159813:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5919 00000100:00100000:2.0:1789429279.168386:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.168765:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634874112 00000100:00100000:0.0:1789429279.168779:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634874112 00000100:00100000:0.0:1789429279.168856:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5482 00000100:00100000:0.0:1789429279.168868:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634874112:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.168891:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.168916:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb07 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.168958:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.168971:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 257) 00010000:00010000:0.0:1789429279.168976:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(76 257) 00010000:00010000:0.0:1789429279.168982:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.169037:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.169053:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 27 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.169069:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648274816:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.169194:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f321b5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.172943:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.173055:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634874240 00000100:00100000:3.0:1789429279.173069:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634874240 00010000:00010000:3.0:1789429279.173122:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.173194:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5920 00000100:00100000:3.0:1789429279.173253:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634874240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.173272:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.173303:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.173319:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.173352:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(76 257) 00010000:00010000:3.0:1789429279.173357:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(76 257) 00010000:00010000:3.0:1789429279.173367:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.173379:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.173425:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.173440:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648274944:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.173544:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00010000:00010000:0.0:1789429279.174507:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635feb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb00 expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.174533:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648274816:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.174569:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.174585:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429279.174652:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634874112:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5786us (6280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.174663:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5482 00000100:00100000:2.0:1789429279.176743:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.176843:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634874368 00000100:00100000:3.0:1789429279.176857:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634874368 00000100:00100000:3.0:1789429279.176927:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5483 00000100:00100000:3.0:1789429279.176938:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634874368:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429279.176960:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429279.176985:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb0e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.177039:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.177051:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(76 257) 00010000:00010000:3.0:1789429279.177056:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 257) 00010000:00010000:3.0:1789429279.177062:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 29 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.177104:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.177120:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.177136:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648275072:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429279.177280:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.183873:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648274944:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.183913:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.183990:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634874240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10739us (11061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.184012:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5920 00000100:00100000:3.0:1789429279.185846:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.186041:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634874496 00000100:00100000:1.0:1789429279.186056:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634874496 00002000:00100000:1.0:1789429279.186119:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f3fbcca80 x1876351634874496/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429279.186133:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcca80 with x1876351634874496 ext(323584->327679) 00010000:00010000:1.0:1789429279.186145:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.186165:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429279.186175:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcca80 00000100:00100000:1.0:1789429279.186272:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1260 00000100:00100000:1.0:1789429279.186283:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634874496:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429279.186533:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634874496:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 250us (699us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429279.186540:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1260 00002000:00100000:1.0:1789429279.186548:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f3fbcca80 x1876351634874496/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429279.186557:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcca80 with x1876351634874496 ext(323584->327679) 00010000:00010000:1.0:1789429279.186563:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.186575:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429279.186582:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcca80 00000100:00100000:0.0:1789429279.189827:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648275072:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.189881:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.189910:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:0.0:1789429279.190013:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634874368:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 13075us (13280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.190024:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5483 00000100:00100000:2.0:1789429279.191906:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.191949:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.192024:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634874752 00000100:00100000:3.0:1789429279.192035:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634874752 00010000:00010000:3.0:1789429279.192079:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.192123:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5921 00000100:00100000:3.0:1789429279.192134:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2369:x1876351634874752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.192150:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.192191:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.192240:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.192269:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635febc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb07 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.192289:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 257) 00010000:00010000:3.0:1789429279.192294:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 257) 00010000:00010000:3.0:1789429279.192304:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 27 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.192316:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 27 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.192360:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 27 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.192376:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648275200:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.192461:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.192611:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634874624 00000100:00100000:1.0:1789429279.192617:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634874624 00000100:00100000:1.0:1789429279.192656:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5484 00000100:00100000:1.0:1789429279.192663:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634874624:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429279.192679:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.192696:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb15 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.192719:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 27 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.192727:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 257) 00010000:00010000:1.0:1789429279.192730:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 257) 00010000:00010000:1.0:1789429279.192735:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.192756:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 27 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.192775:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 27 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.192787:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648275328:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429279.192811:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.196302:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648275200:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.196347:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.196418:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2369:x1876351634874752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4284us (4465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.196433:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5921 00000100:00100000:1.0:1789429279.196743:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648275328:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429279.196775:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 29 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.196804:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429279.196853:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634874624:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4189us (4957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.196862:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5484 00000100:00100000:3.0:1789429279.205757:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.205886:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634874880 00000100:00100000:2.0:1789429279.205900:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634874880 00002000:00100000:2.0:1789429279.205967:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f3fbcea00 x1876351634874880/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.205980:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcea00 with x1876351634874880 ext(323584->360447) 00010000:00010000:2.0:1789429279.205993:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 28 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.206024:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 28 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.206041:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcea00 00000100:00100000:2.0:1789429279.206079:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1261 00000100:00100000:2.0:1789429279.206091:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634874880:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429279.210904:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634874880:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4796us (5143us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429279.210921:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1261 00002000:00100000:2.0:1789429279.210937:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f3fbcea00 x1876351634874880/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.210950:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcea00 with x1876351634874880 ext(323584->360447) 00010000:00010000:2.0:1789429279.210962:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 28 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.210986:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 28 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.210996:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcea00 00000100:00100000:0.0:1789429279.213702:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.214017:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634875008 00000100:00100000:2.0:1789429279.214031:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634875008 00000100:00100000:2.0:1789429279.214106:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5485 00000100:00100000:2.0:1789429279.214119:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634875008:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429279.214144:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429279.214185:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb1c expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.214278:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 257) 00010000:00010000:2.0:1789429279.214288:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.214295:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 257) 00010000:00010000:2.0:1789429279.214302:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.214358:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.214375:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.214390:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031400, rc 0) 00000100:00100000:2.0:1789429279.214701:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634875008:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 583us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.214710:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5485 00000100:00100000:1.0:1789429279.216809:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.217153:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634875136 00000100:00100000:0.0:1789429279.217172:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634875136 00010000:00010000:0.0:1789429279.217253:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 29 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.217309:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5922 00000100:00100000:0.0:1789429279.217321:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634875136:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.217340:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.217370:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 29 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.217386:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 29 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.217417:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72635fec3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb0e expref: 29 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.217438:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 257) 00010000:00010000:0.0:1789429279.217444:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 257) 00010000:00010000:0.0:1789429279.217468:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.217486:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.217537:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.217553:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.217568:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648275584:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.217677:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f321b5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.222054:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648275584:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.222093:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.222187:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634875136:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4859us (5382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.222240:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5922 00000100:00100000:1.0:1789429279.225287:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.225490:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634875264 00000100:00100000:2.0:1789429279.225503:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634875264 00010000:00010000:2.0:1789429279.225556:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.225607:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5923 00000100:00100000:2.0:1789429279.225620:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634875264:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.225639:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.225667:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.225683:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.225711:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635feca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb15 expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.225731:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 257) 00010000:00010000:2.0:1789429279.225737:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 257) 00010000:00010000:2.0:1789429279.225747:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.225759:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.225802:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.225818:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648275712:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.225913:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.229549:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648275712:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.229583:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.229652:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:2370:x1876351634875264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4034us (4378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.229664:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5923 00000100:00100000:1.0:1789429279.235885:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.236576:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634875392 00000100:00100000:0.0:1789429279.236591:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634875392 00000100:00100000:0.0:1789429279.236727:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5486 00000100:00100000:0.0:1789429279.236740:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634875392:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.236764:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.236787:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb23 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.236833:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.236845:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 257) 00010000:00010000:0.0:1789429279.236850:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 257) 00010000:00010000:0.0:1789429279.236856:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.236902:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.236918:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 27 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.236933:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648275840:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.237107:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f321b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.242069:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.242116:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.242239:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634875520 00000100:00100000:2.0:1789429279.242252:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634875520 00010000:00010000:2.0:1789429279.242308:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.242502:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5924 00000100:00100000:1.0:1789429279.242519:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634875520:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429279.242540:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429279.242572:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.242596:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.242633:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 257) 00010000:00010000:1.0:1789429279.242638:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 257) 00010000:00010000:1.0:1789429279.242650:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.242661:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.242712:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.242730:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a51880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648275968:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429279.242832:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c000 going to sleep for 11 seconds 00010000:00010000:0.0:1789429279.242986:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b51a3c35/0xb4c3dad72635fed1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb1c expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.243006:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648275840:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.243039:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.243057:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:0.0:1789429279.243093:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634875392:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6355us (7222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.243102:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5486 00000100:00100000:0.0:1789429279.243129:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634875648 00000100:00100000:0.0:1789429279.243134:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634875648 00000100:00100000:0.0:1789429279.243166:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5487 00000100:00100000:0.0:1789429279.243173:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634875648:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.243259:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.243277:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb2a expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.243299:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.243306:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 257) 00010000:00010000:0.0:1789429279.243310:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 257) 00010000:00010000:0.0:1789429279.243314:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.243336:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.243350:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.243665:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648276096:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.243712:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f321b5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.247647:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a51880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648275968:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.247684:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.247763:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634875520:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5248us (5708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.247780:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5924 00000100:00100000:1.0:1789429279.250509:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.251105:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648276096:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.251153:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.251243:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429279.251371:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634875648:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8195us (9252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.251383:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5487 00000100:00100000:2.0:1789429279.251589:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634875776 00000100:00100000:2.0:1789429279.251600:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634875776 00002000:00100000:2.0:1789429279.251653:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946e15a51c00 x1876351634875776/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.251665:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51c00 with x1876351634875776 ext(323584->327679) 00010000:00010000:2.0:1789429279.251673:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.251690:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.251698:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51c00 00000100:00100000:2.0:1789429279.251732:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1262 00000100:00100000:2.0:1789429279.251742:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634875776:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429279.252101:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634875776:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 359us (1606us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429279.252109:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1262 00002000:00100000:2.0:1789429279.252118:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946e15a51c00 x1876351634875776/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.252127:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51c00 with x1876351634875776 ext(323584->327679) 00010000:00010000:2.0:1789429279.252134:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.252147:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.252154:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51c00 00000100:00100000:3.0:1789429279.255686:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.255748:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.255856:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634875904 00000100:00100000:0.0:1789429279.255869:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634875904 00000100:00100000:0.0:1789429279.255942:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5488 00000100:00100000:0.0:1789429279.255954:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634875904:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.255978:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.256011:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb31 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.256052:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 257) 00010000:00010000:0.0:1789429279.256062:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.256070:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 257) 00010000:00010000:0.0:1789429279.256076:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.256128:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.256146:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.256160:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429279.256278:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634875904:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 326us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.256285:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5488 00000100:00100000:2.0:1789429279.256536:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634876032 00000100:00100000:2.0:1789429279.256542:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634876032 00010000:00010000:2.0:1789429279.256572:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.256610:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5925 00000100:00100000:2.0:1789429279.256619:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2368:x1876351634876032:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.256631:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.256660:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.256675:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.256699:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72635fed8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb23 expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.256717:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 257) 00010000:00010000:2.0:1789429279.256721:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 257) 00010000:00010000:2.0:1789429279.256730:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.256741:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.256773:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.256787:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 27 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.256805:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648276352:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.256880:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.263948:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.264897:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634876160 00000100:00100000:0.0:1789429279.264912:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634876160 00002000:00100000:0.0:1789429279.264983:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f05421f80 x1876351634876160/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.264996:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05421f80 with x1876351634876160 ext(323584->360447) 00010000:00010000:0.0:1789429279.265019:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.265040:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.265050:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05421f80 00000100:00100000:0.0:1789429279.265085:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1263 00000100:00100000:0.0:1789429279.265098:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634876160:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429279.269505:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648276352:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.269549:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.269638:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2368:x1876351634876032:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13018us (13888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.269653:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5925 00000100:00100000:0.0:1789429279.286936:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634876160:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 21824us (22985us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429279.286952:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1263 00002000:00100000:0.0:1789429279.286969:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f05421f80 x1876351634876160/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.286981:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05421f80 with x1876351634876160 ext(323584->360447) 00010000:00010000:0.0:1789429279.286994:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.287028:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.287038:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05421f80 00000100:00100000:3.0:1789429279.289976:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.290121:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634876288 00000100:00100000:1.0:1789429279.290136:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634876288 00000100:00100000:1.0:1789429279.290282:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5489 00000100:00100000:1.0:1789429279.290294:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634876288:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429279.290319:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.290345:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb38 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.290396:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 257) 00010000:00010000:1.0:1789429279.290406:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.290414:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 257) 00010000:00010000:1.0:1789429279.290420:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 29 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.290473:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.290489:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 29 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.290504:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:0.0:1789429279.290847:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634876288:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 553us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.290855:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5489 00000100:00100000:3.0:1789429279.294855:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.294970:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634876416 00000100:00100000:2.0:1789429279.294984:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634876416 00010000:00010000:2.0:1789429279.295045:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.295109:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5926 00000100:00100000:2.0:1789429279.295121:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634876416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.295141:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.295191:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.295540:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.295575:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72635fedf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb2a expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.295600:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 257) 00010000:00010000:2.0:1789429279.295606:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 257) 00010000:00010000:2.0:1789429279.295617:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.295629:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.295685:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.295707:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.295725:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648276608:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.295847:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.298780:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648276608:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.298818:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.298896:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634876416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3774us (4054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.298910:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5926 00000100:00100000:3.0:1789429279.302091:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.302722:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634876544 00000100:00100000:2.0:1789429279.302740:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634876544 00010000:00010000:2.0:1789429279.302799:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.302887:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5927 00000100:00100000:2.0:1789429279.302900:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2368:x1876351634876544:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.302919:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.302951:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.302968:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.303015:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635fee6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb31 expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.303037:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 257) 00010000:00010000:2.0:1789429279.303042:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 257) 00010000:00010000:2.0:1789429279.303053:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.303065:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.303122:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.303139:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648276736:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.303409:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.305869:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648276736:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.305906:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.305980:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:2368:x1876351634876544:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3081us (3903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.305994:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5927 00000100:00100000:3.0:1789429279.313826:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.314514:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634876672 00000100:00100000:0.0:1789429279.314531:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634876672 00000100:00100000:0.0:1789429279.314611:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5490 00000100:00100000:0.0:1789429279.314624:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634876672:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.314648:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.314672:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb3f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.314724:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.314736:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 257) 00010000:00010000:0.0:1789429279.314741:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 257) 00010000:00010000:0.0:1789429279.314746:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.314789:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.314805:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 27 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.314821:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648276864:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.316304:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.322858:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.323087:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648276864:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429279.323148:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.323190:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:2.0:1789429279.323282:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634876672:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8660us (9472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.323294:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5490 00000100:00100000:0.0:1789429279.323295:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634876800 00000100:00100000:0.0:1789429279.323306:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634876800 00002000:00100000:0.0:1789429279.323363:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946e15a51880 x1876351634876800/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.323375:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51880 with x1876351634876800 ext(323584->360447) 00010000:00010000:0.0:1789429279.323383:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.323408:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.323417:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51880 00000100:00100000:0.0:1789429279.323449:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1264 00000100:00100000:0.0:1789429279.323460:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634876800:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429279.328827:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634876800:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5340us (5957us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429279.328852:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1264 00002000:00100000:0.0:1789429279.328878:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946e15a51880 x1876351634876800/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.328897:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51880 with x1876351634876800 ext(323584->360447) 00010000:00010000:0.0:1789429279.328922:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.328943:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.328953:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51880 00000100:00100000:2.0:1789429279.334671:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.334742:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634876928 00000100:00100000:0.0:1789429279.334756:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634876928 00000100:00100000:2.0:1789429279.334780:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.335069:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634877056 00000100:00100000:1.0:1789429279.335074:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634877056 00010000:00010000:1.0:1789429279.335111:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.335157:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5928 00000100:00100000:1.0:1789429279.335168:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2369:x1876351634877056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429279.335198:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429279.335260:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.335277:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.335306:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635feed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb38 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.335328:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 257) 00010000:00010000:1.0:1789429279.335334:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 257) 00010000:00010000:1.0:1789429279.335343:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.335355:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.335403:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.335418:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648276992:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429279.335509:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.335966:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5491 00000100:00100000:0.0:1789429279.335980:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634876928:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.336007:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.336024:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb46 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.337046:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.337066:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 257) 00010000:00010000:0.0:1789429279.337071:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 257) 00010000:00010000:0.0:1789429279.337079:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.337120:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.337138:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 28 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.337153:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648277120:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.337264:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f321b5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.345638:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.345948:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648277120:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.345992:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.346082:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:0.0:1789429279.346300:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634876928:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10324us (11644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.346311:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5491 00000100:00100000:1.0:1789429279.347644:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648276992:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.347677:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634877184 00010000:00010000:1.0:1789429279.347679:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.347689:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634877184 00000100:00100000:1.0:1789429279.347753:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2369:x1876351634877056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12581us (12968us total) trans 0 rc 0/0 00002000:00100000:3.0:1789429279.347754:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f344ba300 x1876351634877184/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.347780:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344ba300 with x1876351634877184 ext(323584->327679) 00000100:00100000:1.0:1789429279.347787:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5928 00010000:00010000:3.0:1789429279.347792:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.347814:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.347822:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344ba300 00000100:00100000:3.0:1789429279.348907:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1265 00000100:00100000:3.0:1789429279.348927:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634877184:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429279.349225:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634877184:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 303us (3600us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429279.349233:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1265 00002000:00100000:3.0:1789429279.349253:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f344ba300 x1876351634877184/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.349264:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344ba300 with x1876351634877184 ext(323584->327679) 00010000:00010000:3.0:1789429279.349273:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.349290:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.349298:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344ba300 00000100:00100000:0.0:1789429279.353613:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.353718:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634877312 00000100:00100000:3.0:1789429279.353733:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634877312 00000100:00100000:3.0:1789429279.353802:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5492 00000100:00100000:3.0:1789429279.353812:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634877312:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429279.353836:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429279.353860:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb4d expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.353901:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 257) 00010000:00010000:3.0:1789429279.353911:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.353919:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 257) 00010000:00010000:3.0:1789429279.353925:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.353975:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.353991:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.354017:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429279.354089:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634877312:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 278us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.354096:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5492 00000100:00100000:0.0:1789429279.355634:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.355873:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634877440 00000100:00100000:2.0:1789429279.355885:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634877440 00010000:00010000:2.0:1789429279.355932:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.355983:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5929 00000100:00100000:2.0:1789429279.355995:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351634877440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.356024:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.356057:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.356075:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.356107:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635fef4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb3f expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.356133:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 257) 00010000:00010000:2.0:1789429279.356140:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 257) 00010000:00010000:2.0:1789429279.356151:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.356362:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.356415:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.356434:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 27 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.356451:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648277376:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.356582:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.364876:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.365009:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648277376:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.365040:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.365121:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634877440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9127us (9496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.365134:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5929 00000100:00100000:2.0:1789429279.365172:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634877568 00000100:00100000:2.0:1789429279.365188:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634877568 00010000:00010000:2.0:1789429279.365334:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.365372:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5930 00000100:00100000:2.0:1789429279.365382:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634877568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.365404:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.365436:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.365452:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.365487:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635fefb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb46 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.365509:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 257) 00010000:00010000:2.0:1789429279.365515:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 257) 00010000:00010000:2.0:1789429279.365525:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.365538:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.365584:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.365602:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648277504:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.365681:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.367804:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648277504:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.367834:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.367890:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634877568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2508us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.367903:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5930 00000100:00100000:0.0:1789429279.377279:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.377478:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634877696 00000100:00100000:2.0:1789429279.377492:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634877696 00000100:00100000:2.0:1789429279.377566:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5493 00000100:00100000:2.0:1789429279.377578:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634877696:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429279.377602:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429279.377627:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb54 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.377682:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.377694:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 257) 00010000:00010000:2.0:1789429279.377700:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 257) 00010000:00010000:2.0:1789429279.377707:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.377752:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.377769:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.377794:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648277632:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429279.377949:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.384584:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.384637:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.384758:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634877824 00000100:00100000:3.0:1789429279.384771:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634877824 00010000:00010000:3.0:1789429279.384829:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.384892:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5931 00000100:00100000:3.0:1789429279.384904:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634877824:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.384923:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.384954:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.384971:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.385009:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 257) 00010000:00010000:3.0:1789429279.385015:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 257) 00010000:00010000:3.0:1789429279.385026:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.385038:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.385088:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.385107:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648277760:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.385250:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789429279.385517:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72635ff02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb4d expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.385540:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648277632:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429279.385569:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.385582:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547200, rc 0) 00000100:00100000:2.0:1789429279.385632:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634877696:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8057us (8368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.385642:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5493 00000100:00100000:1.0:1789429279.386152:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634877952 00000100:00100000:1.0:1789429279.386160:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634877952 00000100:00100000:1.0:1789429279.386257:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5494 00000100:00100000:1.0:1789429279.386270:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634877952:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429279.386291:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.386310:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb5b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.386342:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 27 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.386353:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 257) 00010000:00010000:1.0:1789429279.386358:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 257) 00010000:00010000:1.0:1789429279.386363:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.386398:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 27 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.386413:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 27 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.386427:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648277888:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429279.387025:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.394463:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.394515:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648277760:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.394550:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429279.394559:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634878080 00000100:00100000:1.0:1789429279.394571:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634878080 00000100:00100000:3.0:1789429279.394622:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634877824:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9719us (10054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.394635:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5931 00000100:00100000:0.0:1789429279.394640:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648277888:192.168.203.39@tcp:104: 00002000:00100000:1.0:1789429279.394650:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946e01275880 x1876351634878080/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1789429279.394670:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1789429279.394676:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01275880 with x1876351634878080 ext(323584->360447) 00010000:00010000:1.0:1789429279.394689:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 28 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.394701:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00010000:00010000:1.0:1789429279.394711:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 28 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429279.394721:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01275880 00000100:00100000:0.0:1789429279.394732:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634877952:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8464us (10093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.394741:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5494 00000100:00100000:1.0:1789429279.394756:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1266 00000100:00100000:1.0:1789429279.394770:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634878080:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429279.399555:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634878080:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4772us (5091us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429279.399571:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1266 00002000:00100000:1.0:1789429279.399588:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946e01275880 x1876351634878080/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429279.399599:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01275880 with x1876351634878080 ext(323584->360447) 00010000:00010000:1.0:1789429279.399612:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 28 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.399641:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 28 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429279.399650:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01275880 00000100:00100000:0.0:1789429279.406810:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.406927:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634878208 00000100:00100000:2.0:1789429279.406941:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634878208 00000100:00100000:2.0:1789429279.407009:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5495 00000100:00100000:2.0:1789429279.407021:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634878208:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429279.407044:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429279.407068:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb62 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.407108:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 257) 00010000:00010000:2.0:1789429279.407117:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.407125:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 257) 00010000:00010000:2.0:1789429279.407131:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.407239:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.407258:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.407273:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547400, rc 0) 00000100:00100000:2.0:1789429279.407358:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634878208:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 338us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.407367:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5495 00000100:00100000:1.0:1789429279.413596:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.413989:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634878336 00000100:00100000:3.0:1789429279.414003:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634878336 00010000:00010000:3.0:1789429279.414058:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.414114:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5932 00000100:00100000:3.0:1789429279.414126:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634878336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.414145:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.414171:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.414243:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.414276:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad72635ff09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb54 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.414299:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 257) 00010000:00010000:3.0:1789429279.414304:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 257) 00010000:00010000:3.0:1789429279.414315:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.414333:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.414383:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.414398:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 28 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.414416:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648278144:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.414514:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.418931:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648278144:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.418969:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.419055:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634878336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4931us (5472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.419068:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5932 00000100:00100000:1.0:1789429279.428085:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.428443:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634878464 00000100:00100000:2.0:1789429279.428457:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634878464 00002000:00100000:2.0:1789429279.428522:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f3221ce00 x1876351634878464/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.428535:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221ce00 with x1876351634878464 ext(323584->327679) 00010000:00010000:2.0:1789429279.428546:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.428570:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.428586:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221ce00 00000100:00100000:2.0:1789429279.428620:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1267 00000100:00100000:2.0:1789429279.428632:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634878464:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429279.429907:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634878464:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 1258us (1890us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429279.429920:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1267 00002000:00100000:2.0:1789429279.429930:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f3221ce00 x1876351634878464/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.429941:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221ce00 with x1876351634878464 ext(323584->327679) 00010000:00010000:2.0:1789429279.429960:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.429981:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.429989:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221ce00 00000100:00100000:1.0:1789429279.437726:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.437780:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.437897:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634878720 00000100:00100000:2.0:1789429279.437911:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634878720 00010000:00010000:2.0:1789429279.437977:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.438038:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5933 00000100:00100000:2.0:1789429279.438050:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634878720:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.438070:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.438103:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.438120:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.438149:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb5b expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.438170:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 257) 00010000:00010000:2.0:1789429279.438187:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 257) 00010000:00010000:2.0:1789429279.438256:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.438270:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.438321:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.438339:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648278272:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.438447:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.439359:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634878592 00000100:00100000:0.0:1789429279.439371:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634878592 00000100:00100000:0.0:1789429279.439435:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5496 00000100:00100000:0.0:1789429279.439444:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634878592:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.439462:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.439481:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb69 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.439511:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.439522:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 257) 00010000:00010000:0.0:1789429279.439526:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 257) 00010000:00010000:0.0:1789429279.439531:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.439558:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.439573:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 27 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.439586:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648278400:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.439653:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f321b5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.442867:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648278272:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.442903:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.442979:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634878720:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4929us (5196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.442992:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5933 00000100:00100000:0.0:1789429279.444479:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648278400:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.444523:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 29 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.444552:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429279.444681:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634878592:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5237us (6970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.444695:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5496 00000100:00100000:1.0:1789429279.446169:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.446889:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634878848 00000100:00100000:2.0:1789429279.446903:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634878848 00010000:00010000:2.0:1789429279.446969:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.447027:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5934 00000100:00100000:2.0:1789429279.447039:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634878848:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.447057:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.447087:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.447102:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.447132:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72635ff17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb62 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.447155:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 257) 00010000:00010000:2.0:1789429279.447159:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 257) 00010000:00010000:2.0:1789429279.447169:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.447195:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.447508:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.447525:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648278528:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.447636:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.451932:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648278528:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.451968:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.452081:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634878848:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5042us (5920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.452095:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5934 00000100:00100000:3.0:1789429279.456867:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.457135:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634878976 00000100:00100000:0.0:1789429279.457148:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634878976 00000100:00100000:0.0:1789429279.457276:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5497 00000100:00100000:0.0:1789429279.457288:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634878976:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.457312:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.457337:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb70 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.457382:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.457395:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 257) 00010000:00010000:0.0:1789429279.457400:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 257) 00010000:00010000:0.0:1789429279.457407:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.457452:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.457469:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.457485:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648278656:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.457582:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f321b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.461432:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.461530:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634879104 00000100:00100000:3.0:1789429279.461543:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634879104 00010000:00010000:3.0:1789429279.461601:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.461657:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5935 00000100:00100000:3.0:1789429279.461669:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634879104:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.461696:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.461728:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.461745:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.461779:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 257) 00010000:00010000:3.0:1789429279.461784:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 257) 00010000:00010000:3.0:1789429279.461796:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.461809:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.461860:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.461877:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648278784:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.461982:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789429279.462155:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb69 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.462174:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648278656:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.462269:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.462282:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429279.462327:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634878976:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5041us (5476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.462336:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5497 00000100:00100000:1.0:1789429279.465576:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.465712:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634879232 00000100:00100000:0.0:1789429279.465724:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634879232 00000100:00100000:0.0:1789429279.465797:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5498 00000100:00100000:0.0:1789429279.465810:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634879232:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.465833:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.465858:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb77 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.465900:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 27 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.465911:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 257) 00010000:00010000:0.0:1789429279.465916:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 257) 00010000:00010000:0.0:1789429279.465921:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.465976:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 27 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.465993:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 27 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.466021:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648278912:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.466139:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f321b5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.468514:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648278784:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.468560:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.469131:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634879104:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7458us (7709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.469148:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5935 00000100:00100000:2.0:1789429279.469841:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648278912:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429279.469880:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.469907:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:2.0:1789429279.469956:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634879232:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4149us (4397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.469965:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5498 00000100:00100000:0.0:1789429279.476142:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.476607:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634879360 00000100:00100000:1.0:1789429279.476623:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634879360 00002000:00100000:1.0:1789429279.476694:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f3f17bb80 x1876351634879360/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429279.476785:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17bb80 with x1876351634879360 ext(323584->360447) 00010000:00010000:1.0:1789429279.476799:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.476821:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429279.476830:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f17bb80 00000100:00100000:1.0:1789429279.476874:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1268 00000100:00100000:1.0:1789429279.476885:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634879360:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429279.497671:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634879360:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 20768us (21523us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429279.497693:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1268 00002000:00100000:2.0:1789429279.497710:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (323584->360447) req@ffff946f3f17bb80 x1876351634879360/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.497722:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17bb80 with x1876351634879360 ext(323584->360447) 00010000:00010000:2.0:1789429279.497737:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.497763:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.497773:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f17bb80 00000100:00100000:0.0:1789429279.503850:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.503905:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.504022:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634879616 00000100:00100000:2.0:1789429279.504036:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634879616 00010000:00010000:2.0:1789429279.504090:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.504146:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5936 00000100:00100000:2.0:1789429279.504157:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2369:x1876351634879616:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.504197:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.504247:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.504265:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.504302:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72635ff25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb70 expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.504325:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 257) 00010000:00010000:2.0:1789429279.504330:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 257) 00010000:00010000:2.0:1789429279.504340:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.504353:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.504406:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.504424:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648279040:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.504550:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.506011:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634879488 00000100:00100000:3.0:1789429279.506029:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634879488 00000100:00100000:3.0:1789429279.506114:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5499 00000100:00100000:3.0:1789429279.506125:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634879488:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429279.506143:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429279.506183:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb7e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.506251:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.506262:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 257) 00010000:00010000:3.0:1789429279.506268:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 257) 00010000:00010000:3.0:1789429279.506274:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.506547:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.506565:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 28 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.506581:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648279168:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429279.506806:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.512406:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.512442:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.512479:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634879872 00000100:00100000:1.0:1789429279.512490:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634879872 00000100:00100000:1.0:1789429279.512554:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 519 00000100:00100000:1.0:1789429279.512566:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351634879872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429279.512653:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351634879872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.512661:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 519 00000100:00100000:1.0:1789429279.512722:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.512743:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634880128 00000100:00100000:1.0:1789429279.512747:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634880128 00000100:00100000:1.0:1789429279.512791:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 736 00000100:00100000:1.0:1789429279.512798:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351634880128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429279.512829:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351634880128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.512836:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 736 00000100:00080000:1.0:1789429279.512853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429279.512882:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.512900:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634880384 00000100:00100000:1.0:1789429279.512904:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634880384 00000100:00080000:1.0:1789429279.512918:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429279.513135:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 737 00000100:00100000:1.0:1789429279.513144:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351634880384:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429279.513347:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351634880384:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 203us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.513355:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 737 00000100:00100000:1.0:1789429279.513400:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.513467:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.515309:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634879744 00000100:00100000:3.0:1789429279.515330:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634879744 00002000:00100000:3.0:1789429279.515406:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f3221d500 x1876351634879744/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.515426:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221d500 with x1876351634879744 ext(323584->327679) 00010000:00010000:3.0:1789429279.515438:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.515460:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.515469:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221d500 00000100:00100000:3.0:1789429279.515513:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1269 00000100:00100000:3.0:1789429279.515523:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634879744:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429279.516933:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634879744:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 1401us (4530us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429279.516958:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1269 00002000:00100000:3.0:1789429279.516973:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f3221d500 x1876351634879744/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.516983:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221d500 with x1876351634879744 ext(323584->327679) 00010000:00010000:3.0:1789429279.516993:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.517013:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.517022:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221d500 00000100:00100000:3.0:1789429279.517065:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634880000 00000100:00100000:3.0:1789429279.517072:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634880000 00000100:00100000:3.0:1789429279.517127:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634880256 00000100:00100000:3.0:1789429279.517131:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634880256 00000100:00100000:3.0:1789429279.517160:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 683 00000100:00100000:3.0:1789429279.517169:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+40:2371:x1876351634880000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429279.517628:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648279040:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.517657:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.517682:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 684 00000100:00100000:2.0:1789429279.517691:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634880256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429279.517742:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634880256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 52us (4275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.517749:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 684 00000100:00100000:2.0:1789429279.517790:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2369:x1876351634879616:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13635us (13884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.517800:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5936 00000100:00080000:2.0:1789429279.518959:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429279.519709:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+40:2371:x1876351634880000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 2530us (6297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.519723:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 683 00000100:00100000:3.0:1789429279.519810:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0ab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648279168:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429279.519851:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.519881:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429279.519940:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634879488:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 13817us (16105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.519949:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5499 00000100:00100000:1.0:1789429279.524858:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.524908:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.525049:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634880512 00000100:00100000:2.0:1789429279.525063:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634880512 00010000:00010000:2.0:1789429279.525111:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.525167:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5937 00000100:00100000:2.0:1789429279.525187:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:2368:x1876351634880512:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.525235:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.525268:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.525285:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.525314:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72635ff2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb77 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.525338:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 257) 00010000:00010000:2.0:1789429279.525343:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 257) 00010000:00010000:2.0:1789429279.525354:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.525371:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.525420:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.525438:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648279296:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.525735:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.526288:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634880640 00000100:00100000:0.0:1789429279.526296:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634880640 00000100:00100000:0.0:1789429279.526359:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5500 00000100:00100000:0.0:1789429279.526369:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634880640:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.526387:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.526405:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb85 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.526440:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.526451:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 257) 00010000:00010000:0.0:1789429279.526465:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 257) 00010000:00010000:0.0:1789429279.526471:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.526501:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.526516:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 27 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.526528:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648279424:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.526592:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f321b5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.531302:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648279424:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.531362:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.531392:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429279.531479:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634880640:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5110us (6567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.531490:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5500 00000100:00100000:0.0:1789429279.535838:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648279296:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.535875:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.535956:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:2368:x1876351634880512:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10777us (11109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.535970:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5937 00000100:00100000:1.0:1789429279.539420:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.539628:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634880768 00000100:00100000:0.0:1789429279.539642:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634880768 00010000:00010000:0.0:1789429279.539697:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.539794:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5938 00000100:00100000:0.0:1789429279.539806:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634880768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.539825:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.539854:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.539871:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.539900:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72635ff33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb7e expref: 28 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.539922:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 257) 00010000:00010000:0.0:1789429279.539927:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 257) 00010000:00010000:0.0:1789429279.539937:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.539960:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.540332:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.540358:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648279552:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.540451:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.545892:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.546914:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634880896 00000100:00100000:2.0:1789429279.546931:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634880896 00002000:00100000:2.0:1789429279.547019:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f2f4e2300 x1876351634880896/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.547030:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e2300 with x1876351634880896 ext(323584->327679) 00002000:00010000:2.0:1789429279.547037:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f4e2300 00000100:00100000:2.0:1789429279.547086:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11378 00000100:00100000:2.0:1789429279.547096:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634880896:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429279.547648:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634880896:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 548us (1764us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429279.547658:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11378 00002000:00100000:2.0:1789429279.547666:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f2f4e2300 x1876351634880896/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.547674:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e2300 with x1876351634880896 ext(323584->327679) 00002000:00010000:2.0:1789429279.547679:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f4e2300 00000100:00100000:0.0:1789429279.547836:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648279552:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.547871:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.547904:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634880768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8101us (8497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.547914:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5938 00000100:00100000:1.0:1789429279.551947:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.552422:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634881024 00000100:00100000:0.0:1789429279.552437:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634881024 00000100:00100000:0.0:1789429279.552509:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5501 00000100:00100000:0.0:1789429279.552521:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634881024:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.552543:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.552566:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635ff41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb8c expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.552609:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.552619:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 257) 00010000:00010000:0.0:1789429279.552625:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 257) 00010000:00010000:0.0:1789429279.552631:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635ff41 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb8c expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.552669:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.552686:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 28 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.552703:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648279680:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.552849:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.554997:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.555193:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634881152 00000100:00100000:3.0:1789429279.555234:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634881152 00002000:00100000:3.0:1789429279.555303:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3fbc9880 x1876351634881152/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.555315:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbc9880 with x1876351634881152 ext(327680->331775) 00010000:00010000:3.0:1789429279.555326:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.555346:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.555356:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbc9880 00000100:00100000:3.0:1789429279.555387:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1270 00000100:00100000:3.0:1789429279.555398:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634881152:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429279.555660:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634881152:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 263us (676us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429279.555669:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1270 00002000:00100000:3.0:1789429279.555677:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3fbc9880 x1876351634881152/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.555686:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbc9880 with x1876351634881152 ext(327680->331775) 00010000:00010000:3.0:1789429279.555692:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.555704:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.555711:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbc9880 00000100:00100000:3.0:1789429279.559257:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.559409:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634881280 00000100:00100000:1.0:1789429279.559423:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634881280 00002000:00100000:1.0:1789429279.559482:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f1c0ab480 x1876351634881280/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 4584/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429279.559495:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0ab480 with x1876351634881280 ext(323584->327679) 00010000:00010000:1.0:1789429279.559507:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.559533:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429279.559542:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0ab480 00000100:00100000:1.0:1789429279.559569:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1271 00000100:00100000:1.0:1789429279.559580:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634881280:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1789429279.560088:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634881280:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 507us (886us total) trans 4294969562 rc 0/0 00000100:00100000:1.0:1789429279.560098:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1271 00002000:00100000:1.0:1789429279.560108:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f1c0ab480 x1876351634881280/t4294969562(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 4584/448 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429279.560117:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0ab480 with x1876351634881280 ext(323584->327679) 00010000:00010000:1.0:1789429279.560124:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 31 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.560139:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 31 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429279.560147:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0ab480 00000100:00100000:0.0:1789429279.563057:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648279680:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.563116:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635ff41 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb8c expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.563153:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:0.0:1789429279.563293:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634881024:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10772us (11356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.563304:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5501 00000100:00100000:2.0:1789429279.566953:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.567118:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634881408 00000100:00100000:1.0:1789429279.567137:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634881408 00000100:00100000:1.0:1789429279.567260:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5502 00000100:00100000:1.0:1789429279.567272:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634881408:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429279.567297:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.567321:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb93 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.567362:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 257) 00010000:00010000:1.0:1789429279.567367:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 257) 00010000:00010000:1.0:1789429279.567374:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 32 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.567388:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 32 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.567410:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:1.0:1789429279.567469:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634881408:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 200us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.567477:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5502 00000100:00100000:3.0:1789429279.570560:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.570789:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634881536 00000100:00100000:2.0:1789429279.570802:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634881536 00010000:00010000:2.0:1789429279.570855:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 32 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.570908:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5939 00000100:00100000:2.0:1789429279.570919:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634881536:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.570939:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.570968:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 32 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.570985:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 32 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.571023:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [323584->18446744073709551615] (req 323584->327679) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb85 expref: 32 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.571045:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 257) 00010000:00010000:2.0:1789429279.571051:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 257) 00010000:00010000:2.0:1789429279.571062:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635ff41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb8c expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.571451:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635ff41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb8c expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.571474:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 257) 00010000:00010000:2.0:1789429279.571478:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 257) 00010000:00010000:2.0:1789429279.571484:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 31 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.571495:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 31 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.571545:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 31 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.571563:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648279808:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.571694:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635ff41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb8c expref: 27 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.571705:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648279936:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.571731:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.576926:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648279808:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.578362:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648279936:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.578404:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.578482:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634881536:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7563us (7936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.578570:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5939 00000100:00100000:2.0:1789429279.579518:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.579623:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634881664 00000100:00100000:3.0:1789429279.579634:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634881664 00002000:00100000:3.0:1789429279.579694:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f3fbcad80 x1876351634881664/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.579713:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcad80 with x1876351634881664 ext(323584->327679) 00002000:00010000:3.0:1789429279.579721:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3fbcad80 00000100:00100000:3.0:1789429279.579789:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11379 00000100:00100000:3.0:1789429279.579801:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634881664:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429279.580112:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634881664:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 312us (598us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429279.580120:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11379 00002000:00100000:3.0:1789429279.580128:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (323584->327679) req@ffff946f3fbcad80 x1876351634881664/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.580137:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcad80 with x1876351634881664 ext(323584->327679) 00002000:00010000:3.0:1789429279.580141:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3fbcad80 00000100:00100000:1.0:1789429279.583683:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.583798:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634881792 00000100:00100000:3.0:1789429279.583811:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634881792 00000100:00100000:3.0:1789429279.583922:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5503 00000100:00100000:3.0:1789429279.583935:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634881792:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429279.583959:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429279.583984:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bb9a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.584027:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.584039:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 257) 00010000:00010000:3.0:1789429279.584045:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 257) 00010000:00010000:3.0:1789429279.584051:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.584094:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.584111:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.584127:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648280064:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429279.584333:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.589032:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.589142:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.589335:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634882048 00000100:00100000:0.0:1789429279.589348:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634882048 00000100:00100000:0.0:1789429279.589414:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5504 00000100:00100000:0.0:1789429279.589425:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634882048:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.589447:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.589473:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bba1 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.589516:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 257) 00010000:00010000:0.0:1789429279.589526:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.589535:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 257) 00010000:00010000:0.0:1789429279.589542:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 32 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.589596:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.589614:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 32 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.589628:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429279.589697:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634882048:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 273us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.589705:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5504 00000100:00100000:1.0:1789429279.590045:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634881920 00000100:00100000:1.0:1789429279.590052:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634881920 00010000:00010000:1.0:1789429279.590091:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 32 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.590117:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5940 00000100:00100000:1.0:1789429279.590125:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634881920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429279.590137:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429279.590372:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 32 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.590389:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 32 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.590415:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 257) 00010000:00010000:1.0:1789429279.590419:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 257) 00010000:00010000:1.0:1789429279.590428:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.590446:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.590480:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.590495:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.590513:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648280320:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429279.590594:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c780 going to sleep for 11 seconds 00010000:00010000:3.0:1789429279.591441:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb93 expref: 32 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.591467:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648280064:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429279.591503:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.591515:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.591531:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:1.0:1789429279.595018:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648280320:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429279.595054:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429279.595194:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634881920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5067us (6049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.595415:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5940 00000100:00100000:0.0:1789429279.595653:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634881792:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11719us (11983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.595663:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5503 00000100:00100000:2.0:1789429279.603327:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.603444:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634882176 00000100:00100000:1.0:1789429279.603463:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634882176 00002000:00100000:1.0:1789429279.603533:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f3fbcb480 x1876351634882176/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429279.603547:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcb480 with x1876351634882176 ext(327680->364543) 00010000:00010000:1.0:1789429279.603560:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.603586:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429279.603595:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcb480 00000100:00100000:1.0:1789429279.603632:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1272 00000100:00100000:1.0:1789429279.603642:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2369:x1876351634882176:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429279.611056:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2369:x1876351634882176:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7395us (7724us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429279.611152:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1272 00002000:00100000:1.0:1789429279.611193:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f3fbcb480 x1876351634882176/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429279.611514:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcb480 with x1876351634882176 ext(327680->364543) 00010000:00010000:1.0:1789429279.611530:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.611557:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 29 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429279.611567:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcb480 00000100:00100000:0.0:1789429279.615960:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.616251:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634882432 00000100:00100000:1.0:1789429279.616264:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634882432 00000100:00100000:1.0:1789429279.616343:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5505 00000100:00100000:1.0:1789429279.616356:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634882432:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429279.616383:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.616408:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bba8 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.616454:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 257) 00010000:00010000:1.0:1789429279.616465:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.616472:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 257) 00010000:00010000:1.0:1789429279.616479:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.616536:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.616552:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.616569:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429279.616656:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634882432:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 302us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.616663:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5505 00000100:00100000:2.0:1789429279.622554:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.622680:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634882304 00000100:00100000:0.0:1789429279.622694:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634882304 00010000:00010000:0.0:1789429279.622751:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 30 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.622808:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5941 00000100:00100000:0.0:1789429279.622820:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2370:x1876351634882304:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.622840:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.622873:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 30 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.622890:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 30 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.622924:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ff4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb9a expref: 30 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.622947:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 257) 00010000:00010000:0.0:1789429279.622953:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 257) 00010000:00010000:0.0:1789429279.622964:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.622976:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.623044:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.623060:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.623088:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648280576:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.623481:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.630773:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648280576:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.630817:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.630900:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634882304:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8080us (8364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.630914:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5941 00000100:00100000:1.0:1789429279.639574:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.639904:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634882560 00000100:00100000:0.0:1789429279.639919:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634882560 00002000:00100000:0.0:1789429279.639991:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f2f4e1c00 x1876351634882560/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.640017:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e1c00 with x1876351634882560 ext(327680->331775) 00010000:00010000:0.0:1789429279.640029:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 31 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.640051:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 31 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.640060:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e1c00 00000100:00100000:0.0:1789429279.640106:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1273 00000100:00100000:0.0:1789429279.640117:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634882560:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429279.641649:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634882560:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 1521us (2076us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429279.641664:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1273 00002000:00100000:0.0:1789429279.641676:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f2f4e1c00 x1876351634882560/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.641695:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e1c00 with x1876351634882560 ext(327680->331775) 00010000:00010000:0.0:1789429279.641706:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 31 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.641730:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 31 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.641743:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e1c00 00000100:00100000:2.0:1789429279.648288:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.648653:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634882688 00000100:00100000:0.0:1789429279.648667:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634882688 00000100:00100000:0.0:1789429279.648743:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5506 00000100:00100000:0.0:1789429279.648756:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634882688:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.648780:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.648806:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbaf expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.648846:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 257) 00010000:00010000:0.0:1789429279.648856:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.648863:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(107 257) 00010000:00010000:0.0:1789429279.648869:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 32 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.648920:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.648938:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 32 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.648967:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad000, rc 0) 00000100:00100000:0.0:1789429279.649057:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634882688:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 302us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.649064:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5506 00000100:00100000:3.0:1789429279.651092:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.651850:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634882816 00000100:00100000:0.0:1789429279.651864:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634882816 00010000:00010000:0.0:1789429279.651919:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 32 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.651986:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5942 00000100:00100000:0.0:1789429279.652004:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634882816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.652023:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.652052:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 32 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.652068:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 32 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.652099:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba1 expref: 32 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.652127:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 257) 00010000:00010000:0.0:1789429279.652132:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 257) 00010000:00010000:0.0:1789429279.652143:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.652155:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.652580:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.652599:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 28 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.652616:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648280832:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.652742:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.657688:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648280832:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.657728:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.657805:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634882816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5808us (6723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.657818:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5942 00000100:00100000:2.0:1789429279.660757:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.662291:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634882944 00000100:00100000:3.0:1789429279.662309:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634882944 00010000:00010000:3.0:1789429279.662380:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.662443:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5943 00000100:00100000:3.0:1789429279.662721:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634882944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.662748:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.662779:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.662797:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.662829:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72635ff5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bba8 expref: 29 pid: 8085 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.662854:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 257) 00010000:00010000:3.0:1789429279.662859:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 257) 00010000:00010000:3.0:1789429279.662870:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.662881:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.662931:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.662954:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648280960:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.663092:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.670413:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648280960:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.670456:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.670553:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634882944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8098us (9814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.670567:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5943 00000100:00100000:2.0:1789429279.672779:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.672877:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634883072 00000100:00100000:0.0:1789429279.672889:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634883072 00000100:00100000:0.0:1789429279.672961:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5507 00000100:00100000:0.0:1789429279.672975:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634883072:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.673011:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.673040:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbb6 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.673086:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.673099:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 257) 00010000:00010000:0.0:1789429279.673104:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 257) 00010000:00010000:0.0:1789429279.673110:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.673155:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.673519:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 30 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.673538:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648281088:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429279.673716:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.676312:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.676501:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648281088:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429279.676551:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.676584:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:1.0:1789429279.676663:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634883072:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3690us (3895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.676673:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5507 00000100:00100000:3.0:1789429279.676837:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634883200 00000100:00100000:3.0:1789429279.676847:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634883200 00010000:00010000:3.0:1789429279.676888:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 31 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.676925:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5944 00000100:00100000:3.0:1789429279.676936:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05624050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351634883200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.676953:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.676985:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 31 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.677000:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 31 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.677030:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635ff64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbaf expref: 31 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.677052:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 257) 00010000:00010000:3.0:1789429279.677057:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 257) 00010000:00010000:3.0:1789429279.677067:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.677079:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.677120:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.677136:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648281216:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.677830:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.679057:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.679243:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634883328 00000100:00100000:0.0:1789429279.679255:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634883328 00000100:00100000:0.0:1789429279.679321:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5508 00000100:00100000:0.0:1789429279.679333:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634883328:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.679355:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.679378:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbbd expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.679419:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.679431:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 257) 00010000:00010000:0.0:1789429279.679436:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 257) 00010000:00010000:0.0:1789429279.679444:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.679485:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.679502:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 28 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.679517:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648281344:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.679606:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.685134:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.685294:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648281344:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429279.685340:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.685370:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429279.685452:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634883328:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6119us (6402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.685477:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5508 00000100:00100000:1.0:1789429279.686579:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648281216:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429279.686609:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429279.686663:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05624050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351634883200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9728us (10365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.686675:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5944 00000100:00100000:3.0:1789429279.687893:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634883456 00000100:00100000:3.0:1789429279.687906:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634883456 00002000:00100000:0.0:1789429279.689432:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c34a680 x1876351634883456/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.689449:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c34a680 with x1876351634883456 ext(327680->364543) 00010000:00010000:0.0:1789429279.689462:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.689485:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.689494:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c34a680 00000100:00100000:0.0:1789429279.689580:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1274 00000100:00100000:0.0:1789429279.689593:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634883456:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429279.692582:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634883456:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 2977us (7449us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429279.692598:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1274 00002000:00100000:0.0:1789429279.692613:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c34a680 x1876351634883456/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.692626:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c34a680 with x1876351634883456 ext(327680->364543) 00010000:00010000:0.0:1789429279.692638:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.692661:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.692671:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c34a680 00000100:00100000:3.0:1789429279.696016:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.696066:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.696159:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634883584 00000100:00100000:2.0:1789429279.696192:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634883584 00000100:00100000:2.0:1789429279.696353:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5509 00000100:00100000:2.0:1789429279.696366:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634883584:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429279.696390:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429279.696416:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbc4 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.696469:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 257) 00010000:00010000:2.0:1789429279.696480:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.696488:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 257) 00010000:00010000:2.0:1789429279.696494:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.696544:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.696562:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.696579:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547a00, rc 0) 00000100:00100000:2.0:1789429279.696660:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634883584:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 296us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.696668:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5509 00000100:00100000:0.0:1789429279.697049:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634883712 00000100:00100000:0.0:1789429279.697056:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634883712 00010000:00010000:0.0:1789429279.697086:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.697121:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5945 00000100:00100000:0.0:1789429279.697129:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2371:x1876351634883712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.697140:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.697167:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.697194:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.697251:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbb6 expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.697268:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 257) 00010000:00010000:0.0:1789429279.697272:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 257) 00010000:00010000:0.0:1789429279.697282:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.697293:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.697327:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.697343:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 30 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.697366:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648281600:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.697453:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f062adf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.703724:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648281600:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.703761:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.703836:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634883712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6707us (7768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.703851:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5945 00000100:00100000:0.0:1789429279.706887:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.707614:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634883840 00000100:00100000:1.0:1789429279.707632:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634883840 00002000:00100000:1.0:1789429279.707709:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3f179c00 x1876351634883840/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429279.707723:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179c00 with x1876351634883840 ext(327680->331775) 00010000:00010000:1.0:1789429279.707734:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.707756:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429279.707765:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f179c00 00000100:00100000:1.0:1789429279.707807:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1275 00000100:00100000:1.0:1789429279.707819:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634883840:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429279.708744:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634883840:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 921us (1865us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429279.708757:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1275 00002000:00100000:1.0:1789429279.708767:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3f179c00 x1876351634883840/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429279.708778:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179c00 with x1876351634883840 ext(327680->331775) 00010000:00010000:1.0:1789429279.708787:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.708805:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429279.708813:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f179c00 00000100:00100000:3.0:1789429279.722398:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.724890:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.724958:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634884096 00000100:00100000:3.0:1789429279.724972:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634884096 00010000:00010000:3.0:1789429279.725037:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.725079:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5946 00000100:00100000:3.0:1789429279.725092:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634884096:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.725111:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.725142:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.725752:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.725788:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad72635ff72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbbd expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.725811:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 257) 00010000:00010000:3.0:1789429279.725817:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 257) 00010000:00010000:3.0:1789429279.725828:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.725843:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.725898:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.725915:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648281728:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429279.726123:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634883968 00000100:00100000:1.0:1789429279.726130:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634883968 00000100:00100000:1.0:1789429279.726232:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5510 00000100:00100000:1.0:1789429279.726242:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634883968:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429279.726257:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.726275:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbcb expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.726300:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.726307:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 257) 00010000:00010000:1.0:1789429279.726311:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 257) 00010000:00010000:1.0:1789429279.726316:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 32 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.726340:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.726354:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.726366:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648281856:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429279.726433:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.729064:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.729529:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648281856:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429279.729569:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 32 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.729594:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:1.0:1789429279.729662:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634883968:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3421us (7468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.729673:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5510 00000100:00100000:3.0:1789429279.734154:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648281728:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.734452:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.734545:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634884096:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9453us (9667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.734560:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5946 00000100:00100000:2.0:1789429279.736446:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.736606:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634884224 00000100:00100000:3.0:1789429279.736620:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634884224 00010000:00010000:3.0:1789429279.736674:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.736764:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5947 00000100:00100000:3.0:1789429279.736776:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2368:x1876351634884224:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.736797:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.736828:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.736845:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.736876:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ff79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbc4 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.736898:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 257) 00010000:00010000:3.0:1789429279.736902:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 257) 00010000:00010000:3.0:1789429279.736913:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.736931:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.736980:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.736996:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648281984:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.737094:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.743549:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648281984:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.743593:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.743814:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2368:x1876351634884224:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7037us (7378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.743828:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5947 00000100:00100000:1.0:1789429279.748454:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.750507:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634884352 00000100:00100000:2.0:1789429279.750528:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634884352 00000100:00100000:2.0:1789429279.750681:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5511 00000100:00100000:2.0:1789429279.750694:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634884352:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429279.750718:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429279.750745:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbd2 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.750793:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.750806:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 257) 00010000:00010000:2.0:1789429279.750812:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 257) 00010000:00010000:2.0:1789429279.750819:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.750864:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.750880:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 30 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.750896:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648282112:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429279.751022:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.758507:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648282112:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429279.758558:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.758589:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547800, rc 0) 00000100:00100000:2.0:1789429279.758666:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634884352:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7974us (10240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.758686:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5511 00000100:00100000:2.0:1789429279.762693:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.762769:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634884480 00000100:00100000:0.0:1789429279.762783:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634884480 00002000:00100000:0.0:1789429279.762847:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c348e00 x1876351634884480/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.762861:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c348e00 with x1876351634884480 ext(327680->331775) 00010000:00010000:0.0:1789429279.762872:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.762899:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.762909:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c348e00 00000100:00100000:0.0:1789429279.762949:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1276 00000100:00100000:0.0:1789429279.762970:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634884480:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429279.763275:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634884480:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 307us (596us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429279.763284:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1276 00002000:00100000:0.0:1789429279.763293:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c348e00 x1876351634884480/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.763302:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c348e00 with x1876351634884480 ext(327680->331775) 00010000:00010000:0.0:1789429279.763309:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.763321:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.763328:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c348e00 00000100:00100000:1.0:1789429279.768317:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.768420:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.768767:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634884608 00000100:00100000:2.0:1789429279.768768:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634884736 00000100:00100000:2.0:1789429279.768782:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634884736 00000100:00100000:0.0:1789429279.768783:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634884608 00010000:00010000:2.0:1789429279.768843:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 32 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.768866:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5512 00000100:00100000:0.0:1789429279.768879:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634884608:12345-192.168.203.39@tcp:101:mmap_sanity.0 00000100:00100000:2.0:1789429279.768889:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5948 00010000:00010000:0.0:1789429279.768900:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789429279.768901:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634884736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.768919:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.768924:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbd9 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.768949:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 33 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.768966:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 33 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.768991:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad72635ff80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbcb expref: 33 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.769023:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 257) 00010000:00010000:2.0:1789429279.769127:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 257) 00010000:00010000:2.0:1789429279.769140:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.769155:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.770519:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.770537:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 257) 00010000:00010000:0.0:1789429279.770542:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 257) 00010000:00010000:0.0:1789429279.770548:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.770606:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.770629:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 28 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.770654:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648282240:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429279.770748:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 28 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.770766:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 28 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.770779:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648282368:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429279.770829:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.770830:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.774252:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648282240:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.774290:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.774367:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634884736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5467us (5945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.774380:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5948 00000100:00100000:1.0:1789429279.776475:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648282368:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429279.776529:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.776560:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:1.0:1789429279.776657:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634884608:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7780us (8356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.776668:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5512 00000100:00100000:2.0:1789429279.778910:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.779037:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634884864 00000100:00100000:0.0:1789429279.779049:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634884864 00002000:00100000:0.0:1789429279.779113:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c34b480 x1876351634884864/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.779126:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c34b480 with x1876351634884864 ext(327680->364543) 00010000:00010000:0.0:1789429279.779136:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.779156:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.779185:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c34b480 00000100:00100000:0.0:1789429279.779294:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1277 00000100:00100000:0.0:1789429279.779305:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634884864:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429279.785955:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634884864:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6638us (7044us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429279.785975:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1277 00002000:00100000:0.0:1789429279.785991:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c34b480 x1876351634884864/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.786535:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c34b480 with x1876351634884864 ext(327680->364543) 00010000:00010000:0.0:1789429279.786549:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.786571:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.786579:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c34b480 00000100:00100000:2.0:1789429279.789155:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.789372:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634884992 00000100:00100000:1.0:1789429279.789386:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634884992 00000100:00100000:1.0:1789429279.789467:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5513 00000100:00100000:1.0:1789429279.789480:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634884992:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429279.789507:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.789536:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbe0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.789581:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 257) 00010000:00010000:1.0:1789429279.789592:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.789601:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 257) 00010000:00010000:1.0:1789429279.789606:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.789665:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.789682:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.789697:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:1.0:1789429279.789988:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634884992:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 509us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.790006:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5513 00000100:00100000:2.0:1789429279.792553:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.792990:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634885120 00000100:00100000:0.0:1789429279.793003:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634885120 00010000:00010000:0.0:1789429279.793058:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.793146:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5949 00000100:00100000:0.0:1789429279.793157:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2371:x1876351634885120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.793186:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.793252:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.793270:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.793309:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad72635ff87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd2 expref: 30 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.793336:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 257) 00010000:00010000:0.0:1789429279.793341:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 257) 00010000:00010000:0.0:1789429279.793352:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.793362:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.793413:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.793429:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 30 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.793459:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648282624:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.793577:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f062ad840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.797683:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648282624:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.797727:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.797885:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634885120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4728us (5344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.797904:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5949 00000100:00100000:1.0:1789429279.798596:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.798747:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634885248 00000100:00100000:0.0:1789429279.798758:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634885248 00010000:00010000:0.0:1789429279.798808:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.798846:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5950 00000100:00100000:0.0:1789429279.798855:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351634885248:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.798870:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.798900:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.798914:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.798942:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad72635ff8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbd9 expref: 31 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.798964:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 257) 00010000:00010000:0.0:1789429279.798969:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 257) 00010000:00010000:0.0:1789429279.798978:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.798989:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.799050:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.799066:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648282752:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.799145:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f062ad840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429279.802837:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648282752:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.802877:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.802955:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2369:x1876351634885248:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4099us (4363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.802969:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5950 00000100:00100000:2.0:1789429279.811970:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.812464:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634885376 00000100:00100000:1.0:1789429279.812479:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634885376 00000100:00100000:1.0:1789429279.812568:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5514 00000100:00100000:1.0:1789429279.812581:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634885376:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429279.812607:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.812633:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbe7 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.812680:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.812693:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 257) 00010000:00010000:1.0:1789429279.812698:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 257) 00010000:00010000:1.0:1789429279.812704:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.812747:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.812764:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.812783:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648282880:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429279.812885:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.817471:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.817697:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634885504 00000100:00100000:2.0:1789429279.817711:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634885504 00002000:00100000:2.0:1789429279.817783:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f2f4e0a80 x1876351634885504/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.817797:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e0a80 with x1876351634885504 ext(327680->364543) 00010000:00010000:2.0:1789429279.817809:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.817829:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.817839:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e0a80 00000100:00100000:2.0:1789429279.817875:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1278 00000100:00100000:2.0:1789429279.817886:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634885504:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429279.820081:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648282880:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429279.820130:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.820620:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:2.0:1789429279.820757:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634885376:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8176us (8799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.820768:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5514 00000100:00100000:2.0:1789429279.824681:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634885504:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6778us (7463us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429279.824699:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1278 00002000:00100000:2.0:1789429279.824718:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f2f4e0a80 x1876351634885504/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.824732:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e0a80 with x1876351634885504 ext(327680->364543) 00010000:00010000:2.0:1789429279.824745:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.824775:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.824785:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e0a80 00000100:00100000:0.0:1789429279.828130:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.828378:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634885632 00000100:00100000:2.0:1789429279.828392:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634885632 00000100:00100000:2.0:1789429279.828469:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5515 00000100:00100000:2.0:1789429279.828481:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634885632:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429279.828506:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429279.828531:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbee expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.828578:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 257) 00010000:00010000:2.0:1789429279.828589:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.828597:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 257) 00010000:00010000:2.0:1789429279.828603:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.828658:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.828677:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.828694:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429279.828781:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634885632:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 301us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.828789:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5515 00000100:00100000:1.0:1789429279.831671:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.831954:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634885760 00000100:00100000:2.0:1789429279.831967:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634885760 00010000:00010000:2.0:1789429279.832029:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.832085:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5951 00000100:00100000:2.0:1789429279.832097:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05624c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2370:x1876351634885760:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.832117:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.832145:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.832182:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.832413:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72635ff95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe0 expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.832436:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 257) 00010000:00010000:2.0:1789429279.832442:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 257) 00010000:00010000:2.0:1789429279.832453:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.832476:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.832527:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.832545:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 30 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.832563:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648283136:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.832677:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.835972:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648283136:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.836018:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.836093:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05624c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634885760:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3996us (4435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.836106:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5951 00000100:00100000:1.0:1789429279.838855:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.839129:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634885888 00000100:00100000:2.0:1789429279.839143:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634885888 00002000:00100000:2.0:1789429279.839248:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f2f4e0000 x1876351634885888/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.839262:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e0000 with x1876351634885888 ext(327680->331775) 00010000:00010000:2.0:1789429279.839274:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.839294:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.839304:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e0000 00000100:00100000:2.0:1789429279.839338:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1279 00000100:00100000:2.0:1789429279.839348:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634885888:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429279.839599:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634885888:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 251us (757us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429279.839607:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1279 00002000:00100000:2.0:1789429279.839614:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f2f4e0000 x1876351634885888/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.839630:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e0000 with x1876351634885888 ext(327680->331775) 00010000:00010000:2.0:1789429279.839636:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.839648:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.839656:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e0000 00000100:00100000:1.0:1789429279.842144:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.842308:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.842371:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634886144 00000100:00100000:0.0:1789429279.842384:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634886144 00000100:00100000:3.0:1789429279.842439:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634886016 00010000:00010000:0.0:1789429279.842446:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.842510:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5952 00000100:00100000:0.0:1789429279.842523:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634886144:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.842545:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.842580:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.842598:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.842631:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72635ff9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbe7 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.842656:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 257) 00010000:00010000:0.0:1789429279.842662:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 257) 00010000:00010000:0.0:1789429279.842671:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.842684:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.842737:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.842755:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648283264:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.842868:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f062ad840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.843020:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634886016 00000100:00100000:3.0:1789429279.843067:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5516 00000100:00100000:3.0:1789429279.843076:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c14e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634886016:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429279.843093:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429279.843111:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbf5 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.843143:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.843151:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 257) 00010000:00010000:3.0:1789429279.843155:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 257) 00010000:00010000:3.0:1789429279.843259:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.843289:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.843305:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 28 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.843317:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648283392:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429279.843371:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.846664:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648283392:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429279.846720:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.846748:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429279.846977:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c14e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634886016:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3899us (4844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.847005:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5516 00000100:00100000:1.0:1789429279.855957:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.856662:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648283264:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.856784:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634886272 00000100:00100000:2.0:1789429279.856794:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634886272 00010000:00010000:2.0:1789429279.856853:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.856878:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.856913:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5953 00000100:00100000:2.0:1789429279.856923:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2369:x1876351634886272:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.856941:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789429279.856949:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634886144:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 14429us (14640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.856957:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5952 00010000:00010000:2.0:1789429279.856971:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.856985:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.857901:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbee expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.857935:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 257) 00010000:00010000:2.0:1789429279.857941:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 257) 00010000:00010000:2.0:1789429279.857950:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.857962:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.858031:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.858050:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648283520:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.858153:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.863491:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648283520:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.863528:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429279.863601:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2369:x1876351634886272:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6677us (7661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.863615:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5953 00000100:00100000:1.0:1789429279.866781:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.866914:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634886400 00000100:00100000:2.0:1789429279.866926:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634886400 00000100:00100000:2.0:1789429279.867061:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5517 00000100:00100000:2.0:1789429279.867075:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634886400:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429279.867100:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429279.867126:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bbfc expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.867242:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.867255:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 257) 00010000:00010000:2.0:1789429279.867259:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 257) 00010000:00010000:2.0:1789429279.867264:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.867306:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.867322:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 30 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.867337:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648283648:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429279.867426:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.871102:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648283648:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429279.871542:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.871572:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429279.871652:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634886400:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4580us (4885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.871666:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5517 00000100:00100000:1.0:1789429279.874301:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.875531:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.875969:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634886656 00000100:00100000:2.0:1789429279.875984:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634886656 00000100:00100000:2.0:1789429279.876077:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5518 00000100:00100000:2.0:1789429279.876090:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634886656:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429279.876121:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429279.876339:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc03 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.876383:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 257) 00010000:00010000:2.0:1789429279.876393:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.876402:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 257) 00010000:00010000:2.0:1789429279.876407:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 32 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.876455:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.876471:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 32 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.876485:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546600, rc 0) 00000100:00100000:2.0:1789429279.876662:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634886656:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 573us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.876672:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5518 00000100:00100000:0.0:1789429279.877125:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634886528 00000100:00100000:0.0:1789429279.877142:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634886528 00010000:00010000:0.0:1789429279.877328:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 32 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.877361:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5954 00000100:00100000:0.0:1789429279.877370:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634886528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.877384:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.877413:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 32 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.877429:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 32 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.877467:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72635ffaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbf5 expref: 32 pid: 6681 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.877485:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 257) 00010000:00010000:0.0:1789429279.877490:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 257) 00010000:00010000:0.0:1789429279.877500:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.877510:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.877547:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.877569:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 28 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.877585:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648283904:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.877669:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f062ad840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.882523:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.882626:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648283904:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.882658:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.882736:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634886528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5365us (8448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.882750:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5954 00000100:00100000:3.0:1789429279.882820:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634886784 00000100:00100000:3.0:1789429279.882831:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634886784 00002000:00100000:3.0:1789429279.882889:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f2f4e3800 x1876351634886784/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.882901:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e3800 with x1876351634886784 ext(327680->364543) 00010000:00010000:3.0:1789429279.882912:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.882933:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.882943:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e3800 00000100:00100000:3.0:1789429279.882983:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1280 00000100:00100000:3.0:1789429279.882994:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634886784:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429279.892374:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634886784:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 9358us (9844us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429279.892391:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1280 00002000:00100000:2.0:1789429279.892410:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f2f4e3800 x1876351634886784/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.892422:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e3800 with x1876351634886784 ext(327680->364543) 00010000:00010000:2.0:1789429279.892435:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.892459:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 29 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.892468:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e3800 00000100:00100000:1.0:1789429279.896133:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.896627:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634886912 00000100:00100000:0.0:1789429279.896640:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634886912 00000100:00100000:0.0:1789429279.896778:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5519 00000100:00100000:0.0:1789429279.896791:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634886912:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429279.896817:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429279.896842:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc0a expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.896889:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 257) 00010000:00010000:0.0:1789429279.896899:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.896908:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 257) 00010000:00010000:0.0:1789429279.896914:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.896972:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.896988:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.897003:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429279.897085:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634886912:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 296us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.897093:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5519 00000100:00100000:2.0:1789429279.904129:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.904313:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634887040 00000100:00100000:3.0:1789429279.904327:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634887040 00010000:00010000:3.0:1789429279.904388:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.904446:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5955 00000100:00100000:3.0:1789429279.904471:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2371:x1876351634887040:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.904493:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.904535:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.904556:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.904589:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72635ffb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bbfc expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.904623:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 257) 00010000:00010000:3.0:1789429279.904629:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 257) 00010000:00010000:3.0:1789429279.904640:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.904653:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.904860:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.904879:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 30 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.904897:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648284160:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.905017:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.908274:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648284544:0@lo:400:kworker.0 00000100:00100000:1.0:1789429279.908368:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429279.908421:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789429279.908428:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648284672:0@lo:400:kworker.0 00000100:00100000:1.0:1789429279.908456:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429279.908489:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648284544 00000100:00100000:1.0:1789429279.908498:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648284544 00000100:00100000:0.0:1789429279.908877:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648284416:0@lo:400:kworker.0 00000100:00100000:0.0:1789429279.908920:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429279.908948:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648284928:0@lo:400:kworker.0 00000100:00100000:0.0:1789429279.908972:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429279.908995:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789429279.909001:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648284288:0@lo:400:kworker.0 00000100:00100000:0.0:1789429279.909034:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429279.909063:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648284800:0@lo:400:kworker.0 00000100:00100000:0.0:1789429279.909087:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429279.909120:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648284416 00000100:00100000:0.0:1789429279.909124:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648284416 00000100:00100000:0.0:1789429279.910808:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648284800 00000100:00100000:0.0:1789429279.910822:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648284800 00000100:00100000:3.0:1789429279.911319:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648284672 00000100:00100000:3.0:1789429279.911326:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648284672 00000100:00100000:1.0:1789429279.911359:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1789429279.911373:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648284416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429279.911497:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1789429279.911506:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648284544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429279.911573:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648284544:12345-0@lo:400:kworker.0 Request processed in 67us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.911573:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648284416:12345-0@lo:400:kworker.0 Request processed in 202us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.911581:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1789429279.911589:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1789429279.911810:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1789429279.911818:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648284800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429279.911854:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648284800:12345-0@lo:400:kworker.0 Request processed in 37us (2766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.911861:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1789429279.911889:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648284288 00000100:00100000:0.0:1789429279.911894:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648284288 00000100:00100000:0.0:1789429279.911927:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1789429279.911934:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648284288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429279.911967:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648284288:12345-0@lo:400:kworker.0 Request processed in 35us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.911974:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1789429279.912022:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648284928 00000100:00100000:0.0:1789429279.912027:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648284928 00000100:00100000:0.0:1789429279.912059:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1789429279.912066:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648284928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429279.912099:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648284928:12345-0@lo:400:kworker.0 Request processed in 34us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.912105:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00080000:2.0:1789429279.912212:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429279.912219:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429279.912222:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429279.912359:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648284544:0@lo:400:kworker.0 00000100:00100000:1.0:1789429279.912405:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648284288:0@lo:400:kworker.0 00000100:00100000:1.0:1789429279.912418:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648284800:0@lo:400:kworker.0 00000100:00100000:1.0:1789429279.912432:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648284416:0@lo:400:kworker.0 00000100:00100000:1.0:1789429279.912524:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648284928:0@lo:400:kworker.0 00000100:00100000:3.0:1789429279.912589:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1789429279.912597:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648284672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429279.912643:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648284672:12345-0@lo:400:kworker.0 Request processed in 47us (4186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.912650:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1789429279.912740:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648284672:0@lo:400:kworker.0 00000100:00100000:3.0:1789429279.912758:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.912795:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648284160:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.912815:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.912864:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634887040:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8407us (8750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.912873:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5955 00000100:00100000:0.0:1789429279.913592:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634887168 00000100:00100000:0.0:1789429279.913741:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634887168 00002000:00100000:0.0:1789429279.914352:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c0a9c00 x1876351634887168/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429279.914371:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a9c00 with x1876351634887168 ext(327680->331775) 00010000:00010000:0.0:1789429279.914382:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.914403:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429279.914412:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0a9c00 00000100:00100000:2.0:1789429279.914562:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1281 00000100:00100000:2.0:1789429279.914577:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634887168:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429279.914984:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634887168:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 410us (2226us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429279.914992:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1281 00002000:00100000:2.0:1789429279.915000:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c0a9c00 x1876351634887168/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.915020:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a9c00 with x1876351634887168 ext(327680->331775) 00010000:00010000:2.0:1789429279.915027:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.915045:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.915053:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0a9c00 00000100:00100000:3.0:1789429279.918817:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.918871:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.919016:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634887296 00000100:00100000:2.0:1789429279.919030:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634887296 00000100:00100000:1.0:1789429279.919043:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634887424 00000100:00100000:1.0:1789429279.919047:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634887424 00010000:00010000:1.0:1789429279.919084:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 32 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.919106:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5520 00000100:00100000:2.0:1789429279.919118:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634887296:12345-192.168.203.39@tcp:101:mmap_sanity.0 00000100:00100000:1.0:1789429279.919128:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5956 00000100:00100000:1.0:1789429279.919134:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2370:x1876351634887424:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429279.919138:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.919150:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429279.919160:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc11 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.919190:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 33 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.919318:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 257) 00010000:00010000:2.0:1789429279.919328:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.919337:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 257) 00010000:00010000:2.0:1789429279.919343:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 33 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.920646:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 33 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.920784:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72635ffb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc03 expref: 33 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.920807:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 257) 00010000:00010000:1.0:1789429279.920811:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 257) 00010000:00010000:1.0:1789429279.920820:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.920831:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.920880:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.920897:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.920922:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648285056:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429279.921074:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.921086:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 28 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.921096:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648285184:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429279.921270:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.921474:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789429279.926475:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648285184:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429279.926523:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 32 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.926553:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547a00, rc 0) 00000100:00100000:2.0:1789429279.926950:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634887296:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7832us (8145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.926961:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5520 00000100:00100000:0.0:1789429279.927258:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648285056:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429279.927277:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429279.928733:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634887424:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9588us (9851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429279.928750:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5956 00000100:00100000:2.0:1789429279.928915:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429279.929117:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634887552 00000100:00100000:0.0:1789429279.929127:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634887552 00010000:00010000:0.0:1789429279.929190:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.929284:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5957 00000100:00100000:0.0:1789429279.929295:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2368:x1876351634887552:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.929311:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.929340:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.929362:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.929395:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc0a expref: 29 pid: 20986 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.929416:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 257) 00010000:00010000:0.0:1789429279.929422:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 257) 00010000:00010000:0.0:1789429279.929432:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.929444:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.929501:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.929520:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648285312:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429279.929595:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f062ad600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429279.934447:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648285312:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429279.934483:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429279.934594:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2368:x1876351634887552:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5299us (5678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.934606:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5957 00000100:00100000:1.0:1789429279.944621:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.944894:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.945059:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634887808 00000100:00100000:2.0:1789429279.945073:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634887808 00002000:00100000:2.0:1789429279.945139:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946e15a51500 x1876351634887808/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.945152:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51500 with x1876351634887808 ext(327680->331775) 00002000:00010000:2.0:1789429279.945159:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15a51500 00000100:00100000:3.0:1789429279.945421:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634887680 00000100:00100000:3.0:1789429279.945428:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634887680 00000100:00100000:2.0:1789429279.945436:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11380 00000100:00100000:2.0:1789429279.945451:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634887808:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429279.945481:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5521 00000100:00100000:3.0:1789429279.945492:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634887680:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429279.945504:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429279.945527:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc18 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.945564:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.945575:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 257) 00010000:00010000:3.0:1789429279.945580:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 257) 00010000:00010000:3.0:1789429279.945587:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.945632:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.945649:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.945666:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648285440:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429279.945715:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634887808:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 267us (819us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429279.945725:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11380 00002000:00100000:2.0:1789429279.945734:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946e15a51500 x1876351634887808/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:15/0 lens 488/4536 e 0 to 0 dl 1789429290 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429279.945744:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51500 with x1876351634887808 ext(327680->331775) 00010000:00010000:2.0:1789429279.945752:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.945754:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696780 going to sleep for 11 seconds 00010000:00010000:2.0:1789429279.945772:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429279.945781:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51500 00000100:00100000:1.0:1789429279.950663:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.950781:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.953512:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634888064 00000100:00100000:2.0:1789429279.953535:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634888064 00000100:00100000:0.0:1789429279.953571:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634887936 00000100:00100000:0.0:1789429279.953578:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634887936 00010000:00010000:2.0:1789429279.953608:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 32 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.953653:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5522 00000100:00100000:2.0:1789429279.953655:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5958 00000100:00100000:0.0:1789429279.953667:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634887936:12345-192.168.203.39@tcp:101:mmap_sanity.0 00000100:00100000:2.0:1789429279.953669:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05625050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634888064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429279.953690:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429279.953691:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429279.953715:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc1f expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.953725:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 32 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.953753:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 257) 00010000:00010000:0.0:1789429279.953764:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.953772:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 257) 00010000:00010000:0.0:1789429279.953778:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 33 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.955956:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648285440:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429279.956653:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 33 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.956696:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad72635ffc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc11 expref: 33 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.956730:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 257) 00010000:00010000:2.0:1789429279.956737:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 257) 00010000:00010000:2.0:1789429279.956748:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.956761:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.956826:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429279.956846:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429279.956863:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648285568:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429279.957012:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0836c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789429279.957128:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429279.957142:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429279.957156:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648285696:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429279.957223:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f062ade40 going to sleep for 11 seconds 00010000:00010000:3.0:1789429279.966029:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.966055:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.966071:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429279.966590:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648285568:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.966619:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429279.966763:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648285696:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429279.966792:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 32 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.966812:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:2.0:1789429279.966887:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634887680:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 21394us (22278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.966903:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5521 00000100:00100000:1.0:1789429279.969842:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634887936:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 16160us (19176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.969858:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5522 00000100:00100000:2.0:1789429279.970101:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05625050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634888064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 16433us (19317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429279.970113:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5958 00010000:00010000:1.0:1789429279.971419:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429279.972753:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429279.972894:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634888192 00000100:00100000:3.0:1789429279.972908:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634888192 00002000:00100000:3.0:1789429279.972977:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f2f4e2d80 x1876351634888192/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/0 e 0 to 0 dl 1789429290 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.972998:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e2d80 with x1876351634888192 ext(327680->364543) 00010000:00010000:3.0:1789429279.973008:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.973029:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.973037:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e2d80 00000100:00100000:3.0:1789429279.973072:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1282 00000100:00100000:3.0:1789429279.973084:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634888192:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429279.980024:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634888192:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6926us (7266us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429279.980043:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1282 00002000:00100000:3.0:1789429279.980061:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f2f4e2d80 x1876351634888192/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:15/0 lens 488/440 e 0 to 0 dl 1789429290 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429279.980074:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e2d80 with x1876351634888192 ext(327680->364543) 00010000:00010000:3.0:1789429279.980088:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.980110:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 29 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429279.980121:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e2d80 00000100:00100000:2.0:1789429279.983027:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429279.983128:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.983396:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634888320 00000100:00100000:1.0:1789429279.983408:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634888320 00000100:00100000:1.0:1789429279.983488:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5523 00000100:00100000:1.0:1789429279.983502:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634888320:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429279.983533:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429279.983559:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc26 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.983601:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 257) 00010000:00010000:1.0:1789429279.983611:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.983619:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 257) 00010000:00010000:1.0:1789429279.983625:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.983681:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.983992:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.984020:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429279.984102:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634888320:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 602us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429279.984111:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5523 00000100:00100000:3.0:1789429279.984381:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634888448 00000100:00100000:3.0:1789429279.984389:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634888448 00010000:00010000:3.0:1789429279.984421:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 30 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.984457:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5959 00000100:00100000:3.0:1789429279.984466:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2370:x1876351634888448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429279.984479:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429279.984507:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 30 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.984522:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 30 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.984547:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc18 expref: 30 pid: 20745 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.984563:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 257) 00010000:00010000:3.0:1789429279.984567:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 257) 00010000:00010000:3.0:1789429279.984577:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.984587:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.984618:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429279.984633:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 30 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429279.984647:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648285952:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429279.984793:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429279.993263:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648285952:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429279.993304:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429279.993385:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634888448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8918us (10254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429279.993398:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5959 00000100:00100000:2.0:1789429279.995569:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429279.995682:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634888576 00000100:00100000:1.0:1789429279.995696:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634888576 00010000:00010000:1.0:1789429279.995763:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 31 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.995816:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5960 00000100:00100000:1.0:1789429279.995827:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351634888576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429279.995847:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429279.995878:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 31 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.995895:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 31 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.995927:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72635ffd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc1f expref: 31 pid: 13238 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.995950:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 257) 00010000:00010000:1.0:1789429279.995955:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 257) 00010000:00010000:1.0:1789429279.995964:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.995975:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429279.996024:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429279.996048:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648286080:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429279.996158:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.001127:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648286080:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429280.001196:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429280.001306:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2369:x1876351634888576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5478us (5749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.001320:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5960 00000100:00100000:0.0:1789429280.008829:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.008948:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634888704 00000100:00100000:2.0:1789429280.008963:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634888704 00000100:00100000:2.0:1789429280.009036:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5524 00000100:00100000:2.0:1789429280.009048:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634888704:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429280.009074:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429280.009102:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc2d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.009145:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.009156:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 257) 00010000:00010000:2.0:1789429280.009161:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 257) 00010000:00010000:2.0:1789429280.009187:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.009290:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.009314:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 28 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.009331:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c34bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648286208:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429280.009451:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f4810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.012861:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.012909:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.012942:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634888832 00000100:00100000:1.0:1789429280.012957:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634888832 00010000:00010000:1.0:1789429280.013014:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 29 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.013015:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634888960 00000100:00100000:3.0:1789429280.013022:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634888960 00000100:00100000:3.0:1789429280.013070:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5525 00000100:00100000:3.0:1789429280.013082:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634888960:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.013103:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789429280.013123:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5961 00010000:00010000:3.0:1789429280.013125:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc34 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.013137:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2371:x1876351634888832:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429280.013156:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429280.013186:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 257) 00010000:00010000:3.0:1789429280.013251:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.013262:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 257) 00010000:00010000:3.0:1789429280.013268:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.013421:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c34bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648286208:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429280.017653:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 31 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.017688:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 31 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.017957:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635ffdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc26 expref: 31 pid: 6680 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.017991:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 257) 00010000:00010000:1.0:1789429280.017997:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 257) 00010000:00010000:1.0:1789429280.018007:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.018020:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.018574:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.018592:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.018617:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547e00, rc 0) 00000100:00100000:0.0:1789429280.018721:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634888704:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9673us (9907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.018732:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5524 00010000:00010000:0.0:1789429280.018928:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 30 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.018941:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 30 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.018960:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648286464:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.019110:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f062ade40 going to sleep for 11 seconds 00010000:00010000:2.0:1789429280.019837:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 30 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.019855:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 30 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.019870:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c34b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648286336:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429280.020136:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.023611:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.023744:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648286464:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.023778:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429280.023850:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2371:x1876351634888832:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10717us (11004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.023863:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5961 00000100:00100000:2.0:1789429280.024039:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634889088 00000100:00100000:2.0:1789429280.024050:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634889088 00002000:00100000:2.0:1789429280.024108:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c0abb80 x1876351634889088/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.024121:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0abb80 with x1876351634889088 ext(327680->331775) 00010000:00010000:2.0:1789429280.024131:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 31 pid: 6682 timeout: 1077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.024155:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 31 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.024164:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0abb80 00000100:00100000:2.0:1789429280.024229:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1283 00000100:00100000:2.0:1789429280.024363:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634889088:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429280.024668:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c34b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648286336:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429280.024714:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.024738:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429280.024791:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634888960:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11710us (11880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.024799:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5525 00000100:00100000:2.0:1789429280.024830:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634889088:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 470us (1232us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429280.024839:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1283 00002000:00100000:2.0:1789429280.024847:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c0abb80 x1876351634889088/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.024857:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0abb80 with x1876351634889088 ext(327680->331775) 00010000:00010000:2.0:1789429280.024864:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 31 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.024877:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 31 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.024884:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0abb80 00000100:00100000:0.0:1789429280.033150:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.033321:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634889216 00000100:00100000:1.0:1789429280.033335:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634889216 00000100:00100000:1.0:1789429280.033413:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5526 00000100:00100000:1.0:1789429280.033425:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634889216:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429280.033447:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429280.033473:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc3b expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.033515:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(136 257) 00010000:00010000:1.0:1789429280.033525:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.033538:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 257) 00010000:00010000:1.0:1789429280.033544:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 32 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.033598:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.033617:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 32 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.033632:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429280.036021:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634889216:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2579us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.036039:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5526 00000100:00100000:3.0:1789429280.036466:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.037059:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634889344 00000100:00100000:2.0:1789429280.037074:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634889344 00010000:00010000:2.0:1789429280.037123:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 32 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.037195:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5962 00000100:00100000:2.0:1789429280.037245:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634889344:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.037266:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.037298:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 32 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.037315:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 32 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.037349:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72635ffe2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc2d expref: 32 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.037370:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 257) 00010000:00010000:2.0:1789429280.037375:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 257) 00010000:00010000:2.0:1789429280.037385:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.037397:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.037446:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.037469:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 28 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.037484:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648286720:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.037580:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f4810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.043435:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648286720:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.043478:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.043567:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634889344:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6333us (7100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.043581:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5962 00000100:00100000:3.0:1789429280.046096:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.046308:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634889472 00000100:00100000:1.0:1789429280.046323:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634889472 00002000:00100000:1.0:1789429280.046395:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c0aad80 x1876351634889472/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429280.046407:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0aad80 with x1876351634889472 ext(327680->364543) 00010000:00010000:1.0:1789429280.046419:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.046439:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429280.046448:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0aad80 00000100:00100000:1.0:1789429280.046491:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1284 00000100:00100000:1.0:1789429280.046503:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634889472:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429280.058698:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634889472:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 12177us (12597us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429280.058716:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1284 00002000:00100000:0.0:1789429280.058734:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c0aad80 x1876351634889472/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429280.058755:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0aad80 with x1876351634889472 ext(327680->364543) 00010000:00010000:0.0:1789429280.058770:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.058795:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429280.058806:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0aad80 00000100:00100000:3.0:1789429280.071443:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.071978:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.072256:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634889728 00000100:00100000:2.0:1789429280.072271:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634889728 00010000:00010000:2.0:1789429280.072326:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.072372:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5963 00000100:00100000:2.0:1789429280.072382:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634889728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.072401:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.072429:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.072444:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.072489:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72635ffe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc34 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.072509:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 257) 00010000:00010000:2.0:1789429280.072514:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 257) 00010000:00010000:2.0:1789429280.072524:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.072535:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.072592:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.072611:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648286848:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.072973:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634889600 00000100:00100000:0.0:1789429280.072980:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634889600 00000100:00100000:2.0:1789429280.073014:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f4810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429280.073146:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5527 00000100:00100000:0.0:1789429280.073248:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634889600:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429280.073330:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.073350:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc42 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.073381:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.073390:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 257) 00010000:00010000:0.0:1789429280.073394:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 257) 00010000:00010000:0.0:1789429280.073399:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.073424:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.073440:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 30 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.073452:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648286976:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429280.073592:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f062ade40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429280.080946:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648286976:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429280.080994:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.081023:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad000, rc 0) 00000100:00100000:0.0:1789429280.081112:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634889600:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7956us (9682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.081124:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5527 00000100:00100000:2.0:1789429280.081385:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648286848:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.081402:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.081434:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634889728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9050us (9455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.081445:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5963 00000100:00100000:2.0:1789429280.089092:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.089904:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634889856 00000100:00100000:3.0:1789429280.089920:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634889856 00010000:00010000:3.0:1789429280.089974:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.090026:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5964 00000100:00100000:3.0:1789429280.090037:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634889856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429280.090065:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429280.090093:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.090116:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.090146:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72635fff0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc3b expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.090168:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 257) 00010000:00010000:3.0:1789429280.090181:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 257) 00010000:00010000:3.0:1789429280.090933:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.090951:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.091007:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.091025:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648287104:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.091927:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.092029:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634889984 00000100:00100000:1.0:1789429280.092039:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634889984 00000100:00100000:1.0:1789429280.092107:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5528 00000100:00100000:1.0:1789429280.092118:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634889984:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429280.092137:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429280.092168:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc49 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.092231:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.092242:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 257) 00010000:00010000:1.0:1789429280.092247:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 257) 00010000:00010000:1.0:1789429280.092253:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 32 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.092439:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.092456:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 28 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.092469:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648287232:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429280.092921:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.094192:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696780 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.099051:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648287104:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.099090:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.099186:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634889856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9148us (10106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.099377:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5964 00000100:00100000:1.0:1789429280.100887:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648287232:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429280.100951:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 31 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.100988:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:1.0:1789429280.101076:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634889984:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8959us (9155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.101088:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5528 00000100:00100000:3.0:1789429280.102341:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.102859:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634890112 00000100:00100000:1.0:1789429280.102872:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634890112 00010000:00010000:1.0:1789429280.102924:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 29 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.102978:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5965 00000100:00100000:1.0:1789429280.102991:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05625450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634890112:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429280.103019:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429280.103051:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 29 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.103068:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 29 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.103100:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72635fff7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc42 expref: 29 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.103122:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 257) 00010000:00010000:1.0:1789429280.103128:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 257) 00010000:00010000:1.0:1789429280.103138:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.103152:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.103293:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.103312:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648287360:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429280.103415:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.106971:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648287360:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429280.107023:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429280.107099:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05625450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634890112:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4110us (4765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.107113:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5965 00000100:00100000:0.0:1789429280.113166:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.114586:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.115143:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634890368 00000100:00100000:3.0:1789429280.115179:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634890368 00000100:00100000:3.0:1789429280.115457:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5529 00000100:00100000:3.0:1789429280.115470:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634890368:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.115500:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.115525:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc50 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.115567:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.115578:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 257) 00010000:00010000:3.0:1789429280.115584:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 257) 00010000:00010000:3.0:1789429280.115590:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.115632:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.115659:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 30 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.115676:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648287488:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429280.115855:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.116974:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634890240 00000100:00100000:2.0:1789429280.116988:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634890240 00002000:00100000:2.0:1789429280.117057:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3221df80 x1876351634890240/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.117070:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221df80 with x1876351634890240 ext(327680->331775) 00010000:00010000:2.0:1789429280.117079:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.117096:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.117105:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221df80 00000100:00100000:2.0:1789429280.117146:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1285 00000100:00100000:2.0:1789429280.117168:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634890240:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.117681:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634890240:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 522us (4537us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429280.117691:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1285 00002000:00100000:2.0:1789429280.117710:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3221df80 x1876351634890240/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.117720:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221df80 with x1876351634890240 ext(327680->331775) 00010000:00010000:2.0:1789429280.117728:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.117741:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.117749:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221df80 00000100:00100000:2.0:1789429280.120399:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648287488:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429280.120444:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.120471:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:2.0:1789429280.120569:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634890368:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5101us (5992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.120581:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5529 00000100:00100000:3.0:1789429280.123474:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.123522:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.123629:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634890624 00000100:00100000:2.0:1789429280.123641:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634890624 00010000:00010000:2.0:1789429280.123691:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.123760:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5966 00000100:00100000:2.0:1789429280.123772:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351634890624:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.123791:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.123822:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.123844:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.123872:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72635fffe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc49 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.123894:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 257) 00010000:00010000:2.0:1789429280.123899:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 257) 00010000:00010000:2.0:1789429280.123910:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.123920:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.123969:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.123986:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648287616:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.124107:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f4810c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.124401:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634890496 00000100:00100000:1.0:1789429280.124408:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634890496 00000100:00100000:1.0:1789429280.124451:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5530 00000100:00100000:1.0:1789429280.124460:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634890496:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429280.124477:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429280.124495:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc57 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.124521:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.124537:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(141 257) 00010000:00010000:1.0:1789429280.124541:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 257) 00010000:00010000:1.0:1789429280.124546:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 32 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.124573:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.124588:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 28 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.124600:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648287744:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429280.124640:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.129909:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648287744:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429280.129960:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 32 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.129988:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429280.130064:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634890496:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5603us (6611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.130075:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5530 00000100:00100000:2.0:1789429280.131822:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648287616:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.131855:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.132165:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351634890624:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8383us (8630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.132194:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5966 00000100:00100000:0.0:1789429280.132454:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.132923:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634890752 00000100:00100000:2.0:1789429280.132934:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634890752 00002000:00100000:2.0:1789429280.132990:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f3221f800 x1876351634890752/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.133003:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221f800 with x1876351634890752 ext(327680->364543) 00010000:00010000:2.0:1789429280.133015:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.133033:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.133042:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221f800 00000100:00100000:2.0:1789429280.133080:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1286 00000100:00100000:2.0:1789429280.133090:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634890752:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.142463:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634890752:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 9357us (9994us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429280.142480:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1286 00002000:00100000:2.0:1789429280.142497:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f3221f800 x1876351634890752/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.142509:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221f800 with x1876351634890752 ext(327680->364543) 00010000:00010000:2.0:1789429280.142523:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.142553:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.142563:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221f800 00000100:00100000:3.0:1789429280.147393:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.147438:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.147549:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634890880 00000100:00100000:0.0:1789429280.147563:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634890880 00000100:00100000:0.0:1789429280.147644:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5531 00000100:00100000:0.0:1789429280.147657:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634890880:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429280.147682:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.147718:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc5e expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.147775:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(142 257) 00010000:00010000:0.0:1789429280.147785:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.147794:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(143 257) 00010000:00010000:0.0:1789429280.147800:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.147849:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.147864:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.147879:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429280.147950:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634890880:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 296us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.147959:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5531 00000100:00100000:2.0:1789429280.148097:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634891008 00000100:00100000:2.0:1789429280.148102:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634891008 00010000:00010000:2.0:1789429280.148127:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 30 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.148160:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5967 00000100:00100000:2.0:1789429280.148167:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2371:x1876351634891008:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.148190:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.148246:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 30 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.148261:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 30 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.148283:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360005 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc50 expref: 30 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.148300:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(144 257) 00010000:00010000:2.0:1789429280.148304:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(144 257) 00010000:00010000:2.0:1789429280.148313:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.148324:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.148351:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.148364:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 30 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.148380:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648288000:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.148444:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.151445:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648288000:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.151480:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.151550:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634891008:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3381us (4109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.151563:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5967 00000100:00100000:0.0:1789429280.153932:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.154028:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634891136 00000100:00100000:3.0:1789429280.154040:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634891136 00010000:00010000:3.0:1789429280.154098:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.154194:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5968 00000100:00100000:3.0:1789429280.154234:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634891136:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429280.154253:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429280.154284:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.154301:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.154328:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636000c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc57 expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.154344:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(144 257) 00010000:00010000:3.0:1789429280.154348:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(144 257) 00010000:00010000:3.0:1789429280.154356:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.154364:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.154408:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.154431:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01274a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648288128:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429280.154546:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.156818:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01274a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648288128:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.156855:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.156976:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351634891136:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2744us (3056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.156988:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5968 00000100:00100000:1.0:1789429280.164625:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.165118:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634891264 00000100:00100000:3.0:1789429280.165133:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634891264 00000100:00100000:3.0:1789429280.165249:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5532 00000100:00100000:3.0:1789429280.165262:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634891264:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.165637:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.165663:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc65 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.165710:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.165722:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(144 257) 00010000:00010000:3.0:1789429280.165727:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 257) 00010000:00010000:3.0:1789429280.165734:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 31 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.165852:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 28 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.165870:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 28 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.165894:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01276300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648288256:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429280.166144:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696780 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.172353:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01276300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648288256:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429280.172410:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 31 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.172439:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429280.172543:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634891264:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7282us (7931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.172555:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5532 00000100:00100000:0.0:1789429280.180185:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.186916:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634891392 00000100:00100000:2.0:1789429280.186939:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634891392 00002000:00100000:2.0:1789429280.187032:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f3221ca80 x1876351634891392/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.187046:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221ca80 with x1876351634891392 ext(327680->364543) 00010000:00010000:2.0:1789429280.187062:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 29 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.187092:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 29 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.187102:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221ca80 00000100:00100000:2.0:1789429280.187151:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1287 00000100:00100000:2.0:1789429280.187163:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634891392:12345-192.168.203.39@tcp:3:ldlm_bl.0 00000100:00100000:2.0:1789429280.192415:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634891392:12345-192.168.203.39@tcp:3:ldlm_bl.0 Request processed in 5238us (12237us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429280.192433:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1287 00002000:00100000:2.0:1789429280.192450:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f3221ca80 x1876351634891392/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.192463:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221ca80 with x1876351634891392 ext(327680->364543) 00010000:00010000:2.0:1789429280.192475:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 29 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.192498:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 29 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.192515:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221ca80 00000100:00100000:1.0:1789429280.197825:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.197943:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634891520 00000100:00100000:2.0:1789429280.197959:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634891520 00000100:00100000:2.0:1789429280.198110:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5533 00000100:00100000:2.0:1789429280.198124:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634891520:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429280.198147:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429280.198387:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc6c expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.198435:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(145 257) 00010000:00010000:2.0:1789429280.198445:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.198454:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(146 257) 00010000:00010000:2.0:1789429280.198459:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.198588:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.198607:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.198623:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546e00, rc 0) 00000100:00100000:2.0:1789429280.198701:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634891520:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 581us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.198710:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5533 00000100:00100000:0.0:1789429280.202112:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.202617:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634891648 00000100:00100000:1.0:1789429280.202630:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634891648 00010000:00010000:1.0:1789429280.202684:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 30 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.202775:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5969 00000100:00100000:1.0:1789429280.202787:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2369:x1876351634891648:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429280.202806:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429280.202838:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 30 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.202855:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 30 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.202885:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360013 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc5e expref: 30 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.202907:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 257) 00010000:00010000:1.0:1789429280.202913:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 257) 00010000:00010000:1.0:1789429280.202923:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.202935:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.202985:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.203015:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 30 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.203032:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648288512:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429280.203141:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.206061:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648288512:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429280.206097:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429280.206187:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2369:x1876351634891648:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3401us (4089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.206230:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5969 00000100:00100000:0.0:1789429280.208305:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.208407:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634891776 00000100:00100000:2.0:1789429280.208420:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634891776 00002000:00100000:2.0:1789429280.208499:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3221e680 x1876351634891776/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.208514:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221e680 with x1876351634891776 ext(327680->331775) 00010000:00010000:2.0:1789429280.208525:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.208545:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.208554:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221e680 00000100:00100000:2.0:1789429280.208592:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1288 00000100:00100000:2.0:1789429280.208604:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634891776:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.208872:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634891776:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 269us (578us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429280.208881:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1288 00002000:00100000:2.0:1789429280.208888:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3221e680 x1876351634891776/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.208896:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221e680 with x1876351634891776 ext(327680->331775) 00010000:00010000:2.0:1789429280.208903:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.208915:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.208922:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221e680 00000100:00100000:0.0:1789429280.215928:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.216046:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634891904 00000100:00100000:1.0:1789429280.216060:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634891904 00000100:00100000:1.0:1789429280.216131:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5534 00000100:00100000:1.0:1789429280.216144:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634891904:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429280.216168:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429280.216256:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc73 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.216303:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(147 257) 00010000:00010000:1.0:1789429280.216313:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.216321:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(148 257) 00010000:00010000:1.0:1789429280.216327:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 32 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.216378:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.216393:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 32 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.216408:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429280.216480:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634891904:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 338us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.216489:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5534 00000100:00100000:3.0:1789429280.217715:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.217815:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634892032 00000100:00100000:2.0:1789429280.217824:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634892032 00010000:00010000:2.0:1789429280.217865:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 32 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.217908:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5970 00000100:00100000:2.0:1789429280.217918:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634892032:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.217933:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.217961:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 32 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.217975:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 32 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.218014:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636001a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc65 expref: 32 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.218036:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 257) 00010000:00010000:2.0:1789429280.218040:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 257) 00010000:00010000:2.0:1789429280.218049:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.218061:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.218101:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.218116:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 28 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.218132:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648288768:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.221109:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f4810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429280.224089:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648288768:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.224117:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429280.224348:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634892032:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6428us (6638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.224361:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5970 00000100:00100000:0.0:1789429280.228508:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.229111:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634892160 00000100:00100000:2.0:1789429280.229126:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634892160 00010000:00010000:2.0:1789429280.229653:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.229717:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5971 00000100:00100000:2.0:1789429280.229734:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634892160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.229756:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.229788:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.229804:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.229843:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad726360021 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc6c expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.229866:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 257) 00010000:00010000:2.0:1789429280.229872:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 257) 00010000:00010000:2.0:1789429280.229883:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.229893:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.229962:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.229980:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648288896:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.230115:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f4810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.238734:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648288896:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.238776:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.238862:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634892160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9133us (10368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.238875:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5971 00000100:00100000:0.0:1789429280.243521:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.243619:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634892288 00000100:00100000:1.0:1789429280.243632:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634892288 00000100:00100000:1.0:1789429280.243703:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5535 00000100:00100000:1.0:1789429280.243713:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634892288:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429280.243736:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429280.243760:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc7a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.243803:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.243814:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(149 257) 00010000:00010000:1.0:1789429280.243819:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(150 257) 00010000:00010000:1.0:1789429280.243825:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 29 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.243866:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.243881:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 30 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.243897:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648289024:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429280.243994:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429280.252702:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.252873:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634892416 00000100:00100000:2.0:1789429280.252886:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634892416 00002000:00100000:2.0:1789429280.252958:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3b322d80 x1876351634892416/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.252973:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b322d80 with x1876351634892416 ext(327680->331775) 00010000:00010000:2.0:1789429280.252985:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.253022:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.253033:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b322d80 00000100:00100000:2.0:1789429280.253129:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1289 00000100:00100000:2.0:1789429280.253143:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634892416:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.253497:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634892416:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 355us (810us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429280.253507:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1289 00002000:00100000:2.0:1789429280.253515:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3b322d80 x1876351634892416/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.253524:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b322d80 with x1876351634892416 ext(327680->331775) 00010000:00010000:2.0:1789429280.253531:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.253543:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.253551:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b322d80 00000100:00100000:1.0:1789429280.254127:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648289024:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429280.254165:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 29 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.254228:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429280.254274:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634892288:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10562us (10766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.254283:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5535 00000100:00100000:1.0:1789429280.259409:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.259524:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.259770:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634892672 00000100:00100000:2.0:1789429280.259785:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634892672 00010000:00010000:2.0:1789429280.260243:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.260294:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5972 00000100:00100000:2.0:1789429280.260309:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05626050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634892672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.260330:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.260360:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 31 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.260734:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634892544 00000100:00100000:3.0:1789429280.260743:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634892544 00000100:00100000:3.0:1789429280.260801:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5536 00000100:00100000:3.0:1789429280.260813:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634892544:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.260831:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.260854:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc81 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.260893:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(150 257) 00010000:00010000:3.0:1789429280.260903:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.260912:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(151 257) 00010000:00010000:3.0:1789429280.260920:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 33 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.260979:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.261007:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 33 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.261025:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429280.261107:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+33:33927:x1876351634892544:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 296us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.261116:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5536 00010000:00010000:2.0:1789429280.261340:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 32 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.261371:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360028 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc73 expref: 32 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.261391:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(152 257) 00010000:00010000:2.0:1789429280.261396:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(152 257) 00010000:00010000:2.0:1789429280.261410:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.261422:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.262792:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.262821:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 28 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.262847:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648289280:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429280.262973:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.279454:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648289280:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429280.279496:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429280.279631:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05626050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634892672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 19324us (20104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.279645:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5972 00000100:00100000:0.0:1789429280.285127:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.285337:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634892800 00000100:00100000:1.0:1789429280.285351:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634892800 00002000:00100000:1.0:1789429280.285421:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f340ce300 x1876351634892800/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429280.285435:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340ce300 with x1876351634892800 ext(327680->364543) 00010000:00010000:1.0:1789429280.285446:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 29 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.285468:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 29 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429280.285478:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f340ce300 00000100:00100000:1.0:1789429280.285518:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1290 00000100:00100000:1.0:1789429280.285530:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634892800:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429280.289708:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634892800:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4162us (4580us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429280.289724:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1290 00002000:00100000:1.0:1789429280.289741:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f340ce300 x1876351634892800/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429280.289753:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340ce300 with x1876351634892800 ext(327680->364543) 00010000:00010000:1.0:1789429280.289767:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 29 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.289789:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 29 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429280.289799:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f340ce300 00000100:00100000:3.0:1789429280.295655:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.296101:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634892928 00000100:00100000:2.0:1789429280.296118:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634892928 00000100:00100000:2.0:1789429280.296254:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5537 00000100:00100000:2.0:1789429280.296267:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634892928:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429280.296292:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429280.296317:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc88 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.296368:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(152 257) 00010000:00010000:2.0:1789429280.296378:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.296386:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(153 257) 00010000:00010000:2.0:1789429280.296392:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.296448:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.296467:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.296482:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546e00, rc 0) 00000100:00100000:2.0:1789429280.296545:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634892928:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 282us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.296552:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5537 00000100:00100000:3.0:1789429280.298847:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.299194:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634893056 00000100:00100000:1.0:1789429280.299223:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634893056 00010000:00010000:1.0:1789429280.299276:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 30 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.299330:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5973 00000100:00100000:1.0:1789429280.299341:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2369:x1876351634893056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429280.299358:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429280.299387:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 30 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.299409:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 30 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.299438:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636002f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc7a expref: 30 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.299460:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 257) 00010000:00010000:1.0:1789429280.299472:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 257) 00010000:00010000:1.0:1789429280.299483:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.299495:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.299546:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.299563:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 30 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.299579:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648289536:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429280.299771:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.305053:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.305307:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648289536:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429280.305339:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429280.305414:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2369:x1876351634893056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6073us (6579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.305427:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5973 00000100:00100000:1.0:1789429280.305467:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634893184 00000100:00100000:1.0:1789429280.305475:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634893184 00010000:00010000:1.0:1789429280.305513:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.305556:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5974 00000100:00100000:1.0:1789429280.305567:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634893184:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429280.305589:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429280.305619:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.305633:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.305664:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360036 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc81 expref: 31 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.305696:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 257) 00010000:00010000:1.0:1789429280.305702:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 257) 00010000:00010000:1.0:1789429280.305712:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.305725:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.305770:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.305795:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648289664:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429280.305878:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.308807:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648289664:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429280.308843:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429280.308920:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634893184:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3353us (3881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.308934:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5974 00000100:00100000:0.0:1789429280.321081:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.321259:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.321592:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634893440 00000100:00100000:3.0:1789429280.321608:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634893440 00002000:00100000:3.0:1789429280.321677:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f34022300 x1876351634893440/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429280.321693:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34022300 with x1876351634893440 ext(327680->364543) 00002000:00010000:3.0:1789429280.321702:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34022300 00000100:00100000:2.0:1789429280.321806:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11381 00000100:00100000:2.0:1789429280.321821:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634893440:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429280.323095:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634893312 00000100:00100000:1.0:1789429280.323109:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634893312 00000100:00100000:1.0:1789429280.323185:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5538 00000100:00100000:1.0:1789429280.323196:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634893312:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429280.323256:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429280.323281:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc8f expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.323327:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.323339:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(154 257) 00010000:00010000:1.0:1789429280.323344:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 257) 00010000:00010000:1.0:1789429280.323355:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 31 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.323400:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.323418:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 30 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.323434:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648289792:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429280.323535:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.328360:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634893440:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6525us (7082us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429280.328377:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11381 00002000:00100000:2.0:1789429280.328395:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f34022300 x1876351634893440/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.328407:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34022300 with x1876351634893440 ext(327680->364543) 00010000:00010000:2.0:1789429280.328420:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.328442:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 29 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.328451:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34022300 00000100:00100000:1.0:1789429280.333069:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648289792:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429280.333123:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 31 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.333156:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429280.333312:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634893312:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10117us (12245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.333324:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5538 00000100:00100000:3.0:1789429280.333715:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.333877:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.334016:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634893568 00000100:00100000:1.0:1789429280.334025:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634893568 00000100:00100000:1.0:1789429280.334080:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5539 00000100:00100000:1.0:1789429280.334091:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634893568:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429280.334112:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429280.334135:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc96 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.334177:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(155 257) 00010000:00010000:1.0:1789429280.334187:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.334196:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(156 257) 00010000:00010000:1.0:1789429280.334231:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.334280:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.334298:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.334311:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:1.0:1789429280.334358:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634893568:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 269us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.334365:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5539 00000100:00100000:2.0:1789429280.335718:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634893696 00000100:00100000:2.0:1789429280.335732:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634893696 00010000:00010000:2.0:1789429280.335777:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 30 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.335825:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5975 00000100:00100000:2.0:1789429280.335835:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2370:x1876351634893696:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.335851:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.335878:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 30 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.335895:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 30 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.335923:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636003d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc88 expref: 30 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.335942:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 257) 00010000:00010000:2.0:1789429280.335947:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 257) 00010000:00010000:2.0:1789429280.335958:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.335969:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.336010:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.336026:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 30 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.336044:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648290048:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.336153:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.338603:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648290048:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.338639:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.338709:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634893696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2874us (4995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.338722:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5975 00000100:00100000:2.0:1789429280.348329:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.348443:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634893824 00000100:00100000:0.0:1789429280.348457:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634893824 00002000:00100000:0.0:1789429280.348525:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c348700 x1876351634893824/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429280.348548:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c348700 with x1876351634893824 ext(327680->331775) 00010000:00010000:0.0:1789429280.348559:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.348578:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429280.348587:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c348700 00000100:00100000:0.0:1789429280.348632:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1291 00000100:00100000:0.0:1789429280.348643:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634893824:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429280.349028:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634893824:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 385us (713us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429280.349038:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1291 00002000:00100000:0.0:1789429280.349045:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c348700 x1876351634893824/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429280.349054:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c348700 with x1876351634893824 ext(327680->331775) 00010000:00010000:0.0:1789429280.349060:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.349073:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429280.349080:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c348700 00000100:00100000:0.0:1789429280.355899:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.356027:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634893952 00000100:00100000:1.0:1789429280.356041:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634893952 00000100:00100000:1.0:1789429280.356115:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5540 00000100:00100000:1.0:1789429280.356127:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634893952:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429280.356150:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429280.356182:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bc9d expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.356270:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(157 257) 00010000:00010000:1.0:1789429280.356280:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.356288:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(158 257) 00010000:00010000:1.0:1789429280.356293:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 32 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.356342:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.356365:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 32 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.356379:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429280.356461:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634893952:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 337us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.356469:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5540 00000100:00100000:3.0:1789429280.357045:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.357385:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634894080 00000100:00100000:1.0:1789429280.357393:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634894080 00010000:00010000:1.0:1789429280.357422:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 32 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.357466:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5976 00000100:00100000:1.0:1789429280.357476:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634894080:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429280.357490:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429280.357519:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 32 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.357546:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 32 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.357575:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360044 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc8f expref: 32 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.357600:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 257) 00010000:00010000:1.0:1789429280.357605:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 257) 00010000:00010000:1.0:1789429280.357615:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.357628:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.357666:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.357680:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 28 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.357697:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648290304:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429280.357796:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.366185:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648290304:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429280.366263:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429280.366338:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634894080:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8861us (9293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.366352:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5976 00000100:00100000:3.0:1789429280.366855:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.366937:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634894208 00000100:00100000:0.0:1789429280.366947:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634894208 00010000:00010000:0.0:1789429280.367000:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 29 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.367043:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5977 00000100:00100000:0.0:1789429280.367054:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2369:x1876351634894208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429280.367070:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429280.367099:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 29 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.367115:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 29 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.367146:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636004b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc96 expref: 29 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.367167:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 257) 00010000:00010000:0.0:1789429280.367183:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 257) 00010000:00010000:0.0:1789429280.367195:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.367256:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.367301:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.367317:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648290432:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.367400:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f062ade40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.374062:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648290432:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.374099:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.374185:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2369:x1876351634894208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7131us (7332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.374248:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5977 00000100:00100000:3.0:1789429280.379294:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.379520:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634894336 00000100:00100000:1.0:1789429280.379536:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634894336 00000100:00100000:1.0:1789429280.379616:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5541 00000100:00100000:1.0:1789429280.379629:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634894336:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429280.379661:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429280.379686:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bca4 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.379731:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.379743:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(159 257) 00010000:00010000:1.0:1789429280.379748:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 257) 00010000:00010000:1.0:1789429280.379755:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.379799:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.379814:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 30 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.379831:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648290560:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429280.379935:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.383154:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648290560:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429280.383259:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.383294:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429280.383369:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634894336:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3741us (4089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.383382:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5541 00000100:00100000:0.0:1789429280.390159:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.390341:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.391086:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634894464 00000100:00100000:2.0:1789429280.391101:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634894464 00010000:00010000:2.0:1789429280.391158:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 31 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.391268:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5978 00000100:00100000:2.0:1789429280.391281:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634894464:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.391308:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789429280.391333:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634894592 00000100:00100000:1.0:1789429280.391338:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634894592 00010000:00010000:2.0:1789429280.391338:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 31 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.391354:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 32 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.391371:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5542 00000100:00100000:1.0:1789429280.391378:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634894592:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429280.391382:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360052 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bc9d expref: 32 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.391393:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429280.391408:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 257) 00010000:00010000:1.0:1789429280.391409:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcab expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.391413:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 257) 00010000:00010000:2.0:1789429280.391424:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.391465:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.391484:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.391491:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(160 257) 00010000:00010000:1.0:1789429280.391494:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(161 257) 00010000:00010000:1.0:1789429280.391499:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 32 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.392637:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.392679:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 28 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.392699:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648290688:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429280.392839:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00010000:00010000:2.0:1789429280.392898:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 28 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.392908:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 28 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.392920:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648290816:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.392947:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.396274:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648290688:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429280.396331:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 32 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.396362:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429280.396552:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634894592:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5173us (6208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.396564:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5542 00000100:00100000:2.0:1789429280.407251:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648290816:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.407289:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.407358:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634894464:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 16079us (17220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.407371:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5978 00000100:00100000:3.0:1789429280.408434:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.408510:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634894720 00000100:00100000:2.0:1789429280.408520:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634894720 00002000:00100000:2.0:1789429280.408583:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f3221ea00 x1876351634894720/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.408597:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221ea00 with x1876351634894720 ext(327680->364543) 00010000:00010000:2.0:1789429280.408608:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 29 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.408627:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 29 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.408636:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221ea00 00000100:00100000:2.0:1789429280.408679:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1292 00000100:00100000:2.0:1789429280.408690:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634894720:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.416473:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634894720:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7765us (8025us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429280.416493:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1292 00002000:00100000:2.0:1789429280.416511:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f3221ea00 x1876351634894720/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.416523:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221ea00 with x1876351634894720 ext(327680->364543) 00010000:00010000:2.0:1789429280.416539:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 29 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.416563:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 29 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.416579:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221ea00 00000100:00100000:1.0:1789429280.419360:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648290944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429280.419454:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429280.420437:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789429280.420453:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648291072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429280.420507:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429280.420548:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648290944 00000100:00100000:2.0:1789429280.420557:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648290944 00000100:00100000:2.0:1789429280.420606:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648291072 00000100:00100000:2.0:1789429280.420609:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648291072 00000100:00100000:2.0:1789429280.420627:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789429280.420636:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648290944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429280.420677:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 10223616 granted 880607232 pending 44302336 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429280.420738:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648290944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.420745:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789429280.420762:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789429280.420775:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648291072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429280.421045:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 326959104 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1789429280.421084:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648291072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 316us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.421090:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789429280.422018:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648291072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429280.422056:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648290944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429280.427752:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.427871:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.427921:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634894976 00000100:00100000:0.0:1789429280.427931:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634894976 00000100:00100000:0.0:1789429280.427997:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5543 00000100:00100000:0.0:1789429280.428014:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634894976:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429280.428044:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.428063:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcb2 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.428095:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(161 257) 00010000:00010000:0.0:1789429280.428105:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.428112:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(162 257) 00010000:00010000:0.0:1789429280.428118:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.428160:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.428189:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.428221:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429280.428274:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634894976:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 268us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.428282:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5543 00000100:00100000:1.0:1789429280.428674:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634894848 00000100:00100000:1.0:1789429280.428749:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634894848 00010000:00010000:1.0:1789429280.428772:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 30 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.428830:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5979 00000100:00100000:1.0:1789429280.428841:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05626450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2371:x1876351634894848:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429280.428853:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429280.428871:0:5826:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb blocks from disk: 519 -> 775 00010000:00010000:1.0:1789429280.428881:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 30 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.428915:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 30 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.428942:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360059 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bca4 expref: 30 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.428963:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 257) 00010000:00010000:1.0:1789429280.428968:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 257) 00010000:00010000:1.0:1789429280.428977:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.428995:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.429034:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 30 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.429053:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 30 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.429067:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648291328:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429280.429159:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429280.434627:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.435466:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634895104 00000100:00100000:3.0:1789429280.435480:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634895104 00002000:00100000:3.0:1789429280.435559:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946e15184e00 x1876351634895104/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429280.435573:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184e00 with x1876351634895104 ext(327680->331775) 00010000:00010000:3.0:1789429280.435585:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.435609:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429280.435620:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15184e00 00000100:00100000:3.0:1789429280.435676:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1293 00000100:00100000:3.0:1789429280.435688:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634895104:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429280.435967:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634895104:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 278us (1352us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429280.435977:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1293 00002000:00100000:3.0:1789429280.435988:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946e15184e00 x1876351634895104/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429280.436006:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184e00 with x1876351634895104 ext(327680->331775) 00010000:00010000:3.0:1789429280.436012:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.436037:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429280.436045:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15184e00 00000100:00100000:2.0:1789429280.436827:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648291328:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.436862:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.436918:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05626450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634894848:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8079us (9172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.436930:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5979 00000100:00100000:0.0:1789429280.442679:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.442790:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.442866:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634895360 00000100:00100000:3.0:1789429280.442879:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634895360 00010000:00010000:3.0:1789429280.442929:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.442982:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5980 00000100:00100000:3.0:1789429280.442994:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634895360:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429280.443012:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429280.443055:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.443073:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.443104:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360060 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcab expref: 31 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.443132:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 257) 00010000:00010000:3.0:1789429280.443138:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 257) 00010000:00010000:3.0:1789429280.443148:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.443161:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.443257:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.443278:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648291456:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429280.443909:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.444955:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634895232 00000100:00100000:2.0:1789429280.444971:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634895232 00000100:00100000:2.0:1789429280.445343:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5544 00000100:00100000:2.0:1789429280.445357:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634895232:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429280.445380:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429280.445405:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcb9 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.445520:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.445531:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(163 257) 00010000:00010000:2.0:1789429280.445536:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 257) 00010000:00010000:2.0:1789429280.445542:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.445587:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.445603:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 28 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.445626:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648291584:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429280.445729:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03266e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.449164:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648291584:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429280.449308:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.449337:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546e00, rc 0) 00000100:00100000:3.0:1789429280.449402:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634895232:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4047us (6733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.449413:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5544 00000100:00100000:3.0:1789429280.449698:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648291456:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429280.449714:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429280.449746:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634895360:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6755us (6957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.449758:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5980 00000100:00100000:3.0:1789429280.453104:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.453271:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634895488 00000100:00100000:2.0:1789429280.453286:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634895488 00010000:00010000:2.0:1789429280.453330:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 29 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.453376:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5981 00000100:00100000:2.0:1789429280.453386:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634895488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.454361:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.454391:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 29 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.454409:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 29 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.454433:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360067 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb2 expref: 29 pid: 20745 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.454555:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 257) 00010000:00010000:2.0:1789429280.454560:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 257) 00010000:00010000:2.0:1789429280.454569:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.454586:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.454625:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.454639:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648291712:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.454725:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03266e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.464890:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.465105:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648291712:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.465133:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429280.465257:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634895616 00000100:00100000:3.0:1789429280.465269:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634895616 00000100:00100000:3.0:1789429280.465340:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5545 00000100:00100000:3.0:1789429280.465352:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634895616:12345-192.168.203.39@tcp:101:mmap_sanity.0 00000100:00100000:0.0:1789429280.465416:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351634895488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12027us (12321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.465428:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5981 00010000:00010000:3.0:1789429280.465452:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.465953:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcc0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.466008:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.466019:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(164 257) 00010000:00010000:3.0:1789429280.466025:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 257) 00010000:00010000:3.0:1789429280.466031:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.466152:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.466183:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 30 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.466224:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648291840:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429280.466451:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.471584:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b606300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648291840:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429280.471622:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.471642:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429280.471696:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634895616:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6345us (6826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.471704:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5545 00000100:00100000:0.0:1789429280.473700:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.473779:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634895744 00000100:00100000:2.0:1789429280.473788:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634895744 00010000:00010000:2.0:1789429280.473824:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 31 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.473865:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5982 00000100:00100000:2.0:1789429280.473875:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634895744:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.473889:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.473911:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 31 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.473925:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 31 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.473951:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636006e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcb9 expref: 31 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.473976:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 257) 00010000:00010000:2.0:1789429280.473981:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 257) 00010000:00010000:2.0:1789429280.473990:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.474308:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.474390:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.474405:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c34bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648291968:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.474597:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03266e40 going to sleep for 11 seconds 00000001:00080000:1.0:1789429280.475535:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969556 is committed 00000001:00080000:1.0:1789429280.475558:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969549 is committed 00000001:00080000:1.0:1789429280.475581:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969562 is committed 00000001:00080000:1.0:1789429280.475599:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969550 is committed 00000001:00080000:1.0:1789429280.475619:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969557 is committed 00000100:00100000:3.0:1789429280.476717:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.477335:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634895872 00000100:00100000:0.0:1789429280.477345:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634895872 00000100:00100000:0.0:1789429280.477443:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5546 00000100:00100000:0.0:1789429280.477462:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634895872:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429280.477479:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.477498:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcc7 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.477531:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.477542:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(165 257) 00010000:00010000:0.0:1789429280.477546:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 257) 00010000:00010000:0.0:1789429280.477551:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.477581:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.477595:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 14 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.477615:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648292096:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429280.477738:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.480133:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c34bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648291968:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.480158:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.480415:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634895744:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6539us (6720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.480425:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5982 00000100:00100000:0.0:1789429280.481286:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648292096:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429280.481320:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.481341:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429280.481419:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634895872:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3959us (4708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.481427:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5546 00000100:00100000:1.0:1789429280.489699:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.489805:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634896000 00000100:00100000:2.0:1789429280.489817:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634896000 00002000:00100000:2.0:1789429280.489867:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f3fbcaa00 x1876351634896000/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.489879:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcaa00 with x1876351634896000 ext(327680->364543) 00010000:00010000:2.0:1789429280.489888:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.489906:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.489914:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcaa00 00000100:00100000:2.0:1789429280.489948:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1294 00000100:00100000:2.0:1789429280.489957:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634896000:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.496795:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634896000:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6828us (7095us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429280.496807:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1294 00002000:00100000:2.0:1789429280.496821:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f3fbcaa00 x1876351634896000/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.496831:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcaa00 with x1876351634896000 ext(327680->364543) 00010000:00010000:2.0:1789429280.496841:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.496859:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.496869:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcaa00 00000100:00100000:3.0:1789429280.507911:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.508029:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634896128 00000100:00100000:1.0:1789429280.508049:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634896128 00010000:00010000:1.0:1789429280.508114:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.508183:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5983 00000100:00100000:1.0:1789429280.508196:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634896128:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429280.508270:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429280.508302:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.508331:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.508470:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360075 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc0 expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.508492:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 257) 00010000:00010000:1.0:1789429280.508497:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 257) 00010000:00010000:1.0:1789429280.508508:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.508526:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.508576:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.508594:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648292224:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429280.509108:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.509606:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.509621:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634896256 00000100:00100000:3.0:1789429280.509634:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634896256 00000100:00100000:3.0:1789429280.509695:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5547 00000100:00100000:3.0:1789429280.509710:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634896256:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.509727:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.509745:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcce expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.509787:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.509797:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(166 257) 00010000:00010000:3.0:1789429280.509801:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 257) 00010000:00010000:3.0:1789429280.509806:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.509847:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.509861:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 16 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.509875:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648292352:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429280.509935:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.515176:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648292224:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.515239:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.515290:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634896128:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7097us (7387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.515299:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5983 00000100:00100000:3.0:1789429280.515812:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.515935:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634896384 00000100:00100000:2.0:1789429280.515943:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634896384 00002000:00100000:2.0:1789429280.515990:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3f17b480 x1876351634896384/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.516007:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17b480 with x1876351634896384 ext(327680->331775) 00010000:00010000:2.0:1789429280.516017:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.516034:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.516042:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f17b480 00000100:00100000:2.0:1789429280.516076:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1295 00000100:00100000:2.0:1789429280.516085:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634896384:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.516294:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634896384:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 209us (482us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429280.516301:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1295 00002000:00100000:2.0:1789429280.516308:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f3f17b480 x1876351634896384/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.516317:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17b480 with x1876351634896384 ext(327680->331775) 00010000:00010000:2.0:1789429280.516324:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.516336:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.516343:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f17b480 00000100:00100000:0.0:1789429280.522726:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648292352:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429280.522767:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 15 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.522789:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:0.0:1789429280.522862:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634896256:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 13151us (13755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.522872:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5547 00000100:00100000:1.0:1789429280.540642:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.540689:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.540782:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634896640 00000100:00100000:0.0:1789429280.540793:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634896640 00010000:00010000:0.0:1789429280.540834:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.540888:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5984 00000100:00100000:0.0:1789429280.540898:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634896640:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429280.540914:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429280.540937:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.540951:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.540976:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636007c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcc7 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.540993:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 257) 00010000:00010000:0.0:1789429280.540998:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 257) 00010000:00010000:0.0:1789429280.541018:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.541029:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.541068:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.541089:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648292480:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.541176:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.541566:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634896512 00000100:00100000:3.0:1789429280.541572:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634896512 00000100:00100000:3.0:1789429280.541612:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5548 00000100:00100000:3.0:1789429280.541620:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634896512:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.541632:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.541644:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcd5 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.541664:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.541671:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(167 257) 00010000:00010000:3.0:1789429280.541674:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 257) 00010000:00010000:3.0:1789429280.541679:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.541705:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.541718:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 14 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.541728:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648292608:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429280.541762:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.551788:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648292608:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429280.551827:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.551848:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:2.0:1789429280.551913:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634896512:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10292us (11279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.551923:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5548 00000100:00100000:0.0:1789429280.556063:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648292480:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.556091:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429280.556148:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634896640:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 15250us (15457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.556159:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5984 00000100:00100000:3.0:1789429280.558570:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.558707:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634896768 00000100:00100000:0.0:1789429280.558717:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634896768 00010000:00010000:0.0:1789429280.558753:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 15 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.558794:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5985 00000100:00100000:0.0:1789429280.558802:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2368:x1876351634896768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429280.558814:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429280.558836:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 15 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.558850:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 15 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.558873:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360083 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcce expref: 15 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.558896:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 257) 00010000:00010000:0.0:1789429280.558900:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 257) 00010000:00010000:0.0:1789429280.558908:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.558918:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.558949:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.558963:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648292736:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.559037:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429280.563772:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648292736:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.563799:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429280.563860:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2368:x1876351634896768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5057us (5297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.563871:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5985 00000100:00100000:1.0:1789429280.570389:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.570530:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634896896 00000100:00100000:3.0:1789429280.570542:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634896896 00000100:00100000:3.0:1789429280.570590:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5549 00000100:00100000:3.0:1789429280.570598:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634896896:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.570615:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.570631:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcdc expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.570663:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.570672:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(168 257) 00010000:00010000:3.0:1789429280.570676:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 257) 00010000:00010000:3.0:1789429280.570681:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.570715:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.570727:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 16 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.570739:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648292864:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429280.570815:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.574718:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.574781:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634897024 00000100:00100000:2.0:1789429280.574790:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634897024 00010000:00010000:2.0:1789429280.574826:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.574862:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5986 00000100:00100000:2.0:1789429280.574870:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05625850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634897024:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.574883:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.574901:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.574922:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.574945:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 257) 00010000:00010000:2.0:1789429280.574949:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 257) 00010000:00010000:2.0:1789429280.574957:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.574967:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.575008:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.575020:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c34bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648292992:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.575089:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f012ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.578145:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.578230:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634897152 00000100:00100000:0.0:1789429280.578239:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634897152 00000100:00100000:0.0:1789429280.578293:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5550 00000100:00100000:0.0:1789429280.578302:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634897152:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429280.578319:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.578347:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bce3 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.578369:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c34bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648292992:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.578376:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.578385:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(169 257) 00010000:00010000:2.0:1789429280.578386:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429280.578388:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 257) 00010000:00010000:0.0:1789429280.578392:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.578418:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.578430:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.578444:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648293120:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429280.578482:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05625850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634897024:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3612us (3772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.578491:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.578491:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5986 00010000:00010000:1.0:1789429280.578742:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636008a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcd5 expref: 18 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429280.578757:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648292864:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429280.578774:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.578784:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.578794:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:1.0:1789429280.578818:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634896896:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8221us (8441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.578825:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5549 00000100:00100000:1.0:1789429280.592428:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.592610:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648293120:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429280.592644:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.592667:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429280.592733:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634897152:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 14431us (14596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.592745:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5550 00000100:00100000:3.0:1789429280.592933:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634897280 00000100:00100000:3.0:1789429280.592941:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634897280 00002000:00100000:3.0:1789429280.592985:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f05420700 x1876351634897280/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429280.592994:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05420700 with x1876351634897280 ext(327680->364543) 00010000:00010000:3.0:1789429280.593001:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.593016:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429280.593024:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05420700 00000100:00100000:3.0:1789429280.593053:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1296 00000100:00100000:3.0:1789429280.593063:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634897280:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429280.597240:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634897280:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4139us (4783us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429280.597254:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1296 00002000:00100000:3.0:1789429280.597620:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f05420700 x1876351634897280/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429280.597631:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05420700 with x1876351634897280 ext(327680->364543) 00010000:00010000:3.0:1789429280.597641:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.597659:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429280.597666:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05420700 00000100:00100000:1.0:1789429280.604334:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.604360:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.604456:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634897408 00000100:00100000:0.0:1789429280.604465:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634897408 00000100:00100000:0.0:1789429280.604516:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5551 00000100:00100000:0.0:1789429280.604525:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634897408:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429280.604542:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.604561:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcea expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.604592:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(170 257) 00010000:00010000:0.0:1789429280.604600:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.604607:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(171 257) 00010000:00010000:0.0:1789429280.604613:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.604650:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.604663:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.604675:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:0.0:1789429280.604721:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634897408:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 198us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.604729:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5551 00000100:00100000:2.0:1789429280.610259:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634897536 00000100:00100000:2.0:1789429280.610274:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634897536 00010000:00010000:2.0:1789429280.610320:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 16 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.610411:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5987 00000100:00100000:2.0:1789429280.610422:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634897536:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.610439:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.610473:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 16 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.610489:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 16 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.610515:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360091 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcdc expref: 16 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.610532:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 257) 00010000:00010000:2.0:1789429280.610537:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 257) 00010000:00010000:2.0:1789429280.610546:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.610557:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.610599:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.610619:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 16 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.610632:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c34bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648293376:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.610724:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03266e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.616866:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c34bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648293376:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.616892:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.616945:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634897536:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6524us (12583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.616956:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5987 00000100:00100000:1.0:1789429280.617091:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.617965:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634897664 00000100:00100000:3.0:1789429280.617975:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634897664 00002000:00100000:3.0:1789429280.618020:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f05423100 x1876351634897664/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429280.618031:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05423100 with x1876351634897664 ext(327680->331775) 00010000:00010000:3.0:1789429280.618038:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.618054:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429280.618068:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05423100 00000100:00100000:3.0:1789429280.618111:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1297 00000100:00100000:3.0:1789429280.618119:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634897664:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.619176:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634897664:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 1042us (2070us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429280.619187:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1297 00002000:00100000:2.0:1789429280.619196:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f05423100 x1876351634897664/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.619235:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05423100 with x1876351634897664 ext(327680->331775) 00010000:00010000:2.0:1789429280.619244:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.619259:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.619267:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05423100 00000100:00100000:1.0:1789429280.626086:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.626795:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.626894:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634897792 00000100:00100000:2.0:1789429280.626905:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634897792 00000100:00100000:2.0:1789429280.626961:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5552 00000100:00100000:2.0:1789429280.626972:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634897792:12345-192.168.203.39@tcp:101:mmap_sanity.0 00000100:00100000:0.0:1789429280.627083:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634897920 00000100:00100000:0.0:1789429280.627088:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634897920 00010000:00010000:0.0:1789429280.627111:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 18 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.627363:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429280.627380:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcf1 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.627410:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(172 257) 00010000:00010000:2.0:1789429280.627419:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.627426:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(173 257) 00010000:00010000:2.0:1789429280.627432:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.627669:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.627683:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 19 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.627696:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429280.627750:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634897792:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 780us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.627757:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5552 00000100:00100000:0.0:1789429280.627844:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5988 00000100:00100000:0.0:1789429280.627854:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634897920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429280.627864:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429280.627886:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 18 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.627897:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 18 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.627916:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360098 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bce3 expref: 18 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.627928:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 257) 00010000:00010000:0.0:1789429280.627932:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 257) 00010000:00010000:0.0:1789429280.627940:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.627949:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.627978:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 14 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.627998:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 14 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.628009:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648293632:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.628069:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.632602:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.632713:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648293632:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.632738:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429280.632789:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634897920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4937us (5996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.632799:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5988 00000100:00100000:0.0:1789429280.634892:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634898048 00000100:00100000:0.0:1789429280.634905:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634898048 00010000:00010000:0.0:1789429280.634946:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 15 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.634986:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5989 00000100:00100000:0.0:1789429280.635003:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2369:x1876351634898048:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429280.635018:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429280.635040:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 15 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.635059:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 15 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.635083:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636009f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcea expref: 15 pid: 8085 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.635101:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 257) 00010000:00010000:0.0:1789429280.635106:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 257) 00010000:00010000:0.0:1789429280.635114:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.635123:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.635178:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.635192:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648293760:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.635279:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429280.639525:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648293760:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.639553:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429280.639614:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2369:x1876351634898048:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4611us (7020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.639629:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5989 00000100:00100000:2.0:1789429280.642974:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.643092:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634898176 00000100:00100000:3.0:1789429280.643102:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634898176 00000100:00100000:3.0:1789429280.643176:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5553 00000100:00100000:3.0:1789429280.643186:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634898176:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.643239:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.643260:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcf8 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.643293:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.643302:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(174 257) 00010000:00010000:3.0:1789429280.643306:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 257) 00010000:00010000:3.0:1789429280.643311:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.643343:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.643357:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 16 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.643371:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c008380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648293888:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429280.643434:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.647675:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.647755:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634898304 00000100:00100000:0.0:1789429280.647764:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634898304 00010000:00010000:0.0:1789429280.647799:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.647840:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5990 00000100:00100000:0.0:1789429280.647848:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634898304:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429280.647861:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429280.647882:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.647895:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.647919:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 257) 00010000:00010000:0.0:1789429280.647923:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 257) 00010000:00010000:0.0:1789429280.647932:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.647942:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.647974:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.647999:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648294016:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.648076:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00010000:00010000:2.0:1789429280.653680:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263600a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf1 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.653708:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c008380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648293888:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429280.653744:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.653760:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:2.0:1789429280.653900:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634898176:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10714us (10932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.653909:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5553 00000100:00100000:3.0:1789429280.655409:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.655566:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634898432 00000100:00100000:0.0:1789429280.655574:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634898432 00000100:00100000:0.0:1789429280.655631:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5554 00000100:00100000:0.0:1789429280.655640:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634898432:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429280.655655:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.655672:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bcff expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.655702:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.655711:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(175 257) 00010000:00010000:0.0:1789429280.655715:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 257) 00010000:00010000:0.0:1789429280.655720:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.655753:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.655766:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 14 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.655785:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648294144:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429280.655861:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.659695:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648294016:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429280.659721:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429280.659781:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634898304:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11933us (12115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.659791:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5990 00000100:00100000:2.0:1789429280.660018:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648294144:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429280.660044:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 17 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.660067:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:2.0:1789429280.660107:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634898432:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4468us (4703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.660115:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5554 00000100:00100000:0.0:1789429280.664684:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.664959:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634898560 00000100:00100000:1.0:1789429280.665271:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634898560 00002000:00100000:1.0:1789429280.665323:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f2f65c380 x1876351634898560/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429280.665336:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65c380 with x1876351634898560 ext(327680->364543) 00010000:00010000:1.0:1789429280.665345:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.665363:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429280.665371:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65c380 00000100:00100000:1.0:1789429280.665404:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1298 00000100:00100000:1.0:1789429280.665413:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634898560:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429280.668406:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634898560:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 2985us (3721us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429280.668419:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1298 00002000:00100000:1.0:1789429280.668432:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f2f65c380 x1876351634898560/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429280.668443:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65c380 with x1876351634898560 ext(327680->364543) 00010000:00010000:1.0:1789429280.668453:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.668470:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429280.668478:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65c380 00000100:00100000:1.0:1789429280.671312:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.671736:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634898688 00000100:00100000:3.0:1789429280.671747:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634898688 00000100:00100000:3.0:1789429280.671868:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5555 00000100:00100000:3.0:1789429280.671879:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634898688:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.671895:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.671912:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd06 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.671942:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(176 257) 00010000:00010000:3.0:1789429280.671951:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.671957:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(177 257) 00010000:00010000:3.0:1789429280.671961:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.672004:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.672018:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.672031:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429280.672096:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634898688:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 218us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.672102:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5555 00000100:00100000:0.0:1789429280.674802:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.674904:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634898816 00000100:00100000:2.0:1789429280.674915:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634898816 00010000:00010000:2.0:1789429280.674951:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.674997:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5991 00000100:00100000:2.0:1789429280.675007:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634898816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.675021:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.675044:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.675059:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.675084:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcf8 expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.675100:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 257) 00010000:00010000:2.0:1789429280.675105:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 257) 00010000:00010000:2.0:1789429280.675113:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.675122:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.676104:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.676135:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 16 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.676151:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648294400:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.676533:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03266e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.680718:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.680808:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648294400:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.680830:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.680890:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634898816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5883us (6096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.680901:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5991 00000100:00100000:0.0:1789429280.682056:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634898944 00000100:00100000:0.0:1789429280.682067:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634898944 00002000:00100000:0.0:1789429280.682115:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1191df80 x1876351634898944/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429280.682127:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191df80 with x1876351634898944 ext(327680->331775) 00010000:00010000:0.0:1789429280.682136:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.682175:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429280.682184:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191df80 00000100:00100000:1.0:1789429280.682282:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1299 00000100:00100000:1.0:1789429280.682293:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634898944:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429280.682491:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634898944:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 200us (1781us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429280.682498:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1299 00002000:00100000:1.0:1789429280.682506:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1191df80 x1876351634898944/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429280.682513:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191df80 with x1876351634898944 ext(327680->331775) 00010000:00010000:1.0:1789429280.682520:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.682532:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429280.682539:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191df80 00000100:00100000:1.0:1789429280.688825:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.688957:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634899200 00000100:00100000:3.0:1789429280.688969:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634899200 00010000:00010000:3.0:1789429280.689019:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.689065:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5992 00000100:00100000:3.0:1789429280.689075:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+17:2368:x1876351634899200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429280.689089:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429280.689113:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.689128:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.689341:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bcff expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.689370:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 257) 00010000:00010000:3.0:1789429280.689375:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 257) 00010000:00010000:3.0:1789429280.689383:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.689394:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.689432:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.689446:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c00aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648294528:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.690577:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.690869:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634899072 00000100:00100000:3.0:1789429280.690876:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634899072 00000100:00100000:3.0:1789429280.690926:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5556 00000100:00100000:3.0:1789429280.690936:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634899072:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.690950:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.690965:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd0d expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.690999:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.691009:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(178 257) 00010000:00010000:3.0:1789429280.691014:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 257) 00010000:00010000:3.0:1789429280.691019:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.691046:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.691059:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 14 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.691070:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c008a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648294656:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429280.691144:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.692580:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.698062:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c008a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648294656:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429280.698098:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.698120:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429280.698236:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634899072:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7300us (7661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.698245:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5556 00000100:00100000:2.0:1789429280.699247:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c00aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648294528:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.699268:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.699316:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+17:2368:x1876351634899200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10242us (10500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.699326:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5992 00000100:00100000:0.0:1789429280.702611:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.702805:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634899328 00000100:00100000:3.0:1789429280.702816:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634899328 00010000:00010000:3.0:1789429280.702858:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 15 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.702902:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5993 00000100:00100000:3.0:1789429280.702913:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05627050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634899328:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429280.702928:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429280.702949:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 15 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.702961:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 15 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.702985:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd06 expref: 15 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.703070:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 257) 00010000:00010000:3.0:1789429280.703075:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 257) 00010000:00010000:3.0:1789429280.703084:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.703095:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.703134:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.703552:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c008a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648294784:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.703687:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:0.0:1789429280.710063:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c008a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648294784:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.710095:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429280.710149:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05627050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351634899328:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7237us (7546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.710183:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5993 00000100:00100000:2.0:1789429280.716063:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.720691:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634899456 00000100:00100000:3.0:1789429280.720708:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634899456 00000100:00100000:1.0:1789429280.721029:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.721649:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5557 00000100:00100000:2.0:1789429280.721660:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634899456:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429280.721678:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429280.721695:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd14 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.721735:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.721745:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(179 257) 00010000:00010000:2.0:1789429280.721750:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 257) 00010000:00010000:2.0:1789429280.721755:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.721785:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.721798:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 16 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.721810:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648294912:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429280.721983:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03266e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.722318:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634899584 00000100:00100000:3.0:1789429280.722324:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634899584 00002000:00100000:2.0:1789429280.722417:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1191f100 x1876351634899584/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.722426:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191f100 with x1876351634899584 ext(327680->331775) 00010000:00010000:2.0:1789429280.722433:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.722446:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.722454:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191f100 00000100:00100000:2.0:1789429280.722471:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1300 00000100:00100000:2.0:1789429280.722478:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634899584:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.722754:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634899584:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 275us (1729us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429280.722762:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1300 00002000:00100000:2.0:1789429280.722768:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1191f100 x1876351634899584/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.722777:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191f100 with x1876351634899584 ext(327680->331775) 00010000:00010000:2.0:1789429280.722782:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.722794:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.722801:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191f100 00000100:00100000:2.0:1789429280.727272:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648294912:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429280.727313:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.727336:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429280.727395:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634899456:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5736us (11340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.727405:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5557 00000100:00100000:1.0:1789429280.729481:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.729520:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.729586:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634899840 00000100:00100000:0.0:1789429280.729595:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634899840 00010000:00010000:0.0:1789429280.729636:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.729666:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634899712 00000100:00100000:2.0:1789429280.729673:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634899712 00000100:00100000:0.0:1789429280.729691:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5994 00000100:00100000:0.0:1789429280.729703:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634899840:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789429280.729718:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5558 00010000:00010000:0.0:1789429280.729719:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789429280.729729:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634899712:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429280.729744:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.729745:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 18 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.729762:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 18 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.729762:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd1b expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.729800:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263600c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd0d expref: 19 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.730098:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 257) 00010000:00010000:2.0:1789429280.730108:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.730115:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(180 257) 00010000:00010000:2.0:1789429280.730120:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.730329:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.730346:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.730357:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 257) 00010000:00010000:2.0:1789429280.730360:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 257) 00010000:00010000:2.0:1789429280.730369:0:20986:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.730378:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.730402:0:20986:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.730416:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 14 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.730430:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648295168:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.730600:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0311f840 going to sleep for 11 seconds 00010000:00010000:0.0:1789429280.734636:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429280.734837:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634899840:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5129us (5309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429280.734851:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5994 00000100:00100000:2.0:1789429280.735012:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.735065:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634899968 00000100:00100000:1.0:1789429280.735073:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634899968 00002000:00100000:1.0:1789429280.735112:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c349c00 x1876351634899968/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429280.735124:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c349c00 with x1876351634899968 ext(327680->364543) 00010000:00010000:1.0:1789429280.735133:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.735149:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429280.735179:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c349c00 00000100:00100000:1.0:1789429280.735222:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1301 00000100:00100000:1.0:1789429280.735232:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634899968:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429280.736539:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648295168:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.736574:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546400, rc 0) 00000100:00100000:0.0:1789429280.738678:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634899712:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8941us (9195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.738691:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5558 00000100:00100000:0.0:1789429280.740445:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634899968:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5207us (5425us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429280.740458:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1301 00002000:00100000:0.0:1789429280.740471:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c349c00 x1876351634899968/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429280.740483:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c349c00 with x1876351634899968 ext(327680->364543) 00010000:00010000:0.0:1789429280.740493:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.740511:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429280.740519:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c349c00 00000100:00100000:3.0:1789429280.743960:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.744011:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.744075:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634900096 00000100:00100000:0.0:1789429280.744084:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634900096 00000100:00100000:0.0:1789429280.744138:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5559 00000100:00100000:0.0:1789429280.744147:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634900096:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429280.744182:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.744218:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd22 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.744248:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(181 257) 00010000:00010000:0.0:1789429280.744256:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.744264:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(182 257) 00010000:00010000:0.0:1789429280.744270:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.744285:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634900224 00000100:00100000:2.0:1789429280.744292:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634900224 00010000:00010000:2.0:1789429280.744317:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 17 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.744318:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.744349:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 17 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.744361:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:2.0:1789429280.744366:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5995 00000100:00100000:2.0:1789429280.744376:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634900224:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.744387:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.744408:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 17 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.744414:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634900096:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 265us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.744429:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5559 00010000:00010000:2.0:1789429280.744444:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.744464:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263600c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd14 expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.744478:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 257) 00010000:00010000:2.0:1789429280.744482:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 257) 00010000:00010000:2.0:1789429280.744489:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.744499:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.744524:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.744538:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 16 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.744552:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648295424:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.745893:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0311f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.748967:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.749048:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634900352 00000100:00100000:0.0:1789429280.749058:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634900352 00010000:00010000:0.0:1789429280.749095:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.749137:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5996 00000100:00100000:0.0:1789429280.749146:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634900352:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429280.749181:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429280.749240:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.749255:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.749288:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 257) 00010000:00010000:0.0:1789429280.749293:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 257) 00010000:00010000:0.0:1789429280.749302:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.749312:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.749353:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.749368:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648295552:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.749446:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515300 going to sleep for 11 seconds 00010000:00010000:3.0:1789429280.749979:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263600d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd1b expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.749998:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648295424:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429280.750014:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429280.750062:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634900224:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5688us (6050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.750071:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5995 00000100:00100000:0.0:1789429280.754884:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648295552:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.754913:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429280.754974:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634900352:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5828us (6016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.754985:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5996 00000100:00100000:0.0:1789429280.760289:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.760382:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634900480 00000100:00100000:3.0:1789429280.760392:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634900480 00000100:00100000:3.0:1789429280.760438:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5560 00000100:00100000:3.0:1789429280.760460:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634900480:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.760477:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.760496:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd29 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.760530:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.760547:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(183 257) 00010000:00010000:3.0:1789429280.760552:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 257) 00010000:00010000:3.0:1789429280.760557:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.760593:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.760609:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 14 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.760624:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c009f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648295680:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429280.760697:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.763988:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.764124:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634900608 00000100:00100000:0.0:1789429280.764134:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634900608 00010000:00010000:0.0:1789429280.764183:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 15 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.764268:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5997 00000100:00100000:0.0:1789429280.764278:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634900608:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429280.764292:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429280.764315:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 15 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.764328:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 15 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.764354:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 257) 00010000:00010000:0.0:1789429280.764359:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 257) 00010000:00010000:0.0:1789429280.764367:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.764378:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.764415:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.764429:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648295808:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.764524:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515300 going to sleep for 11 seconds 00010000:00010000:3.0:1789429280.766597:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263600d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd22 expref: 15 pid: 6682 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.766623:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c009f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648295680:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429280.766654:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.766669:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429280.766742:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634900480:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6283us (6461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.766756:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5560 00000100:00100000:3.0:1789429280.768333:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.768872:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634900736 00000100:00100000:0.0:1789429280.768884:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634900736 00000100:00100000:0.0:1789429280.768948:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5561 00000100:00100000:0.0:1789429280.768958:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634900736:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429280.768978:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.769007:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd30 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.769042:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.769052:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(184 257) 00010000:00010000:0.0:1789429280.769056:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 257) 00010000:00010000:0.0:1789429280.769062:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.769098:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.769112:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 16 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.769126:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648295936:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429280.769255:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515840 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.772713:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648295936:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429280.772747:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.772770:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad000, rc 0) 00000100:00100000:2.0:1789429280.772827:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634900736:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3870us (4502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.772835:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5561 00000100:00100000:0.0:1789429280.774706:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648295808:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.774728:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429280.774774:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634900608:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10498us (10796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.774785:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5997 00000100:00100000:3.0:1789429280.779923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.781425:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634900864 00000100:00100000:1.0:1789429280.781436:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634900864 00002000:00100000:0.0:1789429280.781665:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c00a300 x1876351634900864/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429280.781676:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00a300 with x1876351634900864 ext(327680->331775) 00010000:00010000:0.0:1789429280.781686:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.781704:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429280.781712:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c00a300 00000100:00100000:0.0:1789429280.781776:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1302 00000100:00100000:0.0:1789429280.781786:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634900864:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429280.782025:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634900864:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 238us (2256us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429280.782033:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1302 00002000:00100000:0.0:1789429280.782039:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c00a300 x1876351634900864/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429280.782048:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00a300 with x1876351634900864 ext(327680->331775) 00010000:00010000:0.0:1789429280.782054:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.782066:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429280.782075:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c00a300 00000100:00100000:1.0:1789429280.785139:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.785543:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634900992 00000100:00100000:0.0:1789429280.785553:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634900992 00000100:00100000:0.0:1789429280.785661:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5562 00000100:00100000:0.0:1789429280.785672:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634900992:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429280.785689:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.785708:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd37 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.785741:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(185 257) 00010000:00010000:0.0:1789429280.785749:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.785757:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(186 257) 00010000:00010000:0.0:1789429280.785761:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.785802:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.785815:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.785828:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429280.785891:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634900992:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 221us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.785898:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5562 00000100:00100000:3.0:1789429280.790988:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.791111:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634901120 00000100:00100000:2.0:1789429280.791120:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634901120 00010000:00010000:2.0:1789429280.791174:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 18 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.791244:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5998 00000100:00100000:2.0:1789429280.791254:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2369:x1876351634901120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.791269:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.791290:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 18 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.791304:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 18 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.791325:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263600de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd29 expref: 18 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.791340:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(187 257) 00010000:00010000:2.0:1789429280.791344:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(187 257) 00010000:00010000:2.0:1789429280.791352:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.791360:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.791395:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.791408:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 14 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.791419:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648296192:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.791502:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0311f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.809871:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.809936:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634901248 00000100:00100000:0.0:1789429280.809948:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634901248 00000100:00100000:2.0:1789429280.809985:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648296192:192.168.203.39@tcp:105: 00002000:00100000:0.0:1789429280.809999:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1191dc00 x1876351634901248/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429280.810008:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191dc00 with x1876351634901248 ext(327680->364543) 00010000:00010000:0.0:1789429280.810018:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.810018:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429280.810033:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429280.810041:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191dc00 00000100:00100000:0.0:1789429280.810080:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1303 00000100:00100000:0.0:1789429280.810090:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634901248:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.810107:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+17:2369:x1876351634901120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 18855us (19128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.810115:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5998 00000100:00100000:0.0:1789429280.840500:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634901248:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 30400us (30627us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429280.840515:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1303 00002000:00100000:0.0:1789429280.840528:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1191dc00 x1876351634901248/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429280.840539:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191dc00 with x1876351634901248 ext(327680->364543) 00010000:00010000:0.0:1789429280.840548:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.840566:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429280.840574:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191dc00 00000100:00100000:1.0:1789429280.844144:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.844249:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634901376 00000100:00100000:3.0:1789429280.844259:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634901376 00000100:00100000:3.0:1789429280.844313:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5563 00000100:00100000:3.0:1789429280.844323:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634901376:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.844340:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.844357:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd3e expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.844387:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(187 257) 00010000:00010000:3.0:1789429280.844397:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.844404:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(188 257) 00010000:00010000:3.0:1789429280.844410:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.844464:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.844479:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.844498:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429280.844555:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634901376:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 234us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.844562:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5563 00000100:00100000:1.0:1789429280.851022:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.851180:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634901504 00000100:00100000:3.0:1789429280.851190:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634901504 00010000:00010000:3.0:1789429280.851332:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.851367:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5999 00000100:00100000:3.0:1789429280.851378:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351634901504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429280.851394:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429280.851416:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.851429:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.851450:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad7263600e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd30 expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.851468:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 257) 00010000:00010000:3.0:1789429280.851473:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 257) 00010000:00010000:3.0:1789429280.851481:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.851493:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.851531:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.851545:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 16 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.851558:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c00aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648296448:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429280.851700:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.861145:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c00aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648296448:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429280.861189:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429280.861287:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2368:x1876351634901504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9909us (10274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.861298:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5999 00000100:00100000:1.0:1789429280.864703:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.865321:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634901632 00000100:00100000:0.0:1789429280.865333:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634901632 00010000:00010000:0.0:1789429280.865374:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.865466:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6000 00000100:00100000:0.0:1789429280.865476:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05624850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634901632:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429280.865491:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429280.865513:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.865526:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.865549:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263600ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd37 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.865564:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 257) 00010000:00010000:0.0:1789429280.865568:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 257) 00010000:00010000:0.0:1789429280.865576:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.865585:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.865621:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.865634:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648296576:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429280.865707:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515240 going to sleep for 11 seconds 00000100:00100000:1.0:1789429280.878149:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.878344:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634901760 00000100:00100000:3.0:1789429280.878354:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634901760 00000100:00100000:3.0:1789429280.878419:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5564 00000100:00100000:3.0:1789429280.878429:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634901760:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.878447:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.878466:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd45 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.878505:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.878516:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(189 257) 00010000:00010000:3.0:1789429280.878520:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 257) 00010000:00010000:3.0:1789429280.878526:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 18 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.878558:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.878572:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 14 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.878585:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c00aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648296704:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429280.878855:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648296576:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.878873:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429280.879846:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:0.0:1789429280.880390:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05624850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634901632:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 14911us (15692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.880401:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6000 00000100:00100000:3.0:1789429280.888107:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c00aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648296704:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429280.888143:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.888183:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:3.0:1789429280.888268:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634901760:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9840us (10128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.888281:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5564 00000100:00100000:1.0:1789429280.891383:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429280.891427:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.891625:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634901888 00000100:00100000:0.0:1789429280.891636:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634901888 00010000:00010000:0.0:1789429280.891674:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.891719:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6001 00000100:00100000:0.0:1789429280.891728:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634901888:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429280.891743:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429280.891767:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.891797:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.891816:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634902016 00000100:00100000:2.0:1789429280.891823:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634902016 00010000:00010000:0.0:1789429280.891824:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad7263600f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd3e expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.891845:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 257) 00010000:00010000:0.0:1789429280.891850:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 257) 00010000:00010000:0.0:1789429280.891859:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.891868:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5565 00010000:00010000:0.0:1789429280.891873:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.891880:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634902016:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429280.891896:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429280.891913:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd4c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.891919:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.891938:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648296832:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.891942:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.891951:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(190 257) 00010000:00010000:2.0:1789429280.891955:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(191 257) 00010000:00010000:2.0:1789429280.891959:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.891981:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.891994:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 16 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.892006:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648296960:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429280.892027:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515540 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.892035:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0311f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.902545:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648296960:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429280.902582:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.902605:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547400, rc 0) 00000100:00100000:2.0:1789429280.902670:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634902016:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10793us (11241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.902683:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5565 00000100:00100000:1.0:1789429280.902799:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.903051:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634902144 00000100:00100000:2.0:1789429280.903058:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634902144 00002000:00100000:2.0:1789429280.903097:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1191e300 x1876351634902144/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.903106:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191e300 with x1876351634902144 ext(327680->331775) 00010000:00010000:2.0:1789429280.903113:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.903128:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.903135:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191e300 00000100:00100000:2.0:1789429280.903174:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1304 00000100:00100000:2.0:1789429280.903183:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634902144:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.903396:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634902144:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 213us (598us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429280.903403:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1304 00002000:00100000:2.0:1789429280.903410:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1191e300 x1876351634902144/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.903417:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191e300 with x1876351634902144 ext(327680->331775) 00010000:00010000:2.0:1789429280.903423:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.903438:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.903445:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191e300 00000100:00100000:0.0:1789429280.903806:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648296832:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429280.903822:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429280.903858:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634901888:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12131us (12483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.903870:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6001 00000100:00100000:3.0:1789429280.910080:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.910131:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429280.910288:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634902272 00000100:00100000:0.0:1789429280.910299:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634902272 00000100:00100000:0.0:1789429280.910368:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5566 00000100:00100000:0.0:1789429280.910378:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634902272:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429280.910395:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429280.910412:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd53 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.910444:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(191 257) 00010000:00010000:0.0:1789429280.910453:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.910460:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(192 257) 00010000:00010000:0.0:1789429280.910464:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.910505:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.910505:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634902400 00000100:00100000:2.0:1789429280.910512:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634902400 00010000:00010000:2.0:1789429280.910536:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 19 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.910538:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.910564:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:2.0:1789429280.910631:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6002 00000100:00100000:2.0:1789429280.910640:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2369:x1876351634902400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.910649:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.910667:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 19 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.910679:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 19 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.910697:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263600fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd45 expref: 19 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.910713:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 257) 00010000:00010000:2.0:1789429280.910717:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 257) 00010000:00010000:2.0:1789429280.910725:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.910735:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.910759:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.910779:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 14 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.910792:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648297216:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.912653:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0311f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429280.916025:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634902272:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5635us (5944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429280.916038:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5566 00000100:00100000:3.0:1789429280.930601:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.930618:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648297216:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429280.930644:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429280.930699:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+17:2369:x1876351634902400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 20059us (20566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429280.930710:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6002 00000100:00100000:1.0:1789429280.933019:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634902528 00000100:00100000:1.0:1789429280.933032:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634902528 00002000:00100000:1.0:1789429280.933083:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c00b800 x1876351634902528/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429280.933096:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00b800 with x1876351634902528 ext(327680->364543) 00010000:00010000:1.0:1789429280.933104:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429280.933122:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429280.933130:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c00b800 00000100:00100000:1.0:1789429280.933366:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1305 00000100:00100000:1.0:1789429280.933378:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634902528:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429280.940350:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634902528:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6964us (9747us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429280.940364:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1305 00002000:00100000:0.0:1789429280.940377:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c00b800 x1876351634902528/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:16/0 lens 488/440 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429280.940388:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00b800 with x1876351634902528 ext(327680->364543) 00010000:00010000:0.0:1789429280.940399:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429280.941580:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429280.941596:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c00b800 00000100:00100000:2.0:1789429280.949078:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.949228:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634902656 00000100:00100000:3.0:1789429280.949240:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634902656 00000100:00100000:3.0:1789429280.949293:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5567 00000100:00100000:3.0:1789429280.949302:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634902656:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.949318:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.949334:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd5a expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.949378:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(193 257) 00010000:00010000:3.0:1789429280.949386:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.949394:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(194 257) 00010000:00010000:3.0:1789429280.949400:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.949451:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.949466:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.949484:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429280.949538:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634902656:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 237us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.949545:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5567 00000100:00100000:2.0:1789429280.950061:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.950125:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634902784 00000100:00100000:3.0:1789429280.950130:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634902784 00010000:00010000:3.0:1789429280.950152:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.950186:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6003 00000100:00100000:3.0:1789429280.950194:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634902784:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429280.950223:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429280.950245:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.950259:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.950276:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad726360101 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd4c expref: 16 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.950290:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 257) 00010000:00010000:3.0:1789429280.950293:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 257) 00010000:00010000:3.0:1789429280.950300:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.950309:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.950335:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.950347:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 16 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.950361:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c008a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648297472:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429280.950415:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.955725:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.957059:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c008a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648297472:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429280.957087:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429280.957145:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634902784:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6951us (7085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.957156:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6003 00000100:00100000:3.0:1789429280.957193:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634902912 00000100:00100000:3.0:1789429280.957214:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634902912 00010000:00010000:3.0:1789429280.957243:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.957281:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6004 00000100:00100000:3.0:1789429280.957290:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634902912:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429280.957305:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429280.957326:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.957339:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.957363:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360108 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd53 expref: 17 pid: 20986 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.957378:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 257) 00010000:00010000:3.0:1789429280.957382:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 257) 00010000:00010000:3.0:1789429280.957390:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.957400:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.957430:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.957545:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c008a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648297600:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429280.957592:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.966451:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c008a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648297600:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429280.966486:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429280.966540:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634902912:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9251us (10824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.966551:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6004 00000100:00100000:3.0:1789429280.972504:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.972544:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634903040 00000100:00100000:3.0:1789429280.972553:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634903040 00000100:00100000:3.0:1789429280.972603:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5568 00000100:00100000:3.0:1789429280.972612:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:33927:x1876351634903040:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.972631:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.972648:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd61 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.972688:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.972699:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(195 257) 00010000:00010000:3.0:1789429280.972704:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 257) 00010000:00010000:3.0:1789429280.972709:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.972741:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 14 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.972756:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 14 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429280.972770:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c009500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648297728:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429280.973575:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429280.979897:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c009500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648297728:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429280.979933:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.979954:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429280.980011:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:33927:x1876351634903040:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7399us (7515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.980021:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5568 00000100:00100000:3.0:1789429280.981405:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.981642:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634903168 00000100:00100000:2.0:1789429280.981653:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634903168 00010000:00010000:2.0:1789429280.981696:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.981741:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6005 00000100:00100000:2.0:1789429280.981750:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634903168:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429280.981765:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429280.981787:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.981801:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.981824:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad72636010f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd5a expref: 15 pid: 13238 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.981840:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 257) 00010000:00010000:2.0:1789429280.981844:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 257) 00010000:00010000:2.0:1789429280.981854:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.981863:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.981899:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429280.981918:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648297856:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429280.986675:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429280.988822:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.989773:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634903296 00000100:00100000:2.0:1789429280.989785:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634903296 00000100:00100000:2.0:1789429280.989840:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5569 00000100:00100000:2.0:1789429280.989851:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634903296:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429280.989869:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429280.989886:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd68 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.989919:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.989929:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(196 257) 00010000:00010000:2.0:1789429280.989933:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(197 257) 00010000:00010000:2.0:1789429280.989939:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.989971:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.989985:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 16 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429280.990001:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429280.990004:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648297984:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429280.990072:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429280.990091:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634903424 00000100:00100000:2.0:1789429280.990095:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634903424 00002000:00100000:2.0:1789429280.990122:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f2f65e680 x1876351634903424/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/0 e 0 to 0 dl 1789429291 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.990132:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65e680 with x1876351634903424 ext(327680->331775) 00010000:00010000:2.0:1789429280.990139:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.990151:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.990159:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65e680 00000100:00100000:2.0:1789429280.990191:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1306 00000100:00100000:2.0:1789429280.990219:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634903424:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429280.990384:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634903424:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 185us (390us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429280.990393:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1306 00002000:00100000:2.0:1789429280.990400:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f2f65e680 x1876351634903424/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:16/0 lens 488/4536 e 0 to 0 dl 1789429291 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429280.990409:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65e680 with x1876351634903424 ext(327680->331775) 00010000:00010000:2.0:1789429280.990415:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429280.990426:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 17 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429280.990433:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65e680 00000100:00100000:3.0:1789429280.995507:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648297856:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429280.995536:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429280.995635:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634903168:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13884us (14234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.995645:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6005 00000100:00100000:1.0:1789429280.995921:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429280.996038:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634903552 00000100:00100000:3.0:1789429280.996046:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634903552 00000100:00100000:3.0:1789429280.996096:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5570 00000100:00100000:3.0:1789429280.996105:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634903552:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429280.996121:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429280.996137:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd6f expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.996183:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(197 257) 00010000:00010000:3.0:1789429280.996191:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.996229:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(198 257) 00010000:00010000:3.0:1789429280.996235:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.996271:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.996285:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.996298:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:3.0:1789429280.996340:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634903552:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 236us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.996346:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5570 00010000:00010000:3.0:1789429280.996402:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429280.999649:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648297984:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429280.999688:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429280.999710:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546800, rc 0) 00000100:00100000:3.0:1789429280.999781:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634903296:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9931us (11798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429280.999790:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5569 00000001:00080000:3.0:1789429281.002974:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969242 is committed 00000100:00100000:1.0:1789429281.004994:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.005232:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634903680 00000100:00100000:2.0:1789429281.005241:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634903680 00010000:00010000:2.0:1789429281.005298:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 18 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.005340:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6006 00000100:00100000:2.0:1789429281.005352:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634903680:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.005367:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.005388:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 18 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.005403:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 18 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.005427:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360116 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd61 expref: 18 pid: 6681 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.005454:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 257) 00010000:00010000:2.0:1789429281.005484:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(199 257) 00010000:00010000:2.0:1789429281.005494:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.005505:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.005543:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.005556:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 14 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.005569:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648298240:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.005652:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110deb40 going to sleep for 11 seconds 00000100:00080000:1.0:1789429281.006384:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429281.009187:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648298240:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.009241:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.009295:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634903680:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3944us (4308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.009305:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6006 00000100:00100000:0.0:1789429281.016317:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.016415:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634903808 00000100:00100000:1.0:1789429281.016424:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634903808 00002000:00100000:1.0:1789429281.016731:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f2f65f100 x1876351634903808/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.016743:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65f100 with x1876351634903808 ext(327680->364543) 00010000:00010000:1.0:1789429281.016752:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.016770:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429281.016778:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65f100 00000100:00100000:1.0:1789429281.016811:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1307 00000100:00100000:1.0:1789429281.016821:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634903808:12345-192.168.203.39@tcp:3:kworker.0 00000100:00080000:2.0:1789429281.021374:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429281.038846:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634903808:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 22017us (22530us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429281.038859:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1307 00002000:00100000:2.0:1789429281.038871:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f2f65f100 x1876351634903808/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.038888:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65f100 with x1876351634903808 ext(327680->364543) 00010000:00010000:2.0:1789429281.038898:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 15 pid: 6680 timeout: 1078 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.038917:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 15 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.038926:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65f100 00000100:00100000:0.0:1789429281.042819:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.043041:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634903936 00000100:00100000:2.0:1789429281.043052:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634903936 00000100:00100000:2.0:1789429281.043112:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5571 00000100:00100000:2.0:1789429281.043122:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634903936:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.043140:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.043171:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd76 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.043244:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(199 257) 00010000:00010000:2.0:1789429281.043253:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.043260:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(200 257) 00010000:00010000:2.0:1789429281.043266:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.043304:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.043320:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.043333:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547e00, rc 0) 00000100:00100000:2.0:1789429281.043400:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634903936:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 279us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.043407:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5571 00000100:00100000:3.0:1789429281.044133:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.044277:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634904064 00000100:00100000:0.0:1789429281.044284:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634904064 00010000:00010000:0.0:1789429281.044312:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 16 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.044346:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6007 00000100:00100000:0.0:1789429281.044355:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05626850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634904064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.044366:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.044388:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 16 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.044402:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 16 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.044424:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636011d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd68 expref: 16 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.044543:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 257) 00010000:00010000:0.0:1789429281.044548:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 257) 00010000:00010000:0.0:1789429281.044557:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.044567:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.044601:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.044615:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 16 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.044631:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a50e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648298496:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.044704:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515540 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.048820:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.048859:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.048931:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.049002:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634904192 00000100:00100000:0.0:1789429281.049011:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634904192 00000100:00100000:3.0:1789429281.049025:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634904448 00000100:00100000:3.0:1789429281.049033:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634904448 00010000:00010000:3.0:1789429281.049059:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 18 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1789429281.049061:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x29:0x0] (0->12) req@ffff946f1191ce00 x1876351634904192/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 504/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429281.049084:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191ce00 with x1876351634904192 ext(0->12) 00002000:00010000:0.0:1789429281.049089:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1191ce00 00000100:00100000:0.0:1789429281.049112:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11382 00000100:00100000:3.0:1789429281.049117:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6008 00000100:00100000:0.0:1789429281.049126:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634904192:12345-192.168.203.39@tcp:4:diff.0 00000100:00100000:3.0:1789429281.049132:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634904448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429281.049148:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429281.049186:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 18 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.049227:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 18 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.049254:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 257) 00010000:00010000:3.0:1789429281.049259:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 257) 00010000:00010000:3.0:1789429281.049268:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.049280:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.049317:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.049338:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c008e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648298624:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429281.049607:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.049628:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634904320 00000100:00100000:3.0:1789429281.049632:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634904320 00000100:00100000:3.0:1789429281.049672:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5572 00000100:00100000:3.0:1789429281.049680:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634904320:12345-192.168.203.39@tcp:16:kworker.0 00000100:00100000:3.0:1789429281.049732:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634904320:12345-192.168.203.39@tcp:16:kworker.0 Request processed in 52us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.049739:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5572 00010000:00010000:2.0:1789429281.050331:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360124 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd6f expref: 18 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.050349:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a50e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648298496:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.050366:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.050401:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05626850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634904064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6047us (6271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.050408:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6007 00000100:00100000:0.0:1789429281.050933:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634904192:12345-192.168.203.39@tcp:4:diff.0 Request processed in 1808us (2119us total) trans 4294969563 rc 0/0 00000100:00100000:0.0:1789429281.050941:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11382 00002000:00100000:0.0:1789429281.050949:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x29:0x0] (0->12) req@ffff946f1191ce00 x1876351634904192/t4294969563(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 504/448 e 0 to 0 dl 1789429292 ref 1 fl Complete:/600/0 rc 0/0 job:'diff.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429281.050957:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191ce00 with x1876351634904192 ext(0->12) 00002000:00010000:0.0:1789429281.050963:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1191ce00 00000100:00100000:3.0:1789429281.055115:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.055175:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.055570:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634904576 00000100:00100000:0.0:1789429281.055581:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634904576 00002000:00100000:0.0:1789429281.055639:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2b:0x0] (0->94159) req@ffff946f1c009f80 x1876351634904576/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429281.055650:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c009f80 with x1876351634904576 ext(0->94159) 00002000:00010000:0.0:1789429281.055656:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c009f80 00000100:00100000:0.0:1789429281.055690:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11383 00000100:00100000:0.0:1789429281.055700:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351634904576:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00080000:3.0:1789429281.055893:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429281.055935:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634904704 00000100:00100000:1.0:1789429281.055940:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634904704 00000100:00100000:1.0:1789429281.055977:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5573 00000100:00100000:1.0:1789429281.055985:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634904704:12345-192.168.203.39@tcp:16:kworker.0 00000100:00100000:1.0:1789429281.056043:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634904704:12345-192.168.203.39@tcp:16:kworker.0 Request processed in 58us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.056051:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5573 00000100:00100000:1.0:1789429281.062389:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.062545:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c008e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648298624:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429281.062569:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429281.062632:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634904448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13504us (13699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.062643:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6008 00000100:00100000:0.0:1789429281.062765:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634904832 00000100:00100000:0.0:1789429281.062773:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634904832 00000100:00100000:0.0:1789429281.062820:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5574 00000100:00100000:0.0:1789429281.062829:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634904832:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429281.062844:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429281.062861:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd7d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.062890:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.062901:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(201 257) 00010000:00010000:0.0:1789429281.062905:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 257) 00010000:00010000:0.0:1789429281.062910:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.062943:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 14 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.062957:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 14 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.062970:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648298752:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429281.063101:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.076707:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.079858:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634904960 00000100:00100000:2.0:1789429281.079872:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634904960 00000100:00100000:2.0:1789429281.079939:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5575 00000100:00100000:2.0:1789429281.079950:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634904960:12345-192.168.203.39@tcp:16:kworker.0 00000100:00100000:2.0:1789429281.080063:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634904960:12345-192.168.203.39@tcp:16:kworker.0 Request processed in 114us (3365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.080071:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5575 00000100:00100000:0.0:1789429281.080948:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634904576:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 25245us (25767us total) trans 4294969243 rc 0/0 00000100:00100000:0.0:1789429281.080958:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11383 00002000:00100000:0.0:1789429281.080968:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2b:0x0] (0->94159) req@ffff946f1c009f80 x1876351634904576/t4294969243(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/448 e 0 to 0 dl 1789429292 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429281.080978:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c009f80 with x1876351634904576 ext(0->94159) 00002000:00010000:0.0:1789429281.080984:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c009f80 00000100:00100000:0.0:1789429281.086876:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.087302:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634905088 00000100:00100000:2.0:1789429281.087315:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634905088 00002000:00100000:2.0:1789429281.087363:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946e15a50e00 x1876351634905088/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.087374:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a50e00 with x1876351634905088 ext(327680->364543) 00010000:00010000:2.0:1789429281.087384:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 15 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.087400:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 15 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.087407:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a50e00 00000100:00100000:2.0:1789429281.087450:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1308 00000100:00100000:2.0:1789429281.087460:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634905088:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429281.089402:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648298752:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.090582:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.090611:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:2.0:1789429281.097015:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634904832:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 34173us (34621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.097029:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5574 00000100:00100000:2.0:1789429281.100178:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634905088:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 12702us (13295us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429281.100697:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1308 00002000:00100000:2.0:1789429281.100711:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946e15a50e00 x1876351634905088/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.100722:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a50e00 with x1876351634905088 ext(327680->364543) 00010000:00010000:2.0:1789429281.100734:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 15 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.100759:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 15 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.100768:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a50e00 00000100:00100000:1.0:1789429281.109723:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.109841:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.110283:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634905344 00000100:00100000:2.0:1789429281.110294:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634905344 00010000:00010000:2.0:1789429281.110332:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 15 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.110372:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6009 00000100:00100000:2.0:1789429281.110381:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634905344:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.110395:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.110418:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 15 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.110433:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 15 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.110458:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad72636012b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd76 expref: 15 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.110476:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 257) 00010000:00010000:2.0:1789429281.110481:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 257) 00010000:00010000:2.0:1789429281.110488:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.110499:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.110537:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.110551:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648298880:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.110641:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.110850:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634905216 00000100:00100000:3.0:1789429281.110857:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634905216 00000100:00100000:3.0:1789429281.110901:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5576 00000100:00100000:3.0:1789429281.110910:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634905216:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.110924:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.110938:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd84 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.110961:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.110976:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(202 257) 00010000:00010000:3.0:1789429281.110979:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(203 257) 00010000:00010000:3.0:1789429281.110987:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.111009:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.111022:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 18 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.111033:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c008e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648299008:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429281.112559:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.116300:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648298880:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.116328:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.116372:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634905344:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5991us (6530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.116383:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6009 00000100:00100000:1.0:1789429281.116656:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.116745:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634905472 00000100:00100000:3.0:1789429281.116753:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634905472 00002000:00100000:3.0:1789429281.116844:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f417f2680 x1876351634905472/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429281.116862:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f2680 with x1876351634905472 ext(327680->331775) 00010000:00010000:3.0:1789429281.116872:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 19 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.116891:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 19 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.116894:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c008e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648299008:192.168.203.39@tcp:104: 00002000:00010000:3.0:1789429281.116908:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f417f2680 00010000:00010000:2.0:1789429281.116922:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.116940:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429281.116945:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1309 00000100:00100000:3.0:1789429281.116957:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634905472:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.116978:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634905216:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6069us (7262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.116997:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5576 00000100:00100000:3.0:1789429281.117497:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634905472:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 540us (839us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429281.117506:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1309 00002000:00100000:3.0:1789429281.117513:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f417f2680 x1876351634905472/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429281.117522:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f2680 with x1876351634905472 ext(327680->331775) 00010000:00010000:3.0:1789429281.117528:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 19 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.117541:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 19 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429281.117548:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f417f2680 00000100:00100000:2.0:1789429281.121955:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.122081:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634905600 00000100:00100000:0.0:1789429281.122091:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634905600 00000100:00100000:2.0:1789429281.122446:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.122674:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634905728 00000100:00100000:3.0:1789429281.122679:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634905728 00010000:00010000:3.0:1789429281.122708:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 20 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.122749:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6010 00000100:00100000:3.0:1789429281.122759:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:2369:x1876351634905728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789429281.122846:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5577 00000100:00100000:0.0:1789429281.122856:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634905600:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429281.122872:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429281.122887:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd8b expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.122896:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.122914:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(203 257) 00010000:00010000:0.0:1789429281.122939:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.122950:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(204 257) 00010000:00010000:0.0:1789429281.122956:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 21 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.122971:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 21 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.122987:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 21 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.123005:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360132 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd7d expref: 21 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.123898:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.123926:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.123932:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 257) 00010000:00010000:3.0:1789429281.123939:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 257) 00010000:00010000:3.0:1789429281.123949:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.123960:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.123978:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00010000:00010000:2.0:1789429281.124091:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.124106:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 14 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.124121:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648299264:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.124248:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.126863:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634905600:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3998us (4907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.126874:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5577 00000100:00100000:3.0:1789429281.127330:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648299264:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429281.127350:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429281.127400:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2369:x1876351634905728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4642us (4954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.127410:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6010 00000100:00100000:0.0:1789429281.129932:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.130002:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634905856 00000100:00100000:1.0:1789429281.130012:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634905856 00010000:00010000:1.0:1789429281.130050:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 15 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.130372:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6011 00000100:00100000:1.0:1789429281.130383:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634905856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429281.130399:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429281.130421:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 15 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.130436:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 15 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.130461:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360139 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd84 expref: 15 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.130477:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 257) 00010000:00010000:1.0:1789429281.130481:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 257) 00010000:00010000:1.0:1789429281.130488:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.130499:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.130537:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.130550:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648299392:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429281.130633:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.133782:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648299392:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429281.133808:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429281.133899:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351634905856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3518us (3974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.133908:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6011 00000100:00100000:3.0:1789429281.140983:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.141288:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634905984 00000100:00100000:2.0:1789429281.141299:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634905984 00000100:00100000:2.0:1789429281.141363:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5578 00000100:00100000:2.0:1789429281.141374:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634905984:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.141392:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.141410:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd92 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.141444:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.141454:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(205 257) 00010000:00010000:2.0:1789429281.141470:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 257) 00010000:00010000:2.0:1789429281.141476:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.141519:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.141535:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 18 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.141548:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648299520:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429281.141719:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.152386:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648299520:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429281.152420:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.152441:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546a00, rc 0) 00000100:00100000:2.0:1789429281.152551:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634905984:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11178us (11576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.152560:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5578 00000100:00100000:2.0:1789429281.158686:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.158891:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634906112 00000100:00100000:0.0:1789429281.158900:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634906112 00002000:00100000:0.0:1789429281.158950:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c349880 x1876351634906112/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.158963:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c349880 with x1876351634906112 ext(327680->331775) 00010000:00010000:0.0:1789429281.158977:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 19 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.158995:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 19 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.159003:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c349880 00000100:00100000:0.0:1789429281.159035:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1310 00000100:00100000:0.0:1789429281.159045:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634906112:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429281.159266:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634906112:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 221us (589us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429281.159283:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1310 00002000:00100000:0.0:1789429281.159291:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f1c349880 x1876351634906112/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.159301:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c349880 with x1876351634906112 ext(327680->331775) 00010000:00010000:0.0:1789429281.159307:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 19 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.159319:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 19 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.159327:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c349880 00000100:00100000:2.0:1789429281.163178:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.164436:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634906240 00000100:00100000:0.0:1789429281.164449:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634906240 00000100:00100000:0.0:1789429281.164516:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5579 00000100:00100000:0.0:1789429281.164526:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634906240:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429281.164543:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429281.164561:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bd99 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.164598:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(206 257) 00010000:00010000:0.0:1789429281.164607:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.164614:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(207 257) 00010000:00010000:0.0:1789429281.164619:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.164660:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.164674:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.164687:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad000, rc 0) 00000100:00100000:0.0:1789429281.164753:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634906240:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 228us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.164760:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5579 00000100:00100000:3.0:1789429281.175503:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.176006:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634906368 00000100:00100000:2.0:1789429281.176018:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634906368 00010000:00010000:2.0:1789429281.176287:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 20 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.176332:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6012 00000100:00100000:2.0:1789429281.176581:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634906368:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.176599:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.176623:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 20 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.176638:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 20 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.176661:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad726360140 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd8b expref: 20 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.176678:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 257) 00010000:00010000:2.0:1789429281.176682:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 257) 00010000:00010000:2.0:1789429281.176691:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.176702:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.176741:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.176754:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 14 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.176767:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1191c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648299776:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.176844:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.184559:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1191c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648299776:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.184587:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.184641:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634906368:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8300us (9146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.184652:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6012 00000100:00100000:0.0:1789429281.191844:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.192004:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634906496 00000100:00100000:3.0:1789429281.192014:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634906496 00002000:00100000:3.0:1789429281.192065:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f344b9880 x1876351634906496/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429281.192077:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b9880 with x1876351634906496 ext(327680->364543) 00010000:00010000:3.0:1789429281.192087:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.192105:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429281.192114:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b9880 00000100:00100000:3.0:1789429281.192146:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1311 00000100:00100000:3.0:1789429281.192160:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634906496:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.201774:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634906496:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 9605us (9929us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429281.201787:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1311 00002000:00100000:2.0:1789429281.201798:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f344b9880 x1876351634906496/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.201807:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b9880 with x1876351634906496 ext(327680->364543) 00010000:00010000:2.0:1789429281.201817:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.201834:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.201841:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b9880 00000100:00100000:3.0:1789429281.205388:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.206015:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634906752 00000100:00100000:2.0:1789429281.206027:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634906752 00010000:00010000:2.0:1789429281.206067:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.206325:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6013 00000100:00100000:2.0:1789429281.206347:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634906752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.206364:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.206388:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.206403:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.206426:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360147 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd92 expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.206443:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 257) 00010000:00010000:2.0:1789429281.206448:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 257) 00010000:00010000:2.0:1789429281.206456:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.206467:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.206507:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.206522:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1191c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648299904:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.206596:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.217816:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.221411:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634906624 00000100:00100000:2.0:1789429281.221426:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634906624 00000100:00100000:2.0:1789429281.221825:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5580 00000100:00100000:2.0:1789429281.221837:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634906624:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.221854:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.221875:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bda0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.221906:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.221915:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(208 257) 00010000:00010000:2.0:1789429281.221919:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 257) 00010000:00010000:2.0:1789429281.221925:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.221959:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.221974:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 18 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.221987:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648300032:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429281.222192:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.223052:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1191c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648299904:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.223072:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.223119:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634906752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 16783us (17741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.223129:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6013 00000100:00100000:2.0:1789429281.227111:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648300032:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.227111:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:2.0:1789429281.227144:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.227867:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546a00, rc 0) 00000100:00100000:2.0:1789429281.227930:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634906624:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6093us (10121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.227938:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5580 00000100:00100000:0.0:1789429281.229471:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634906880 00000100:00100000:0.0:1789429281.229483:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634906880 00010000:00010000:0.0:1789429281.229525:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 19 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.229572:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6014 00000100:00100000:0.0:1789429281.229581:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05627c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634906880:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.229596:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.229618:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 19 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.229632:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 19 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.229659:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000050ec1c3/0xb4c3dad72636014e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bd99 expref: 19 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.229676:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 257) 00010000:00010000:0.0:1789429281.229681:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 257) 00010000:00010000:0.0:1789429281.229688:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.229698:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.229735:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.229748:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648300160:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.229829:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.234134:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648300160:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.234170:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.234266:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05627c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634906880:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4685us (7161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.234278:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6014 00000100:00100000:1.0:1789429281.239326:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.243327:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634907008 00000100:00100000:3.0:1789429281.243342:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634907008 00000100:00100000:2.0:1789429281.244007:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5581 00000100:00100000:2.0:1789429281.244019:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+18:33927:x1876351634907008:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.244038:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.244058:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bda7 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.244093:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.244103:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(209 257) 00010000:00010000:2.0:1789429281.244108:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(210 257) 00010000:00010000:2.0:1789429281.244112:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.244144:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.244170:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 14 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.244184:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648300288:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429281.244308:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.247080:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.247175:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634907136 00000100:00100000:1.0:1789429281.247185:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634907136 00002000:00100000:1.0:1789429281.247271:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c008380 x1876351634907136/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.247281:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c008380 with x1876351634907136 ext(327680->364543) 00010000:00010000:1.0:1789429281.247291:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 15 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.247306:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 15 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429281.247321:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c008380 00000100:00100000:1.0:1789429281.247351:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1312 00000100:00100000:1.0:1789429281.247361:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634907136:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.251635:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648300288:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429281.251671:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.251693:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546c00, rc 0) 00000100:00100000:2.0:1789429281.251758:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634907008:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7740us (12441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.251768:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5581 00000100:00100000:0.0:1789429281.251992:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351634907136:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4631us (4919us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429281.252005:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1312 00002000:00100000:0.0:1789429281.252015:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (327680->364543) req@ffff946f1c008380 x1876351634907136/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.252026:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c008380 with x1876351634907136 ext(327680->364543) 00010000:00010000:0.0:1789429281.252033:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 15 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.252047:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 15 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.252054:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c008380 00000100:00100000:3.0:1789429281.259414:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.260279:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634907392 00000100:00100000:2.0:1789429281.260290:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634907392 00000100:00100000:2.0:1789429281.260361:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5582 00000100:00100000:2.0:1789429281.260373:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634907392:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.260391:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.260412:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bdae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.260448:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(210 257) 00010000:00010000:2.0:1789429281.260457:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.260467:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(211 257) 00000100:00100000:3.0:1789429281.260469:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:2.0:1789429281.260477:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.260520:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.260535:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.260548:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547a00, rc 0) 00000100:00100000:2.0:1789429281.260612:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634907392:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 242us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.260620:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5582 00000100:00100000:0.0:1789429281.260936:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634907264 00000100:00100000:0.0:1789429281.260941:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634907264 00010000:00010000:0.0:1789429281.260966:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 16 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.260997:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6015 00000100:00100000:0.0:1789429281.261004:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351634907264:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.261015:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.261036:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 16 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.261048:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 16 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.261072:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad726360155 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda0 expref: 16 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.261087:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(212 257) 00010000:00010000:0.0:1789429281.261091:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(212 257) 00010000:00010000:0.0:1789429281.261099:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.261119:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.261147:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.261160:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 18 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.261184:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648300544:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.261301:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515900 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.266100:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.266266:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648300544:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429281.266291:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429281.266356:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2368:x1876351634907264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5351us (5897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.266367:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6015 00000100:00100000:0.0:1789429281.266675:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634907520 00000100:00100000:0.0:1789429281.266683:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634907520 00002000:00100000:0.0:1789429281.266724:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f34072d80 x1876351634907520/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.266736:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072d80 with x1876351634907520 ext(327680->331775) 00010000:00010000:0.0:1789429281.266746:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 19 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.266760:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 19 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.266767:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34072d80 00000100:00100000:0.0:1789429281.266835:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1313 00000100:00100000:0.0:1789429281.266844:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634907520:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429281.267026:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634907520:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 183us (934us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429281.267033:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1313 00002000:00100000:0.0:1789429281.267039:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f34072d80 x1876351634907520/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.267048:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072d80 with x1876351634907520 ext(327680->331775) 00010000:00010000:0.0:1789429281.267054:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 19 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.267065:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 19 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.267072:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34072d80 00000100:00100000:3.0:1789429281.271857:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.271899:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.272118:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634907776 00000100:00100000:1.0:1789429281.272129:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634907776 00000100:00100000:1.0:1789429281.272226:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5583 00000100:00100000:1.0:1789429281.272237:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:33927:x1876351634907776:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429281.272255:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429281.272273:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bdb5 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.272304:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(212 257) 00010000:00010000:1.0:1789429281.272313:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.272321:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(213 257) 00010000:00010000:1.0:1789429281.272326:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.272370:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.272382:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.272395:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429281.272445:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634907776:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 211us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.272452:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5583 00000100:00100000:2.0:1789429281.272897:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634907648 00000100:00100000:2.0:1789429281.272902:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634907648 00010000:00010000:2.0:1789429281.272924:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 20 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.272954:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6016 00000100:00100000:2.0:1789429281.272963:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634907648:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.272973:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.273002:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 20 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.273021:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 20 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.273041:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad72636015c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bda7 expref: 20 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.273056:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 257) 00010000:00010000:2.0:1789429281.273060:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 257) 00010000:00010000:2.0:1789429281.273068:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.273078:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.273105:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.273119:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 14 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.273132:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648300800:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.273249:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.281463:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648300800:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.281491:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.281547:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634907648:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8585us (9698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.281557:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6016 00000100:00100000:1.0:1789429281.283276:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.283413:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634907904 00000100:00100000:2.0:1789429281.283422:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634907904 00010000:00010000:2.0:1789429281.283455:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.283495:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6017 00000100:00100000:2.0:1789429281.283504:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2369:x1876351634907904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.283516:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.283538:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.283551:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.283575:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360163 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdae expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.283592:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 257) 00010000:00010000:2.0:1789429281.283597:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 257) 00010000:00010000:2.0:1789429281.283606:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.283622:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.283656:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.283670:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648300928:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.283742:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.286440:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648300928:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.286472:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.286526:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2369:x1876351634907904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3022us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.286537:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6017 00000100:00100000:3.0:1789429281.289400:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.289525:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634908032 00000100:00100000:2.0:1789429281.289535:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634908032 00002000:00100000:2.0:1789429281.289582:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f34073100 x1876351634908032/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.289593:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073100 with x1876351634908032 ext(327680->331775) 00002000:00010000:2.0:1789429281.289599:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34073100 00000100:00100000:2.0:1789429281.289626:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11384 00000100:00100000:2.0:1789429281.289635:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634908032:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.289834:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634908032:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 200us (443us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429281.289845:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11384 00002000:00100000:2.0:1789429281.289852:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f34073100 x1876351634908032/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.289859:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073100 with x1876351634908032 ext(327680->331775) 00002000:00010000:2.0:1789429281.289862:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34073100 00000100:00100000:1.0:1789429281.294575:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.294661:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.294758:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634908288 00000100:00100000:0.0:1789429281.294768:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634908288 00002000:00100000:0.0:1789429281.294815:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f417f2300 x1876351634908288/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1789429281.294815:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634908160 00000100:00100000:2.0:1789429281.294823:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634908160 00002000:00100000:0.0:1789429281.294831:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f2300 with x1876351634908288 ext(331776->335871) 00002000:00010000:0.0:1789429281.294837:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f417f2300 00000100:00100000:2.0:1789429281.294871:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5584 00000100:00100000:0.0:1789429281.294875:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11385 00000100:00100000:2.0:1789429281.294886:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33938:x1876351634908160:12345-192.168.203.39@tcp:101:mmap_sanity.0 00000100:00100000:0.0:1789429281.294887:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+19:2369:x1876351634908288:12345-192.168.203.39@tcp:3:kworker.0 00010000:00010000:2.0:1789429281.294904:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.294924:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360171 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bdbc expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.294953:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.294962:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(214 257) 00000100:00100000:0.0:1789429281.295069:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+19:2369:x1876351634908288:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 185us (407us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429281.295077:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11385 00002000:00100000:0.0:1789429281.295084:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f417f2300 x1876351634908288/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.295093:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f2300 with x1876351634908288 ext(331776->335871) 00010000:00010000:0.0:1789429281.295099:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.295124:0:18633:0:(ldlm_lockd.c:595:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x40000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 19 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.295132:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f417f2300 00010000:00010000:2.0:1789429281.295336:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(215 257) 00010000:00010000:2.0:1789429281.295344:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360171 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdbc expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.295378:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.295393:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 18 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.295407:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648301056:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429281.295466:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.300538:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.300560:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648301056:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429281.300597:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360171 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdbc expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.300670:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547a00, rc 0) 00000100:00100000:0.0:1789429281.300718:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634908416 00000100:00100000:0.0:1789429281.300726:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634908416 00002000:00100000:0.0:1789429281.300771:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f34070380 x1876351634908416/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 4584/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.300782:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070380 with x1876351634908416 ext(327680->331775) 00010000:00010000:0.0:1789429281.300789:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 19 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.300805:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 19 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.300814:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34070380 00000100:00100000:2.0:1789429281.300846:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634908160:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5961us (6278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.300854:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1314 00000100:00100000:2.0:1789429281.300859:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5584 00000100:00100000:0.0:1789429281.300868:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634908416:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1789429281.301888:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634908416:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 1018us (1356us total) trans 4294969564 rc 0/0 00000100:00100000:0.0:1789429281.301909:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1314 00002000:00100000:0.0:1789429281.301918:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f34070380 x1876351634908416/t4294969564(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 4584/448 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.301928:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070380 with x1876351634908416 ext(327680->331775) 00010000:00010000:0.0:1789429281.301936:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 21 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.301951:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 21 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.301958:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34070380 00000100:00100000:3.0:1789429281.307894:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.308116:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634908544 00000100:00100000:2.0:1789429281.308126:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634908544 00000100:00100000:2.0:1789429281.308478:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5585 00000100:00100000:2.0:1789429281.308490:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+21:33927:x1876351634908544:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.308507:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.308525:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bdc3 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.308555:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(215 257) 00010000:00010000:2.0:1789429281.308653:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 257) 00010000:00010000:2.0:1789429281.308662:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.308677:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.308692:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547c00, rc 0) 00000100:00100000:2.0:1789429281.309416:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+22:33927:x1876351634908544:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 924us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.309426:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5585 00000100:00100000:3.0:1789429281.312058:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.312297:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634908672 00000100:00100000:0.0:1789429281.312306:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634908672 00010000:00010000:0.0:1789429281.312342:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 22 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.312434:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6018 00000100:00100000:0.0:1789429281.312444:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+22:2368:x1876351634908672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.312467:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789429281.312486:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1789429279 -> 1789429281 00002000:00010000:0.0:1789429281.312489:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1789429279 -> 1789429281 00010000:00010000:0.0:1789429281.312495:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 22 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.312508:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 22 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.312532:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636016a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [327680->18446744073709551615] (req 327680->331775) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdb5 expref: 22 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.312550:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 257) 00010000:00010000:0.0:1789429281.312555:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 257) 00010000:00010000:0.0:1789429281.312563:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360171 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdbc expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.312572:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360171 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdbc expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.312580:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 257) 00010000:00010000:0.0:1789429281.312583:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 257) 00010000:00010000:0.0:1789429281.312588:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 21 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.312595:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 21 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.312630:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 21 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.312645:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648301184:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.312734:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360171 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdbc expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.312744:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648301312:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.312767:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.318133:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.318140:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344bbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648301184:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429281.318174:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634908800 00000100:00100000:1.0:1789429281.318181:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634908800 00002000:00100000:1.0:1789429281.318260:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f34070a80 x1876351634908800/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.318270:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070a80 with x1876351634908800 ext(327680->331775) 00002000:00010000:1.0:1789429281.318275:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34070a80 00000100:00100000:1.0:1789429281.318296:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11386 00000100:00100000:1.0:1789429281.318304:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634908800:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429281.320631:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634908800:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 2318us (2496us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429281.320644:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11386 00002000:00100000:1.0:1789429281.320655:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (327680->331775) req@ffff946f34070a80 x1876351634908800/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.320665:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070a80 with x1876351634908800 ext(327680->331775) 00002000:00010000:1.0:1789429281.320671:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34070a80 00000100:00100000:2.0:1789429281.320736:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648301312:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.320762:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.320883:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+21:2368:x1876351634908672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8440us (8834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.320892:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6018 00000100:00100000:3.0:1789429281.326658:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.327829:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634908928 00000100:00100000:1.0:1789429281.327843:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634908928 00000100:00100000:1.0:1789429281.327953:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5586 00000100:00100000:1.0:1789429281.327963:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634908928:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429281.327991:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429281.328011:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bdca expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.328052:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.328061:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(216 257) 00010000:00010000:1.0:1789429281.328066:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(217 257) 00010000:00010000:1.0:1789429281.328070:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.328104:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.328118:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 20 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.328133:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648301440:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429281.328244:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.336006:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.336155:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634909056 00000100:00100000:0.0:1789429281.336175:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634909056 00000100:00100000:1.0:1789429281.336183:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648301440:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429281.336243:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1789429281.336258:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f34072680 x1876351634909056/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:1.0:1789429281.336265:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00002000:00100000:0.0:1789429281.336271:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072680 with x1876351634909056 ext(331776->335871) 00010000:00010000:0.0:1789429281.336280:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.336297:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.336310:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34072680 00000100:00100000:0.0:1789429281.336332:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1315 00000100:00100000:1.0:1789429281.336446:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634908928:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8482us (9798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.336449:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351634909056:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429281.336459:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5586 00000100:00100000:0.0:1789429281.336637:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351634909056:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 191us (636us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429281.339069:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1315 00002000:00100000:0.0:1789429281.339088:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f34072680 x1876351634909056/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.339100:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072680 with x1876351634909056 ext(331776->335871) 00010000:00010000:0.0:1789429281.339110:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.339130:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.339138:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34072680 00000100:00100000:3.0:1789429281.346398:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.346484:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.347039:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634909184 00000100:00100000:1.0:1789429281.347041:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634909312 00000100:00100000:0.0:1789429281.347050:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634909184 00000100:00100000:1.0:1789429281.347050:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634909312 00010000:00010000:0.0:1789429281.347097:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 22 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.347126:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5587 00000100:00100000:1.0:1789429281.347139:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+22:33927:x1876351634909312:12345-192.168.203.39@tcp:101:mmap_sanity.0 00000100:00100000:0.0:1789429281.347141:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6019 00010000:00010000:1.0:1789429281.347156:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789429281.347168:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+22:2371:x1876351634909184:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.347184:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429281.347185:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bdd1 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.347254:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(217 257) 00010000:00010000:1.0:1789429281.347264:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.347271:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(218 257) 00010000:00010000:1.0:1789429281.347277:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 23 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.347328:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.347343:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 23 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.347356:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429281.347422:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634909312:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 285us (1033us total) trans 0 rc 0/0 00010000:00010000:0.0:1789429281.347426:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.347433:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5587 00010000:00010000:0.0:1789429281.347449:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 22 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.347471:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360178 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdc3 expref: 22 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.347486:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 257) 00010000:00010000:0.0:1789429281.347489:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 257) 00010000:00010000:0.0:1789429281.347497:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.347506:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.347531:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.347544:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 15 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.347558:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648301696:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.347613:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.350691:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648301696:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.350716:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.350772:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634909184:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3614us (4287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.350787:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6019 00000100:00100000:3.0:1789429281.351735:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.351802:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634909440 00000100:00100000:0.0:1789429281.351809:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634909440 00002000:00100000:0.0:1789429281.351852:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (331776->368639) req@ffff946f3f8d8a80 x1876351634909440/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.351863:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8a80 with x1876351634909440 ext(331776->368639) 00010000:00010000:0.0:1789429281.351871:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 16 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.351886:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 16 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.351893:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8d8a80 00000100:00100000:0.0:1789429281.351924:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1316 00000100:00100000:0.0:1789429281.351933:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634909440:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429281.357314:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634909440:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5372us (5573us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429281.357327:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1316 00002000:00100000:0.0:1789429281.357339:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (331776->368639) req@ffff946f3f8d8a80 x1876351634909440/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.357355:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8a80 with x1876351634909440 ext(331776->368639) 00010000:00010000:0.0:1789429281.357366:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 16 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.357383:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 16 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.357390:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8d8a80 00000100:00100000:3.0:1789429281.361886:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.361929:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.361961:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634909568 00000100:00100000:2.0:1789429281.361973:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634909568 00000100:00100000:2.0:1789429281.362034:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5588 00000100:00100000:2.0:1789429281.362045:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634909568:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.362063:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.362083:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bdd8 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.362129:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(219 257) 00010000:00010000:2.0:1789429281.362137:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.362145:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(220 257) 00010000:00010000:2.0:1789429281.362151:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.362245:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.362262:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 17 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.362270:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634909696 00010000:00010000:2.0:1789429281.362274:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546600, rc 0) 00000100:00100000:0.0:1789429281.362277:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634909696 00010000:00010000:0.0:1789429281.362303:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 18 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.362330:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6020 00000100:00100000:2.0:1789429281.362338:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634909568:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 294us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.362340:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634909696:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789429281.362354:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5588 00010000:00010000:0.0:1789429281.362356:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.362379:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.362393:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.362415:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636017f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdca expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.362435:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 257) 00010000:00010000:0.0:1789429281.362439:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 257) 00010000:00010000:0.0:1789429281.362448:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.362458:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.362484:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.362497:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 20 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.362510:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648301952:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.362581:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.366604:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648301952:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.366635:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.366698:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634909696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4359us (4767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.366708:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6020 00000100:00100000:2.0:1789429281.369396:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.369588:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634909824 00000100:00100000:3.0:1789429281.369597:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634909824 00010000:00010000:3.0:1789429281.369637:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 21 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.369717:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6021 00000100:00100000:3.0:1789429281.369727:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0fb44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634909824:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429281.369741:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429281.369764:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 21 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.369789:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 21 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.369811:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad726360186 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd1 expref: 21 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.369827:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 257) 00010000:00010000:3.0:1789429281.369830:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 257) 00010000:00010000:3.0:1789429281.369837:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.369844:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.369873:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.369883:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648302080:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429281.369947:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.375342:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8db800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648302080:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.375380:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.375529:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0fb44c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351634909824:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5801us (6139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.375541:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6021 00000100:00100000:0.0:1789429281.381660:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.381719:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634909952 00000100:00100000:2.0:1789429281.381730:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634909952 00000100:00100000:2.0:1789429281.381788:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5589 00000100:00100000:2.0:1789429281.381799:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+20:33927:x1876351634909952:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.381816:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.381837:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bddf expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.381869:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.381879:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(221 257) 00010000:00010000:2.0:1789429281.381883:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(222 257) 00010000:00010000:2.0:1789429281.381889:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 21 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.381920:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 15 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.381933:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 15 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.381946:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648302208:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429281.382116:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.385193:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.385554:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634910080 00000100:00100000:2.0:1789429281.385555:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1191f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648302208:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.385561:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634910080 00010000:00010000:2.0:1789429281.385593:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 21 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789429281.385605:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (331776->368639) req@ffff946f417f0380 x1876351634910080/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429281.385614:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f0380 with x1876351634910080 ext(331776->368639) 00010000:00010000:2.0:1789429281.385621:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547200, rc 0) 00010000:00010000:3.0:1789429281.385621:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 16 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.385634:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 16 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429281.385641:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f417f0380 00000100:00100000:2.0:1789429281.385674:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+21:33927:x1876351634909952:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3876us (4023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.385686:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5589 00000100:00100000:3.0:1789429281.385710:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1317 00000100:00100000:3.0:1789429281.385719:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634910080:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.387716:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634910080:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 1990us (2525us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429281.387728:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1317 00002000:00100000:2.0:1789429281.387738:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (331776->368639) req@ffff946f417f0380 x1876351634910080/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.387747:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f0380 with x1876351634910080 ext(331776->368639) 00010000:00010000:2.0:1789429281.387757:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 16 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.387772:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 16 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.387780:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f417f0380 00000100:00100000:3.0:1789429281.389312:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.389364:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634910208 00000100:00100000:1.0:1789429281.389373:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634910208 00000100:00100000:1.0:1789429281.389425:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5590 00000100:00100000:1.0:1789429281.389435:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634910208:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429281.389451:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429281.389478:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bde6 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.389508:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(222 257) 00010000:00010000:1.0:1789429281.389516:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.389529:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(223 257) 00010000:00010000:1.0:1789429281.389534:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.389571:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.389586:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.389598:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:1.0:1789429281.389647:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634910208:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 214us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.389654:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5590 00000100:00100000:0.0:1789429281.389986:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.390109:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634910336 00000100:00100000:1.0:1789429281.390114:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634910336 00010000:00010000:1.0:1789429281.390133:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 17 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.390189:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6022 00000100:00100000:1.0:1789429281.390196:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2368:x1876351634910336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429281.390239:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429281.390260:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 17 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.390278:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 17 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.390297:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad72636018d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdd8 expref: 17 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.390311:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 257) 00010000:00010000:1.0:1789429281.390316:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 257) 00010000:00010000:1.0:1789429281.390324:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.390333:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.390358:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.390371:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 20 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.390384:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648302464:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429281.390448:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.393335:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.393527:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648302464:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429281.393548:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429281.393598:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351634910336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3401us (3611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.393607:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6022 00000100:00100000:3.0:1789429281.395375:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634910464 00000100:00100000:3.0:1789429281.395389:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634910464 00002000:00100000:2.0:1789429281.395594:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f1191f800 x1876351634910464/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.395606:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191f800 with x1876351634910464 ext(331776->335871) 00010000:00010000:2.0:1789429281.395616:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.395635:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.395644:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191f800 00000100:00100000:2.0:1789429281.395719:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1318 00000100:00100000:2.0:1789429281.395729:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351634910464:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.395916:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351634910464:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 188us (2590us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429281.395923:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1318 00002000:00100000:2.0:1789429281.395931:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f1191f800 x1876351634910464/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.395940:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191f800 with x1876351634910464 ext(331776->335871) 00010000:00010000:2.0:1789429281.395945:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.395957:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.395966:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191f800 00000100:00100000:2.0:1789429281.402641:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.402705:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634910592 00000100:00100000:1.0:1789429281.402715:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634910592 00000100:00100000:1.0:1789429281.402781:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5591 00000100:00100000:1.0:1789429281.402791:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+21:33927:x1876351634910592:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429281.402809:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429281.402826:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bded expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.402859:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(224 257) 00010000:00010000:1.0:1789429281.402868:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.402875:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(225 257) 00010000:00010000:1.0:1789429281.402881:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.402920:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.402935:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.402952:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429281.403014:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+22:33927:x1876351634910592:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 224us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.403021:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5591 00000100:00100000:3.0:1789429281.405052:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.405135:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634910720 00000100:00100000:0.0:1789429281.405143:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634910720 00010000:00010000:0.0:1789429281.405327:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 22 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.405370:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6023 00000100:00100000:0.0:1789429281.405381:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+22:2368:x1876351634910720:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.405395:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.405417:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 22 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.405432:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 22 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.405576:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360194 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bddf expref: 22 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.405596:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 257) 00010000:00010000:0.0:1789429281.405601:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 257) 00010000:00010000:0.0:1789429281.405610:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.405622:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.405659:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.405673:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 15 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.405694:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648302720:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.405806:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515300 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.409659:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.410110:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648302720:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429281.410132:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429281.410257:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+21:2368:x1876351634910720:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4877us (5212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.410267:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6023 00000100:00100000:1.0:1789429281.410296:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634910848 00000100:00100000:1.0:1789429281.410302:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634910848 00010000:00010000:1.0:1789429281.410332:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 16 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.410360:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6024 00000100:00100000:1.0:1789429281.410378:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634910848:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429281.410390:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429281.410410:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 16 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.410423:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 16 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.410445:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636019b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bde6 expref: 16 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.410461:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 257) 00010000:00010000:1.0:1789429281.410465:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 257) 00010000:00010000:1.0:1789429281.410474:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.410483:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.410518:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.410530:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648302848:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429281.410576:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.413476:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648302848:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.413501:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.413599:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634910848:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3231us (3948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.413609:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6024 00000100:00100000:3.0:1789429281.424008:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.425316:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634910976 00000100:00100000:2.0:1789429281.425328:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634910976 00000100:00100000:2.0:1789429281.425389:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5592 00000100:00100000:2.0:1789429281.425398:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634910976:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.425414:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.425430:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bdf4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.425470:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.425481:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(226 257) 00010000:00010000:2.0:1789429281.425485:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 257) 00010000:00010000:2.0:1789429281.425491:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.425523:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.425537:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 20 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.425550:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648302976:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429281.425624:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.426292:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.426363:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634911104 00000100:00100000:0.0:1789429281.426369:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634911104 00002000:00100000:0.0:1789429281.426407:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f34071500 x1876351634911104/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.426417:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071500 with x1876351634911104 ext(331776->335871) 00010000:00010000:0.0:1789429281.426423:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 21 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.426437:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 21 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.426445:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34071500 00000100:00100000:0.0:1789429281.426543:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1319 00000100:00100000:0.0:1789429281.426553:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634911104:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429281.426721:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634911104:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 169us (430us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429281.426729:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1319 00002000:00100000:0.0:1789429281.426736:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f34071500 x1876351634911104/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.426745:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071500 with x1876351634911104 ext(331776->335871) 00010000:00010000:0.0:1789429281.426750:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 21 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.426761:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 21 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.426767:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34071500 00000100:00100000:2.0:1789429281.430756:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648302976:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429281.430792:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.430820:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547c00, rc 0) 00000100:00100000:2.0:1789429281.430883:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634910976:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5485us (6901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.430892:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5592 00000100:00100000:0.0:1789429281.431185:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.431393:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634911232 00000100:00100000:2.0:1789429281.431400:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634911232 00010000:00010000:2.0:1789429281.431428:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 21 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.431467:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6025 00000100:00100000:2.0:1789429281.431476:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+21:2369:x1876351634911232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.431487:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.431508:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 21 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.431520:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 21 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.431544:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263601a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bded expref: 21 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.431558:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 257) 00010000:00010000:2.0:1789429281.431562:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 257) 00010000:00010000:2.0:1789429281.431571:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.431581:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.431614:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.431628:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648303104:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.431680:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f110de540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.431865:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.432070:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634911360 00000100:00100000:2.0:1789429281.432079:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634911360 00000100:00100000:2.0:1789429281.432114:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5593 00000100:00100000:2.0:1789429281.432121:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+21:33927:x1876351634911360:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.432133:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.432145:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bdfb expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.432314:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.432323:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(227 257) 00010000:00010000:2.0:1789429281.432327:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 257) 00010000:00010000:2.0:1789429281.432331:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.432358:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.432369:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 15 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.432380:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648303232:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429281.432432:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.437137:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.437303:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648303232:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.437338:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.437361:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546c00, rc 0) 00000100:00100000:3.0:1789429281.437418:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+22:33927:x1876351634911360:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5297us (5554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.437426:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5593 00000100:00100000:2.0:1789429281.437541:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648303104:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.437553:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.437575:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+21:2369:x1876351634911232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6101us (6392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.437584:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6025 00000100:00100000:1.0:1789429281.438333:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634911488 00000100:00100000:1.0:1789429281.438342:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634911488 00002000:00100000:1.0:1789429281.438383:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (331776->368639) req@ffff946f2f4e2a00 x1876351634911488/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.438393:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e2a00 with x1876351634911488 ext(331776->368639) 00010000:00010000:1.0:1789429281.438401:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 16 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.438415:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 16 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429281.438427:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e2a00 00000100:00100000:1.0:1789429281.438453:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1320 00000100:00100000:1.0:1789429281.438461:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634911488:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429281.442270:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634911488:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3799us (5132us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429281.442284:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1320 00002000:00100000:1.0:1789429281.442296:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (331776->368639) req@ffff946f2f4e2a00 x1876351634911488/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.442307:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e2a00 with x1876351634911488 ext(331776->368639) 00010000:00010000:1.0:1789429281.442318:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 16 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.442335:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 16 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429281.442343:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e2a00 00000100:00100000:3.0:1789429281.445538:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.445580:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.445668:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634911744 00000100:00100000:2.0:1789429281.445677:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634911744 00010000:00010000:2.0:1789429281.445716:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 16 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.445758:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6026 00000100:00100000:2.0:1789429281.445767:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351634911744:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.445782:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.445803:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 16 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.445822:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 16 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.445845:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdf4 expref: 16 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.445863:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 257) 00010000:00010000:2.0:1789429281.445868:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 257) 00010000:00010000:2.0:1789429281.445877:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.445887:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.445923:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.445937:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648303360:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.446021:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.446391:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634911616 00000100:00100000:1.0:1789429281.446397:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634911616 00000100:00100000:1.0:1789429281.446437:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5594 00000100:00100000:1.0:1789429281.446445:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634911616:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429281.446459:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429281.446473:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be02 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.446499:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.446508:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(228 257) 00010000:00010000:1.0:1789429281.446512:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(229 257) 00010000:00010000:1.0:1789429281.446517:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.446540:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.446553:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 20 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.446563:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648303488:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429281.446610:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.450828:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.450924:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648303360:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.450948:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.450998:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2368:x1876351634911744:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5232us (5417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.451011:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6026 00000100:00100000:0.0:1789429281.451091:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634911872 00000100:00100000:0.0:1789429281.451099:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634911872 00002000:00100000:0.0:1789429281.451142:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f3f8d8000 x1876351634911872/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.451178:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8000 with x1876351634911872 ext(331776->335871) 00010000:00010000:0.0:1789429281.451187:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.451234:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.451247:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8d8000 00000100:00100000:0.0:1789429281.451266:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1321 00000100:00100000:0.0:1789429281.451275:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634911872:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429281.451461:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634911872:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 186us (641us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429281.451469:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1321 00002000:00100000:0.0:1789429281.451476:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f3f8d8000 x1876351634911872/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.451485:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8000 with x1876351634911872 ext(331776->335871) 00010000:00010000:0.0:1789429281.451491:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.451503:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 21 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.451511:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8d8000 00000100:00100000:1.0:1789429281.451974:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648303488:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429281.451998:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.452016:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429281.452054:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634911616:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5610us (6526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.452064:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5594 00000100:00100000:0.0:1789429281.457314:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.457372:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.457430:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634912128 00000100:00100000:2.0:1789429281.457438:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634912128 00000100:00100000:2.0:1789429281.457489:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5595 00000100:00100000:2.0:1789429281.457499:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+21:33927:x1876351634912128:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.457516:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.457534:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be09 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.457566:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634912000 00010000:00010000:2.0:1789429281.457570:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(229 257) 00000100:00100000:3.0:1789429281.457570:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634912000 00010000:00010000:2.0:1789429281.457578:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.457585:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(230 257) 00010000:00010000:3.0:1789429281.457589:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.457590:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 23 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.457628:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6027 00010000:00010000:2.0:1789429281.457629:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.457635:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634912000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429281.457643:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.457644:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 23 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.457656:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547c00, rc 0) 00010000:00010000:3.0:1789429281.457662:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.457672:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.457690:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263601b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdfb expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.457703:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 257) 00010000:00010000:3.0:1789429281.457707:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 257) 00010000:00010000:3.0:1789429281.457714:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.457723:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.457747:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 15 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.457750:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+22:33927:x1876351634912128:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 253us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.457758:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5595 00010000:00010000:3.0:1789429281.457766:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 15 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.457790:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648303744:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429281.458410:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.461957:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.462247:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648303744:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429281.462269:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429281.462320:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351634912000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4685us (5012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.462331:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6027 00000100:00100000:3.0:1789429281.462358:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634912256 00000100:00100000:3.0:1789429281.462363:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634912256 00010000:00010000:3.0:1789429281.462391:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 16 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.462418:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6028 00000100:00100000:3.0:1789429281.462426:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0fb45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351634912256:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429281.462438:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429281.463150:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 16 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.463178:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 16 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.463235:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be02 expref: 16 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.463250:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 257) 00010000:00010000:3.0:1789429281.463254:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 257) 00010000:00010000:3.0:1789429281.463262:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.463272:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.463309:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.463323:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648303872:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.463856:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.466131:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648303872:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.466379:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.466473:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0fb45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2368:x1876351634912256:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4046us (4523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.466484:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6028 00000100:00100000:1.0:1789429281.466991:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.467055:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634912384 00000100:00100000:3.0:1789429281.467063:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634912384 00002000:00100000:3.0:1789429281.467104:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f417f3100 x1876351634912384/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429281.467115:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f3100 with x1876351634912384 ext(331776->335871) 00002000:00010000:3.0:1789429281.467121:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f417f3100 00000100:00100000:3.0:1789429281.467145:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11387 00000100:00100000:3.0:1789429281.467154:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634912384:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429281.467348:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634912384:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 194us (365us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429281.467355:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11387 00002000:00100000:3.0:1789429281.467365:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f417f3100 x1876351634912384/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429281.467372:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f3100 with x1876351634912384 ext(331776->335871) 00002000:00010000:3.0:1789429281.467375:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f417f3100 00000100:00100000:0.0:1789429281.471748:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.472548:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634912512 00000100:00100000:3.0:1789429281.472560:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634912512 00002000:00100000:3.0:1789429281.472614:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f2f4e3480 x1876351634912512/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429281.472624:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e3480 with x1876351634912512 ext(335872->339967) 00002000:00010000:3.0:1789429281.472630:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f4e3480 00000100:00100000:2.0:1789429281.472696:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11388 00000100:00100000:2.0:1789429281.472708:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+21:2368:x1876351634912512:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.472969:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+21:2368:x1876351634912512:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 263us (1230us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429281.472976:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11388 00002000:00100000:2.0:1789429281.472993:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f2f4e3480 x1876351634912512/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.473001:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e3480 with x1876351634912512 ext(335872->339967) 00002000:00010000:2.0:1789429281.473005:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f4e3480 00000100:00100000:0.0:1789429281.473506:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.473576:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634912640 00000100:00100000:2.0:1789429281.473582:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634912640 00000100:00100000:2.0:1789429281.473624:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5596 00000100:00100000:2.0:1789429281.473632:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33938:x1876351634912640:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.473643:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.473658:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263601c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be10 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.473692:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.473701:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(231 257) 00010000:00010000:2.0:1789429281.473705:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(232 257) 00010000:00010000:2.0:1789429281.473709:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263601c5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be10 expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.473737:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 20 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.473749:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 20 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.473761:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648304000:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429281.473825:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f182179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.479538:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.479629:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634912768 00000100:00100000:2.0:1789429281.479639:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634912768 00002000:00100000:2.0:1789429281.479689:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f3f8d9880 x1876351634912768/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 4584/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.479699:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d9880 with x1876351634912768 ext(331776->335871) 00010000:00010000:2.0:1789429281.479708:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 21 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.479738:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 21 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.479745:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8d9880 00000100:00100000:2.0:1789429281.479773:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1322 00000100:00100000:2.0:1789429281.479781:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351634912768:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429281.480352:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634912768:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 570us (822us total) trans 4294969565 rc 0/0 00000100:00100000:2.0:1789429281.480361:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1322 00002000:00100000:2.0:1789429281.480368:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f3f8d9880 x1876351634912768/t4294969565(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 4584/448 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.480377:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d9880 with x1876351634912768 ext(331776->335871) 00010000:00010000:2.0:1789429281.480383:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.480396:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.480403:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8d9880 00000100:00100000:0.0:1789429281.480693:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.480824:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634912896 00000100:00100000:3.0:1789429281.480830:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634912896 00000100:00100000:3.0:1789429281.480876:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5597 00000100:00100000:3.0:1789429281.480885:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634912896:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.480896:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.480913:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be17 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.480937:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(232 257) 00010000:00010000:3.0:1789429281.480942:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 257) 00010000:00010000:3.0:1789429281.480948:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.480961:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.480973:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429281.481007:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+24:33927:x1876351634912896:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 124us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.481014:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5597 00000100:00100000:3.0:1789429281.483621:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.483818:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634913024 00000100:00100000:1.0:1789429281.483829:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634913024 00010000:00010000:1.0:1789429281.483867:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 24 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.483907:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6029 00000100:00100000:1.0:1789429281.483917:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+24:2369:x1876351634913024:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429281.483931:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429281.483954:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 24 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.483968:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 24 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.484049:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 257) 00010000:00010000:1.0:1789429281.484054:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 257) 00010000:00010000:1.0:1789429281.484063:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263601c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be10 expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.484074:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263601c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be10 expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.484082:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 257) 00010000:00010000:1.0:1789429281.484086:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 257) 00010000:00010000:1.0:1789429281.484091:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.484099:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.484132:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.484228:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648304128:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429281.484315:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263601c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be10 expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.484326:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648304256:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429281.484349:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00010000:00010000:2.0:1789429281.484437:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad7263601be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [331776->18446744073709551615] (req 331776->335871) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be09 expref: 24 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.484452:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648304000:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429281.484476:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263601c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be10 expref: 16 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.484486:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546a00, rc 0) 00000100:00100000:2.0:1789429281.484514:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634912640:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10883us (11009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.484521:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5596 00000100:00100000:1.0:1789429281.492767:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.492869:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634913152 00000100:00100000:2.0:1789429281.492878:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634913152 00002000:00100000:2.0:1789429281.492925:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f417f0a80 x1876351634913152/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.492936:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f0a80 with x1876351634913152 ext(331776->335871) 00002000:00010000:2.0:1789429281.492942:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f417f0a80 00000100:00100000:2.0:1789429281.492972:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11389 00000100:00100000:2.0:1789429281.492981:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634913152:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.493197:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634913152:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 216us (438us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429281.493225:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11389 00002000:00100000:2.0:1789429281.493232:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (331776->335871) req@ffff946f417f0a80 x1876351634913152/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.493239:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f0a80 with x1876351634913152 ext(331776->335871) 00002000:00010000:2.0:1789429281.493243:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f417f0a80 00000100:00100000:3.0:1789429281.496899:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.497167:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634913280 00000100:00100000:1.0:1789429281.497179:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634913280 00000100:00100000:1.0:1789429281.497271:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5598 00000100:00100000:1.0:1789429281.497283:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634913280:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429281.497299:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429281.497319:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be1e expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.497352:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 23 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.497363:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(233 257) 00010000:00010000:1.0:1789429281.497368:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 257) 00010000:00010000:1.0:1789429281.497373:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.497407:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 23 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.497422:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.497435:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648304384:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429281.497500:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.498532:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648304256:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.498547:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648304128:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.498568:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.498613:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351634913024:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 14698us (15000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.498622:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6029 00000100:00100000:3.0:1789429281.501424:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.501750:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648304384:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429281.501970:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.501993:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:1.0:1789429281.502057:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634913280:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4776us (5166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.502065:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5598 00000100:00100000:0.0:1789429281.502185:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634913408 00000100:00100000:0.0:1789429281.502193:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634913408 00010000:00010000:0.0:1789429281.502246:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.502272:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6030 00000100:00100000:0.0:1789429281.502279:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634913408:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.502291:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.502310:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.502322:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.502346:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263601cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be17 expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.502360:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 257) 00010000:00010000:0.0:1789429281.502365:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 257) 00010000:00010000:0.0:1789429281.502373:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.502384:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.502742:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.502758:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648304512:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.503055:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.503684:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.503834:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634913536 00000100:00100000:0.0:1789429281.503841:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634913536 00000100:00100000:0.0:1789429281.503921:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5599 00000100:00100000:0.0:1789429281.503930:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634913536:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429281.503945:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429281.503961:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be25 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.503998:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.504006:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(234 257) 00010000:00010000:0.0:1789429281.504010:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 257) 00010000:00010000:0.0:1789429281.504014:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.504045:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.504057:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 16 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.504068:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648304640:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429281.504126:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.506786:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648304640:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.506822:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.506842:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:3.0:1789429281.506903:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+24:33927:x1876351634913536:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2973us (3221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.506913:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5599 00000100:00100000:2.0:1789429281.507926:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648304512:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.507949:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.508006:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634913408:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5726us (6589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.508016:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6030 00000100:00100000:1.0:1789429281.509242:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.509312:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634913664 00000100:00100000:0.0:1789429281.509320:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634913664 00002000:00100000:0.0:1789429281.509357:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f344b9f80 x1876351634913664/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.509368:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b9f80 with x1876351634913664 ext(335872->372735) 00010000:00010000:0.0:1789429281.509376:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.509390:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.509398:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b9f80 00000100:00100000:0.0:1789429281.509423:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1323 00000100:00100000:0.0:1789429281.509430:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351634913664:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429281.512344:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351634913664:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 2903us (3094us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429281.512358:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1323 00002000:00100000:0.0:1789429281.512373:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f344b9f80 x1876351634913664/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.512384:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b9f80 with x1876351634913664 ext(335872->372735) 00010000:00010000:0.0:1789429281.512396:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.512414:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.512422:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b9f80 00000100:00100000:3.0:1789429281.515719:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.515807:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.515888:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634913792 00000100:00100000:0.0:1789429281.515898:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634913792 00000100:00100000:0.0:1789429281.515955:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5600 00000100:00100000:0.0:1789429281.515964:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634913792:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429281.515981:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429281.516009:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be2c expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.516039:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(235 257) 00010000:00010000:0.0:1789429281.516048:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.516056:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(236 257) 00010000:00010000:0.0:1789429281.516062:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.516103:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.516118:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.516129:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429281.516226:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634913792:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 237us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.516234:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5600 00000100:00100000:2.0:1789429281.517668:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634913920 00000100:00100000:2.0:1789429281.517678:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634913920 00010000:00010000:2.0:1789429281.517713:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.517741:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6031 00000100:00100000:2.0:1789429281.517748:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634913920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.517761:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.517891:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.517907:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.517929:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263601d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be1e expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.517945:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 257) 00010000:00010000:2.0:1789429281.517949:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 257) 00010000:00010000:2.0:1789429281.517958:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.517974:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.518065:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.518080:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 22 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.518094:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648304896:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.518315:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.525242:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.525327:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634914048 00000100:00100000:2.0:1789429281.525337:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634914048 00002000:00100000:2.0:1789429281.525381:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f417f0000 x1876351634914048/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.525393:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f0000 with x1876351634914048 ext(335872->339967) 00010000:00010000:2.0:1789429281.525402:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.525419:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.525427:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f417f0000 00000100:00100000:2.0:1789429281.525447:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1324 00000100:00100000:2.0:1789429281.525455:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634914048:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.525613:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634914048:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 158us (379us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429281.525620:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1324 00002000:00100000:2.0:1789429281.525626:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f417f0000 x1876351634914048/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.525634:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f0000 with x1876351634914048 ext(335872->339967) 00010000:00010000:2.0:1789429281.525639:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.525650:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.525657:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f417f0000 00000100:00100000:3.0:1789429281.525973:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648304896:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429281.526051:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429281.526115:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634913920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8366us (10405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.526123:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6031 00000100:00100000:0.0:1789429281.531287:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.531348:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.531352:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634914176 00000100:00100000:2.0:1789429281.531362:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634914176 00010000:00010000:2.0:1789429281.531401:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.531442:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634914304 00000100:00100000:3.0:1789429281.531448:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634914304 00000100:00100000:2.0:1789429281.531453:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6032 00000100:00100000:2.0:1789429281.531474:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+24:2368:x1876351634914176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.531487:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.531509:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 24 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.531529:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 24 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.531553:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263601da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be25 expref: 24 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.531570:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 257) 00010000:00010000:2.0:1789429281.531574:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 257) 00010000:00010000:2.0:1789429281.531583:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.531593:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.531627:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.531640:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648305024:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.531711:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.534573:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5601 00000100:00100000:3.0:1789429281.534596:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634914304:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.534616:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.534635:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be33 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.534670:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.534680:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(237 257) 00010000:00010000:3.0:1789429281.534685:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 257) 00010000:00010000:3.0:1789429281.534691:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 24 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.534723:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 16 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.534739:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 16 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.534752:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648305152:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.534991:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.536095:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648305024:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429281.536118:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429281.536169:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+24:2368:x1876351634914176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4682us (4877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.536181:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6032 00000100:00100000:1.0:1789429281.539616:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.539791:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634914432 00000100:00100000:0.0:1789429281.539801:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634914432 00010000:00010000:0.0:1789429281.539839:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 17 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.539885:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6033 00000100:00100000:0.0:1789429281.539894:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2371:x1876351634914432:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.539909:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.539934:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 17 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.539955:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 17 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.539993:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 257) 00010000:00010000:0.0:1789429281.539998:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 257) 00010000:00010000:0.0:1789429281.540006:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.540016:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.540049:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.540063:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648305280:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.540142:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789429281.542956:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad7263601e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be2c expref: 17 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.542981:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648305152:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.543024:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.543041:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:3.0:1789429281.543196:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634914304:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8609us (11846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.543237:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5601 00000100:00100000:2.0:1789429281.545427:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648305280:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.545453:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.546419:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634914432:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6521us (6807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.546436:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6033 00000100:00100000:1.0:1789429281.548435:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.548507:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634914560 00000100:00100000:3.0:1789429281.548517:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634914560 00000100:00100000:3.0:1789429281.548572:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5602 00000100:00100000:3.0:1789429281.548582:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634914560:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.548599:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.548617:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be3a expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.548656:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 22 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.548667:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(238 257) 00010000:00010000:3.0:1789429281.548671:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 257) 00010000:00010000:3.0:1789429281.548676:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.548709:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 22 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.548723:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 22 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.548738:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648305408:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.548923:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.552079:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.552279:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648305408:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.552312:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.552335:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429281.552384:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634914560:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3803us (3956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.552396:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5602 00000100:00100000:0.0:1789429281.552481:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634914688 00000100:00100000:0.0:1789429281.552490:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634914688 00010000:00010000:0.0:1789429281.552525:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.552559:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6034 00000100:00100000:0.0:1789429281.552567:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634914688:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.552580:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.552600:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.552613:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.552636:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad7263601e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be33 expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.552650:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 257) 00010000:00010000:0.0:1789429281.552654:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 257) 00010000:00010000:0.0:1789429281.552662:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.552672:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.552703:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.552716:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648305536:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.552763:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.558638:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.558714:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634914816 00000100:00100000:3.0:1789429281.558724:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634914816 00000100:00100000:3.0:1789429281.558785:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5603 00000100:00100000:3.0:1789429281.558795:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634914816:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.558817:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.558835:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be41 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.558869:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.558879:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(239 257) 00010000:00010000:3.0:1789429281.558883:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 257) 00010000:00010000:3.0:1789429281.558889:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.558921:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.558935:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 16 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.558949:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648305664:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.559028:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.559174:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648305536:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.559195:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.559248:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+24:2370:x1876351634914688:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6680us (7178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.559257:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6034 00000100:00100000:1.0:1789429281.561812:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.561949:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634914944 00000100:00100000:3.0:1789429281.561957:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634914944 00002000:00100000:3.0:1789429281.562007:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f3407ad80 x1876351634914944/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429281.562018:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407ad80 with x1876351634914944 ext(335872->372735) 00010000:00010000:3.0:1789429281.562027:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.562043:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429281.562051:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3407ad80 00000100:00100000:3.0:1789429281.562075:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1325 00000100:00100000:3.0:1789429281.562083:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634914944:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429281.562704:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648305664:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429281.562732:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 23 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.562748:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:0.0:1789429281.562792:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634914816:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4000us (4163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.562800:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5603 00000100:00100000:3.0:1789429281.566028:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634914944:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3934us (4210us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429281.566040:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1325 00002000:00100000:3.0:1789429281.566052:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f3407ad80 x1876351634914944/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429281.566064:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407ad80 with x1876351634914944 ext(335872->372735) 00010000:00010000:3.0:1789429281.566074:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.566092:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429281.566102:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3407ad80 00000100:00100000:2.0:1789429281.569672:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.569757:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634915072 00000100:00100000:1.0:1789429281.569823:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634915072 00000100:00100000:1.0:1789429281.569880:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5604 00000100:00100000:1.0:1789429281.569889:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634915072:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429281.569906:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429281.569924:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be48 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.569957:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(240 257) 00010000:00010000:1.0:1789429281.569965:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.569974:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(241 257) 00010000:00010000:1.0:1789429281.569979:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.570082:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.570098:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.570111:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429281.570366:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634915072:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 478us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.570375:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5604 00000100:00100000:1.0:1789429281.572674:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.573957:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634915200 00000100:00100000:2.0:1789429281.573970:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634915200 00010000:00010000:2.0:1789429281.574067:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.574250:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6035 00000100:00100000:2.0:1789429281.574261:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0fb45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634915200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.574275:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.574298:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.574312:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.574337:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263601ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be3a expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.574354:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 257) 00010000:00010000:2.0:1789429281.574359:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 257) 00010000:00010000:2.0:1789429281.574369:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.574380:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.574424:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.574439:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 22 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.574452:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648305920:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.574614:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.578156:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.578717:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648305920:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.578741:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.578804:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0fb45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634915200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4544us (6136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.578815:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6035 00000100:00100000:0.0:1789429281.578928:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634915328 00000100:00100000:0.0:1789429281.578935:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634915328 00002000:00100000:0.0:1789429281.578976:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f415c7480 x1876351634915328/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.578998:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c7480 with x1876351634915328 ext(335872->339967) 00010000:00010000:0.0:1789429281.579007:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.579023:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.579031:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c7480 00000100:00100000:0.0:1789429281.579056:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1326 00000100:00100000:0.0:1789429281.579065:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634915328:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429281.579253:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634915328:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 189us (1117us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429281.579261:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1326 00002000:00100000:0.0:1789429281.579267:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f415c7480 x1876351634915328/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.579283:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c7480 with x1876351634915328 ext(335872->339967) 00010000:00010000:0.0:1789429281.579289:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.579301:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.579309:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c7480 00000100:00100000:1.0:1789429281.583338:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.583395:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.583470:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634915584 00000100:00100000:2.0:1789429281.583481:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634915584 00010000:00010000:2.0:1789429281.583518:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.583562:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6036 00000100:00100000:2.0:1789429281.583572:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351634915584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.583586:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.583608:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.583622:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.583645:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263601f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be41 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.583662:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 257) 00010000:00010000:2.0:1789429281.583667:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 257) 00010000:00010000:2.0:1789429281.583675:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.583687:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.583722:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.583736:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648306048:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.583939:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573180 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.584592:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634915456 00000100:00100000:3.0:1789429281.584599:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634915456 00000100:00100000:3.0:1789429281.584644:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5605 00000100:00100000:3.0:1789429281.584653:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634915456:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.584666:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.584681:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be4f expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.584705:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.584714:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(242 257) 00010000:00010000:3.0:1789429281.584718:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 257) 00010000:00010000:3.0:1789429281.584723:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 24 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.584747:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.584760:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 16 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.584840:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648306176:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.584926:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.590169:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.590696:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34073800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648306048:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429281.590721:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429281.590777:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+24:2369:x1876351634915584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7196us (7371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.590788:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6036 00000100:00100000:3.0:1789429281.590817:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634915712 00000100:00100000:3.0:1789429281.590823:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634915712 00010000:00010000:3.0:1789429281.590858:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 17 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.590891:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6037 00000100:00100000:3.0:1789429281.590900:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634915712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429281.590913:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429281.590934:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 17 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.590947:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 17 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.590971:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 257) 00010000:00010000:3.0:1789429281.590976:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 257) 00010000:00010000:3.0:1789429281.591079:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.591090:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.591131:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.591145:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648306304:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429281.591277:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789429281.591306:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263601fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be48 expref: 17 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.591320:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648306176:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.591338:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.591349:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429281.591369:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634915456:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6718us (8040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.591377:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5605 00000100:00100000:3.0:1789429281.594702:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648306304:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429281.594730:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429281.594788:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634915712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3889us (4643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.594800:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6037 00000100:00100000:1.0:1789429281.607521:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.607689:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634915840 00000100:00100000:3.0:1789429281.607699:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634915840 00000100:00100000:3.0:1789429281.607747:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5606 00000100:00100000:3.0:1789429281.607756:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634915840:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.607784:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.607803:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be56 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.607837:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 22 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.607847:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(243 257) 00010000:00010000:3.0:1789429281.607852:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 257) 00010000:00010000:3.0:1789429281.607857:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.607889:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 22 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.607903:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 22 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.607915:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648306432:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.608003:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.609020:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.610092:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634915968 00000100:00100000:3.0:1789429281.610104:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634915968 00002000:00100000:3.0:1789429281.610156:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f3f8daa00 x1876351634915968/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429281.610187:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8daa00 with x1876351634915968 ext(335872->339967) 00010000:00010000:3.0:1789429281.610197:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.610228:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429281.610237:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8daa00 00000100:00100000:3.0:1789429281.610328:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1327 00000100:00100000:3.0:1789429281.610338:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351634915968:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429281.610529:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351634915968:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 191us (1512us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429281.610537:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1327 00002000:00100000:3.0:1789429281.610543:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f3f8daa00 x1876351634915968/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429281.610551:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8daa00 with x1876351634915968 ext(335872->339967) 00010000:00010000:3.0:1789429281.610556:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.610567:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429281.610573:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8daa00 00000100:00100000:3.0:1789429281.615270:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648306432:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.615308:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.615331:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429281.615420:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634915840:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7664us (7910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.615430:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5606 00000100:00100000:2.0:1789429281.616312:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.616399:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634916224 00000100:00100000:0.0:1789429281.616407:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634916224 00010000:00010000:0.0:1789429281.616442:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.616524:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6038 00000100:00100000:0.0:1789429281.616534:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634916224:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.616548:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.616571:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.616586:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.616610:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360204 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be4f expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.616642:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 257) 00010000:00010000:0.0:1789429281.616655:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 257) 00010000:00010000:0.0:1789429281.616664:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.616675:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.616712:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.616727:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648306560:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.616989:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.617272:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.617388:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634916096 00000100:00100000:0.0:1789429281.617394:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634916096 00000100:00100000:0.0:1789429281.617428:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5607 00000100:00100000:0.0:1789429281.617435:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634916096:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429281.617448:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429281.617470:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be5d expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.617496:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.617511:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(244 257) 00010000:00010000:0.0:1789429281.617515:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(245 257) 00010000:00010000:0.0:1789429281.617519:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.617542:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.617556:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 16 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.617567:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648306688:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429281.617610:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515900 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.625860:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648306688:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429281.625904:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.625927:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:1.0:1789429281.625989:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+24:33927:x1876351634916096:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8553us (8717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.625998:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5607 00000100:00100000:0.0:1789429281.627049:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648306560:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.627068:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.627116:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634916224:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10583us (10807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.627126:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6038 00000100:00100000:3.0:1789429281.627471:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.628157:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634916352 00000100:00100000:1.0:1789429281.628174:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634916352 00002000:00100000:1.0:1789429281.628247:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946e0265f480 x1876351634916352/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.628258:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265f480 with x1876351634916352 ext(335872->372735) 00010000:00010000:1.0:1789429281.628265:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.628415:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429281.628431:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265f480 00000100:00100000:1.0:1789429281.628456:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1328 00000100:00100000:1.0:1789429281.628465:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634916352:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429281.636747:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634916352:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 8272us (9265us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429281.636757:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1328 00002000:00100000:1.0:1789429281.636770:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946e0265f480 x1876351634916352/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.636778:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265f480 with x1876351634916352 ext(335872->372735) 00010000:00010000:1.0:1789429281.636787:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.636801:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429281.636807:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265f480 00000100:00100000:2.0:1789429281.643315:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.643478:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634916480 00000100:00100000:0.0:1789429281.643489:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634916480 00000100:00100000:0.0:1789429281.643548:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5608 00000100:00100000:0.0:1789429281.643557:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c14d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634916480:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429281.643575:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429281.643594:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be64 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.643628:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(245 257) 00010000:00010000:0.0:1789429281.643655:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.643663:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(246 257) 00010000:00010000:0.0:1789429281.643669:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.643715:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.643731:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.643745:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429281.643857:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c14d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634916480:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 301us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.643865:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5608 00000100:00100000:2.0:1789429281.646739:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.649101:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634916608 00000100:00100000:3.0:1789429281.649114:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634916608 00010000:00010000:0.0:1789429281.649285:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.649713:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6039 00000100:00100000:0.0:1789429281.649724:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2368:x1876351634916608:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.649743:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.649767:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.649783:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.649809:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636020b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be56 expref: 18 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.649826:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 257) 00010000:00010000:0.0:1789429281.649831:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 257) 00010000:00010000:0.0:1789429281.649841:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.649852:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.649890:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.649903:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 22 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.649917:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648306944:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.650014:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.652847:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648306944:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.652873:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.652931:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2368:x1876351634916608:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3208us (6202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.652942:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6039 00000100:00100000:3.0:1789429281.657003:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.657249:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634916736 00000100:00100000:2.0:1789429281.657259:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634916736 00010000:00010000:2.0:1789429281.657299:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.657332:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6040 00000100:00100000:2.0:1789429281.657342:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634916736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.657369:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.657393:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.657408:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.657431:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360212 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be5d expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.657448:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 257) 00010000:00010000:2.0:1789429281.657452:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 257) 00010000:00010000:2.0:1789429281.657460:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.657474:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.657512:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.657525:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648307072:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.657702:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573240 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.663536:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648307072:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.663564:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.663622:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+22:2370:x1876351634916736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6279us (6633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.663634:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6040 00000100:00100000:2.0:1789429281.670880:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.671021:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634916864 00000100:00100000:3.0:1789429281.671032:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634916864 00000100:00100000:3.0:1789429281.671089:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5609 00000100:00100000:3.0:1789429281.671100:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+22:33927:x1876351634916864:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.671118:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.671134:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be6b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.671185:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.671196:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(247 257) 00010000:00010000:3.0:1789429281.671228:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(248 257) 00010000:00010000:3.0:1789429281.671235:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.671270:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 16 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.671283:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 16 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.671467:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648307200:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.671614:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.678313:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.678344:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.678453:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634917120 00000100:00100000:1.0:1789429281.678464:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634917120 00000100:00100000:0.0:1789429281.678471:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634916992 00000100:00100000:0.0:1789429281.678478:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634916992 00000100:00100000:1.0:1789429281.678526:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5610 00000100:00100000:1.0:1789429281.678536:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634917120:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429281.678551:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429281.678564:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 18 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.678568:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be72 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.678608:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6041 00000100:00100000:0.0:1789429281.678617:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634916992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429281.678626:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(248 257) 00010000:00010000:0.0:1789429281.678628:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429281.678637:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.678645:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(249 257) 00010000:00010000:1.0:1789429281.678650:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.678709:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648307200:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429281.678759:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 19 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.678954:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 19 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.678992:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad726360219 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be64 expref: 19 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.679008:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 257) 00010000:00010000:0.0:1789429281.679011:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 257) 00010000:00010000:0.0:1789429281.679019:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.679029:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.679062:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.679076:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.679089:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648307328:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429281.679230:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.679240:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.679251:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648307456:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429281.679404:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515e40 going to sleep for 11 seconds 00010000:00010000:3.0:1789429281.679688:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.679701:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.679712:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:1.0:1789429281.680841:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.686341:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634916864:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 15232us (15459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.686354:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5609 00000100:00100000:1.0:1789429281.686709:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648307456:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429281.686740:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.686779:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:1.0:1789429281.686832:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634917120:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8297us (8486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.686843:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5610 00000100:00100000:0.0:1789429281.687147:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648307328:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.687176:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.687240:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634916992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8624us (8947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.687255:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6041 00000100:00100000:2.0:1789429281.691285:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.691516:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634917248 00000100:00100000:1.0:1789429281.691527:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634917248 00002000:00100000:1.0:1789429281.691575:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f417f3b80 x1876351634917248/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.691587:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f3b80 with x1876351634917248 ext(335872->339967) 00010000:00010000:1.0:1789429281.691597:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.691613:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429281.691621:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f417f3b80 00000100:00100000:1.0:1789429281.691654:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1329 00000100:00100000:1.0:1789429281.691664:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351634917248:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429281.691868:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351634917248:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 204us (593us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429281.691876:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1329 00002000:00100000:1.0:1789429281.691883:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f417f3b80 x1876351634917248/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.691893:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f3b80 with x1876351634917248 ext(335872->339967) 00010000:00010000:1.0:1789429281.691900:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.691919:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 23 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429281.691927:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f417f3b80 00000100:00100000:2.0:1789429281.698133:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.698247:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634917376 00000100:00100000:1.0:1789429281.698256:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634917376 00000100:00100000:1.0:1789429281.698317:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5611 00000100:00100000:1.0:1789429281.698326:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634917376:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429281.698343:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429281.698361:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be79 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.698392:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(250 257) 00010000:00010000:1.0:1789429281.698400:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.698408:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(251 257) 00010000:00010000:1.0:1789429281.698414:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.698453:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.698467:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.698486:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429281.698553:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+24:33927:x1876351634917376:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 227us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.698560:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5611 00000100:00100000:0.0:1789429281.700288:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.700372:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634917504 00000100:00100000:2.0:1789429281.700379:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634917504 00010000:00010000:2.0:1789429281.700410:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 24 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.700448:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6042 00000100:00100000:2.0:1789429281.700457:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0fb46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+24:2370:x1876351634917504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.700470:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.700492:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 24 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.700521:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 24 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.700544:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360220 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be6b expref: 24 pid: 6682 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.700562:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 257) 00010000:00010000:2.0:1789429281.700566:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 257) 00010000:00010000:2.0:1789429281.700575:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.700586:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.700620:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.700634:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 16 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.700647:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648307712:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.700711:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.702819:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648307712:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.702845:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.702900:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0fb46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634917504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2444us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.702911:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6042 00000100:00100000:1.0:1789429281.712910:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.715711:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634917632 00000100:00100000:2.0:1789429281.715727:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634917632 00002000:00100000:2.0:1789429281.715913:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f415c6300 x1876351634917632/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.715925:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6300 with x1876351634917632 ext(335872->372735) 00010000:00010000:2.0:1789429281.715934:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.715951:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.715959:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c6300 00000100:00100000:2.0:1789429281.716106:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1330 00000100:00100000:2.0:1789429281.716117:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2371:x1876351634917632:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.736701:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2371:x1876351634917632:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 20389us (23602us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429281.736715:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1330 00002000:00100000:2.0:1789429281.736728:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f415c6300 x1876351634917632/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.736738:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6300 with x1876351634917632 ext(335872->372735) 00010000:00010000:2.0:1789429281.736749:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.736765:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.736778:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c6300 00000100:00100000:0.0:1789429281.748337:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.748420:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.749138:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634917888 00000100:00100000:2.0:1789429281.749168:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634917888 00010000:00010000:2.0:1789429281.749239:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.749273:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6043 00000100:00100000:2.0:1789429281.749284:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351634917888:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.749298:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.749320:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.749335:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.749359:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360227 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be72 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.749377:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 257) 00010000:00010000:2.0:1789429281.749381:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 257) 00010000:00010000:2.0:1789429281.749390:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.749400:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.749439:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.749455:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648307840:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.749639:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.750241:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634917760 00000100:00100000:1.0:1789429281.750248:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634917760 00000100:00100000:1.0:1789429281.750404:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5612 00000100:00100000:1.0:1789429281.750414:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634917760:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429281.750428:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429281.750443:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be80 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.750469:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.750487:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(252 257) 00010000:00010000:1.0:1789429281.750491:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(253 257) 00010000:00010000:1.0:1789429281.750496:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.750532:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 22 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.750551:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 22 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.750562:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648307968:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429281.750617:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.754135:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.754896:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648307968:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429281.754930:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.754953:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429281.755026:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634917760:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4613us (6697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.755033:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5612 00000100:00100000:2.0:1789429281.755556:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648307840:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.755572:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.755597:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351634917888:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6315us (7176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.755608:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6043 00000100:00100000:2.0:1789429281.755629:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634918016 00000100:00100000:2.0:1789429281.755635:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634918016 00010000:00010000:2.0:1789429281.755660:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.755685:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6044 00000100:00100000:2.0:1789429281.755692:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351634918016:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.755704:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.755726:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.755738:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.755765:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636022e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be79 expref: 23 pid: 6681 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.755781:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(253 257) 00010000:00010000:2.0:1789429281.755785:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(253 257) 00010000:00010000:2.0:1789429281.755793:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.755802:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.755832:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.755845:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648308096:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.755896:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.758579:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648308096:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.758606:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.758671:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351634918016:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2977us (4543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.758682:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6044 00000100:00100000:0.0:1789429281.767400:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.767899:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634918144 00000100:00100000:1.0:1789429281.767908:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634918144 00000100:00100000:1.0:1789429281.767964:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5613 00000100:00100000:1.0:1789429281.767972:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+22:33927:x1876351634918144:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429281.767994:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429281.768011:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be87 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.768042:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.768058:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(253 257) 00010000:00010000:1.0:1789429281.768063:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(254 257) 00010000:00010000:1.0:1789429281.768068:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.768098:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.768112:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 16 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.768125:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648308224:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429281.768246:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c300 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.773304:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648308224:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429281.773345:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.773370:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429281.773438:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634918144:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5466us (6046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.773446:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5613 00000100:00100000:1.0:1789429281.781033:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.781306:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634918272 00000100:00100000:2.0:1789429281.781315:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634918272 00002000:00100000:2.0:1789429281.781364:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f415c6680 x1876351634918272/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.781376:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6680 with x1876351634918272 ext(335872->372735) 00010000:00010000:2.0:1789429281.781385:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.781408:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.781416:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c6680 00000100:00100000:2.0:1789429281.781499:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1331 00000100:00100000:2.0:1789429281.781510:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351634918272:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.785692:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351634918272:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4173us (4658us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429281.785706:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1331 00002000:00100000:2.0:1789429281.785721:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f415c6680 x1876351634918272/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.785732:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6680 with x1876351634918272 ext(335872->372735) 00010000:00010000:2.0:1789429281.785742:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.785760:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.785769:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c6680 00000100:00100000:3.0:1789429281.790372:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.790657:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634918528 00000100:00100000:0.0:1789429281.790667:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634918528 00010000:00010000:0.0:1789429281.790705:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.790786:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6045 00000100:00100000:0.0:1789429281.790804:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2371:x1876351634918528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.790821:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.790844:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.790859:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.790883:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360235 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be80 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.790901:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(254 257) 00010000:00010000:0.0:1789429281.790905:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(254 257) 00010000:00010000:0.0:1789429281.790913:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.790922:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.790961:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.790976:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648308352:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.791060:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515900 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.793672:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.793829:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648308352:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.793851:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.793903:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634918528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3108us (3538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.793916:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6045 00000100:00100000:3.0:1789429281.794892:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634918400 00000100:00100000:3.0:1789429281.794902:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634918400 00000100:00100000:3.0:1789429281.794949:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5614 00000100:00100000:3.0:1789429281.794960:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634918400:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.794978:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.794995:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be8e expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.795027:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.795037:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(254 257) 00010000:00010000:3.0:1789429281.795042:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 257) 00010000:00010000:3.0:1789429281.795047:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.795080:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.795094:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 22 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.795108:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648308480:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.795193:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.796917:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.797059:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634918656 00000100:00100000:2.0:1789429281.797068:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634918656 00002000:00100000:2.0:1789429281.797112:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f415c6a00 x1876351634918656/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.797130:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6a00 with x1876351634918656 ext(335872->339967) 00010000:00010000:2.0:1789429281.797148:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.797175:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.797184:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c6a00 00000100:00100000:2.0:1789429281.797233:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1332 00000100:00100000:2.0:1789429281.797243:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634918656:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.797752:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634918656:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 508us (840us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429281.797761:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1332 00002000:00100000:2.0:1789429281.797768:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f415c6a00 x1876351634918656/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.797775:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6a00 with x1876351634918656 ext(335872->339967) 00010000:00010000:2.0:1789429281.797782:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.797795:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.797802:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c6a00 00000100:00100000:3.0:1789429281.803375:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648308480:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.803416:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.803444:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429281.803534:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634918400:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8576us (9869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.803544:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5614 00000100:00100000:1.0:1789429281.805426:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.805555:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634918784 00000100:00100000:0.0:1789429281.805564:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634918784 00000100:00100000:0.0:1789429281.805618:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5615 00000100:00100000:0.0:1789429281.805627:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634918784:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429281.805644:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429281.805661:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be95 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.805691:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(255 257) 00010000:00010000:0.0:1789429281.805699:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.805706:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(256 257) 00010000:00010000:0.0:1789429281.805712:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.805749:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.805763:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.805786:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:0.0:1789429281.805840:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+24:33927:x1876351634918784:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 213us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.805847:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5615 00000100:00100000:1.0:1789429281.806083:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.807446:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634918912 00000100:00100000:3.0:1789429281.807601:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634918912 00010000:00010000:3.0:1789429281.807643:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 24 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.807735:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6046 00000100:00100000:3.0:1789429281.807744:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+24:2371:x1876351634918912:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429281.807758:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429281.807790:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 24 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.807804:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 24 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.807826:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636023c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be87 expref: 24 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.807844:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(257 257) 00010000:00010000:3.0:1789429281.807848:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(257 257) 00010000:00010000:3.0:1789429281.807857:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.807867:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.807903:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.807917:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 16 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.807931:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648308736:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429281.808021:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.810951:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648308736:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429281.810979:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429281.811045:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634918912:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3300us (4960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.811055:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6046 00000100:00100000:0.0:1789429281.814432:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.814491:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634919040 00000100:00100000:2.0:1789429281.814501:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634919040 00010000:00010000:2.0:1789429281.814540:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.814588:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6047 00000100:00100000:2.0:1789429281.814599:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351634919040:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.814619:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.814644:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.814660:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.814683:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360243 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be8e expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.814699:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(257 257) 00010000:00010000:2.0:1789429281.814704:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(257 257) 00010000:00010000:2.0:1789429281.814712:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.814723:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.814760:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.814787:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648308864:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.814869:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573180 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.818568:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648308864:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.818594:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.818653:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2369:x1876351634919040:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4055us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.818665:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6047 00000100:00100000:1.0:1789429281.835863:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.835912:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.836043:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634919168 00000100:00100000:3.0:1789429281.836054:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634919168 00000100:00100000:3.0:1789429281.836112:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5616 00000100:00100000:3.0:1789429281.836122:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634919168:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.836149:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.836185:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1be9c expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.836261:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.836272:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(257 257) 00010000:00010000:3.0:1789429281.836276:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(258 257) 00010000:00010000:3.0:1789429281.836282:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.836315:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.836329:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 22 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.836343:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648308992:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.836411:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.837795:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634919296 00000100:00100000:0.0:1789429281.837808:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634919296 00002000:00100000:0.0:1789429281.837855:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f054d5500 x1876351634919296/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.837865:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d5500 with x1876351634919296 ext(335872->339967) 00010000:00010000:0.0:1789429281.837874:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 23 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.837889:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 23 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.837898:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d5500 00000100:00100000:0.0:1789429281.837924:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1333 00000100:00100000:0.0:1789429281.837933:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634919296:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429281.838171:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634919296:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 239us (2258us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429281.838180:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1333 00002000:00100000:0.0:1789429281.838188:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f054d5500 x1876351634919296/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.838195:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d5500 with x1876351634919296 ext(335872->339967) 00010000:00010000:0.0:1789429281.838240:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 23 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.838252:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 23 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.838259:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d5500 00000100:00100000:3.0:1789429281.846545:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648308992:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.846582:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.846604:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:3.0:1789429281.846698:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634919168:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10576us (10844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.846710:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5616 00000100:00100000:1.0:1789429281.861284:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.861330:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.861412:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634919552 00000100:00100000:0.0:1789429281.861422:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634919552 00010000:00010000:0.0:1789429281.861459:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 23 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.861502:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6048 00000100:00100000:0.0:1789429281.861512:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634919552:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.861528:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.861550:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 23 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.861564:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 23 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.861587:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636024a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be95 expref: 23 pid: 8085 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.861604:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(258 257) 00010000:00010000:0.0:1789429281.861609:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(258 257) 00010000:00010000:0.0:1789429281.861617:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.861626:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.861659:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.861674:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648309120:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.861739:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.861894:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634919424 00000100:00100000:2.0:1789429281.861900:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634919424 00000100:00100000:2.0:1789429281.861950:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5617 00000100:00100000:2.0:1789429281.861958:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634919424:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.861969:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.861983:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bea3 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.862004:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.862011:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(258 257) 00010000:00010000:2.0:1789429281.862015:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(259 257) 00010000:00010000:2.0:1789429281.862020:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 24 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.862043:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.862055:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 16 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.862071:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648309248:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429281.862099:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.872247:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648309120:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429281.872274:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429281.872326:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+24:2371:x1876351634919552:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10814us (10993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429281.872336:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6048 00000100:00100000:2.0:1789429281.873169:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648309248:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429281.873235:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.873257:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547000, rc 0) 00000100:00100000:2.0:1789429281.873291:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634919424:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11334us (12017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.873299:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5617 00000100:00100000:1.0:1789429281.887609:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.887696:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634919680 00000100:00100000:0.0:1789429281.887707:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634919680 00002000:00100000:0.0:1789429281.887755:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f0822a300 x1876351634919680/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.887766:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0822a300 with x1876351634919680 ext(335872->372735) 00010000:00010000:0.0:1789429281.887775:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.887791:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.887811:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f0822a300 00000100:00100000:0.0:1789429281.887844:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1334 00000100:00100000:0.0:1789429281.887853:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634919680:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429281.910017:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634919680:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 22155us (22409us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429281.910031:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1334 00002000:00100000:0.0:1789429281.910044:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f0822a300 x1876351634919680/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429281.910054:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0822a300 with x1876351634919680 ext(335872->372735) 00010000:00010000:0.0:1789429281.910065:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.910085:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429281.910092:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f0822a300 00000100:00100000:0.0:1789429281.916251:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.916294:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.916369:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634919936 00000100:00100000:1.0:1789429281.916379:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634919936 00010000:00010000:1.0:1789429281.916418:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.916458:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6049 00000100:00100000:1.0:1789429281.916468:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0fb46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2368:x1876351634919936:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429281.916482:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429281.916505:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.916518:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.916550:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad726360251 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be9c expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.916567:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(259 257) 00010000:00010000:1.0:1789429281.916572:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(259 257) 00010000:00010000:1.0:1789429281.916580:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.916591:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.916626:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.916641:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648309376:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429281.916729:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.917282:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634919808 00000100:00100000:3.0:1789429281.917288:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634919808 00000100:00100000:3.0:1789429281.917326:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5618 00000100:00100000:3.0:1789429281.917334:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634919808:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.917347:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.917360:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1beaa expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.917381:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.917390:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(259 257) 00010000:00010000:3.0:1789429281.917393:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 257) 00010000:00010000:3.0:1789429281.917398:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.917422:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.917435:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 22 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.917445:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648309504:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.917496:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.921972:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648309376:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429281.922006:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429281.922057:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0fb46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2368:x1876351634919936:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5591us (5761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.922069:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6049 00000100:00100000:3.0:1789429281.922719:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648309504:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.922745:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.922764:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429281.922805:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634919808:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5471us (6563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.922812:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5618 00000100:00100000:0.0:1789429281.925704:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.925860:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634920064 00000100:00100000:1.0:1789429281.925871:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634920064 00010000:00010000:1.0:1789429281.925909:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.925950:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6050 00000100:00100000:1.0:1789429281.925961:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634920064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429281.925975:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429281.926009:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.926023:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.926048:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360258 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bea3 expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.926065:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 257) 00010000:00010000:1.0:1789429281.926069:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 257) 00010000:00010000:1.0:1789429281.926078:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.926088:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.926125:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.926139:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648309632:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429281.926280:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429281.932614:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648309632:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429281.932641:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429281.932702:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+22:2371:x1876351634920064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6742us (7006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.932715:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6050 00000100:00100000:2.0:1789429281.938542:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429281.938638:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634920192 00000100:00100000:3.0:1789429281.938648:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634920192 00000100:00100000:3.0:1789429281.938714:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5619 00000100:00100000:3.0:1789429281.938724:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+22:33927:x1876351634920192:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.938741:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.938759:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1beb1 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.938795:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.938805:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(260 257) 00010000:00010000:3.0:1789429281.938809:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(261 257) 00010000:00010000:3.0:1789429281.938814:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 23 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.938847:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.938864:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 16 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.938877:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648309760:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.938954:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.951043:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.951395:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634920320 00000100:00100000:1.0:1789429281.951405:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634920320 00002000:00100000:1.0:1789429281.951453:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f2f65ce00 x1876351634920320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.951465:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65ce00 with x1876351634920320 ext(335872->372735) 00010000:00010000:1.0:1789429281.951475:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.951494:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429281.951503:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65ce00 00000100:00100000:1.0:1789429281.951543:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1335 00000100:00100000:1.0:1789429281.951553:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634920320:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429281.953070:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648309760:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.953103:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 23 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.953122:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429281.953198:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634920192:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 14475us (14664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.953241:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5619 00000100:00100000:1.0:1789429281.957121:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634920320:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5559us (6076us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429281.957136:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1335 00002000:00100000:1.0:1789429281.957164:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f2f65ce00 x1876351634920320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:17/0 lens 488/440 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429281.957175:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65ce00 with x1876351634920320 ext(335872->372735) 00010000:00010000:1.0:1789429281.957185:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.957237:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429281.957245:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f65ce00 00000100:00100000:0.0:1789429281.962315:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.962357:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.962445:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634920576 00000100:00100000:2.0:1789429281.962465:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634920576 00010000:00010000:2.0:1789429281.962505:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.962536:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6051 00000100:00100000:2.0:1789429281.962546:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634920576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429281.962560:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429281.962581:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.962595:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.962618:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636025f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beaa expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.962634:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(261 257) 00010000:00010000:2.0:1789429281.962639:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(261 257) 00010000:00010000:2.0:1789429281.962646:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.962656:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.962705:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.962719:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34079c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648309888:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429281.962798:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429281.963317:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634920448 00000100:00100000:3.0:1789429281.963323:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634920448 00000100:00100000:3.0:1789429281.963366:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5620 00000100:00100000:3.0:1789429281.963375:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634920448:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429281.963387:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429281.963401:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1beb8 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.963425:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.963437:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(261 257) 00010000:00010000:3.0:1789429281.963441:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(262 257) 00010000:00010000:3.0:1789429281.963445:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.963561:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.963576:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 22 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429281.963587:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648310016:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429281.963644:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429281.970824:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34079c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648309888:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.970851:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.970906:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634920576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8360us (8546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.970917:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6051 00000100:00100000:3.0:1789429281.975522:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648310016:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429281.975561:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 17 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429281.975582:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429281.975638:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634920448:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 12264us (13332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429281.975648:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5620 00000100:00100000:0.0:1789429281.977273:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.977354:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634920704 00000100:00100000:2.0:1789429281.977362:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634920704 00002000:00100000:2.0:1789429281.977401:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f1c008a80 x1876351634920704/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/0 e 0 to 0 dl 1789429292 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.977412:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c008a80 with x1876351634920704 ext(335872->339967) 00010000:00010000:2.0:1789429281.977419:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.977434:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.977441:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c008a80 00000100:00100000:2.0:1789429281.977459:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1336 00000100:00100000:2.0:1789429281.977467:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634920704:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429281.977650:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634920704:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 183us (382us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429281.977657:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1336 00002000:00100000:2.0:1789429281.977664:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f1c008a80 x1876351634920704/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:17/0 lens 488/4536 e 0 to 0 dl 1789429292 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429281.977680:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c008a80 with x1876351634920704 ext(335872->339967) 00010000:00010000:2.0:1789429281.977686:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.977697:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 23 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429281.977704:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c008a80 00000100:00100000:0.0:1789429281.980923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429281.981017:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634920832 00000100:00100000:2.0:1789429281.981028:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634920832 00000100:00100000:2.0:1789429281.981088:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5621 00000100:00100000:2.0:1789429281.981098:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634920832:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429281.981115:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429281.981135:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bebf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.981186:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(262 257) 00010000:00010000:2.0:1789429281.981195:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.981237:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(263 257) 00010000:00010000:2.0:1789429281.981243:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 24 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.981282:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.981295:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 24 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429281.981308:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429281.981357:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+24:33927:x1876351634920832:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 260us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.981363:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5621 00000100:00100000:3.0:1789429281.984385:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429281.984745:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634920960 00000100:00100000:0.0:1789429281.984756:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634920960 00010000:00010000:0.0:1789429281.984793:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 24 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.984876:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6052 00000100:00100000:0.0:1789429281.984886:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+24:2371:x1876351634920960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429281.984899:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429281.984921:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 24 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.984934:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 24 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.984957:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360266 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb1 expref: 24 pid: 20986 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.984974:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(264 257) 00010000:00010000:0.0:1789429281.984989:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(264 257) 00010000:00010000:0.0:1789429281.984998:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.985014:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.985049:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429281.985062:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 16 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429281.985075:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c008e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648310272:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429281.985165:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429281.989056:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429281.989254:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634921088 00000100:00100000:1.0:1789429281.989264:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634921088 00010000:00010000:1.0:1789429281.989303:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.989340:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6053 00000100:00100000:1.0:1789429281.989350:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634921088:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429281.989364:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429281.989387:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.989400:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.989424:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(264 257) 00010000:00010000:1.0:1789429281.989429:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(264 257) 00010000:00010000:1.0:1789429281.989438:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.989447:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429281.989483:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429281.989498:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648310400:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429281.989571:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789429281.990225:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad72636026d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1beb8 expref: 17 pid: 13238 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429281.990242:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c008e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648310272:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429281.990259:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429281.990297:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634920960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5413us (5921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429281.990305:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6052 00000100:00100000:1.0:1789429281.994189:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648310400:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429281.994244:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429281.994298:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634921088:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4949us (5251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429281.994309:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6053 00000100:00100000:0.0:1789429282.001081:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.001186:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634921216 00000100:00100000:3.0:1789429282.001196:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634921216 00000100:00100000:3.0:1789429282.001292:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5622 00000100:00100000:3.0:1789429282.001303:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634921216:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429282.001322:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429282.001341:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bec6 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.001378:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.001389:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(264 257) 00010000:00010000:3.0:1789429282.001394:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(265 257) 00010000:00010000:3.0:1789429282.001400:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.001439:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 22 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.001455:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 22 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.001470:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648310528:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429282.001547:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429282.008409:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.010342:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648310528:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.010379:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.010400:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:1.0:1789429282.010476:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634921216:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9174us (9404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.010485:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5622 00000100:00100000:3.0:1789429282.011633:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634921344 00000100:00100000:3.0:1789429282.011644:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634921344 00010000:00010000:3.0:1789429282.011695:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.011735:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6054 00000100:00100000:3.0:1789429282.011745:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634921344:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.011759:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.011779:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.011792:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.011814:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad726360274 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bebf expref: 23 pid: 6680 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.011830:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(265 257) 00010000:00010000:3.0:1789429282.011834:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(265 257) 00010000:00010000:3.0:1789429282.011842:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.011851:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.011888:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.011907:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648310656:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.011974:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429282.013765:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.013888:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634921472 00000100:00100000:1.0:1789429282.013896:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634921472 00000100:00100000:1.0:1789429282.013944:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5623 00000100:00100000:1.0:1789429282.013953:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634921472:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.013968:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.013994:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1becd expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.014025:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.014033:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(265 257) 00010000:00010000:1.0:1789429282.014037:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(266 257) 00010000:00010000:1.0:1789429282.014042:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.014070:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.014082:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 16 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.014094:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648310784:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429282.014375:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789429282.020954:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429282.021843:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648310656:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.021872:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429282.021919:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+24:2371:x1876351634921344:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10175us (13520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.021929:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6054 00000100:00100000:0.0:1789429282.026227:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.026812:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634921600 00000100:00100000:1.0:1789429282.026823:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634921600 00002000:00100000:1.0:1789429282.026869:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f1191d500 x1876351634921600/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.026880:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191d500 with x1876351634921600 ext(335872->372735) 00010000:00010000:1.0:1789429282.026889:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 17 pid: 20745 timeout: 1079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.026905:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 17 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.026913:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191d500 00000100:00100000:1.0:1789429282.026950:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1337 00000100:00100000:1.0:1789429282.026959:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634921600:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429282.031948:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648310784:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.032003:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 23 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.032027:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:1.0:1789429282.032091:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634921472:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 18138us (18333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.032100:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5623 00000100:00100000:1.0:1789429282.036688:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634921600:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 9719us (10458us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429282.036702:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1337 00002000:00100000:1.0:1789429282.036716:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (335872->372735) req@ffff946f1191d500 x1876351634921600/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/440 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.036727:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191d500 with x1876351634921600 ext(335872->372735) 00010000:00010000:1.0:1789429282.036738:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 17 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.036757:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 17 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.036766:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191d500 00000100:00100000:2.0:1789429282.040578:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.040881:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634921728 00000100:00100000:3.0:1789429282.040891:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634921728 00000100:00100000:3.0:1789429282.040952:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5624 00000100:00100000:3.0:1789429282.040962:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634921728:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429282.040979:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429282.040996:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bed4 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.041028:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(266 257) 00010000:00010000:3.0:1789429282.041037:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.041045:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(1 266) 00010000:00010000:3.0:1789429282.041050:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.041093:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.041108:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.041128:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429282.041197:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634921728:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 236us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.041243:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5624 00000100:00100000:3.0:1789429282.041712:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.042375:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634921856 00000100:00100000:0.0:1789429282.042394:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634921856 00010000:00010000:0.0:1789429282.042433:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 18 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.042473:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6055 00000100:00100000:0.0:1789429282.042482:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634921856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429282.042495:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429282.042520:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 18 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.042534:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 18 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.042562:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad72636027b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bec6 expref: 18 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.042580:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 266) 00010000:00010000:0.0:1789429282.042584:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 266) 00010000:00010000:0.0:1789429282.042593:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.042604:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.042638:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.042652:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 22 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.042666:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1191d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648311040:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429282.042759:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515540 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.052558:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.052696:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634921984 00000100:00100000:0.0:1789429282.052707:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634921984 00002000:00100000:0.0:1789429282.052755:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946e0265d180 x1876351634921984/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.052765:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d180 with x1876351634921984 ext(335872->339967) 00010000:00010000:0.0:1789429282.052774:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 23 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.052790:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 23 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.052797:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265d180 00000100:00100000:0.0:1789429282.052833:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1338 00000100:00100000:0.0:1789429282.052842:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634921984:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429282.053023:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634921984:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 180us (474us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429282.053030:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1338 00002000:00100000:0.0:1789429282.053037:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946e0265d180 x1876351634921984/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.053045:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d180 with x1876351634921984 ext(335872->339967) 00010000:00010000:0.0:1789429282.053050:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 23 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.053062:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 23 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.053074:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265d180 00000100:00100000:2.0:1789429282.062340:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1191d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648311040:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429282.062369:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429282.062434:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634921856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 19953us (20723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.062445:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6055 00000100:00100000:3.0:1789429282.071175:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.071262:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.071386:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634922240 00000100:00100000:1.0:1789429282.071395:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634922240 00000100:00100000:1.0:1789429282.071441:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5625 00000100:00100000:1.0:1789429282.071450:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+23:33927:x1876351634922240:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.071465:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.071482:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bedb expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.071512:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(2 266) 00010000:00010000:1.0:1789429282.071519:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.071527:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(3 266) 00010000:00010000:1.0:1789429282.071533:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.071576:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.071590:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.071602:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429282.071656:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+24:33927:x1876351634922240:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 207us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.071663:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5625 00000100:00100000:2.0:1789429282.071866:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634922112 00000100:00100000:2.0:1789429282.071871:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634922112 00010000:00010000:2.0:1789429282.071901:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 24 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.071927:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6056 00000100:00100000:2.0:1789429282.071934:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+24:2369:x1876351634922112:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429282.071943:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429282.071961:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 24 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.071979:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 24 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.071999:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360282 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1becd expref: 24 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.072014:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 266) 00010000:00010000:2.0:1789429282.072017:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 266) 00010000:00010000:2.0:1789429282.072025:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.072034:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.072055:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.072068:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 16 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.072082:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3407b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648311296:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429282.072300:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f5733c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429282.080978:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3407b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648311296:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429282.081010:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429282.081072:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351634922112:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9137us (9912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.081083:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6056 00000100:00100000:0.0:1789429282.084046:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.084138:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634922368 00000100:00100000:1.0:1789429282.084166:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634922368 00010000:00010000:1.0:1789429282.084240:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 17 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.084281:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6057 00000100:00100000:1.0:1789429282.084292:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2368:x1876351634922368:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429282.084309:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429282.085181:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 17 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.085231:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 17 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.085262:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad726360289 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bed4 expref: 17 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.085281:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 266) 00010000:00010000:1.0:1789429282.085285:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 266) 00010000:00010000:1.0:1789429282.085294:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.085303:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.085356:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.085372:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648311424:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429282.085442:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.088809:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648311424:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.088836:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429282.088895:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351634922368:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4604us (4857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.088905:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6057 00000100:00100000:0.0:1789429282.091393:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.091610:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634922496 00000100:00100000:3.0:1789429282.091619:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634922496 00002000:00100000:3.0:1789429282.091664:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f1191c380 x1876351634922496/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.091676:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191c380 with x1876351634922496 ext(335872->339967) 00002000:00010000:3.0:1789429282.091682:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1191c380 00000100:00100000:3.0:1789429282.091715:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11390 00000100:00100000:3.0:1789429282.091725:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634922496:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429282.091931:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634922496:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 207us (546us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429282.091938:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11390 00002000:00100000:3.0:1789429282.091945:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f1191c380 x1876351634922496/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.091953:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191c380 with x1876351634922496 ext(335872->339967) 00002000:00010000:3.0:1789429282.091957:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1191c380 00000100:00100000:0.0:1789429282.097369:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.097472:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634922624 00000100:00100000:1.0:1789429282.097483:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634922624 00000100:00100000:1.0:1789429282.097536:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5626 00000100:00100000:1.0:1789429282.097546:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634922624:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.097563:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.097580:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360297 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bee2 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.097611:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.097621:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(4 266) 00010000:00010000:1.0:1789429282.097625:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 266) 00010000:00010000:1.0:1789429282.097630:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360297 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee2 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.097663:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.097676:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 22 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.097690:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648311552:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429282.097768:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.101872:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648311552:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.101909:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360297 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee2 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.101937:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:1.0:1789429282.102001:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634922624:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4456us (4640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.102010:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5626 00000100:00100000:3.0:1789429282.108106:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.108144:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.108312:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634922752 00000100:00100000:2.0:1789429282.108323:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634922752 00002000:00100000:2.0:1789429282.108382:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946e0265c700 x1876351634922752/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 4584/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.108394:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265c700 with x1876351634922752 ext(335872->339967) 00010000:00010000:2.0:1789429282.108403:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 23 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.108418:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 23 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.108427:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265c700 00000100:00100000:2.0:1789429282.108457:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634922880 00000100:00100000:2.0:1789429282.108461:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634922880 00002000:00100000:2.0:1789429282.108478:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff946e0265f100 x1876351634922880/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.108486:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265f100 with x1876351634922880 ext(339968->344063) 00010000:00010000:2.0:1789429282.108491:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 24 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.108501:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 24 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.108524:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265f100 00000100:00100000:2.0:1789429282.108545:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1339 00000100:00100000:2.0:1789429282.108554:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+24:2371:x1876351634922752:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429282.108916:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634922752:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 362us (818us total) trans 4294969566 rc 0/0 00000100:00100000:2.0:1789429282.108925:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1339 00002000:00100000:2.0:1789429282.108932:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946e0265c700 x1876351634922752/t4294969566(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 4584/448 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.108941:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265c700 with x1876351634922752 ext(335872->339967) 00010000:00010000:2.0:1789429282.108947:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 26 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.108958:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 26 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.108965:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265c700 00000100:00100000:2.0:1789429282.108981:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1340 00000100:00100000:2.0:1789429282.108987:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+25:2368:x1876351634922880:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429282.109065:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+25:2368:x1876351634922880:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 77us (920us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429282.109072:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1340 00002000:00100000:2.0:1789429282.109078:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff946e0265f100 x1876351634922880/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.109087:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265f100 with x1876351634922880 ext(339968->344063) 00010000:00010000:2.0:1789429282.109092:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 25 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.109103:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 25 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.109110:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265f100 00000100:00100000:0.0:1789429282.116376:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.116473:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634923008 00000100:00100000:1.0:1789429282.116483:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634923008 00000100:00100000:1.0:1789429282.116557:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5627 00000100:00100000:1.0:1789429282.116566:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:33927:x1876351634923008:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.116584:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.116608:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bee9 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.116640:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(5 266) 00010000:00010000:1.0:1789429282.116645:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 266) 00010000:00010000:1.0:1789429282.116651:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.116664:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.116678:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429282.116741:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634923008:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 176us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.116748:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5627 00000100:00100000:3.0:1789429282.118608:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.118771:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634923136 00000100:00100000:1.0:1789429282.118781:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634923136 00010000:00010000:1.0:1789429282.118815:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 26 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.118861:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6058 00000100:00100000:1.0:1789429282.118871:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2370:x1876351634923136:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429282.118886:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429282.118906:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1789429281 -> 1789429282 00002000:00010000:1.0:1789429282.118909:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1789429281 -> 1789429282 00010000:00010000:1.0:1789429282.118916:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 26 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.118930:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 26 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.118953:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360290 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [335872->18446744073709551615] (req 335872->339967) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bedb expref: 26 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.118971:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 266) 00010000:00010000:1.0:1789429282.118976:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 266) 00010000:00010000:1.0:1789429282.119045:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360297 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee2 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.119055:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360297 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee2 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.119071:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 266) 00010000:00010000:1.0:1789429282.119074:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 266) 00010000:00010000:1.0:1789429282.119079:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.119088:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.119128:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.119142:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648311680:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.120359:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360297 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee2 expref: 16 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.120371:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648311808:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429282.120393:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.122639:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648311680:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429282.122654:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648311808:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.122679:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429282.122731:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634923136:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3861us (4131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.122742:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6058 00000100:00100000:0.0:1789429282.127129:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.137887:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634923264 00000100:00100000:2.0:1789429282.137906:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634923264 00002000:00100000:2.0:1789429282.137968:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f3b323800 x1876351634923264/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.137991:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b323800 with x1876351634923264 ext(335872->339967) 00002000:00010000:2.0:1789429282.137998:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b323800 00000100:00100000:2.0:1789429282.138026:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11391 00000100:00100000:2.0:1789429282.138035:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634923264:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429282.138428:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634923264:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 392us (11307us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429282.138436:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11391 00002000:00100000:2.0:1789429282.138444:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (335872->339967) req@ffff946f3b323800 x1876351634923264/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.138454:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b323800 with x1876351634923264 ext(335872->339967) 00002000:00010000:2.0:1789429282.138458:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b323800 00000100:00100000:3.0:1789429282.140661:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.141291:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634923392 00000100:00100000:2.0:1789429282.141304:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634923392 00002000:00100000:2.0:1789429282.141353:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff946e0265fb80 x1876351634923392/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.141364:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265fb80 with x1876351634923392 ext(339968->344063) 00002000:00010000:2.0:1789429282.141370:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e0265fb80 00000100:00100000:2.0:1789429282.141405:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11392 00000100:00100000:2.0:1789429282.141415:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634923392:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429282.141619:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634923392:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 205us (1114us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429282.141627:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11392 00002000:00100000:2.0:1789429282.141634:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff946e0265fb80 x1876351634923392/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.141642:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265fb80 with x1876351634923392 ext(339968->344063) 00002000:00010000:2.0:1789429282.141646:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e0265fb80 00000100:00100000:1.0:1789429282.148612:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.148662:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.148858:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634923648 00000100:00100000:3.0:1789429282.148869:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634923648 00002000:00100000:3.0:1789429282.148918:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f0822b800 x1876351634923648/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.148929:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0822b800 with x1876351634923648 ext(344064->348159) 00002000:00010000:3.0:1789429282.148935:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f0822b800 00000100:00100000:2.0:1789429282.149069:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634923520 00000100:00100000:2.0:1789429282.149074:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634923520 00000100:00100000:2.0:1789429282.149122:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5628 00000100:00100000:2.0:1789429282.149133:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634923520:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.149148:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.149174:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263602a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bef0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.149234:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.149251:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(6 266) 00010000:00010000:2.0:1789429282.149256:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 266) 00010000:00010000:2.0:1789429282.149261:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263602a5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef0 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.149303:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.149317:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 25 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.149331:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3407b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648311936:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429282.149405:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573540 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.150280:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1341 00000100:00100000:1.0:1789429282.150296:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2368:x1876351634923648:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429282.155252:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:2368:x1876351634923648:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4952us (6579us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429282.155265:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1341 00002000:00100000:0.0:1789429282.155277:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f0822b800 x1876351634923648/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.155288:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0822b800 with x1876351634923648 ext(344064->348159) 00010000:00010000:0.0:1789429282.155299:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 25 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.155320:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 25 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.155330:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f0822b800 00000100:00100000:1.0:1789429282.168828:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.168868:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634923776 00000100:00100000:1.0:1789429282.168878:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634923776 00002000:00100000:1.0:1789429282.168924:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff946f0822b100 x1876351634923776/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 4584/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.168936:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0822b100 with x1876351634923776 ext(339968->344063) 00010000:00010000:1.0:1789429282.168945:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 25 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.168963:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 25 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.168972:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f0822b100 00000100:00100000:1.0:1789429282.168998:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1342 00000100:00100000:1.0:1789429282.169008:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634923776:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1789429282.169437:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634923776:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 428us (617us total) trans 4294969567 rc 0/0 00000100:00100000:1.0:1789429282.169446:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1342 00002000:00100000:1.0:1789429282.169454:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff946f0822b100 x1876351634923776/t4294969567(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 4584/448 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.169469:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0822b100 with x1876351634923776 ext(339968->344063) 00010000:00010000:1.0:1789429282.169475:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 27 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.169487:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 27 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.169495:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f0822b100 00000100:00100000:1.0:1789429282.169894:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3407b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648311936:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.169921:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263602a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef0 expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.169939:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547800, rc 0) 00000100:00100000:1.0:1789429282.169976:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634923520:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 20845us (21374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.169984:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5628 00000100:00100000:0.0:1789429282.178344:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.178405:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.178532:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634924032 00000100:00100000:2.0:1789429282.178533:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634923904 00000100:00100000:1.0:1789429282.178543:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634924032 00000100:00100000:2.0:1789429282.178543:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634923904 00010000:00010000:1.0:1789429282.178587:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 28 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.178601:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5629 00000100:00100000:2.0:1789429282.178612:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634923904:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.178628:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.178649:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bef7 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.178670:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6059 00010000:00010000:2.0:1789429282.178677:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(7 266) 00010000:00010000:2.0:1789429282.178684:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 266) 00000100:00100000:3.0:1789429282.178685:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:2368:x1876351634924032:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429282.178695:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 29 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.178701:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429282.178714:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 29 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.178729:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546600, rc 0) 00010000:00010000:3.0:1789429282.178735:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 29 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.178753:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 29 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.178778:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad72636029e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [339968->18446744073709551615] (req 339968->344063) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee9 expref: 29 pid: 20986 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.178797:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 266) 00000100:00100000:2.0:1789429282.178802:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634923904:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 189us (465us total) trans 0 rc 0/0 00010000:00010000:3.0:1789429282.178803:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 266) 00000100:00100000:2.0:1789429282.178814:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5629 00010000:00010000:3.0:1789429282.178818:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263602a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef0 expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.178837:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263602a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef0 expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.178850:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 266) 00010000:00010000:3.0:1789429282.178853:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 266) 00010000:00010000:3.0:1789429282.178859:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 27 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.178869:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 27 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.178948:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 27 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.178963:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3407b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648312064:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429282.179019:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263602a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef0 expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.179030:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648312192:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429282.179054:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429282.193250:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3407b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648312064:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429282.195288:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648312192:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429282.195320:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429282.195381:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634924032:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 16701us (16974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.195392:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6059 00000100:00100000:3.0:1789429282.196656:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.196811:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634924160 00000100:00100000:0.0:1789429282.196819:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634924160 00002000:00100000:0.0:1789429282.196861:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff946e0265e300 x1876351634924160/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.196872:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265e300 with x1876351634924160 ext(339968->344063) 00002000:00010000:0.0:1789429282.196878:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e0265e300 00000100:00100000:0.0:1789429282.196909:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11394 00000100:00100000:0.0:1789429282.196917:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634924160:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429282.197441:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634924160:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 523us (789us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429282.197450:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11394 00002000:00100000:0.0:1789429282.197458:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (339968->344063) req@ffff946e0265e300 x1876351634924160/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.197466:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265e300 with x1876351634924160 ext(339968->344063) 00002000:00010000:0.0:1789429282.197470:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e0265e300 00000100:00100000:2.0:1789429282.205502:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.205586:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.205692:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634924416 00000100:00100000:3.0:1789429282.205702:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634924416 00002000:00100000:3.0:1789429282.205755:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f3407b480 x1876351634924416/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.205767:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407b480 with x1876351634924416 ext(344064->348159) 00002000:00010000:3.0:1789429282.205773:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3407b480 00000100:00100000:3.0:1789429282.205803:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11395 00000100:00100000:3.0:1789429282.205813:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634924416:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429282.206012:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634924416:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 199us (425us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429282.206020:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11395 00002000:00100000:3.0:1789429282.206027:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f3407b480 x1876351634924416/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.206036:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407b480 with x1876351634924416 ext(344064->348159) 00002000:00010000:3.0:1789429282.206040:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3407b480 00000100:00100000:1.0:1789429282.206836:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634924288 00000100:00100000:1.0:1789429282.206845:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634924288 00000100:00100000:1.0:1789429282.206893:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5630 00000100:00100000:1.0:1789429282.206902:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634924288:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.206915:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.206935:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1befe expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.206968:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.206978:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(8 266) 00010000:00010000:1.0:1789429282.206982:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 266) 00010000:00010000:1.0:1789429282.206987:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.207125:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.207143:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 26 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.207234:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648312320:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429282.207310:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429282.211565:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.211733:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634924544 00000100:00100000:3.0:1789429282.211744:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634924544 00000100:00100000:3.0:1789429282.211796:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5631 00000100:00100000:3.0:1789429282.211805:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634924544:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429282.211823:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429282.211843:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf05 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.211874:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(9 266) 00010000:00010000:3.0:1789429282.211883:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.211891:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(10 266) 00010000:00010000:3.0:1789429282.211897:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.211935:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648312320:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429282.211941:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.211959:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.211964:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.211991:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00010000:00010000:3.0:1789429282.211995:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:1.0:1789429282.212056:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634924288:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5154us (6563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.212064:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5630 00000100:00100000:3.0:1789429282.215403:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634924544:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3587us (3837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.215416:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5631 00000100:00100000:0.0:1789429282.215680:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.215840:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634924672 00000100:00100000:3.0:1789429282.215850:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634924672 00010000:00010000:3.0:1789429282.215883:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 28 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.215922:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6060 00000100:00100000:3.0:1789429282.215931:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:2371:x1876351634924672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.215943:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.215965:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 28 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.216042:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 28 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.216069:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef7 expref: 28 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.216086:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 266) 00010000:00010000:3.0:1789429282.216091:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 266) 00010000:00010000:3.0:1789429282.216100:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.216112:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.216342:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.216355:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 18 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.216369:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648312576:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.216433:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.221697:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648312576:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.221724:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.221781:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634924672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5850us (6101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.221792:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6060 00000100:00100000:2.0:1789429282.234044:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.234296:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634924800 00000100:00100000:0.0:1789429282.234305:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634924800 00002000:00100000:0.0:1789429282.234356:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f1c00aa00 x1876351634924800/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.234368:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00aa00 with x1876351634924800 ext(344064->380927) 00010000:00010000:0.0:1789429282.234378:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 19 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.234398:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 19 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.234414:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c00aa00 00000100:00100000:0.0:1789429282.234446:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1343 00000100:00100000:0.0:1789429282.234455:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634924800:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429282.246060:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634924800:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 11595us (12014us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429282.246073:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1343 00002000:00100000:3.0:1789429282.246086:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f1c00aa00 x1876351634924800/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/440 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.246096:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00aa00 with x1876351634924800 ext(344064->380927) 00010000:00010000:3.0:1789429282.246107:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 19 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.246124:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 19 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429282.246131:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c00aa00 00000100:00100000:0.0:1789429282.256681:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.257118:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634924928 00000100:00100000:1.0:1789429282.257129:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634924928 00000100:00100000:1.0:1789429282.258114:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5632 00000100:00100000:1.0:1789429282.258128:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634924928:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.258162:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.258182:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf0c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.258228:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(11 266) 00010000:00010000:1.0:1789429282.258237:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.258244:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(12 266) 00010000:00010000:1.0:1789429282.258250:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.258288:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.258300:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 20 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.258313:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429282.258365:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634924928:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 241us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.258371:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5632 00000100:00100000:3.0:1789429282.259591:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.259674:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634925056 00000100:00100000:1.0:1789429282.259683:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634925056 00010000:00010000:1.0:1789429282.259714:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 20 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.259756:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6061 00000100:00100000:1.0:1789429282.259765:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351634925056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429282.259778:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429282.259802:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 20 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.259815:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 20 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.259838:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1befe expref: 20 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.259854:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 266) 00010000:00010000:1.0:1789429282.259858:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 266) 00010000:00010000:1.0:1789429282.259866:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.259876:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.259910:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.259923:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 26 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.259936:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648312832:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429282.260022:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.266774:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648312832:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.266801:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429282.266858:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2369:x1876351634925056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7093us (7271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.266869:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6061 00000100:00100000:0.0:1789429282.267379:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.267443:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634925184 00000100:00100000:1.0:1789429282.267450:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634925184 00010000:00010000:1.0:1789429282.267483:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.267520:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6062 00000100:00100000:1.0:1789429282.267530:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634925184:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429282.267546:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429282.267569:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.267589:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.267615:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad7263602ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf05 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.267631:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 266) 00010000:00010000:1.0:1789429282.267636:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 266) 00010000:00010000:1.0:1789429282.267645:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.267656:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.267692:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.267708:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648312960:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429282.267775:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.270510:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648312960:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.270538:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429282.270588:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634925184:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3058us (3210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.270602:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6062 00000100:00100000:0.0:1789429282.281564:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.281657:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634925312 00000100:00100000:1.0:1789429282.281668:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634925312 00000100:00100000:1.0:1789429282.281725:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5633 00000100:00100000:1.0:1789429282.281735:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634925312:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.281751:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.281770:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf13 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.281804:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.281815:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(13 266) 00010000:00010000:1.0:1789429282.281819:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 266) 00010000:00010000:1.0:1789429282.281824:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.281856:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 18 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.281870:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 18 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.281883:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648313088:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429282.281965:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429282.286047:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.286824:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634925440 00000100:00100000:3.0:1789429282.286835:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634925440 00002000:00100000:3.0:1789429282.286888:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f1c009500 x1876351634925440/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.286900:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c009500 with x1876351634925440 ext(344064->380927) 00010000:00010000:3.0:1789429282.286908:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 19 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.286925:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 19 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429282.286933:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c009500 00000100:00100000:3.0:1789429282.286966:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1344 00000100:00100000:3.0:1789429282.286975:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634925440:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429282.288578:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648313088:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429282.288613:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.288633:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:2.0:1789429282.288694:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634925312:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6960us (7138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.288704:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5633 00000100:00100000:3.0:1789429282.298799:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634925440:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 11812us (12750us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429282.298814:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1344 00002000:00100000:3.0:1789429282.298828:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f1c009500 x1876351634925440/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/440 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.298838:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c009500 with x1876351634925440 ext(344064->380927) 00010000:00010000:3.0:1789429282.298850:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 19 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.298869:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 19 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429282.298876:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c009500 00000100:00100000:2.0:1789429282.314884:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.315236:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634925568 00000100:00100000:0.0:1789429282.315246:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634925568 00000100:00100000:0.0:1789429282.315305:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5634 00000100:00100000:0.0:1789429282.315315:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634925568:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429282.315334:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429282.315353:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf1a expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.315382:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(14 266) 00010000:00010000:0.0:1789429282.315390:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.315397:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(15 266) 00010000:00010000:0.0:1789429282.315402:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.315442:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.315460:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.315472:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429282.315538:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634925568:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 224us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429282.315546:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5634 00000100:00100000:2.0:1789429282.316046:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.316140:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634925696 00000100:00100000:0.0:1789429282.316145:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634925696 00010000:00010000:0.0:1789429282.316176:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 20 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.316225:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6063 00000100:00100000:0.0:1789429282.316233:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634925696:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429282.316242:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429282.316263:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 20 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.316276:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 20 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.316299:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263602c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf0c expref: 20 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.316319:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 266) 00010000:00010000:0.0:1789429282.316323:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 266) 00010000:00010000:0.0:1789429282.316330:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.316339:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.316363:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.316375:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 26 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.316387:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648313344:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429282.316441:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.323364:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648313344:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.323389:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.323446:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634925696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7213us (7400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.323457:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6063 00000100:00100000:3.0:1789429282.334973:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.335079:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634925824 00000100:00100000:2.0:1789429282.335090:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634925824 00002000:00100000:2.0:1789429282.335137:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946e0265c380 x1876351634925824/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.335165:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265c380 with x1876351634925824 ext(344064->348159) 00010000:00010000:2.0:1789429282.335176:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.335196:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.335244:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265c380 00000100:00100000:2.0:1789429282.335269:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1345 00000100:00100000:2.0:1789429282.335278:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634925824:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429282.335496:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634925824:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 218us (533us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429282.335504:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1345 00002000:00100000:2.0:1789429282.335511:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946e0265c380 x1876351634925824/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.335520:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265c380 with x1876351634925824 ext(344064->348159) 00010000:00010000:2.0:1789429282.335525:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.335538:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.335544:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265c380 00000100:00100000:2.0:1789429282.342834:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.343047:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634925952 00000100:00100000:3.0:1789429282.343056:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634925952 00000100:00100000:3.0:1789429282.343111:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5635 00000100:00100000:3.0:1789429282.343121:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634925952:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429282.343138:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429282.343168:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf21 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.343236:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(16 266) 00010000:00010000:3.0:1789429282.343246:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.343254:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(17 266) 00010000:00010000:3.0:1789429282.343259:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.343297:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.343312:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.343326:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429282.343377:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634925952:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 258us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.343384:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5635 00000100:00100000:1.0:1789429282.354740:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.354994:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634926080 00000100:00100000:3.0:1789429282.355005:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634926080 00010000:00010000:3.0:1789429282.355045:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 28 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.355088:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6064 00000100:00100000:3.0:1789429282.355097:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:2370:x1876351634926080:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.355113:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.355135:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 28 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.355303:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 28 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.355328:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263602c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf13 expref: 28 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.355345:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 266) 00010000:00010000:3.0:1789429282.355350:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 266) 00010000:00010000:3.0:1789429282.355369:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.355379:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.355420:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.355434:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 18 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.355448:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648313600:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.355525:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429282.360640:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.360713:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634926208 00000100:00100000:1.0:1789429282.360722:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634926208 00010000:00010000:1.0:1789429282.360761:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.360802:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6065 00000100:00100000:1.0:1789429282.360811:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2369:x1876351634926208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429282.360826:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429282.360849:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.360862:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.360888:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 266) 00010000:00010000:1.0:1789429282.360893:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 266) 00010000:00010000:1.0:1789429282.360903:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.360913:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.360954:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.360973:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648313728:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429282.361290:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789429282.361429:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263602cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf1a expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.361451:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648313600:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.361543:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.361575:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634926080:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6478us (6844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.361584:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6064 00000100:00100000:1.0:1789429282.364317:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648313728:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.364345:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429282.364686:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2369:x1876351634926208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3873us (4054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429282.364698:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6065 00000100:00100000:0.0:1789429282.372884:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.373400:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634926336 00000100:00100000:2.0:1789429282.373412:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634926336 00000100:00100000:2.0:1789429282.373468:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5636 00000100:00100000:2.0:1789429282.373478:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634926336:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.373496:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.373514:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf28 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.373548:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.373559:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(18 266) 00010000:00010000:2.0:1789429282.373564:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 266) 00010000:00010000:2.0:1789429282.373569:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.373599:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.373613:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 26 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.373627:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648313856:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429282.373706:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573180 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.379936:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.380376:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634926464 00000100:00100000:0.0:1789429282.380386:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634926464 00002000:00100000:0.0:1789429282.380436:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946e0265d500 x1876351634926464/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.380449:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d500 with x1876351634926464 ext(344064->348159) 00010000:00010000:0.0:1789429282.380458:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.380474:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.380482:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265d500 00000100:00100000:0.0:1789429282.380510:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1346 00000100:00100000:0.0:1789429282.380520:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634926464:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429282.380720:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634926464:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 201us (792us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429282.380728:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1346 00002000:00100000:0.0:1789429282.380736:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946e0265d500 x1876351634926464/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.380745:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d500 with x1876351634926464 ext(344064->348159) 00010000:00010000:0.0:1789429282.380751:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.380763:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.380771:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265d500 00000100:00100000:2.0:1789429282.382456:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648313856:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429282.382491:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.382511:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547e00, rc 0) 00000100:00100000:2.0:1789429282.382588:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634926336:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9110us (9713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.382597:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5636 00000100:00100000:3.0:1789429282.391769:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.391809:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.391899:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634926720 00000100:00100000:1.0:1789429282.391909:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634926720 00010000:00010000:1.0:1789429282.391945:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.391991:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6066 00000100:00100000:1.0:1789429282.392002:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:2369:x1876351634926720:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429282.392017:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429282.392039:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.392054:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.392077:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263602d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf21 expref: 27 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.392095:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 266) 00010000:00010000:1.0:1789429282.392100:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 266) 00010000:00010000:1.0:1789429282.392109:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.392120:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.392175:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.392191:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648313984:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429282.392317:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429282.393129:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634926592 00000100:00100000:2.0:1789429282.393146:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634926592 00000100:00100000:2.0:1789429282.393228:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5637 00000100:00100000:2.0:1789429282.393237:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634926592:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.393250:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.393266:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf2f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.393292:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.393301:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(19 266) 00010000:00010000:2.0:1789429282.393305:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 266) 00010000:00010000:2.0:1789429282.393310:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.393335:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.393348:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 18 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.393360:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648314112:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429282.393419:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.395715:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648313984:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.395741:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429282.395791:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+28:2369:x1876351634926720:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3790us (3978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.395801:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6066 00000100:00100000:2.0:1789429282.400134:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648314112:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429282.400179:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.400235:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546800, rc 0) 00000100:00100000:2.0:1789429282.400304:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634926592:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7068us (8543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.400313:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5637 00000100:00100000:3.0:1789429282.402471:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.402565:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634926848 00000100:00100000:2.0:1789429282.402573:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634926848 00002000:00100000:2.0:1789429282.402621:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946e0265d880 x1876351634926848/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.402633:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d880 with x1876351634926848 ext(344064->380927) 00010000:00010000:2.0:1789429282.402641:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 19 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.402657:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 19 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.402665:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265d880 00000100:00100000:2.0:1789429282.402697:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1347 00000100:00100000:2.0:1789429282.402706:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634926848:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429282.407426:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634926848:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4708us (4963us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429282.407440:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1347 00002000:00100000:2.0:1789429282.407452:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946e0265d880 x1876351634926848/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/440 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.407469:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d880 with x1876351634926848 ext(344064->380927) 00010000:00010000:2.0:1789429282.407479:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 19 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.407497:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 19 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.407506:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265d880 00000100:00100000:0.0:1789429282.413454:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.413549:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634926976 00000100:00100000:1.0:1789429282.413559:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634926976 00000100:00100000:1.0:1789429282.413624:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5638 00000100:00100000:1.0:1789429282.413634:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634926976:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.413653:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.413671:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf36 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.413702:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(20 266) 00010000:00010000:1.0:1789429282.413711:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.413719:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(21 266) 00010000:00010000:1.0:1789429282.413725:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.413762:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.413776:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.413788:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429282.413846:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634926976:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 213us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.413853:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5638 00000100:00100000:1.0:1789429282.418530:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.418783:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634927104 00000100:00100000:3.0:1789429282.418795:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634927104 00010000:00010000:3.0:1789429282.418837:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.418881:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6067 00000100:00100000:3.0:1789429282.418891:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351634927104:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.418905:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.418929:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.418942:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.418966:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263602dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf28 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.418997:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 266) 00010000:00010000:3.0:1789429282.419001:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 266) 00010000:00010000:3.0:1789429282.419009:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.419018:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.419058:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.419071:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 26 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.419085:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1191ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648314368:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.421175:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429282.426740:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.426820:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634927232 00000100:00100000:1.0:1789429282.426830:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634927232 00010000:00010000:1.0:1789429282.426867:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.426908:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6068 00000100:00100000:1.0:1789429282.426917:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:2369:x1876351634927232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429282.426932:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429282.426953:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.426968:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.427004:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 266) 00010000:00010000:1.0:1789429282.427008:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 266) 00010000:00010000:1.0:1789429282.427016:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.427026:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.427063:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 19 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.427078:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648314496:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429282.427172:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789429282.427591:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad7263602e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf2f expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.427608:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1191ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648314368:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.427626:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.427668:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2369:x1876351634927104:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8777us (9154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.427679:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6067 00000100:00100000:1.0:1789429282.432177:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648314496:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.432253:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429282.432309:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2369:x1876351634927232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5392us (5578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.432321:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6068 00000100:00100000:1.0:1789429282.439643:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.439743:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634927360 00000100:00100000:2.0:1789429282.439755:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634927360 00000100:00100000:2.0:1789429282.439814:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5639 00000100:00100000:2.0:1789429282.439824:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634927360:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.439842:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.439861:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf3d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.439895:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.439905:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(22 266) 00010000:00010000:2.0:1789429282.439909:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 266) 00010000:00010000:2.0:1789429282.439914:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.439949:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.439963:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 18 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.439977:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648314624:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429282.440072:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573180 going to sleep for 11 seconds 00000100:00100000:2.0:1789429282.454458:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.456606:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634927488 00000100:00100000:1.0:1789429282.456622:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634927488 00002000:00100000:1.0:1789429282.456672:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f2f4e1180 x1876351634927488/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.456683:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e1180 with x1876351634927488 ext(344064->380927) 00010000:00010000:1.0:1789429282.456693:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 19 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.456710:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 19 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.456717:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e1180 00000100:00100000:1.0:1789429282.456747:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1348 00000100:00100000:1.0:1789429282.456755:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634927488:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429282.465373:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648314624:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429282.465406:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.465430:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546600, rc 0) 00000100:00100000:2.0:1789429282.465493:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634927360:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 25669us (25860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.465503:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5639 00000100:00100000:1.0:1789429282.476647:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634927488:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 19881us (22187us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429282.476661:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1348 00002000:00100000:1.0:1789429282.476676:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f2f4e1180 x1876351634927488/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/440 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.476687:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f4e1180 with x1876351634927488 ext(344064->380927) 00010000:00010000:1.0:1789429282.476698:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 19 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.476718:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 19 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.476735:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f4e1180 00000100:00100000:3.0:1789429282.483263:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.483311:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.483398:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634927616 00000100:00100000:2.0:1789429282.483408:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634927616 00000100:00100000:2.0:1789429282.483466:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5640 00000100:00100000:2.0:1789429282.483476:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634927616:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.483494:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.483527:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf44 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.483564:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(23 266) 00010000:00010000:2.0:1789429282.483573:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.483581:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(24 266) 00010000:00010000:2.0:1789429282.483587:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 20 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.483628:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.483644:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 20 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.483656:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429282.483721:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634927616:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 245us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.483728:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5640 00000100:00100000:0.0:1789429282.483852:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634927744 00000100:00100000:0.0:1789429282.483856:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634927744 00010000:00010000:0.0:1789429282.483877:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 20 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.483909:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6069 00000100:00100000:0.0:1789429282.483916:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351634927744:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429282.483926:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429282.483948:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 20 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.483960:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 20 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.483981:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad7263602eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf36 expref: 20 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.483993:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 266) 00010000:00010000:0.0:1789429282.483997:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 266) 00010000:00010000:0.0:1789429282.484003:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.484011:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.484038:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.484050:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 26 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.484062:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05422d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648314880:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429282.484110:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429282.488863:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05422d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648314880:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429282.488891:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429282.488953:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2368:x1876351634927744:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5035us (5639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.488966:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6069 00000100:00100000:3.0:1789429282.500172:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.501091:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634927872 00000100:00100000:1.0:1789429282.501103:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634927872 00002000:00100000:1.0:1789429282.501261:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f3f8da300 x1876351634927872/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.501272:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8da300 with x1876351634927872 ext(344064->348159) 00010000:00010000:1.0:1789429282.501282:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.501299:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.501307:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8da300 00000100:00100000:1.0:1789429282.501388:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1349 00000100:00100000:1.0:1789429282.501398:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634927872:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429282.501862:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634927872:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 463us (1706us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429282.501870:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1349 00002000:00100000:1.0:1789429282.501878:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f3f8da300 x1876351634927872/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.501886:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8da300 with x1876351634927872 ext(344064->348159) 00010000:00010000:1.0:1789429282.501892:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.501904:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.501911:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8da300 00000100:00100000:3.0:1789429282.509514:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.509563:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.509598:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634928000 00000100:00100000:2.0:1789429282.509610:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634928000 00000100:00100000:2.0:1789429282.509715:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5641 00000100:00100000:2.0:1789429282.509725:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634928000:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.509744:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.509760:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf4b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.509793:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(25 266) 00010000:00010000:2.0:1789429282.509802:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.509809:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(26 266) 00000100:00100000:0.0:1789429282.509810:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634928128 00000100:00100000:0.0:1789429282.509817:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634928128 00010000:00010000:2.0:1789429282.509817:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.509847:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 29 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.509862:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.509878:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.509882:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6070 00000100:00100000:0.0:1789429282.509894:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634928128:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429282.509898:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547000, rc 0) 00010000:00010000:0.0:1789429282.509906:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429282.509928:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 29 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.509941:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 29 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.509962:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad7263602f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf3d expref: 29 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.509969:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634928000:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 243us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.509979:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5641 00010000:00010000:0.0:1789429282.509998:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 266) 00010000:00010000:0.0:1789429282.510113:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 266) 00010000:00010000:0.0:1789429282.510125:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.510136:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.510180:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.510195:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 18 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.510248:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05423b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648315136:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429282.522090:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429282.527619:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.527790:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634928256 00000100:00100000:3.0:1789429282.527800:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634928256 00010000:00010000:3.0:1789429282.527842:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 19 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.527885:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6071 00000100:00100000:3.0:1789429282.527895:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2369:x1876351634928256:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.527911:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.527933:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 19 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.527947:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 19 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.527972:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 266) 00010000:00010000:3.0:1789429282.527977:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 266) 00010000:00010000:3.0:1789429282.528095:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.528113:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.528173:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.528188:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34071f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648315264:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.528298:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789429282.529034:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263602f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf44 expref: 19 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.529052:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05423b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648315136:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429282.529069:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429282.529112:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634928128:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 19219us (19548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429282.529125:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6070 00000100:00100000:0.0:1789429282.531027:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34071f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648315264:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429282.531050:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429282.531092:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2369:x1876351634928256:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3197us (3482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429282.531102:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6071 00000100:00100000:3.0:1789429282.537995:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.538138:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634928384 00000100:00100000:1.0:1789429282.538147:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634928384 00000100:00100000:1.0:1789429282.538241:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5642 00000100:00100000:1.0:1789429282.538252:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634928384:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.538269:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.538288:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf52 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.538319:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.538329:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(27 266) 00010000:00010000:1.0:1789429282.538333:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 266) 00010000:00010000:1.0:1789429282.538339:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.538371:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.538386:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 26 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.538400:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648315392:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429282.538483:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.543700:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.549302:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634928512 00000100:00100000:3.0:1789429282.549320:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634928512 00000100:00100000:1.0:1789429282.550185:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648315392:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.550247:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.550271:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429282.550323:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634928384:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 12073us (12348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.550332:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5642 00002000:00100000:2.0:1789429282.551504:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f119c7100 x1876351634928512/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.551522:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c7100 with x1876351634928512 ext(344064->348159) 00010000:00010000:2.0:1789429282.551530:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.551547:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.551554:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c7100 00000100:00100000:2.0:1789429282.551595:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1350 00000100:00100000:2.0:1789429282.551605:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634928512:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429282.551836:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634928512:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 232us (8145us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429282.551844:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1350 00002000:00100000:2.0:1789429282.551851:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f119c7100 x1876351634928512/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.551860:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c7100 with x1876351634928512 ext(344064->348159) 00010000:00010000:2.0:1789429282.551865:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.551877:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.551883:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f119c7100 00000100:00100000:0.0:1789429282.557727:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.557801:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.557857:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634928768 00000100:00100000:3.0:1789429282.557868:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634928768 00010000:00010000:3.0:1789429282.557902:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.557973:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6072 00000100:00100000:3.0:1789429282.557989:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634928768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.558003:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.558024:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.558037:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.558065:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360300 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf4b expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.558082:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 266) 00010000:00010000:3.0:1789429282.558087:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 266) 00010000:00010000:3.0:1789429282.558095:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.558105:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.558148:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.558169:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34070000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648315520:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.558280:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.561895:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34070000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648315520:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.561922:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.561995:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2368:x1876351634928768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4005us (4191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.562006:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6072 00000100:00100000:2.0:1789429282.562511:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634928640 00000100:00100000:2.0:1789429282.562521:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634928640 00000100:00100000:2.0:1789429282.562577:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5643 00000100:00100000:2.0:1789429282.562586:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634928640:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.562602:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.562623:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf59 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.562656:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.562667:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(28 266) 00010000:00010000:2.0:1789429282.562671:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 266) 00010000:00010000:2.0:1789429282.562676:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.562710:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.562724:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 18 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.562738:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648315648:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429282.562805:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.566303:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.566472:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648315648:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.566507:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.566530:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:1.0:1789429282.566590:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634928640:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4004us (8870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.566600:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5643 00000100:00100000:2.0:1789429282.566887:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634928896 00000100:00100000:2.0:1789429282.566895:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634928896 00002000:00100000:2.0:1789429282.566935:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f34070000 x1876351634928896/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.566945:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070000 with x1876351634928896 ext(344064->380927) 00010000:00010000:2.0:1789429282.566952:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.566967:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.566980:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34070000 00000100:00100000:2.0:1789429282.567009:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1351 00000100:00100000:2.0:1789429282.567018:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634928896:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429282.573057:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634928896:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6028us (6765us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429282.573071:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1351 00002000:00100000:2.0:1789429282.573085:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f34070000 x1876351634928896/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/440 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.573094:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070000 with x1876351634928896 ext(344064->380927) 00010000:00010000:2.0:1789429282.573104:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.573122:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.573135:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34070000 00000100:00100000:0.0:1789429282.577188:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.577268:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.577407:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634929152 00000100:00100000:3.0:1789429282.577417:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634929152 00010000:00010000:3.0:1789429282.577468:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.577509:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6073 00000100:00100000:3.0:1789429282.577518:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2369:x1876351634929152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.577532:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.577556:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.577572:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.577597:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360307 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf52 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.577615:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 266) 00010000:00010000:3.0:1789429282.577619:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 266) 00010000:00010000:3.0:1789429282.577627:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.577638:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.577677:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.577698:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648315776:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.577780:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.577847:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634929024 00000100:00100000:1.0:1789429282.577852:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634929024 00000100:00100000:1.0:1789429282.577898:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5644 00000100:00100000:1.0:1789429282.577913:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634929024:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.577928:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.577947:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf60 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.577967:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.577981:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(29 266) 00010000:00010000:1.0:1789429282.577985:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 266) 00010000:00010000:1.0:1789429282.577990:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.578020:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.578033:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 26 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.578050:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648315904:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429282.578086:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429282.582431:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.582530:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648315776:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.582552:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.582607:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351634929152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5088us (5337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.582617:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6073 00000100:00100000:3.0:1789429282.582649:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634929280 00000100:00100000:3.0:1789429282.582654:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634929280 00010000:00010000:3.0:1789429282.582680:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.582708:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6074 00000100:00100000:3.0:1789429282.582716:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634929280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.582726:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.582746:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.582759:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.582784:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 266) 00010000:00010000:3.0:1789429282.582788:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 266) 00010000:00010000:3.0:1789429282.582797:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.582807:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.582839:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.582852:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648316032:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.582896:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00010000:00010000:1.0:1789429282.583340:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad72636030e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf59 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.583356:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648315904:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.583377:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.583387:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:1.0:1789429282.583421:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634929024:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5516us (6242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.583428:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5644 00000100:00100000:3.0:1789429282.587485:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648316032:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.587510:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.587562:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+26:2370:x1876351634929280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4845us (5139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.587573:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6074 00000100:00100000:3.0:1789429282.593973:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.594087:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634929408 00000100:00100000:2.0:1789429282.594098:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634929408 00000100:00100000:2.0:1789429282.594164:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5645 00000100:00100000:2.0:1789429282.594176:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634929408:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.594193:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.594246:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf67 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.594280:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.594290:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(30 266) 00010000:00010000:2.0:1789429282.594295:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 266) 00010000:00010000:2.0:1789429282.594300:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.594335:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.594349:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 18 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.594365:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648316160:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429282.594457:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573840 going to sleep for 11 seconds 00000100:00100000:2.0:1789429282.598458:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648316160:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429282.598495:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.598518:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547600, rc 0) 00000100:00100000:2.0:1789429282.598582:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634929408:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4408us (4617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.598591:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5645 00000100:00100000:0.0:1789429282.602329:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.602541:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634929536 00000100:00100000:1.0:1789429282.602552:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634929536 00002000:00100000:1.0:1789429282.602603:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f05422d80 x1876351634929536/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.602615:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05422d80 with x1876351634929536 ext(344064->380927) 00010000:00010000:1.0:1789429282.602624:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.602642:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.602650:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05422d80 00000100:00100000:1.0:1789429282.602682:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1352 00000100:00100000:1.0:1789429282.602691:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634929536:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429282.608138:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634929536:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5438us (5810us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429282.608159:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1352 00002000:00100000:1.0:1789429282.608170:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f05422d80 x1876351634929536/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/440 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.608188:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05422d80 with x1876351634929536 ext(344064->380927) 00010000:00010000:1.0:1789429282.608215:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.608235:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.608792:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05422d80 00000100:00100000:0.0:1789429282.611403:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.611524:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634929664 00000100:00100000:1.0:1789429282.611533:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634929664 00000100:00100000:1.0:1789429282.611594:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5646 00000100:00100000:1.0:1789429282.611605:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634929664:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.611623:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.611652:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf6e expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.611687:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(31 266) 00010000:00010000:1.0:1789429282.611696:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.611704:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(32 266) 00010000:00010000:1.0:1789429282.611709:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.611749:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.611766:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.611778:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429282.614040:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634929664:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2425us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.614053:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5646 00000100:00100000:2.0:1789429282.614830:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.614937:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634929792 00000100:00100000:0.0:1789429282.614946:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634929792 00010000:00010000:0.0:1789429282.614978:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 20 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.615002:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6075 00000100:00100000:0.0:1789429282.615008:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634929792:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429282.615018:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429282.615037:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 20 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.615046:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 20 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.615063:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360315 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf60 expref: 20 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.615077:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 266) 00010000:00010000:0.0:1789429282.615080:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 266) 00010000:00010000:0.0:1789429282.615086:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.615093:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.615120:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.615129:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 26 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.615139:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648316416:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429282.615313:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515900 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.617943:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648316416:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.617972:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.618033:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634929792:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3023us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.618045:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6075 00000100:00100000:2.0:1789429282.620825:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.620924:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634929920 00000100:00100000:0.0:1789429282.620936:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634929920 00002000:00100000:0.0:1789429282.620995:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f1c349500 x1876351634929920/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.621008:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c349500 with x1876351634929920 ext(344064->348159) 00010000:00010000:0.0:1789429282.621019:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.621038:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.621046:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c349500 00000100:00100000:0.0:1789429282.621084:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1353 00000100:00100000:0.0:1789429282.621094:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634929920:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429282.621453:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634929920:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 359us (637us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429282.621462:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1353 00002000:00100000:0.0:1789429282.621469:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f1c349500 x1876351634929920/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.621478:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c349500 with x1876351634929920 ext(344064->348159) 00010000:00010000:0.0:1789429282.621484:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.621496:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.621503:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c349500 00000100:00100000:2.0:1789429282.628897:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.629733:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634930048 00000100:00100000:1.0:1789429282.629745:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634930048 00000100:00100000:1.0:1789429282.629810:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5647 00000100:00100000:1.0:1789429282.629820:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634930048:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.629839:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.629859:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf75 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.629891:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(33 266) 00010000:00010000:1.0:1789429282.629899:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.629907:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(34 266) 00010000:00010000:1.0:1789429282.629912:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.629953:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.629970:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.630135:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:1.0:1789429282.630319:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634930048:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 500us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.630327:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5647 00000100:00100000:1.0:1789429282.634383:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.634551:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634930176 00000100:00100000:2.0:1789429282.634562:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634930176 00010000:00010000:2.0:1789429282.634613:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 28 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.634656:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6076 00000100:00100000:2.0:1789429282.634665:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:2368:x1876351634930176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429282.634682:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429282.634705:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 28 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.634718:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 28 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.634749:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad72636031c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf67 expref: 28 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.634766:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 266) 00010000:00010000:2.0:1789429282.634771:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 266) 00010000:00010000:2.0:1789429282.634780:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.634790:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.634828:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.634842:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 18 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.634856:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648316672:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429282.634940:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429282.638702:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648316672:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429282.638731:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429282.638797:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634930176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4132us (4423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429282.638810:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6076 00000100:00100000:0.0:1789429282.642528:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.642590:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634930304 00000100:00100000:3.0:1789429282.642601:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634930304 00010000:00010000:3.0:1789429282.642641:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.642693:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6077 00000100:00100000:3.0:1789429282.642704:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2369:x1876351634930304:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.642719:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.642742:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.642757:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.642784:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360323 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf6e expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.642800:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 266) 00010000:00010000:3.0:1789429282.642804:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 266) 00010000:00010000:3.0:1789429282.642812:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.642821:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.642859:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.642880:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648316800:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.643011:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.645101:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648316800:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.645124:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.645195:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2369:x1876351634930304:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2492us (2771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.645238:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6077 00000100:00100000:2.0:1789429282.657347:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.657484:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634930432 00000100:00100000:1.0:1789429282.657495:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634930432 00000100:00100000:1.0:1789429282.657557:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5648 00000100:00100000:1.0:1789429282.657671:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634930432:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.657691:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.657710:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf7c expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.657743:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.657753:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(35 266) 00010000:00010000:1.0:1789429282.657757:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 266) 00010000:00010000:1.0:1789429282.657762:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.657800:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.657814:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 26 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.657828:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648316928:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429282.657914:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429282.661706:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.662008:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634930560 00000100:00100000:2.0:1789429282.662018:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634930560 00000100:00100000:1.0:1789429282.662599:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648316928:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.662635:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 19 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.662656:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429282.662717:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634930432:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5050us (5380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.662726:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5648 00002000:00100000:2.0:1789429282.663359:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946e0265ea00 x1876351634930560/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.663377:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265ea00 with x1876351634930560 ext(344064->348159) 00010000:00010000:2.0:1789429282.663386:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.663402:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.663409:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265ea00 00000100:00100000:2.0:1789429282.663537:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1354 00000100:00100000:2.0:1789429282.663549:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+27:2369:x1876351634930560:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429282.663730:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+27:2369:x1876351634930560:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 184us (2033us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429282.663737:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1354 00002000:00100000:2.0:1789429282.663743:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946e0265ea00 x1876351634930560/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.663752:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265ea00 with x1876351634930560 ext(344064->348159) 00010000:00010000:2.0:1789429282.663758:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.663768:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.663775:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e0265ea00 00000100:00100000:3.0:1789429282.672921:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.673018:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634930688 00000100:00100000:2.0:1789429282.673027:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634930688 00000100:00100000:2.0:1789429282.673308:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5649 00000100:00100000:2.0:1789429282.673318:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634930688:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.673333:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.673349:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf83 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.673377:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(36 266) 00010000:00010000:2.0:1789429282.673385:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.673392:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(37 266) 00010000:00010000:2.0:1789429282.673398:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.673441:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.673454:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.673466:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546600, rc 0) 00000100:00100000:2.0:1789429282.673514:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634930688:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 198us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.673520:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5649 00000100:00100000:0.0:1789429282.679351:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.684282:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634930816 00000100:00100000:3.0:1789429282.684299:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634930816 00010000:00010000:0.0:1789429282.684447:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 28 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.684496:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6078 00000100:00100000:0.0:1789429282.684506:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+28:2370:x1876351634930816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429282.684521:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429282.684546:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 28 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.684560:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 28 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.684584:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636032a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf75 expref: 28 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.684602:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 266) 00010000:00010000:0.0:1789429282.684606:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 266) 00010000:00010000:0.0:1789429282.684614:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.684631:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.684669:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.684681:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 18 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.684693:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648317184:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429282.684778:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429282.690719:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648317184:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429282.690743:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429282.690801:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634930816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6296us (11459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.690813:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6078 00000100:00100000:3.0:1789429282.698746:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.698849:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634930944 00000100:00100000:0.0:1789429282.698860:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634930944 00002000:00100000:0.0:1789429282.698921:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f34073800 x1876351634930944/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.698932:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073800 with x1876351634930944 ext(344064->380927) 00010000:00010000:0.0:1789429282.698941:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.698957:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.698966:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34073800 00000100:00100000:0.0:1789429282.698997:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1355 00000100:00100000:0.0:1789429282.699007:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634930944:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429282.703021:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634930944:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4004us (4273us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429282.703033:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1355 00002000:00100000:2.0:1789429282.703052:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f34073800 x1876351634930944/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/440 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.703062:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073800 with x1876351634930944 ext(344064->380927) 00010000:00010000:2.0:1789429282.703072:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.703090:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.703098:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34073800 00000100:00100000:3.0:1789429282.708076:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.708305:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634931072 00000100:00100000:0.0:1789429282.708314:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634931072 00010000:00010000:0.0:1789429282.708350:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.708388:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6079 00000100:00100000:0.0:1789429282.708397:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634931072:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429282.708411:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429282.708432:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.708446:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.708478:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360331 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf7c expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.708497:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 266) 00010000:00010000:0.0:1789429282.708501:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 266) 00010000:00010000:0.0:1789429282.708510:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.708520:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.708560:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.708574:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648317312:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429282.708661:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.714274:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.714362:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634931200 00000100:00100000:3.0:1789429282.714373:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634931200 00000100:00100000:0.0:1789429282.714557:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648317312:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429282.714588:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429282.714647:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634931072:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6250us (6579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429282.714656:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6079 00000100:00100000:3.0:1789429282.715502:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5650 00000100:00100000:3.0:1789429282.715517:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634931200:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429282.715534:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429282.715554:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf8a expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.715599:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.715609:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(38 266) 00010000:00010000:3.0:1789429282.715614:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 266) 00010000:00010000:3.0:1789429282.715619:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.715653:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.715667:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 26 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.715679:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05423b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648317440:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429282.715899:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.718937:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05423b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648317440:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429282.718970:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.718992:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429282.719115:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634931200:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3601us (4851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.719126:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5650 00000100:00100000:0.0:1789429282.720287:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.720404:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634931328 00000100:00100000:3.0:1789429282.720412:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634931328 00010000:00010000:3.0:1789429282.720638:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.720687:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6080 00000100:00100000:3.0:1789429282.720699:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634931328:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.720714:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.720737:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.720750:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.720774:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360338 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf83 expref: 27 pid: 6681 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.720790:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 266) 00010000:00010000:3.0:1789429282.720794:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 266) 00010000:00010000:3.0:1789429282.720802:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.720812:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.720846:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.720860:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05423b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648317568:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.720936:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.724600:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05423b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648317568:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.724627:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.724687:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+26:2370:x1876351634931328:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3989us (4404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.724697:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6080 00000100:00100000:2.0:1789429282.730291:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.730426:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.730795:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634931456 00000100:00100000:1.0:1789429282.730806:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634931456 00000100:00100000:1.0:1789429282.730961:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5651 00000100:00100000:1.0:1789429282.730972:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:33927:x1876351634931456:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.731003:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.731022:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf91 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.731374:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.731386:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(39 266) 00010000:00010000:1.0:1789429282.731392:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 266) 00010000:00010000:1.0:1789429282.731398:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.731506:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.731521:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 18 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.731535:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e10309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648317696:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429282.731618:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.731671:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634931584 00000100:00100000:3.0:1789429282.731677:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634931584 00002000:00100000:2.0:1789429282.731731:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946e15a51180 x1876351634931584/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429282.731742:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51180 with x1876351634931584 ext(344064->380927) 00010000:00010000:2.0:1789429282.731749:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.731761:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429282.731768:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51180 00000100:00100000:2.0:1789429282.731796:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1356 00000100:00100000:2.0:1789429282.731804:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634931584:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429282.747190:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634931584:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 15375us (16753us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429282.747244:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1356 00002000:00100000:0.0:1789429282.747256:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946e15a51180 x1876351634931584/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/440 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.747267:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51180 with x1876351634931584 ext(344064->380927) 00010000:00010000:0.0:1789429282.747278:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.747294:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.747306:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51180 00000100:00100000:1.0:1789429282.750726:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e10309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648317696:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.750761:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.750784:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429282.750840:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634931456:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 19869us (20557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.750852:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5651 00000100:00100000:2.0:1789429282.754704:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.754747:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.754825:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634931712 00000100:00100000:3.0:1789429282.754836:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634931712 00010000:00010000:3.0:1789429282.755101:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.755161:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6081 00000100:00100000:3.0:1789429282.755171:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634931712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.755188:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.755246:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.755260:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.755285:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636033f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf8a expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.755302:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 266) 00010000:00010000:3.0:1789429282.755307:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 266) 00010000:00010000:3.0:1789429282.755316:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.755328:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.755364:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.755377:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05423b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648317824:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.755619:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.755678:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634931840 00000100:00100000:1.0:1789429282.755683:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634931840 00000100:00100000:1.0:1789429282.755721:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5652 00000100:00100000:1.0:1789429282.755728:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634931840:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.755741:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.755754:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf98 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.755775:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.755782:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(40 266) 00010000:00010000:1.0:1789429282.755786:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 266) 00010000:00010000:1.0:1789429282.755790:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.755812:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.755825:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 26 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.755835:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e10309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648317952:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429282.755859:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.758884:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e10309500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648317952:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.758917:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.758938:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:1.0:1789429282.759028:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634931840:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3299us (4279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.759037:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5652 00000100:00100000:3.0:1789429282.765679:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05423b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648317824:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.765707:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.765767:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634931712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10597us (11072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.765778:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6081 00000100:00100000:2.0:1789429282.765862:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.766446:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634931968 00000100:00100000:0.0:1789429282.766454:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634931968 00002000:00100000:0.0:1789429282.766658:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f3221ed80 x1876351634931968/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.766670:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221ed80 with x1876351634931968 ext(344064->348159) 00010000:00010000:0.0:1789429282.766679:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.766695:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.766703:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221ed80 00000100:00100000:0.0:1789429282.766734:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1357 00000100:00100000:0.0:1789429282.766744:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634931968:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429282.766916:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634931968:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 173us (1055us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429282.766923:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1357 00002000:00100000:0.0:1789429282.766930:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f3221ed80 x1876351634931968/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.766938:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221ed80 with x1876351634931968 ext(344064->348159) 00010000:00010000:0.0:1789429282.766943:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.766956:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.766964:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221ed80 00000100:00100000:1.0:1789429282.781242:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.781403:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634932096 00000100:00100000:2.0:1789429282.781415:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634932096 00000100:00100000:2.0:1789429282.781490:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5653 00000100:00100000:2.0:1789429282.781501:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634932096:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.781527:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.781544:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bf9f expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.781594:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(41 266) 00010000:00010000:2.0:1789429282.781604:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.781627:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(42 266) 00010000:00010000:2.0:1789429282.781634:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.781694:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.781710:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 28 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.781728:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429282.781790:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634932096:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 291us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.781797:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5653 00000100:00100000:2.0:1789429282.783543:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.783714:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634932224 00000100:00100000:1.0:1789429282.783724:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634932224 00010000:00010000:1.0:1789429282.783759:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 28 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.783802:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6082 00000100:00100000:1.0:1789429282.783813:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+28:2370:x1876351634932224:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429282.783830:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429282.783854:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 28 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.783866:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 28 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.783888:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad726360346 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf91 expref: 28 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.783911:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 266) 00010000:00010000:1.0:1789429282.783917:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 266) 00010000:00010000:1.0:1789429282.783926:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.783936:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.783973:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.783986:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 18 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.784000:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b4e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648318208:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429282.784084:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.798815:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.798934:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b4e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648318208:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.798963:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429282.799006:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634932352 00000100:00100000:0.0:1789429282.799015:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634932352 00000100:00100000:1.0:1789429282.799031:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634932224:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 15217us (15496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.799043:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6082 00010000:00010000:0.0:1789429282.799053:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.799094:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6083 00000100:00100000:0.0:1789429282.799105:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634932352:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429282.799119:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429282.799161:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.799175:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.799238:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636034d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf98 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.799256:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 266) 00010000:00010000:0.0:1789429282.799261:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 266) 00010000:00010000:0.0:1789429282.799269:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.799279:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.799330:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.799344:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648318336:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429282.799402:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429282.801298:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.801426:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634932480 00000100:00100000:3.0:1789429282.801436:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634932480 00000100:00100000:3.0:1789429282.801486:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5654 00000100:00100000:3.0:1789429282.801497:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634932480:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429282.801514:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429282.801532:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bfa6 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.801564:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.801580:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(43 266) 00010000:00010000:3.0:1789429282.801584:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 266) 00010000:00010000:3.0:1789429282.801589:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.801615:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 26 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.801748:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 26 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.801763:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05421880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648318464:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429282.801836:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429282.807755:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.807888:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634932608 00000100:00100000:1.0:1789429282.807898:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634932608 00010000:00010000:1.0:1789429282.807934:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 27 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.807978:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6084 00000100:00100000:1.0:1789429282.807988:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634932608:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429282.808005:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429282.808027:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 27 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.808041:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 27 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.808067:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 266) 00010000:00010000:1.0:1789429282.808072:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 266) 00010000:00010000:1.0:1789429282.808081:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.808090:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.808139:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.808162:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b4e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648318592:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429282.808271:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.808960:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05421880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648318464:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429282.808994:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.809007:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429282.809085:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634932480:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7589us (7794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.809094:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5654 00010000:00010000:0.0:1789429282.809329:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360354 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bf9f expref: 27 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.809355:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648318336:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429282.809368:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429282.809392:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634932352:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10289us (10587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429282.809399:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6083 00000100:00100000:2.0:1789429282.819938:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.821122:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634932736 00000100:00100000:1.0:1789429282.821140:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634932736 00000100:00100000:1.0:1789429282.821302:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5655 00000100:00100000:1.0:1789429282.821314:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634932736:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.821332:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.821359:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bfad expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.821395:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.821405:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(44 266) 00010000:00010000:1.0:1789429282.821409:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 266) 00010000:00010000:1.0:1789429282.821414:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.821447:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.821461:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 18 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.821476:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648318720:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429282.821563:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.830296:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b4e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648318592:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.830326:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429282.830570:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+28:2368:x1876351634932608:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 22581us (22822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.830584:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6084 00000100:00100000:2.0:1789429282.834026:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.837283:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648318720:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.837322:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 27 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.837345:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:1.0:1789429282.837413:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634932736:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 16100us (17483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.837423:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5655 00000100:00100000:0.0:1789429282.838054:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634932864 00000100:00100000:0.0:1789429282.838063:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634932864 00002000:00100000:0.0:1789429282.838105:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f3f17a680 x1876351634932864/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.838115:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17a680 with x1876351634932864 ext(344064->380927) 00010000:00010000:0.0:1789429282.838123:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.838145:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.838163:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f17a680 00000100:00100000:0.0:1789429282.838277:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1358 00000100:00100000:0.0:1789429282.838288:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634932864:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429282.849621:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634932864:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 11325us (15594us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429282.849634:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1358 00002000:00100000:0.0:1789429282.849645:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (344064->380927) req@ffff946f3f17a680 x1876351634932864/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/440 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.849657:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17a680 with x1876351634932864 ext(344064->380927) 00010000:00010000:0.0:1789429282.849668:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.849688:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.849697:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f17a680 00000100:00100000:2.0:1789429282.864817:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.864860:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.864987:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634932992 00000100:00100000:1.0:1789429282.864997:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634932992 00000100:00100000:1.0:1789429282.865068:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5656 00000100:00100000:1.0:1789429282.865079:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634932992:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.865096:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.865114:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bfb4 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.865158:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(45 266) 00010000:00010000:1.0:1789429282.865167:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.865175:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(46 266) 00010000:00010000:1.0:1789429282.865180:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.865260:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.865275:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.865287:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429282.865338:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634932992:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 261us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.865345:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5656 00000100:00100000:3.0:1789429282.865491:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634933120 00000100:00100000:3.0:1789429282.865496:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634933120 00010000:00010000:3.0:1789429282.865519:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 20 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.865549:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6085 00000100:00100000:3.0:1789429282.865556:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634933120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.865565:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.865585:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 20 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.865598:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 20 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.865617:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636035b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfa6 expref: 20 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.865630:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 266) 00010000:00010000:3.0:1789429282.865633:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 266) 00010000:00010000:3.0:1789429282.865640:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.865650:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.865745:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 26 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.865759:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 26 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.865786:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648318976:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429282.865854:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515300 going to sleep for 11 seconds 00000100:00100000:0.0:1789429282.871915:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648318976:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429282.871940:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429282.871999:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634933120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6442us (7137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429282.872008:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6085 00000100:00100000:3.0:1789429282.878197:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.878311:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634933248 00000100:00100000:0.0:1789429282.878320:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634933248 00002000:00100000:0.0:1789429282.878365:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f05421880 x1876351634933248/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.878377:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05421880 with x1876351634933248 ext(344064->348159) 00010000:00010000:0.0:1789429282.878386:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.878403:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.878413:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05421880 00000100:00100000:0.0:1789429282.878443:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1359 00000100:00100000:0.0:1789429282.878452:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634933248:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429282.878634:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+27:2368:x1876351634933248:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 182us (445us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429282.878646:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1359 00002000:00100000:0.0:1789429282.878654:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f05421880 x1876351634933248/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429282.878663:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05421880 with x1876351634933248 ext(344064->348159) 00010000:00010000:0.0:1789429282.878669:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.878681:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429282.878688:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05421880 00000100:00100000:3.0:1789429282.882727:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.883076:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634933376 00000100:00100000:0.0:1789429282.883086:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634933376 00010000:00010000:0.0:1789429282.883124:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.883174:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6086 00000100:00100000:0.0:1789429282.883184:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634933376:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429282.883236:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429282.883259:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.883275:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.883304:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad726360362 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfad expref: 27 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.883322:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 266) 00010000:00010000:0.0:1789429282.883327:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 266) 00010000:00010000:0.0:1789429282.883335:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.883347:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.883383:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.883399:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648319104:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429282.883483:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.883854:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.883920:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634933504 00000100:00100000:3.0:1789429282.883925:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634933504 00000100:00100000:3.0:1789429282.883962:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5657 00000100:00100000:3.0:1789429282.883969:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+27:33927:x1876351634933504:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429282.883983:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429282.883996:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bfbb expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.884016:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.884025:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(47 266) 00010000:00010000:3.0:1789429282.884029:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 266) 00010000:00010000:3.0:1789429282.884034:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.884056:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.884070:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 18 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.884081:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05423800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648319232:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429282.884123:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f076960c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.888482:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05423800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648319232:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.888520:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.888543:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:1.0:1789429282.888601:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634933504:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4632us (4747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.888611:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5657 00000100:00100000:3.0:1789429282.888923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.889015:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648319104:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429282.889028:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429282.889050:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634933376:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5867us (6333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429282.889058:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6086 00000100:00100000:0.0:1789429282.889495:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634933632 00000100:00100000:0.0:1789429282.889502:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634933632 00010000:00010000:0.0:1789429282.889528:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.889691:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6087 00000100:00100000:2.0:1789429282.889703:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634933632:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429282.889717:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429282.889739:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.889754:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.889895:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360369 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfb4 expref: 19 pid: 8085 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.889923:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 266) 00010000:00010000:2.0:1789429282.889927:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 266) 00010000:00010000:2.0:1789429282.889934:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.889944:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.890091:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.890105:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648319360:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429282.890243:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.901888:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.902003:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648319360:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429282.902029:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429282.902090:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351634933632:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12389us (13166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.902100:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6087 00000100:00100000:3.0:1789429282.902667:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634933760 00000100:00100000:3.0:1789429282.902677:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634933760 00002000:00100000:3.0:1789429282.902721:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f054da680 x1876351634933760/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.902731:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054da680 with x1876351634933760 ext(344064->348159) 00002000:00010000:3.0:1789429282.902737:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054da680 00000100:00100000:3.0:1789429282.902765:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11396 00000100:00100000:3.0:1789429282.902774:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634933760:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429282.902993:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634933760:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 220us (1114us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429282.903001:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11396 00002000:00100000:3.0:1789429282.903007:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f054da680 x1876351634933760/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.903015:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054da680 with x1876351634933760 ext(344064->348159) 00002000:00010000:3.0:1789429282.903018:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054da680 00000100:00100000:1.0:1789429282.907380:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.907487:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634933888 00000100:00100000:3.0:1789429282.907617:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634933888 00000100:00100000:3.0:1789429282.907724:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5658 00000100:00100000:3.0:1789429282.907736:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33938:x1876351634933888:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429282.907754:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429282.907775:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad726360377 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bfc2 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.907814:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.907830:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(48 266) 00010000:00010000:3.0:1789429282.907834:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 266) 00010000:00010000:3.0:1789429282.907840:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad726360377 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc2 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.907874:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.907888:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 26 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.907901:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05421c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648319488:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429282.908072:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.912280:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05421c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648319488:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429282.912319:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad726360377 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc2 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.912342:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:3.0:1789429282.912411:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634933888:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4676us (5040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.912421:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5658 00000100:00100000:0.0:1789429282.912586:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.912954:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634934016 00000100:00100000:3.0:1789429282.912961:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634934016 00002000:00100000:3.0:1789429282.913012:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f3f8da680 x1876351634934016/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.913022:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8da680 with x1876351634934016 ext(348160->352255) 00010000:00010000:3.0:1789429282.913028:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 27 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.913043:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 27 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429282.913051:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8da680 00000100:00100000:3.0:1789429282.913079:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1360 00000100:00100000:3.0:1789429282.913087:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634934016:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429282.913296:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634934016:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 210us (710us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429282.913304:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1360 00002000:00100000:3.0:1789429282.913310:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f3f8da680 x1876351634934016/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.913318:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8da680 with x1876351634934016 ext(348160->352255) 00010000:00010000:3.0:1789429282.913324:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 27 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.913336:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 27 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429282.913349:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8da680 00000100:00100000:0.0:1789429282.918323:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.918585:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634934144 00000100:00100000:3.0:1789429282.918594:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634934144 00002000:00100000:3.0:1789429282.918642:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f3f8db800 x1876351634934144/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 4584/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.918653:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8db800 with x1876351634934144 ext(344064->348159) 00010000:00010000:3.0:1789429282.918663:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 27 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.918679:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 27 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429282.918687:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8db800 00000100:00100000:3.0:1789429282.918719:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1361 00000100:00100000:3.0:1789429282.918729:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634934144:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1789429282.919113:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634934144:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 383us (797us total) trans 4294969568 rc 0/0 00000100:00100000:3.0:1789429282.919120:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1361 00002000:00100000:3.0:1789429282.919127:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946f3f8db800 x1876351634934144/t4294969568(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 4584/448 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.919320:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8db800 with x1876351634934144 ext(344064->348159) 00010000:00010000:3.0:1789429282.919328:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 29 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.919341:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 29 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429282.919349:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8db800 00000100:00100000:2.0:1789429282.920145:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.920260:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634934272 00000100:00100000:1.0:1789429282.920267:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634934272 00000100:00100000:1.0:1789429282.920313:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5659 00000100:00100000:1.0:1789429282.920322:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634934272:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.920334:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.920352:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bfc9 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.920379:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(49 266) 00010000:00010000:1.0:1789429282.920385:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 266) 00010000:00010000:1.0:1789429282.920390:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.920402:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.920414:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:1.0:1789429282.920462:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634934272:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 140us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.920470:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5659 00000100:00100000:1.0:1789429282.923466:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.923687:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634934400 00000100:00100000:2.0:1789429282.923699:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634934400 00010000:00010000:2.0:1789429282.923756:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 30 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.923941:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6088 00000100:00100000:2.0:1789429282.923952:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+30:2369:x1876351634934400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429282.923974:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789429282.924000:0:11354:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1789429282 -> 1789429283 00002000:00010000:2.0:1789429282.924003:0:11354:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1789429282 -> 1789429283 00010000:00010000:2.0:1789429282.924010:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 30 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.924024:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 30 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.924485:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad726360370 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [344064->18446744073709551615] (req 344064->348159) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfbb expref: 30 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.924515:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 266) 00010000:00010000:2.0:1789429282.924520:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 266) 00010000:00010000:2.0:1789429282.924530:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad726360377 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc2 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.924541:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad726360377 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc2 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.924550:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 266) 00010000:00010000:2.0:1789429282.924553:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 266) 00010000:00010000:2.0:1789429282.924558:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.924566:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.924604:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.924618:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648319616:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429282.924716:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad726360377 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc2 expref: 18 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.924725:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01276300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648319744:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429282.924747:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.929466:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648319616:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429282.929483:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01276300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648319744:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429282.929509:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429282.929557:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:2369:x1876351634934400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5606us (6100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.929568:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6088 00000100:00100000:2.0:1789429282.931773:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.931864:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634934528 00000100:00100000:3.0:1789429282.931874:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634934528 00002000:00100000:3.0:1789429282.931924:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946e01275500 x1876351634934528/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.931935:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01275500 with x1876351634934528 ext(344064->348159) 00002000:00010000:3.0:1789429282.931941:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e01275500 00000100:00100000:3.0:1789429282.931971:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11397 00000100:00100000:3.0:1789429282.931980:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634934528:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429282.932284:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634934528:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 304us (519us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429282.932292:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11397 00002000:00100000:3.0:1789429282.932300:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (344064->348159) req@ffff946e01275500 x1876351634934528/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.932308:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01275500 with x1876351634934528 ext(344064->348159) 00002000:00010000:3.0:1789429282.932924:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e01275500 00000100:00100000:0.0:1789429282.938684:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.938781:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634934656 00000100:00100000:2.0:1789429282.938791:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634934656 00000100:00100000:2.0:1789429282.938852:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5660 00000100:00100000:2.0:1789429282.938862:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634934656:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429282.938879:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429282.938896:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bfd0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.938930:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.938941:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(50 266) 00010000:00010000:2.0:1789429282.938946:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 266) 00010000:00010000:2.0:1789429282.938951:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 20 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.939000:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.939016:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 28 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429282.939030:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01277800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648319872:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429282.939127:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429282.946664:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429282.947272:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01277800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648319872:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429282.947315:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 20 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429282.947345:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547c00, rc 0) 00000100:00100000:2.0:1789429282.947410:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634934656:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8548us (8736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429282.947419:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5660 00000100:00100000:1.0:1789429282.947946:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634934784 00000100:00100000:1.0:1789429282.947955:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634934784 00002000:00100000:1.0:1789429282.948385:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f3f8db100 x1876351634934784/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.948590:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8db100 with x1876351634934784 ext(348160->352255) 00010000:00010000:1.0:1789429282.948601:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 29 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.948618:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 29 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.948627:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8db100 00000100:00100000:1.0:1789429282.948660:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1362 00000100:00100000:1.0:1789429282.948672:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634934784:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429282.948936:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634934784:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 267us (2281us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429282.948944:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1362 00002000:00100000:1.0:1789429282.948951:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f3f8db100 x1876351634934784/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:18/0 lens 488/4536 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.948959:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8db100 with x1876351634934784 ext(348160->352255) 00010000:00010000:1.0:1789429282.948965:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 29 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.948976:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 29 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.948990:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8db100 00000100:00100000:0.0:1789429282.952756:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429282.952928:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634934912 00000100:00100000:1.0:1789429282.952938:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634934912 00000100:00100000:1.0:1789429282.953060:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5661 00000100:00100000:1.0:1789429282.953070:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634934912:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.953089:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.953107:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bfd7 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.953140:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(51 266) 00010000:00010000:1.0:1789429282.953159:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.953167:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(52 266) 00010000:00010000:1.0:1789429282.953172:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.953243:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.953252:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1789429282.953258:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.953271:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:1.0:1789429282.953329:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634934912:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 260us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.953336:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5661 00000100:00100000:3.0:1789429282.953394:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634935040 00000100:00100000:3.0:1789429282.953399:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634935040 00010000:00010000:3.0:1789429282.953425:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 30 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.953455:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6089 00000100:00100000:3.0:1789429282.953462:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634935040:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.953471:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.953502:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 30 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.953515:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 30 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.953534:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad72636037e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc9 expref: 30 pid: 6680 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.953548:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 266) 00010000:00010000:3.0:1789429282.953551:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 266) 00010000:00010000:3.0:1789429282.953559:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.953569:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.953592:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.953612:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 19 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.953625:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05421c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648320128:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.953677:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.958724:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05421c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648320128:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.958752:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.958813:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634935040:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5349us (5558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.958824:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6089 00000100:00100000:0.0:1789429282.961667:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.961766:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634935168 00000100:00100000:3.0:1789429282.961775:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634935168 00002000:00100000:3.0:1789429282.961823:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946f2f50aa00 x1876351634935168/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/0 e 0 to 0 dl 1789429293 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429282.961835:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f50aa00 with x1876351634935168 ext(348160->385023) 00010000:00010000:3.0:1789429282.961846:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.961863:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429282.961872:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f50aa00 00000100:00100000:3.0:1789429282.961943:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1363 00000100:00100000:3.0:1789429282.961953:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634935168:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429282.970125:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634935168:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7533us (7828us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429282.970157:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1363 00002000:00100000:1.0:1789429282.970173:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946f2f50aa00 x1876351634935168/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:18/0 lens 488/440 e 0 to 0 dl 1789429293 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429282.970193:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f50aa00 with x1876351634935168 ext(348160->385023) 00010000:00010000:1.0:1789429282.970240:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.970258:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429282.970266:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f50aa00 00000100:00100000:3.0:1789429282.972932:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.973016:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.973169:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634935424 00000100:00100000:0.0:1789429282.973179:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634935424 00010000:00010000:0.0:1789429282.973251:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.973295:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6090 00000100:00100000:0.0:1789429282.973304:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634935424:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429282.973320:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429282.973350:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.973364:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.973389:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e07b154b/0xb4c3dad726360385 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd0 expref: 20 pid: 6682 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.973411:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 266) 00010000:00010000:0.0:1789429282.973415:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 266) 00010000:00010000:0.0:1789429282.973423:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.973432:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.973469:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.973483:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648320256:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429282.973725:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429282.974754:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634935296 00000100:00100000:1.0:1789429282.974763:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634935296 00000100:00100000:1.0:1789429282.974816:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5662 00000100:00100000:1.0:1789429282.974825:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634935296:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429282.974839:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429282.974853:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bfde expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.974879:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.974889:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(53 266) 00010000:00010000:1.0:1789429282.974893:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 266) 00010000:00010000:1.0:1789429282.974898:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 21 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.974924:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.974937:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 28 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.974949:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648320384:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429282.975021:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429282.978058:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648320256:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429282.978083:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429282.978165:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634935424:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4857us (5143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429282.978176:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6090 00000100:00100000:0.0:1789429282.992279:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429282.992357:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634935552 00000100:00100000:3.0:1789429282.992368:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634935552 00010000:00010000:3.0:1789429282.992409:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 29 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.992455:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6091 00000100:00100000:3.0:1789429282.992465:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634935552:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429282.992480:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429282.992510:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 29 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.992523:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 29 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.992550:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 266) 00010000:00010000:3.0:1789429282.992555:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 266) 00010000:00010000:3.0:1789429282.992564:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.992574:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429282.992957:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429282.993038:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05423800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648320512:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429282.993114:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696000 going to sleep for 11 seconds 00010000:00010000:1.0:1789429282.993247:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad72636038c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfd7 expref: 29 pid: 20745 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429282.993264:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648320384:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429282.993289:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429282.993299:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:1.0:1789429282.993340:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634935296:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 18515us (20416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429282.993352:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5662 00000100:00100000:2.0:1789429282.994850:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429282.994925:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634935680 00000100:00100000:0.0:1789429282.994932:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634935680 00000100:00100000:0.0:1789429282.994979:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5663 00000100:00100000:0.0:1789429282.994988:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634935680:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429282.995007:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429282.995025:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bfe5 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.995055:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.995066:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(54 266) 00010000:00010000:0.0:1789429282.995070:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 266) 00010000:00010000:0.0:1789429282.995075:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.995114:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429282.995128:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 19 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429282.995141:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648320640:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429282.995238:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429282.999856:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05423800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648320512:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429282.999883:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429282.999937:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634935552:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7472us (7667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429282.999951:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6091 00000100:00100000:0.0:1789429283.016472:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648320640:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429283.016508:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 29 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.016532:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:0.0:1789429283.016592:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634935680:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 21605us (21748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.016602:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5663 00000100:00100000:2.0:1789429283.019969:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.020073:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634935808 00000100:00100000:0.0:1789429283.020082:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634935808 00002000:00100000:0.0:1789429283.020161:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946e01274e00 x1876351634935808/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.020174:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01274e00 with x1876351634935808 ext(348160->385023) 00010000:00010000:0.0:1789429283.020183:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.020234:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.020245:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01274e00 00000100:00100000:0.0:1789429283.020276:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1364 00000100:00100000:0.0:1789429283.020285:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634935808:12345-192.168.203.39@tcp:3:kworker.0 00000100:00080000:3.0:1789429283.020520:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429283.026515:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634935808:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6220us (6545us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429283.026528:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1364 00002000:00100000:0.0:1789429283.026541:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946e01274e00 x1876351634935808/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.026552:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01274e00 with x1876351634935808 ext(348160->385023) 00010000:00010000:0.0:1789429283.026562:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 1080 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.026581:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.026590:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01274e00 00000100:00100000:3.0:1789429283.035717:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.037075:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.037251:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634936064 00000100:00100000:1.0:1789429283.037262:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634936064 00010000:00010000:1.0:1789429283.037301:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.037342:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6092 00000100:00100000:1.0:1789429283.037353:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634936064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.037369:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429283.037390:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.037405:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.037432:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad726360393 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfde expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.037448:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=1s v=(55 266) 00010000:00010000:1.0:1789429283.037453:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 266) 00010000:00010000:1.0:1789429283.037461:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.037472:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.037514:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.037527:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648320768:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.037749:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.037789:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634935936 00000100:00100000:2.0:1789429283.037795:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634935936 00000100:00100000:2.0:1789429283.037834:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5664 00000100:00100000:2.0:1789429283.037842:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634935936:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.037856:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.037869:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bfec expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.037889:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.037898:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(55 266) 00010000:00010000:2.0:1789429283.037901:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 266) 00010000:00010000:2.0:1789429283.037906:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 21 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.037928:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.037940:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 28 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.037950:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01274a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648320896:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429283.037989:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573540 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.041756:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648320768:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.041779:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429283.041836:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634936064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4482us (4764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.041843:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01274a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648320896:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429283.041850:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6092 00010000:00010000:2.0:1789429283.041871:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 20 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.041892:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546400, rc 0) 00000100:00100000:2.0:1789429283.041917:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634935936:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4076us (6209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.041924:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5664 00010000:00010000:3.0:1789429283.044349:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429283.045090:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.045187:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634936192 00000100:00100000:0.0:1789429283.045197:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634936192 00002000:00100000:0.0:1789429283.045296:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f05423b80 x1876351634936192/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.045308:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05423b80 with x1876351634936192 ext(348160->352255) 00010000:00010000:0.0:1789429283.045317:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 29 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.045332:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 29 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.045341:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05423b80 00000100:00100000:0.0:1789429283.045373:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1365 00000100:00100000:0.0:1789429283.045383:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634936192:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.045588:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634936192:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 205us (503us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429283.045595:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1365 00002000:00100000:0.0:1789429283.045602:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f05423b80 x1876351634936192/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.045618:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05423b80 with x1876351634936192 ext(348160->352255) 00010000:00010000:0.0:1789429283.045625:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 29 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.045638:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 29 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.045646:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f05423b80 00000100:00080000:3.0:1789429283.045714:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429283.049285:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.049336:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.049518:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634936320 00000100:00100000:1.0:1789429283.049529:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634936320 00000100:00100000:1.0:1789429283.049591:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5665 00000100:00100000:1.0:1789429283.049602:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634936320:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.049619:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.049637:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bff3 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.049669:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(56 266) 00010000:00010000:1.0:1789429283.049677:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.049685:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(57 266) 00010000:00010000:1.0:1789429283.049691:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.049729:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.049745:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 30 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.049757:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:1.0:1789429283.049812:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634936320:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 212us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.049818:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5665 00000100:00100000:0.0:1789429283.050387:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634936448 00000100:00100000:0.0:1789429283.050393:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634936448 00010000:00010000:0.0:1789429283.050417:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 30 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.050443:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6093 00000100:00100000:0.0:1789429283.050450:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351634936448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429283.050459:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429283.050480:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 30 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.050491:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 30 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.050509:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa49979/0xb4c3dad72636039a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfe5 expref: 30 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.050528:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 266) 00010000:00010000:0.0:1789429283.050531:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 266) 00010000:00010000:0.0:1789429283.050538:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.050547:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.050572:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.050585:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 19 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.050597:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648321152:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.050664:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.053448:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648321152:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.053472:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.053524:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634936448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3073us (4186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.053535:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6093 00000100:00100000:1.0:1789429283.056639:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.056740:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634936576 00000100:00100000:0.0:1789429283.056751:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634936576 00010000:00010000:0.0:1789429283.056786:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.056827:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6094 00000100:00100000:0.0:1789429283.056837:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634936576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429283.056853:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429283.056876:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.056890:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.056913:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263603a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfec expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.056929:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 266) 00010000:00010000:0.0:1789429283.056933:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 266) 00010000:00010000:0.0:1789429283.056941:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.056951:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.057000:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.057020:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648321280:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.057100:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.060416:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648321280:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.060442:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.060495:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634936576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3658us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.060506:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6094 00000100:00100000:3.0:1789429283.069510:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.069611:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634936704 00000100:00100000:1.0:1789429283.069620:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634936704 00000100:00100000:1.0:1789429283.069681:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5666 00000100:00100000:1.0:1789429283.069692:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634936704:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.069708:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.069725:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1bffa expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.069757:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.069766:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(58 266) 00010000:00010000:1.0:1789429283.069770:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(59 266) 00010000:00010000:1.0:1789429283.069777:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.069807:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.069821:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 28 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.069835:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648321408:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429283.069920:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.073371:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.073458:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634936832 00000100:00100000:0.0:1789429283.073467:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634936832 00002000:00100000:0.0:1789429283.073516:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f054d7800 x1876351634936832/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.073528:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d7800 with x1876351634936832 ext(348160->352255) 00010000:00010000:0.0:1789429283.073536:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 29 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.073552:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 29 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.073561:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d7800 00000100:00100000:0.0:1789429283.073592:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1366 00000100:00100000:0.0:1789429283.073603:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634936832:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.073818:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634936832:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 216us (456us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429283.073829:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1366 00002000:00100000:0.0:1789429283.073835:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f054d7800 x1876351634936832/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.073843:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d7800 with x1876351634936832 ext(348160->352255) 00010000:00010000:0.0:1789429283.073849:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 29 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.073859:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 29 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.073866:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d7800 00000100:00100000:3.0:1789429283.073956:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648321408:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429283.073997:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.074014:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:3.0:1789429283.074053:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634936704:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4363us (4553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.074061:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5666 00000100:00100000:1.0:1789429283.078840:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.078877:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.078954:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634936960 00000100:00100000:0.0:1789429283.078964:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634936960 00000100:00100000:0.0:1789429283.079031:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5667 00000100:00100000:0.0:1789429283.079040:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634936960:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429283.079057:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429283.079074:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c001 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.079103:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(59 266) 00010000:00010000:0.0:1789429283.079111:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.079119:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(60 266) 00010000:00010000:0.0:1789429283.079124:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.079181:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.079196:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.079244:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:0.0:1789429283.079295:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634936960:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 255us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.079302:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5667 00000100:00100000:3.0:1789429283.079472:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634937088 00000100:00100000:3.0:1789429283.079477:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634937088 00010000:00010000:3.0:1789429283.079500:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 30 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.079530:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6095 00000100:00100000:3.0:1789429283.079538:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634937088:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429283.079548:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429283.079567:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 30 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.079580:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 30 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.079600:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263603a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bff3 expref: 30 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.079614:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 266) 00010000:00010000:3.0:1789429283.079618:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 266) 00010000:00010000:3.0:1789429283.079626:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.079635:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.079658:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.079671:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 19 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.079683:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648321664:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429283.079732:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.085697:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.085812:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648321664:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429283.085843:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429283.085901:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634937088:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6362us (7021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.085911:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6095 00000100:00100000:0.0:1789429283.086003:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634937216 00000100:00100000:0.0:1789429283.086010:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634937216 00002000:00100000:0.0:1789429283.086053:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946e01274a80 x1876351634937216/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.086064:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01274a80 with x1876351634937216 ext(348160->385023) 00010000:00010000:0.0:1789429283.086072:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.086088:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.086095:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01274a80 00000100:00100000:0.0:1789429283.086125:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1367 00000100:00100000:0.0:1789429283.086144:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634937216:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.090438:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634937216:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4295us (4742us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429283.090452:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1367 00002000:00100000:0.0:1789429283.090466:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946e01274a80 x1876351634937216/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.090477:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01274a80 with x1876351634937216 ext(348160->385023) 00010000:00010000:0.0:1789429283.090487:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.090505:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.090514:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e01274a80 00000100:00100000:3.0:1789429283.095309:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.095642:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634937344 00000100:00100000:2.0:1789429283.095652:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634937344 00000100:00100000:2.0:1789429283.095706:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5668 00000100:00100000:2.0:1789429283.095716:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634937344:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.095733:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.095750:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c008 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.095782:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(61 266) 00010000:00010000:2.0:1789429283.095790:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.095797:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(62 266) 00010000:00010000:2.0:1789429283.095803:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 21 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.095846:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.095867:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 21 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.095880:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429283.095939:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634937344:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 224us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.095947:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5668 00000100:00100000:1.0:1789429283.101413:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.102302:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634937472 00000100:00100000:2.0:1789429283.102314:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634937472 00010000:00010000:2.0:1789429283.102353:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.102406:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6096 00000100:00100000:2.0:1789429283.102418:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634937472:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429283.102433:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429283.102463:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.102479:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.102505:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bffa expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.102530:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 266) 00010000:00010000:2.0:1789429283.102534:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 266) 00010000:00010000:2.0:1789429283.102542:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.102554:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.102594:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 28 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.102608:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 28 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.102623:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01276300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648321920:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429283.102695:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573540 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.108750:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01276300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648321920:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429283.108779:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429283.108849:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634937472:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6432us (7443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.108860:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6096 00000100:00100000:2.0:1789429283.109358:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.109540:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634937600 00000100:00100000:0.0:1789429283.109548:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634937600 00010000:00010000:0.0:1789429283.109584:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 29 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.109625:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6097 00000100:00100000:0.0:1789429283.109634:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634937600:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429283.109648:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429283.109668:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 29 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.109688:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 29 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.109711:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad7263603b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c001 expref: 29 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.109732:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 266) 00010000:00010000:0.0:1789429283.109736:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 266) 00010000:00010000:0.0:1789429283.109745:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.109754:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.109798:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.109812:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648322048:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.109885:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.117774:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648322048:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.117812:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.117871:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+28:2370:x1876351634937600:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8237us (8514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.117885:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6097 00000100:00100000:1.0:1789429283.122064:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.122438:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634937728 00000100:00100000:2.0:1789429283.122448:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634937728 00000100:00100000:2.0:1789429283.122540:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5669 00000100:00100000:2.0:1789429283.122550:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634937728:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.122567:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.122595:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c00f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.122627:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.122638:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(63 266) 00010000:00010000:2.0:1789429283.122643:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 266) 00010000:00010000:2.0:1789429283.122649:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.122681:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.122695:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 19 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.122710:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648322176:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429283.122787:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573540 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.125257:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648322176:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429283.125293:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.125313:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:1.0:1789429283.125368:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634937728:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2820us (3313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.125377:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5669 00000100:00100000:3.0:1789429283.127484:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.128419:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634937856 00000100:00100000:0.0:1789429283.128430:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634937856 00010000:00010000:0.0:1789429283.128472:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.128513:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6098 00000100:00100000:0.0:1789429283.128523:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634937856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429283.128538:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429283.128562:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.128873:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.128903:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a900eb4d/0xb4c3dad7263603bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c008 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.128919:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 266) 00010000:00010000:0.0:1789429283.128923:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 266) 00010000:00010000:0.0:1789429283.128932:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.128943:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.129054:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.129069:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648322304:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.129244:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515540 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.133123:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.133268:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634937984 00000100:00100000:2.0:1789429283.133279:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634937984 00000100:00100000:2.0:1789429283.133335:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5670 00000100:00100000:2.0:1789429283.133345:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634937984:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.133363:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.133381:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c016 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.133413:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.133423:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(64 266) 00010000:00010000:2.0:1789429283.133427:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 266) 00010000:00010000:2.0:1789429283.133433:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 21 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.133464:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.133477:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 28 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.133491:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648322432:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429283.133556:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573300 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.136004:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648322304:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.136029:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.136082:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634937856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7560us (8605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.136092:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6098 00000100:00100000:3.0:1789429283.139352:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648322432:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429283.139390:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.139411:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547000, rc 0) 00000100:00100000:3.0:1789429283.139457:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634937984:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6113us (6343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.139466:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5670 00000100:00100000:3.0:1789429283.142350:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.142466:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634938112 00000100:00100000:1.0:1789429283.142477:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634938112 00002000:00100000:1.0:1789429283.142527:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f3f8d9c00 x1876351634938112/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.142539:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d9c00 with x1876351634938112 ext(348160->352255) 00010000:00010000:1.0:1789429283.142548:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.142560:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429283.142565:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8d9c00 00000100:00100000:1.0:1789429283.142701:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1368 00000100:00100000:1.0:1789429283.142712:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634938112:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429283.142889:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634938112:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 179us (548us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429283.142897:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1368 00002000:00100000:1.0:1789429283.142904:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f3f8d9c00 x1876351634938112/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.142912:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d9c00 with x1876351634938112 ext(348160->352255) 00010000:00010000:1.0:1789429283.142919:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.142931:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429283.142943:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f8d9c00 00000100:00100000:2.0:1789429283.147265:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.147378:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634938368 00000100:00100000:3.0:1789429283.147388:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634938368 00010000:00010000:3.0:1789429283.147425:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.147464:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6099 00000100:00100000:3.0:1789429283.147472:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634938368:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429283.147487:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429283.147508:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.147524:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.147549:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263603c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c00f expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.147567:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 266) 00010000:00010000:3.0:1789429283.147572:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 266) 00010000:00010000:3.0:1789429283.147589:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.147599:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.147641:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.147659:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648322560:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429283.147741:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429283.149302:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.149442:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634938240 00000100:00100000:2.0:1789429283.149450:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634938240 00000100:00100000:2.0:1789429283.149505:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5671 00000100:00100000:2.0:1789429283.149514:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634938240:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.149533:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.149550:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c01d expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.149764:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.149775:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(65 266) 00010000:00010000:2.0:1789429283.149779:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 266) 00010000:00010000:2.0:1789429283.149784:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.149812:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.149827:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 19 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.149839:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648322688:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429283.149909:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429283.152860:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648322560:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429283.152888:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429283.152998:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634938368:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5524us (5741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.153009:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6099 00000100:00100000:0.0:1789429283.153122:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.153338:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634938496 00000100:00100000:3.0:1789429283.153345:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634938496 00002000:00100000:3.0:1789429283.153384:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946f2f508700 x1876351634938496/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.153393:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f508700 with x1876351634938496 ext(348160->385023) 00010000:00010000:3.0:1789429283.153400:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.153413:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.153419:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f508700 00000100:00100000:3.0:1789429283.153438:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1369 00000100:00100000:3.0:1789429283.153447:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634938496:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429283.155251:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648322688:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429283.155283:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 29 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.155303:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547600, rc 0) 00000100:00100000:2.0:1789429283.155418:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634938240:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5903us (6124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.155426:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5671 00000100:00100000:3.0:1789429283.161514:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634938496:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 8054us (8380us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429283.161527:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1369 00002000:00100000:3.0:1789429283.161540:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946f2f508700 x1876351634938496/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.161551:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f508700 with x1876351634938496 ext(348160->385023) 00010000:00010000:3.0:1789429283.161561:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.161578:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.161586:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f508700 00000100:00100000:3.0:1789429283.166154:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.166260:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634938624 00000100:00100000:1.0:1789429283.166271:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634938624 00000100:00100000:1.0:1789429283.166325:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5672 00000100:00100000:1.0:1789429283.166335:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634938624:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.166355:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.166372:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c024 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.166402:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(66 266) 00010000:00010000:1.0:1789429283.166409:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.166415:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(67 266) 00010000:00010000:1.0:1789429283.166420:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 21 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.166459:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.166473:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 21 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.166485:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:3.0:1789429283.167112:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.167396:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634938752 00000100:00100000:2.0:1789429283.167402:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634938752 00010000:00010000:2.0:1789429283.167430:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 22 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.167553:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6100 00000100:00100000:2.0:1789429283.167562:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351634938752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429283.167583:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429283.167605:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 22 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.167618:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 22 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.167649:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263603cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c016 expref: 22 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.167664:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 266) 00010000:00010000:2.0:1789429283.167668:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 266) 00010000:00010000:2.0:1789429283.167677:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.167685:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.167714:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.167727:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 28 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.167740:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648322944:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.168587:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634938624:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2249us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.168596:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5672 00000100:00100000:2.0:1789429283.171835:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.176403:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648322944:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429283.176430:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429283.176484:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351634938752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8921us (9371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.176495:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6100 00000100:00100000:0.0:1789429283.177840:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.177911:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634938880 00000100:00100000:3.0:1789429283.177919:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634938880 00010000:00010000:3.0:1789429283.177955:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.177991:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6101 00000100:00100000:3.0:1789429283.178001:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2369:x1876351634938880:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429283.178014:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429283.178036:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.178055:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.178079:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c01d expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.178097:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 266) 00010000:00010000:3.0:1789429283.178102:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 266) 00010000:00010000:3.0:1789429283.178110:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.178120:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.178175:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.178190:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648323072:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429283.178286:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429283.182553:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648323072:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429283.182592:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429283.182654:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+28:2369:x1876351634938880:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4653us (4817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.182668:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6101 00000100:00100000:0.0:1789429283.188389:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.188477:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634939008 00000100:00100000:1.0:1789429283.188487:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634939008 00000100:00100000:1.0:1789429283.188544:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5673 00000100:00100000:1.0:1789429283.188553:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634939008:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.188572:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.188602:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c02b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.188648:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.188659:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(68 266) 00010000:00010000:1.0:1789429283.188664:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 266) 00010000:00010000:1.0:1789429283.188669:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.188702:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.188716:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 19 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.188730:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34079c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648323200:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429283.188964:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.193868:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.193883:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34079c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648323200:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429283.193925:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.193947:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634939264 00010000:00010000:1.0:1789429283.193949:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:3.0:1789429283.193954:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634939264 00010000:00010000:3.0:1789429283.193990:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.194007:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634939008:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5454us (5628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.194015:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5673 00000100:00100000:3.0:1789429283.194027:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6102 00000100:00100000:3.0:1789429283.194034:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634939264:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429283.194046:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429283.194068:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.194081:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.194105:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263603d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c024 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.194119:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 266) 00010000:00010000:3.0:1789429283.194123:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 266) 00010000:00010000:3.0:1789429283.194131:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.194142:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.194252:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.194266:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648323328:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429283.194328:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696240 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.198737:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.198865:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648323328:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.198890:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429283.199062:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2370:x1876351634939264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5026us (5200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.199073:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6102 00000100:00100000:0.0:1789429283.199323:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.199443:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634939136 00000100:00100000:3.0:1789429283.199451:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634939136 00000100:00100000:3.0:1789429283.199498:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5674 00000100:00100000:3.0:1789429283.199507:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634939136:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429283.199525:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429283.199543:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c032 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.199573:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.199582:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(69 266) 00010000:00010000:3.0:1789429283.199586:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 266) 00010000:00010000:3.0:1789429283.199591:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.199621:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.199639:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 28 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.199651:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648323456:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429283.199713:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.199973:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634939392 00000100:00100000:1.0:1789429283.199978:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634939392 00002000:00100000:1.0:1789429283.200009:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f2f508a80 x1876351634939392/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.200019:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f508a80 with x1876351634939392 ext(348160->352255) 00010000:00010000:1.0:1789429283.200025:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.200037:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429283.200044:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f508a80 00000100:00100000:1.0:1789429283.200074:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1370 00000100:00100000:1.0:1789429283.200081:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634939392:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429283.200326:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634939392:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 244us (1002us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429283.200334:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1370 00002000:00100000:1.0:1789429283.200340:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f2f508a80 x1876351634939392/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.200349:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f508a80 with x1876351634939392 ext(348160->352255) 00010000:00010000:1.0:1789429283.200356:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.200365:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429283.200373:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f508a80 00000100:00100000:3.0:1789429283.208607:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648323456:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429283.208647:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.208669:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429283.208730:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634939136:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9223us (10001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.208738:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5674 00000100:00100000:2.0:1789429283.212437:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.212533:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.212730:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634939648 00000100:00100000:0.0:1789429283.212740:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634939648 00000100:00100000:0.0:1789429283.212797:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5675 00000100:00100000:0.0:1789429283.212808:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634939648:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429283.212825:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789429283.212988:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634939520 00000100:00100000:3.0:1789429283.212993:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634939520 00010000:00010000:0.0:1789429283.212999:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c039 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.213015:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 31 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.213030:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(70 266) 00010000:00010000:0.0:1789429283.213038:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.213045:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(71 266) 00000100:00100000:3.0:1789429283.213046:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6103 00010000:00010000:0.0:1789429283.213051:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.213053:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634939520:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429283.213062:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429283.213082:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 31 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.213088:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.213101:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 31 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.213169:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.213184:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429283.213357:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634939648:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 551us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.213365:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5675 00010000:00010000:3.0:1789429283.214424:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263603e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c02b expref: 30 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.214445:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 266) 00010000:00010000:3.0:1789429283.214449:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 266) 00010000:00010000:3.0:1789429283.214458:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.214468:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.215155:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.215175:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 19 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.215190:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648323712:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429283.215275:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573300 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.221073:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648323712:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.221103:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.221168:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634939520:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8114us (8633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.221179:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6103 00000100:00100000:2.0:1789429283.221480:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.223127:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634939776 00000100:00100000:0.0:1789429283.223371:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634939776 00002000:00100000:0.0:1789429283.223425:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946f1c0aaa00 x1876351634939776/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.223436:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0aaa00 with x1876351634939776 ext(348160->385023) 00010000:00010000:0.0:1789429283.223445:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.223462:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.223470:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0aaa00 00000100:00100000:0.0:1789429283.223543:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1371 00000100:00100000:0.0:1789429283.223553:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634939776:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.228531:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634939776:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4968us (7042us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429283.228545:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1371 00002000:00100000:0.0:1789429283.228558:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946f1c0aaa00 x1876351634939776/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.228568:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0aaa00 with x1876351634939776 ext(348160->385023) 00010000:00010000:0.0:1789429283.228578:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.228597:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.228606:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0aaa00 00000100:00100000:1.0:1789429283.231386:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.231427:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.231575:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634939904 00000100:00100000:0.0:1789429283.231585:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634939904 00010000:00010000:0.0:1789429283.231624:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.231667:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6104 00000100:00100000:0.0:1789429283.231677:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634939904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429283.231696:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429283.231721:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.231734:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.231754:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad7263603e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c032 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.231772:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 266) 00010000:00010000:0.0:1789429283.231776:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 266) 00010000:00010000:0.0:1789429283.231784:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.231793:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.231829:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.231841:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f509c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648323840:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.231920:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.232666:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634940032 00000100:00100000:2.0:1789429283.232673:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634940032 00000100:00100000:2.0:1789429283.232727:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5676 00000100:00100000:2.0:1789429283.232736:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634940032:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.232750:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.232765:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c040 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.232786:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.232795:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(72 266) 00010000:00010000:2.0:1789429283.232798:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 266) 00010000:00010000:2.0:1789429283.232803:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 21 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.232827:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.232840:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 28 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.232851:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648323968:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429283.232908:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573540 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.235496:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648323968:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429283.235536:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 21 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.235556:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546c00, rc 0) 00000100:00100000:2.0:1789429283.236089:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634940032:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2915us (4222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.236098:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5676 00000100:00100000:0.0:1789429283.237158:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f509c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648323840:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.237186:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.237437:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634939904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5759us (6056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.237449:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6104 00000100:00100000:3.0:1789429283.238651:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.238955:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634940160 00000100:00100000:2.0:1789429283.238963:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634940160 00002000:00100000:2.0:1789429283.239067:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f29de8e00 x1876351634940160/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.239079:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de8e00 with x1876351634940160 ext(348160->352255) 00010000:00010000:2.0:1789429283.239088:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.239104:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429283.239111:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29de8e00 00000100:00100000:0.0:1789429283.239182:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1372 00000100:00100000:0.0:1789429283.239194:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2368:x1876351634940160:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.239428:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2368:x1876351634940160:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 236us (780us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429283.239435:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1372 00002000:00100000:0.0:1789429283.239443:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f29de8e00 x1876351634940160/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.239451:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de8e00 with x1876351634940160 ext(348160->352255) 00010000:00010000:0.0:1789429283.239457:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.239468:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.239475:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29de8e00 00000100:00100000:1.0:1789429283.242783:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.243251:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.243333:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634940288 00000100:00100000:2.0:1789429283.243343:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634940288 00000100:00100000:2.0:1789429283.243395:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5677 00000100:00100000:2.0:1789429283.243406:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634940288:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.243422:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.243440:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c047 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.243764:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634940416 00000100:00100000:1.0:1789429283.243768:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634940416 00010000:00010000:1.0:1789429283.243792:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 31 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.243825:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6105 00000100:00100000:1.0:1789429283.243833:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634940416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.243844:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429283.244045:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(73 266) 00010000:00010000:2.0:1789429283.244055:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.244062:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(74 266) 00010000:00010000:2.0:1789429283.244067:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 31 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.244079:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 31 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.244093:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 31 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.244109:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.244111:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263603ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c039 expref: 31 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.244124:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.244126:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 266) 00010000:00010000:1.0:1789429283.244129:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 266) 00010000:00010000:1.0:1789429283.244158:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.244305:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.244320:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547600, rc 0) 00010000:00010000:1.0:1789429283.244331:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.244343:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 19 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.244355:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648324224:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429283.244474:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634940288:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 1067us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.244481:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5677 00000100:00100000:1.0:1789429283.246053:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.250404:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.250553:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634940544 00000100:00100000:2.0:1789429283.250563:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634940544 00010000:00010000:2.0:1789429283.250610:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.250644:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6106 00000100:00100000:2.0:1789429283.250655:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634940544:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429283.250669:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429283.250692:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.250707:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.250731:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 266) 00010000:00010000:2.0:1789429283.250735:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 266) 00010000:00010000:2.0:1789429283.250743:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.250752:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.250796:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.250811:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648324352:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429283.250905:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573540 going to sleep for 11 seconds 00010000:00010000:3.0:1789429283.252330:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263603f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c040 expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.252352:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648324224:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429283.252373:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429283.252423:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634940416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8590us (9172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.252433:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6105 00000100:00100000:1.0:1789429283.254713:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648324352:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.254740:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429283.254943:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634940544:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4288us (4546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.254954:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6106 00000100:00100000:1.0:1789429283.263251:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.266021:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634940672 00000100:00100000:3.0:1789429283.266037:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634940672 00000100:00100000:2.0:1789429283.266406:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5678 00000100:00100000:2.0:1789429283.266420:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634940672:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.266440:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.266458:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c04e expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.266500:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.266511:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(75 266) 00010000:00010000:2.0:1789429283.266515:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(76 266) 00010000:00010000:2.0:1789429283.266521:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.266554:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.266567:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 28 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.266592:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648324480:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429283.266686:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.268830:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.268965:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634940800 00000100:00100000:0.0:1789429283.268985:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634940800 00002000:00100000:0.0:1789429283.269032:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f1c0a8700 x1876351634940800/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.269043:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a8700 with x1876351634940800 ext(348160->352255) 00010000:00010000:0.0:1789429283.269051:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.269067:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.269082:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0a8700 00000100:00100000:0.0:1789429283.269113:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1373 00000100:00100000:0.0:1789429283.269122:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634940800:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.269333:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634940800:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 211us (512us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429283.269341:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1373 00002000:00100000:0.0:1789429283.269348:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f1c0a8700 x1876351634940800/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.269356:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a8700 with x1876351634940800 ext(348160->352255) 00010000:00010000:0.0:1789429283.269362:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.269374:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.269380:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c0a8700 00000100:00100000:3.0:1789429283.270478:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648324480:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429283.270511:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.270528:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546400, rc 0) 00000100:00100000:3.0:1789429283.270627:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634940672:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4209us (7428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.270635:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5678 00000100:00100000:2.0:1789429283.273674:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.274196:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.274543:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634940928 00000100:00100000:0.0:1789429283.274553:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634940928 00000100:00100000:0.0:1789429283.274713:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5679 00000100:00100000:0.0:1789429283.274725:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634940928:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429283.274742:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429283.274760:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c055 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.274807:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(76 266) 00010000:00010000:0.0:1789429283.274816:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.274823:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(77 266) 00010000:00010000:0.0:1789429283.274828:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.274878:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.274893:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.274911:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429283.274981:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634940928:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 251us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.274989:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5679 00000100:00100000:2.0:1789429283.275451:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634941056 00000100:00100000:2.0:1789429283.275457:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634941056 00010000:00010000:2.0:1789429283.275483:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 30 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.275520:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6107 00000100:00100000:2.0:1789429283.275528:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351634941056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429283.275538:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429283.275560:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 30 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.275586:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 30 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.275607:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263603fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c047 expref: 30 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.275620:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 266) 00010000:00010000:2.0:1789429283.275624:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 266) 00010000:00010000:2.0:1789429283.275631:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.275640:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.275667:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.275678:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 19 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.275691:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648324736:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429283.275752:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573180 going to sleep for 11 seconds 00000100:00100000:3.0:1789429283.280321:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.280498:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648324736:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429283.280527:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.280665:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634941184 00000100:00100000:0.0:1789429283.280673:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634941184 00002000:00100000:0.0:1789429283.280724:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946f29de9f80 x1876351634941184/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.280736:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9f80 with x1876351634941184 ext(348160->385023) 00010000:00010000:0.0:1789429283.280745:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.280762:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.280771:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29de9f80 00000100:00100000:0.0:1789429283.280809:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1374 00000100:00100000:0.0:1789429283.280818:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634941184:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429283.281089:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634941056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5560us (6891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.281099:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6107 00000100:00100000:0.0:1789429283.286904:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634941184:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6075us (6579us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429283.286919:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1374 00002000:00100000:0.0:1789429283.286931:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (348160->385023) req@ffff946f29de9f80 x1876351634941184/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.286950:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9f80 with x1876351634941184 ext(348160->385023) 00010000:00010000:0.0:1789429283.286960:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.286977:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.286986:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29de9f80 00000100:00100000:0.0:1789429283.300236:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.300365:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634941312 00000100:00100000:2.0:1789429283.300375:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634941312 00000100:00100000:2.0:1789429283.300433:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5680 00000100:00100000:2.0:1789429283.300443:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634941312:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.300461:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.300479:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c05c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.300512:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(78 266) 00010000:00010000:2.0:1789429283.300521:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.300528:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(79 266) 00010000:00010000:2.0:1789429283.300534:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 21 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.300575:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.300649:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634941440 00010000:00010000:2.0:1789429283.300650:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.300653:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634941440 00010000:00010000:2.0:1789429283.300667:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 22 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.300674:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 22 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.300680:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547600, rc 0) 00000100:00100000:1.0:1789429283.300706:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6108 00000100:00100000:1.0:1789429283.300713:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634941440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.300722:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789429283.300731:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:33938:x1876351634941312:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 290us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.300737:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5680 00010000:00010000:1.0:1789429283.300740:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 22 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.300752:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.300771:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad726360403 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c04e expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.300785:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 266) 00010000:00010000:1.0:1789429283.300789:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 266) 00010000:00010000:1.0:1789429283.300797:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.300807:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.300834:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.300846:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 28 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.300860:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648324992:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.300908:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c900 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.304934:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.305043:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648324992:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.305068:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429283.305069:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634941568 00000100:00100000:3.0:1789429283.305076:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634941568 00010000:00010000:3.0:1789429283.305115:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.305133:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634941440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4420us (4557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.305142:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6108 00000100:00100000:3.0:1789429283.305165:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6109 00000100:00100000:3.0:1789429283.305175:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634941568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429283.305188:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429283.305750:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.305765:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.305792:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad72636040a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c055 expref: 29 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.305819:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 266) 00010000:00010000:1.0:1789429283.305824:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 266) 00010000:00010000:1.0:1789429283.305832:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.305843:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.305881:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.305895:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648325120:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.305958:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.312404:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648325120:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.312431:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429283.312494:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+28:2371:x1876351634941568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7319us (7570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.312505:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6109 00000100:00100000:3.0:1789429283.317347:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.317442:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634941696 00000100:00100000:2.0:1789429283.317452:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634941696 00000100:00100000:2.0:1789429283.317512:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5681 00000100:00100000:2.0:1789429283.317522:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:33927:x1876351634941696:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.317539:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.317556:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c063 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.317590:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.317600:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(80 266) 00010000:00010000:2.0:1789429283.317604:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 266) 00010000:00010000:2.0:1789429283.317609:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.317643:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 19 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.317657:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 19 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.317672:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648325248:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429283.317745:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573180 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.326549:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.326757:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648325248:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429283.326813:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.326836:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547000, rc 0) 00000100:00100000:1.0:1789429283.326893:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:33927:x1876351634941696:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9371us (9554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.326903:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5681 00000100:00100000:3.0:1789429283.327122:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634941824 00000100:00100000:3.0:1789429283.327130:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634941824 00010000:00010000:3.0:1789429283.327171:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.327235:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6110 00000100:00100000:3.0:1789429283.327245:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634941824:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429283.327258:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429283.327280:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.327294:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.327318:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad726360411 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c05c expref: 20 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.327330:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 266) 00010000:00010000:3.0:1789429283.327334:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 266) 00010000:00010000:3.0:1789429283.327341:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.327351:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.327388:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.327405:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f092a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648325376:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429283.327454:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.332839:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.333074:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634941952 00000100:00100000:2.0:1789429283.333083:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634941952 00002000:00100000:2.0:1789429283.333131:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f2f508000 x1876351634941952/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.333142:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f508000 with x1876351634941952 ext(348160->352255) 00002000:00010000:2.0:1789429283.333157:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f508000 00000100:00100000:2.0:1789429283.333186:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11398 00000100:00100000:2.0:1789429283.333196:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634941952:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429283.333406:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634941952:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 211us (576us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429283.333414:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11398 00002000:00100000:2.0:1789429283.333421:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (348160->352255) req@ffff946f2f508000 x1876351634941952/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.333428:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f508000 with x1876351634941952 ext(348160->352255) 00002000:00010000:2.0:1789429283.333431:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f508000 00000100:00100000:3.0:1789429283.333818:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f092a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648325376:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429283.333840:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429283.333870:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634941824:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6626us (7331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.333879:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6110 00000100:00100000:0.0:1789429283.348277:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.348322:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.348407:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634942080 00000100:00100000:3.0:1789429283.348418:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634942080 00000100:00100000:3.0:1789429283.348465:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5682 00000100:00100000:3.0:1789429283.348475:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33938:x1876351634942080:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429283.348495:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429283.348514:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636041f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c06a expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.348550:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.348561:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(81 266) 00010000:00010000:3.0:1789429283.348566:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 266) 00010000:00010000:3.0:1789429283.348572:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636041f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c06a expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.348607:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.348622:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 28 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.348636:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f092a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648325504:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429283.348718:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.349175:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634942208 00000100:00100000:2.0:1789429283.349181:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634942208 00002000:00100000:2.0:1789429283.349246:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (352256->356351) req@ffff946f3f17ad80 x1876351634942208/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.349264:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17ad80 with x1876351634942208 ext(352256->356351) 00010000:00010000:2.0:1789429283.349271:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.349285:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429283.349292:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f17ad80 00000100:00100000:2.0:1789429283.349317:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1375 00000100:00100000:2.0:1789429283.349325:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634942208:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429283.349509:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634942208:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 183us (1185us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429283.349517:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1375 00002000:00100000:2.0:1789429283.349524:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (352256->356351) req@ffff946f3f17ad80 x1876351634942208/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.349533:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17ad80 with x1876351634942208 ext(352256->356351) 00010000:00010000:2.0:1789429283.349539:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.349551:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429283.349559:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f17ad80 00000100:00100000:0.0:1789429283.362471:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.363098:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634942336 00000100:00100000:3.0:1789429283.363108:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634942336 00002000:00100000:3.0:1789429283.363175:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f3fbcb800 x1876351634942336/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.363187:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcb800 with x1876351634942336 ext(356352->360447) 00010000:00010000:3.0:1789429283.363196:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.363241:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.363250:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcb800 00000100:00100000:3.0:1789429283.363275:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1376 00000100:00100000:3.0:1789429283.363284:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634942336:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429283.363473:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634942336:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 189us (1009us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429283.363480:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1376 00002000:00100000:3.0:1789429283.363487:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f3fbcb800 x1876351634942336/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.363496:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcb800 with x1876351634942336 ext(356352->360447) 00010000:00010000:3.0:1789429283.363502:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.363512:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.363519:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3fbcb800 00000100:00100000:3.0:1789429283.365466:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f092a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648325504:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429283.365498:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636041f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->352255] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c06a expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.365519:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4200, rc 0) 00000100:00100000:3.0:1789429283.365567:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634942080:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 17093us (17302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.365576:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5682 00000100:00100000:0.0:1789429283.367190:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.367361:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634942464 00000100:00100000:1.0:1789429283.367370:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634942464 00002000:00100000:1.0:1789429283.367412:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (348160->356351) req@ffff946f344b8000 x1876351634942464/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 8680/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.367424:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b8000 with x1876351634942464 ext(348160->356351) 00010000:00010000:1.0:1789429283.367432:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.367448:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 29 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429283.367456:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b8000 00000100:00100000:1.0:1789429283.367482:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1377 00000100:00100000:1.0:1789429283.367490:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634942464:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1789429283.367864:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634942464:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 373us (683us total) trans 4294969569 rc 0/0 00000100:00100000:1.0:1789429283.367872:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1377 00002000:00100000:1.0:1789429283.367878:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (348160->356351) req@ffff946f344b8000 x1876351634942464/t4294969569(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 8680/448 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.367886:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f344b8000 with x1876351634942464 ext(348160->356351) 00010000:00010000:1.0:1789429283.367892:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 31 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.367905:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 31 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429283.367912:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f344b8000 00000100:00100000:0.0:1789429283.372380:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.372480:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634942592 00000100:00100000:2.0:1789429283.372490:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634942592 00000100:00100000:2.0:1789429283.372541:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5683 00000100:00100000:2.0:1789429283.372549:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634942592:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.372564:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.372588:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c071 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.372618:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(82 266) 00010000:00010000:2.0:1789429283.372623:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 266) 00010000:00010000:2.0:1789429283.372629:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.372640:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.372651:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546c00, rc 0) 00000100:00100000:2.0:1789429283.372694:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634942592:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 146us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.372700:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5683 00000100:00100000:2.0:1789429283.374563:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.374698:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634942720 00000100:00100000:0.0:1789429283.374705:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634942720 00010000:00010000:0.0:1789429283.374739:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 32 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.374868:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6111 00000100:00100000:0.0:1789429283.374878:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634942720:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429283.374892:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429283.374916:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 32 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.374935:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 32 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.374957:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726360418 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [348160->18446744073709551615] (req 348160->352255) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c063 expref: 32 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.374984:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 266) 00010000:00010000:0.0:1789429283.374988:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 266) 00010000:00010000:0.0:1789429283.374998:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636041f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c06a expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.375008:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636041f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c06a expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.375017:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 266) 00010000:00010000:0.0:1789429283.375019:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 266) 00010000:00010000:0.0:1789429283.375024:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.375034:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.375068:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.375088:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01276300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648325632:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.375258:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636041f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c06a expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.375269:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648325760:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.375294:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515900 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.381452:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01276300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648325632:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.381466:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648325760:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.381490:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.381554:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634942720:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6676us (6998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.381566:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6111 00000100:00100000:2.0:1789429283.383878:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.384123:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634942848 00000100:00100000:1.0:1789429283.384193:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634942848 00002000:00100000:1.0:1789429283.385310:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (348160->356351) req@ffff946f1191e680 x1876351634942848/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.385323:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191e680 with x1876351634942848 ext(348160->356351) 00002000:00010000:1.0:1789429283.385329:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1191e680 00000100:00100000:1.0:1789429283.385407:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11399 00000100:00100000:1.0:1789429283.385416:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634942848:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429283.385696:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634942848:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 279us (1824us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1789429283.385704:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11399 00002000:00100000:1.0:1789429283.385711:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (348160->356351) req@ffff946f1191e680 x1876351634942848/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/8632 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.385720:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191e680 with x1876351634942848 ext(348160->356351) 00002000:00010000:1.0:1789429283.385724:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1191e680 00000100:00100000:2.0:1789429283.391009:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.391271:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634942976 00000100:00100000:0.0:1789429283.391282:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634942976 00000100:00100000:0.0:1789429283.391342:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5684 00000100:00100000:0.0:1789429283.391352:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634942976:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429283.391370:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429283.391387:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c078 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.391421:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.391438:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(83 266) 00010000:00010000:0.0:1789429283.391442:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 266) 00010000:00010000:0.0:1789429283.391447:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 21 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.391483:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.391497:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 30 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.391511:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648325888:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429283.391589:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515900 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.395188:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.395409:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648325888:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429283.395438:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 21 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.395462:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:1.0:1789429283.395518:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634942976:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4167us (4516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.395527:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5684 00000100:00100000:0.0:1789429283.396040:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634943104 00000100:00100000:0.0:1789429283.396047:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634943104 00002000:00100000:0.0:1789429283.396086:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f1191d180 x1876351634943104/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.396095:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191d180 with x1876351634943104 ext(356352->360447) 00010000:00010000:0.0:1789429283.396102:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 31 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.396115:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 31 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.396127:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191d180 00000100:00100000:0.0:1789429283.396174:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1378 00000100:00100000:0.0:1789429283.396183:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634943104:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.396419:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634943104:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 236us (1241us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429283.396426:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1378 00002000:00100000:0.0:1789429283.396433:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f1191d180 x1876351634943104/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.396441:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1191d180 with x1876351634943104 ext(356352->360447) 00010000:00010000:0.0:1789429283.396447:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 31 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.396458:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 31 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.396465:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1191d180 00000100:00100000:2.0:1789429283.406066:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.406164:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.407140:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634943232 00000100:00100000:0.0:1789429283.407158:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634943232 00000100:00100000:0.0:1789429283.407221:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5685 00000100:00100000:0.0:1789429283.407231:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1191ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634943232:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429283.407248:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429283.407267:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c07f expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.407305:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(84 266) 00010000:00010000:0.0:1789429283.407314:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.407322:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(85 266) 00010000:00010000:0.0:1789429283.407327:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 32 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.407365:0:6680:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.407379:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 32 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.407392:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429283.407446:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1191ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634943232:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 215us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.407453:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5685 00000100:00100000:0.0:1789429283.409261:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634943360 00000100:00100000:0.0:1789429283.409272:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634943360 00010000:00010000:0.0:1789429283.409304:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 32 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.409350:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6112 00000100:00100000:0.0:1789429283.409359:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634943360:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429283.409373:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429283.409394:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 32 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.409408:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 32 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.409431:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad726360426 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c071 expref: 32 pid: 6681 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.409445:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 266) 00010000:00010000:0.0:1789429283.409449:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 266) 00010000:00010000:0.0:1789429283.409458:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.409468:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.409498:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.409513:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 20 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.409527:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648326144:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.409600:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.425062:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.427285:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634943488 00000100:00100000:0.0:1789429283.427296:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634943488 00002000:00100000:0.0:1789429283.427351:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f417f1180 x1876351634943488/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.427362:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f1180 with x1876351634943488 ext(356352->393215) 00010000:00010000:0.0:1789429283.427371:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.427401:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.427410:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f417f1180 00000100:00100000:0.0:1789429283.427432:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1379 00000100:00100000:0.0:1789429283.427441:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634943488:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.427661:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648326144:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.427677:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.427703:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634943360:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 18346us (21540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.427712:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6112 00000100:00100000:3.0:1789429283.440287:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634943488:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 12836us (15222us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429283.440301:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1379 00002000:00100000:3.0:1789429283.440313:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f417f1180 x1876351634943488/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.440323:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f417f1180 with x1876351634943488 ext(356352->393215) 00010000:00010000:3.0:1789429283.440333:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.440351:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.440360:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f417f1180 00000100:00100000:0.0:1789429283.447613:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.447658:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.447780:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634943616 00000100:00100000:1.0:1789429283.447790:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634943616 00000100:00100000:1.0:1789429283.447845:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5686 00000100:00100000:1.0:1789429283.447855:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634943616:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.447872:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.447942:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c086 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.447974:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(86 266) 00010000:00010000:1.0:1789429283.447983:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.447991:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(87 266) 00010000:00010000:1.0:1789429283.447996:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 22 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.448037:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.448057:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 22 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.448071:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:1.0:1789429283.448133:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:33938:x1876351634943616:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 279us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.448140:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5686 00000100:00100000:1.0:1789429283.448173:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634943744 00000100:00100000:1.0:1789429283.448177:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634943744 00010000:00010000:1.0:1789429283.448193:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 22 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.448238:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6113 00000100:00100000:1.0:1789429283.448246:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2371:x1876351634943744:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.448256:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429283.448278:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 22 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.448292:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 22 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.448311:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad72636042d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c078 expref: 22 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.448328:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 266) 00010000:00010000:1.0:1789429283.448331:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 266) 00010000:00010000:1.0:1789429283.448339:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.448350:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.448373:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.448386:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 30 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.448400:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f417f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648326400:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.448452:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.451156:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f417f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648326400:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.451182:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429283.451255:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634943744:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3009us (3595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.451266:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6113 00000100:00100000:0.0:1789429283.451481:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.451593:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634943872 00000100:00100000:3.0:1789429283.451601:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634943872 00010000:00010000:3.0:1789429283.451633:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 31 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.451665:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6114 00000100:00100000:3.0:1789429283.451672:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351634943872:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429283.451685:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429283.451708:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 31 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.451720:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 31 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.451744:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad726360434 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c07f expref: 31 pid: 6680 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.451756:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 266) 00010000:00010000:3.0:1789429283.451760:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 266) 00010000:00010000:3.0:1789429283.451768:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.451789:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.451822:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.451835:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f092a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648326528:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429283.451892:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f07696480 going to sleep for 11 seconds 00000100:00100000:3.0:1789429283.454333:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f092a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648326528:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429283.454359:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429283.454405:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2368:x1876351634943872:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2731us (2925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.454415:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6114 00000100:00100000:3.0:1789429283.470374:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.470468:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634944000 00000100:00100000:0.0:1789429283.470478:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634944000 00000100:00100000:0.0:1789429283.470531:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5687 00000100:00100000:0.0:1789429283.470540:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634944000:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429283.470560:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429283.470591:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c08d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.470624:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.470633:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(88 266) 00010000:00010000:0.0:1789429283.470637:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 266) 00010000:00010000:0.0:1789429283.470642:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.470675:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.470688:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.470701:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648326656:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429283.470783:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.471551:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.471868:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634944128 00000100:00100000:3.0:1789429283.471874:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634944128 00002000:00100000:3.0:1789429283.471909:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f29de9c00 x1876351634944128/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.471920:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9c00 with x1876351634944128 ext(356352->393215) 00010000:00010000:3.0:1789429283.471927:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.471942:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.471951:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29de9c00 00000100:00100000:3.0:1789429283.471980:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1380 00000100:00100000:3.0:1789429283.471990:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634944128:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429283.480337:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648326656:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429283.480371:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.480394:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:1.0:1789429283.480449:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634944000:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9909us (10084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.480457:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5687 00000100:00100000:3.0:1789429283.484508:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634944128:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 12134us (12573us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429283.484524:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1380 00002000:00100000:3.0:1789429283.484538:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f29de9c00 x1876351634944128/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.484547:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9c00 with x1876351634944128 ext(356352->393215) 00010000:00010000:3.0:1789429283.484557:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.484574:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.484582:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29de9c00 00000100:00100000:1.0:1789429283.499247:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.501220:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.501263:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634944384 00000100:00100000:1.0:1789429283.501274:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634944384 00010000:00010000:1.0:1789429283.501314:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.501351:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6115 00000100:00100000:1.0:1789429283.501361:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634944384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.501375:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429283.501402:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.501415:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.501441:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad72636043b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c086 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.501470:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 266) 00010000:00010000:1.0:1789429283.501476:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 266) 00010000:00010000:1.0:1789429283.501485:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.501494:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.501534:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.501548:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648326784:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.501621:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.507581:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634944256 00000100:00100000:2.0:1789429283.507595:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634944256 00000100:00100000:2.0:1789429283.507666:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5688 00000100:00100000:2.0:1789429283.507676:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f417f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634944256:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.507695:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.507725:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c094 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.507759:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.507768:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(89 266) 00010000:00010000:2.0:1789429283.507773:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 266) 00010000:00010000:2.0:1789429283.507778:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 22 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.507812:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.507826:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 30 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.507841:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648326912:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429283.507924:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.512292:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648326784:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.512318:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429283.512387:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634944384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11026us (11185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.512399:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6115 00000100:00100000:3.0:1789429283.520836:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648326912:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429283.520876:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 21 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.520898:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546600, rc 0) 00000100:00100000:3.0:1789429283.521047:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f417f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634944256:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 13363us (21801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.521058:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5688 00000100:00100000:0.0:1789429283.532672:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.533032:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634944512 00000100:00100000:3.0:1789429283.533043:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634944512 00002000:00100000:3.0:1789429283.533091:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f29deaa00 x1876351634944512/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.533103:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29deaa00 with x1876351634944512 ext(356352->360447) 00010000:00010000:3.0:1789429283.533112:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.533139:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.533157:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29deaa00 00000100:00100000:3.0:1789429283.533188:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1381 00000100:00100000:3.0:1789429283.533209:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351634944512:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429283.533419:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351634944512:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 221us (756us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429283.533427:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1381 00002000:00100000:3.0:1789429283.533433:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f29deaa00 x1876351634944512/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.533450:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29deaa00 with x1876351634944512 ext(356352->360447) 00010000:00010000:3.0:1789429283.533457:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.533473:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.533479:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29deaa00 00000100:00100000:2.0:1789429283.558669:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.558711:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.558744:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634944640 00000100:00100000:2.0:1789429283.558753:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634944640 00000100:00100000:2.0:1789429283.558797:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5689 00000100:00100000:2.0:1789429283.558806:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634944640:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.558824:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.558842:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c09b expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.558875:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(90 266) 00010000:00010000:2.0:1789429283.558884:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.558892:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(91 266) 00010000:00010000:2.0:1789429283.558897:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 32 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.558936:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.558951:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 32 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.558964:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:1.0:1789429283.559055:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634944768 00000100:00100000:1.0:1789429283.559060:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634944768 00010000:00010000:1.0:1789429283.559080:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 33 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.559105:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6116 00000100:00100000:1.0:1789429283.559111:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+33:2369:x1876351634944768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.559120:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429283.559156:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 33 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.559170:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 33 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.559190:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360442 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c08d expref: 33 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.559218:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 266) 00010000:00010000:1.0:1789429283.559222:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 266) 00010000:00010000:1.0:1789429283.559229:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.559238:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.559262:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.559275:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 20 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.559289:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648327168:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.559365:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.564947:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634944640:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6129us (6221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.564961:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5689 00000100:00100000:1.0:1789429283.569786:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648327168:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.569885:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429283.569935:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351634944768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10823us (11274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.569947:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6116 00000100:00100000:1.0:1789429283.572889:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.572922:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634944896 00000100:00100000:1.0:1789429283.572931:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634944896 00010000:00010000:1.0:1789429283.572967:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.573002:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6117 00000100:00100000:1.0:1789429283.573012:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634944896:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.573026:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429283.573049:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.573063:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.573086:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360449 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c094 expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.573102:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 266) 00010000:00010000:1.0:1789429283.573107:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 266) 00010000:00010000:1.0:1789429283.573116:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.573133:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.573179:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.573194:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648327296:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.573294:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.577858:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.577885:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634945024 00000100:00100000:1.0:1789429283.577893:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634945024 00000100:00100000:1.0:1789429283.577937:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5690 00000100:00100000:1.0:1789429283.577945:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634945024:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.577961:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.577977:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0a2 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.578010:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.578019:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(92 266) 00010000:00010000:1.0:1789429283.578024:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 266) 00010000:00010000:1.0:1789429283.578029:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 22 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.578067:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 30 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.578080:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 30 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.578094:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648327424:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429283.578177:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.582797:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648327296:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.582821:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.582882:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2371:x1876351634944896:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9870us (9999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.582892:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6117 00000100:00100000:1.0:1789429283.597792:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.597817:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634945152 00000100:00100000:1.0:1789429283.597826:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634945152 00010000:00010000:1.0:1789429283.597865:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 31 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.597901:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6118 00000100:00100000:1.0:1789429283.597911:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634945152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.597924:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789429283.597941:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648327424:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429283.597946:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 31 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.597958:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 31 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.597991:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 21 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.598009:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:3.0:1789429283.598070:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b606300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634945024:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 20124us (20218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.598077:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5690 00010000:00010000:1.0:1789429283.600652:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360450 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c09b expref: 31 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.600675:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 266) 00010000:00010000:1.0:1789429283.600680:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 266) 00010000:00010000:1.0:1789429283.600688:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.600699:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.600741:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.600756:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648327552:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.600827:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.600885:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.602948:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634945280 00000100:00100000:0.0:1789429283.602964:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634945280 00000100:00100000:1.0:1789429283.603133:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5691 00000100:00100000:1.0:1789429283.603151:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634945280:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.603169:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.603189:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0a9 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.603246:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.603261:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(93 266) 00010000:00010000:1.0:1789429283.603265:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 266) 00010000:00010000:1.0:1789429283.603270:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 32 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.603304:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.603319:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 20 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.603334:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c34bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648327680:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429283.603419:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.611479:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c34bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648327680:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429283.611516:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 32 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.611538:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:0.0:1789429283.611596:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634945280:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8453us (10710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.611604:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5691 00000100:00100000:3.0:1789429283.612289:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648327552:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429283.612305:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429283.612345:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634945152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 14435us (14562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.612355:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6118 00000100:00100000:1.0:1789429283.618588:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.618673:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634945408 00000100:00100000:0.0:1789429283.618683:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634945408 00002000:00100000:0.0:1789429283.618732:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f1c348000 x1876351634945408/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.618743:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c348000 with x1876351634945408 ext(356352->393215) 00010000:00010000:0.0:1789429283.618751:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.618768:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.618776:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c348000 00000100:00100000:0.0:1789429283.618808:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1382 00000100:00100000:0.0:1789429283.618823:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634945408:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429283.631647:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634945408:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 12816us (13058us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429283.631660:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1382 00002000:00100000:3.0:1789429283.631674:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f1c348000 x1876351634945408/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.631685:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c348000 with x1876351634945408 ext(356352->393215) 00010000:00010000:3.0:1789429283.631696:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.631713:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.631721:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f1c348000 00000100:00100000:3.0:1789429283.635309:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.635344:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634945536 00000100:00100000:3.0:1789429283.635353:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634945536 00000100:00100000:3.0:1789429283.635405:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5692 00000100:00100000:3.0:1789429283.635419:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634945536:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429283.635436:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429283.636314:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0b0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.636352:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(94 266) 00010000:00010000:3.0:1789429283.636362:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.636369:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(95 266) 00010000:00010000:3.0:1789429283.636374:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 22 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.636412:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.636430:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 22 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.636664:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.636691:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634945664 00000100:00100000:0.0:1789429283.636696:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634945664 00010000:00010000:0.0:1789429283.636720:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 23 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.636742:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6119 00000100:00100000:0.0:1789429283.636749:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2370:x1876351634945664:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429283.636758:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429283.636776:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 23 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.636789:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 23 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.636810:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad726360457 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a2 expref: 23 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.636822:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 266) 00010000:00010000:0.0:1789429283.636825:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 266) 00010000:00010000:0.0:1789429283.636834:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.636843:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.636868:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.636879:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 30 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.636892:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648327936:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.636966:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515300 going to sleep for 11 seconds 00010000:00010000:3.0:1789429283.637792:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:2.0:1789429283.637934:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:33938:x1876351634945536:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2516us (2627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.637944:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5692 00000100:00100000:0.0:1789429283.640936:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.640966:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634945792 00000100:00100000:2.0:1789429283.640974:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634945792 00000100:00100000:0.0:1789429283.640984:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648327936:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.641006:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1789429283.641031:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f2f509f80 x1876351634945792/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1789429283.641051:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634945664:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4302us (4388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.641067:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6119 00002000:00100000:2.0:1789429283.641303:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f509f80 with x1876351634945792 ext(356352->360447) 00010000:00010000:2.0:1789429283.641314:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.641330:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429283.641338:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f509f80 00000100:00100000:2.0:1789429283.641360:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1383 00000100:00100000:2.0:1789429283.641370:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351634945792:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429283.641537:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351634945792:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 168us (608us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429283.641544:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1383 00002000:00100000:2.0:1789429283.641550:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f2f509f80 x1876351634945792/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.641558:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f509f80 with x1876351634945792 ext(356352->360447) 00010000:00010000:2.0:1789429283.641564:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.641578:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429283.641584:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f509f80 00000100:00100000:1.0:1789429283.651497:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.651560:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634945920 00000100:00100000:3.0:1789429283.651570:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634945920 00000100:00100000:1.0:1789429283.651584:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.651606:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634946048 00000100:00100000:1.0:1789429283.651610:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634946048 00000100:00100000:3.0:1789429283.651616:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5693 00000100:00100000:3.0:1789429283.651623:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634945920:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.651632:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 32 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.651637:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429283.651652:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0b7 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.651657:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6120 00000100:00100000:1.0:1789429283.651664:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+33:2368:x1876351634946048:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.651671:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429283.651679:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(96 266) 00010000:00010000:3.0:1789429283.651686:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.651693:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(97 266) 00010000:00010000:3.0:1789429283.651704:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 33 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.651833:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 33 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.651846:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 33 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.651866:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08edc4c/0xb4c3dad72636045e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0a9 expref: 33 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.651878:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 266) 00010000:00010000:1.0:1789429283.651893:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 266) 00010000:00010000:1.0:1789429283.651902:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.651911:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.651943:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.651956:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 20 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.651968:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648328064:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.652359:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.658657:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648328064:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.658681:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.658732:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2368:x1876351634946048:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7067us (7145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.658743:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6120 00010000:00010000:2.0:1789429283.659850:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 20 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.659868:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 20 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.659884:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648328192:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429283.659960:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538900 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.681738:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.681808:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.681833:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634946304 00000100:00100000:1.0:1789429283.681842:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634946304 00000100:00100000:1.0:1789429283.681887:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5694 00000100:00100000:1.0:1789429283.681897:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634946304:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.681914:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.681933:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0be expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.681962:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(98 266) 00010000:00010000:1.0:1789429283.681970:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.681977:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(99 266) 00010000:00010000:1.0:1789429283.681982:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 22 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.682028:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.682044:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 22 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.682057:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:2.0:1789429283.685077:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634946176 00000100:00100000:2.0:1789429283.685092:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634946176 00010000:00010000:2.0:1789429283.685154:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 23 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.685213:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6121 00000100:00100000:2.0:1789429283.685223:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2371:x1876351634946176:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429283.685238:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429283.685259:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 23 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.685273:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 23 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.685299:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 266) 00010000:00010000:2.0:1789429283.685303:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 266) 00010000:00010000:2.0:1789429283.685312:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.685321:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.685357:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.685371:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.685383:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648328448:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.687193:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:33938:x1876351634946304:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5287us (5375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.687221:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5694 00000100:00100000:2.0:1789429283.689425:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d63c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789429283.691118:0:8085:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.39@tcp) returned -22 from blocking AST (req@000000002ece0bd6 x1876351648328192) - normal race ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 22 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.691360:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360465 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b0 expref: 22 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.691377:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648328192:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429283.691417:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.691429:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.691442:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:0.0:1789429283.691495:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634945920:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 39870us (40003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.691505:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5693 00000100:00100000:2.0:1789429283.695758:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648328448:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429283.695787:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429283.695849:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634946176:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10626us (14121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.695860:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6121 00000100:00100000:3.0:1789429283.697739:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.697977:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634946432 00000100:00100000:1.0:1789429283.697987:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634946432 00010000:00010000:1.0:1789429283.698024:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.698067:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6122 00000100:00100000:1.0:1789429283.698076:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f093b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634946432:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.698089:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429283.698111:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.698125:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.698164:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad72636046c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0b7 expref: 31 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.698179:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 266) 00010000:00010000:1.0:1789429283.698183:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 266) 00010000:00010000:1.0:1789429283.698192:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.698240:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.698280:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.698295:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648328576:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.698365:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.709977:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.710013:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634946560 00000100:00100000:1.0:1789429283.710023:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634946560 00002000:00100000:1.0:1789429283.710071:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946e10309500 x1876351634946560/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1789429283.710273:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648328576:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.710296:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.710346:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f093b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351634946432:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12270us (12614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.710357:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6122 00002000:00100000:1.0:1789429283.711031:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10309500 with x1876351634946560 ext(356352->393215) 00002000:00010000:1.0:1789429283.711038:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e10309500 00000100:00100000:1.0:1789429283.711076:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11400 00000100:00100000:1.0:1789429283.711088:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634946560:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429283.712632:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.712704:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634946688 00000100:00100000:3.0:1789429283.713024:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634946688 00000100:00100000:3.0:1789429283.713075:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5695 00000100:00100000:3.0:1789429283.713085:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634946688:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429283.713098:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429283.713117:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0c5 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.713160:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 22 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.713170:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(100 266) 00010000:00010000:3.0:1789429283.713175:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 266) 00010000:00010000:3.0:1789429283.713180:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.713258:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 22 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.713273:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 22 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.713287:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f091880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648328704:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429283.713356:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538900 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.715948:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634946560:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4853us (5969us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429283.715963:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11400 00002000:00100000:1.0:1789429283.715976:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946e10309500 x1876351634946560/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.715986:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10309500 with x1876351634946560 ext(356352->393215) 00010000:00010000:1.0:1789429283.715995:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.716017:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 21 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429283.716025:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e10309500 00000100:00100000:2.0:1789429283.719409:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f091880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648328704:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429283.719446:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.719470:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:2.0:1789429283.719567:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634946688:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6483us (6940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.719577:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5695 00000100:00100000:1.0:1789429283.721095:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.721372:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634946816 00000100:00100000:3.0:1789429283.721382:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634946816 00000100:00100000:3.0:1789429283.721462:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5696 00000100:00100000:3.0:1789429283.721472:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634946816:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429283.721488:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429283.721506:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0cc expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.721536:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(101 266) 00010000:00010000:3.0:1789429283.721545:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.721553:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(102 266) 00010000:00010000:3.0:1789429283.721558:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 22 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.721594:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.721609:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 22 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.721623:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:1.0:1789429283.721662:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.721672:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:33938:x1876351634946816:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 201us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.721680:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5696 00000100:00100000:1.0:1789429283.722270:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634946944 00000100:00100000:1.0:1789429283.722276:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634946944 00010000:00010000:1.0:1789429283.722303:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 22 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.722337:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6123 00000100:00100000:1.0:1789429283.722347:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634946944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.722359:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429283.722385:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 22 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.722401:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 22 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.722429:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360473 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0be expref: 22 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.722443:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 266) 00010000:00010000:1.0:1789429283.722448:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 266) 00010000:00010000:1.0:1789429283.722457:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.722468:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.722498:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.722514:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 30 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.722527:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b4e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648328960:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.722600:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.727566:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.727930:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b4e2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648328960:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429283.728032:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429283.728093:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634946944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5746us (6431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.728104:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6123 00000100:00100000:0.0:1789429283.728686:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634947072 00000100:00100000:0.0:1789429283.728695:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634947072 00002000:00100000:0.0:1789429283.728737:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f3221fb80 x1876351634947072/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.728747:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221fb80 with x1876351634947072 ext(356352->360447) 00010000:00010000:0.0:1789429283.728755:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.728781:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.728789:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221fb80 00000100:00100000:0.0:1789429283.728814:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1384 00000100:00100000:0.0:1789429283.728823:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634947072:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.729316:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634947072:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 492us (1759us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429283.729325:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1384 00002000:00100000:0.0:1789429283.729332:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f3221fb80 x1876351634947072/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.729341:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221fb80 with x1876351634947072 ext(356352->360447) 00010000:00010000:0.0:1789429283.729347:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.729359:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.729366:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3221fb80 00000100:00100000:1.0:1789429283.744574:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.744673:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.744722:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634947328 00000100:00100000:1.0:1789429283.744733:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634947328 00010000:00010000:1.0:1789429283.744771:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.744805:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6124 00000100:00100000:1.0:1789429283.744815:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351634947328:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.744830:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429283.744851:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.744865:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.744891:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad72636047a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0c5 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.744905:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 266) 00010000:00010000:1.0:1789429283.744910:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 266) 00010000:00010000:1.0:1789429283.744920:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.744932:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.744970:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.744984:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648329088:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.745062:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789429283.745329:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634947200 00000100:00100000:3.0:1789429283.745334:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634947200 00000100:00100000:3.0:1789429283.745369:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5697 00000100:00100000:3.0:1789429283.745377:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634947200:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429283.745390:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429283.748193:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0d3 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.748712:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648329088:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.748738:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429283.748786:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351634947328:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3972us (4113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.748800:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6124 00010000:00010000:3.0:1789429283.749062:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.749073:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(103 266) 00010000:00010000:3.0:1789429283.749078:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 266) 00010000:00010000:3.0:1789429283.749084:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 31 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.749179:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 20 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.749196:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 20 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.750045:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f093800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648329216:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429283.750125:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538900 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.760183:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.761062:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f093800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648329216:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429283.761110:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 31 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.761133:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:2.0:1789429283.761545:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634947200:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 15822us (16651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.761556:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5697 00000100:00100000:2.0:1789429283.761601:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634947456 00000100:00100000:2.0:1789429283.761608:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634947456 00010000:00010000:2.0:1789429283.761643:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.761673:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6125 00000100:00100000:2.0:1789429283.761682:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634947456:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429283.761695:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429283.761717:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.761744:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.761767:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360481 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0cc expref: 21 pid: 20745 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.761780:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 266) 00010000:00010000:2.0:1789429283.761784:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 266) 00010000:00010000:2.0:1789429283.761792:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.761801:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.761835:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.761849:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648329344:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429283.761906:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.762390:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.762939:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634947584 00000100:00100000:0.0:1789429283.762946:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634947584 00000100:00100000:0.0:1789429283.763333:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5698 00000100:00100000:0.0:1789429283.763341:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634947584:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429283.763355:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429283.763371:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0da expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.763395:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.763404:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(104 266) 00010000:00010000:0.0:1789429283.763408:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 266) 00010000:00010000:0.0:1789429283.763413:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.763438:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.763450:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 30 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.763462:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648329472:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429283.763518:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.767818:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648329472:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429283.767818:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648329344:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429283.767853:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429283.767862:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.767884:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:1.0:1789429283.767920:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:33938:x1876351634947584:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4574us (5526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.767921:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351634947456:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6233us (7739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.767935:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5698 00000100:00100000:3.0:1789429283.767939:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6125 00000100:00100000:2.0:1789429283.770961:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.771053:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634947712 00000100:00100000:1.0:1789429283.771063:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634947712 00010000:00010000:1.0:1789429283.771100:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 31 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.771162:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6126 00000100:00100000:1.0:1789429283.771178:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634947712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.771309:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429283.771334:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 31 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.777930:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 31 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.777970:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad726360488 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0d3 expref: 31 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.777988:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 266) 00010000:00010000:1.0:1789429283.777993:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 266) 00010000:00010000:1.0:1789429283.778000:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.778011:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.778067:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.778083:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648329600:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.778190:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.783983:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.784118:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648329600:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.784139:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429283.784230:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634947712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13055us (13278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.784241:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6126 00000100:00100000:3.0:1789429283.787576:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634947840 00000100:00100000:3.0:1789429283.787590:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634947840 00000100:00100000:3.0:1789429283.787665:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5699 00000100:00100000:3.0:1789429283.787674:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634947840:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429283.787691:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429283.787710:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0e1 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.787743:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.787753:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(105 266) 00010000:00010000:3.0:1789429283.787757:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 266) 00010000:00010000:3.0:1789429283.787762:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.787806:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.787821:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 20 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.787835:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f092d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648329728:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429283.787916:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538900 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.788297:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.788359:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634947968 00000100:00100000:0.0:1789429283.788365:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634947968 00002000:00100000:0.0:1789429283.788399:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f02d67480 x1876351634947968/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.788409:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d67480 with x1876351634947968 ext(356352->393215) 00010000:00010000:0.0:1789429283.788416:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.788429:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.788436:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f02d67480 00000100:00100000:0.0:1789429283.788460:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1385 00000100:00100000:0.0:1789429283.788468:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634947968:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429283.792716:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f092d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648329728:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429283.792749:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 31 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.792771:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429283.792828:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634947840:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5155us (8862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.792837:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5699 00000100:00100000:0.0:1789429283.795732:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634947968:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7233us (7405us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429283.795745:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1385 00002000:00100000:0.0:1789429283.795757:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f02d67480 x1876351634947968/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.795768:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d67480 with x1876351634947968 ext(356352->393215) 00010000:00010000:0.0:1789429283.795779:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.795797:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.795806:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f02d67480 00000100:00100000:2.0:1789429283.803827:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.803908:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.803989:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634948096 00000100:00100000:3.0:1789429283.803989:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634948224 00000100:00100000:1.0:1789429283.804001:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634948096 00000100:00100000:3.0:1789429283.804001:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634948224 00010000:00010000:3.0:1789429283.804050:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 22 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.804063:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5700 00000100:00100000:1.0:1789429283.804073:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:33938:x1876351634948096:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.804087:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.804104:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0e8 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429283.804133:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6127 00010000:00010000:1.0:1789429283.804134:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(106 266) 00010000:00010000:1.0:1789429283.804154:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.804162:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(107 266) 00000100:00100000:3.0:1789429283.804168:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2369:x1876351634948224:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.804172:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 23 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.804181:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429283.804228:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 23 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.804242:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.804246:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 23 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.804277:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad72636048f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0da expref: 23 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.805038:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.805055:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 266) 00010000:00010000:1.0:1789429283.805063:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 266) 00010000:00010000:1.0:1789429283.805072:0:20986:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.805082:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.805111:0:20986:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.805133:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 30 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.805157:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648329984:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.806702:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00010000:00010000:3.0:1789429283.807164:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429283.811735:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.811836:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648329984:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.811860:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:1.0:1789429283.811919:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:33938:x1876351634948096:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7847us (8101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.811927:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5700 00000100:00100000:3.0:1789429283.812155:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634948352 00000100:00100000:3.0:1789429283.812162:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634948352 00002000:00100000:3.0:1789429283.812224:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f02d64380 x1876351634948352/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.812235:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d64380 with x1876351634948352 ext(356352->360447) 00010000:00010000:3.0:1789429283.812244:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.812260:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.812268:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f02d64380 00000100:00100000:3.0:1789429283.812301:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1386 00000100:00100000:3.0:1789429283.812310:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634948352:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429283.813069:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634948352:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 757us (1341us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429283.813078:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1386 00002000:00100000:3.0:1789429283.813085:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f02d64380 x1876351634948352/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.813095:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d64380 with x1876351634948352 ext(356352->360447) 00010000:00010000:3.0:1789429283.813102:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.813120:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429283.813126:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f02d64380 00000100:00100000:0.0:1789429283.813510:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2369:x1876351634948224:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9366us (9600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.813524:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6127 00000100:00100000:2.0:1789429283.818029:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.818163:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634948480 00000100:00100000:3.0:1789429283.818173:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634948480 00000100:00100000:3.0:1789429283.818263:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5701 00000100:00100000:3.0:1789429283.818273:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634948480:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429283.818291:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429283.818308:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0ef expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.818338:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(108 266) 00010000:00010000:3.0:1789429283.818347:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.818354:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(109 266) 00010000:00010000:3.0:1789429283.818360:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 32 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.818403:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.818417:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 32 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429283.818436:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429283.818484:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634948480:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 212us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429283.818491:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5701 00000100:00100000:1.0:1789429283.824910:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.825177:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634948608 00000100:00100000:2.0:1789429283.825188:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634948608 00010000:00010000:2.0:1789429283.827095:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 32 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.827162:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6128 00000100:00100000:2.0:1789429283.827173:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634948608:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429283.827189:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429283.827517:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 32 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.827533:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 32 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.827558:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726360496 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e1 expref: 32 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.827582:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 266) 00010000:00010000:2.0:1789429283.827586:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 266) 00010000:00010000:2.0:1789429283.827603:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.827614:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.827657:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.827671:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 20 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.827685:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648330240:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429283.827813:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.832611:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.832710:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648330240:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429283.832736:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429283.832789:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634948608:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5618us (7889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.832800:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6128 00000100:00100000:2.0:1789429283.832830:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634948736 00000100:00100000:2.0:1789429283.832836:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634948736 00010000:00010000:2.0:1789429283.832864:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 21 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.832898:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6129 00000100:00100000:2.0:1789429283.832906:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634948736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429283.832918:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429283.832939:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 21 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.832958:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 21 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.832982:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636049d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0e8 expref: 21 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.832998:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 266) 00010000:00010000:2.0:1789429283.833003:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 266) 00010000:00010000:2.0:1789429283.833010:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.833020:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.833054:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.833068:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648330368:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429283.833113:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.848368:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.848512:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648330368:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429283.848536:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429283.848595:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634948736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 15689us (15993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.848611:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6129 00000100:00100000:0.0:1789429283.850405:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634948864 00000100:00100000:0.0:1789429283.850421:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634948864 00000100:00100000:3.0:1789429283.852758:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.853079:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5702 00000100:00100000:1.0:1789429283.853090:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c14c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33938:x1876351634948864:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.853108:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.853127:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0f6 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.853175:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.853185:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(110 266) 00010000:00010000:1.0:1789429283.853191:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 266) 00010000:00010000:1.0:1789429283.853195:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.853255:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.853269:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 30 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.853282:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648330496:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429283.853352:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.855841:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634948992 00000100:00100000:0.0:1789429283.855854:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634948992 00002000:00100000:0.0:1789429283.855908:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f2f092d80 x1876351634948992/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.855920:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092d80 with x1876351634948992 ext(356352->360447) 00010000:00010000:0.0:1789429283.855928:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 31 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.855943:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 31 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.855951:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f092d80 00000100:00100000:0.0:1789429283.855989:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1387 00000100:00100000:0.0:1789429283.855998:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634948992:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429283.856487:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634948992:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 488us (3736us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429283.856497:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1387 00002000:00100000:2.0:1789429283.856504:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f2f092d80 x1876351634948992/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.856513:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092d80 with x1876351634948992 ext(356352->360447) 00010000:00010000:2.0:1789429283.856519:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 31 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.856531:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 31 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429283.856537:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f2f092d80 00000100:00100000:2.0:1789429283.857122:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648330496:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429283.857166:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 21 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.857183:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:2.0:1789429283.857248:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c14c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634948864:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4159us (8888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.857255:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5702 00000100:00100000:3.0:1789429283.861355:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.862074:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634949120 00000100:00100000:2.0:1789429283.862084:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634949120 00000100:00100000:2.0:1789429283.862156:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5703 00000100:00100000:2.0:1789429283.862167:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634949120:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.862183:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.862241:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c0fd expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.862274:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(111 266) 00010000:00010000:2.0:1789429283.862282:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.862289:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(112 266) 00010000:00010000:2.0:1789429283.862294:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 32 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.862334:0:6682:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.862348:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 32 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.862361:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547e00, rc 0) 00000100:00100000:2.0:1789429283.862419:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634949120:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 254us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.862426:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5703 00000100:00100000:1.0:1789429283.864837:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.864925:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634949248 00000100:00100000:0.0:1789429283.864934:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634949248 00010000:00010000:0.0:1789429283.864968:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 32 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.865015:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6130 00000100:00100000:0.0:1789429283.865024:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351634949248:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429283.865038:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429283.865060:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 32 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.865073:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 32 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.865094:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049993670/0xb4c3dad7263604a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0ef expref: 32 pid: 13238 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.865111:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 266) 00010000:00010000:0.0:1789429283.865115:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 266) 00010000:00010000:0.0:1789429283.865122:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.865151:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.865187:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 20 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.865249:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 20 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.865263:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34071f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648330752:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.865335:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429283.870313:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.870445:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34071f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648330752:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.870470:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.870521:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634949248:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5497us (5691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.870533:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6130 00000100:00100000:1.0:1789429283.871108:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634949376 00000100:00100000:1.0:1789429283.871116:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634949376 00002000:00100000:1.0:1789429283.871178:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f41210850 x1876351634949376/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.871189:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f41210850 with x1876351634949376 ext(356352->393215) 00010000:00010000:1.0:1789429283.871229:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.871246:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429283.871255:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f41210850 00000100:00100000:1.0:1789429283.871279:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1388 00000100:00100000:1.0:1789429283.871288:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f41210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634949376:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429283.878494:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f41210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634949376:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7196us (8179us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429283.878509:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1388 00002000:00100000:1.0:1789429283.878522:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f41210850 x1876351634949376/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.878533:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f41210850 with x1876351634949376 ext(356352->393215) 00010000:00010000:1.0:1789429283.878544:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.878561:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429283.878570:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f41210850 00000100:00100000:3.0:1789429283.886063:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.886105:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.886242:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634949504 00000100:00100000:0.0:1789429283.886252:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634949504 00010000:00010000:0.0:1789429283.886289:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.886320:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6131 00000100:00100000:0.0:1789429283.886328:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f093100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2368:x1876351634949504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429283.886343:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429283.886364:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.886379:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.886405:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0f6 expref: 21 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.886424:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 266) 00010000:00010000:0.0:1789429283.886429:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 266) 00010000:00010000:0.0:1789429283.886437:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.886465:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.886501:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.886515:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34071f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648330880:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.886590:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.887263:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634949632 00000100:00100000:1.0:1789429283.887269:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634949632 00000100:00100000:1.0:1789429283.887311:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5704 00000100:00100000:1.0:1789429283.887319:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634949632:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.887334:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.887349:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c104 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.887372:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.887394:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(113 266) 00010000:00010000:1.0:1789429283.887397:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 266) 00010000:00010000:1.0:1789429283.887402:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 22 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.887426:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 30 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.887439:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 30 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.887449:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648331008:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429283.887627:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c900 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.891669:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34071f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648330880:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.891692:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.891743:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f093100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351634949504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5415us (5688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.891754:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6131 00000100:00100000:1.0:1789429283.893514:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648331008:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429283.893553:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 21 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.893577:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429283.893636:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33938:x1876351634949632:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6316us (7529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.893645:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5704 00000100:00100000:3.0:1789429283.894992:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.895087:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634949760 00000100:00100000:0.0:1789429283.895097:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634949760 00010000:00010000:0.0:1789429283.895156:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.895232:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6132 00000100:00100000:0.0:1789429283.895243:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634949760:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429283.895260:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429283.895281:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.895302:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.895328:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078d7dcfc/0xb4c3dad7263604b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c0fd expref: 31 pid: 6682 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.895346:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 266) 00010000:00010000:0.0:1789429283.895351:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 266) 00010000:00010000:0.0:1789429283.895360:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.895371:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.895409:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429283.895424:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34071f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648331136:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429283.895516:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429283.900661:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34071f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648331136:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429283.900690:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429283.900741:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351634949760:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5499us (5753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.900756:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6132 00000100:00100000:3.0:1789429283.900976:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.901045:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634949888 00000100:00100000:2.0:1789429283.901053:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634949888 00002000:00100000:2.0:1789429283.901099:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f2f091f80 x1876351634949888/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.901110:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091f80 with x1876351634949888 ext(356352->393215) 00002000:00010000:2.0:1789429283.901115:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f091f80 00000100:00100000:2.0:1789429283.901151:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11401 00000100:00100000:2.0:1789429283.901160:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634949888:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429283.910994:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.913330:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634949888:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 12160us (12353us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429283.913344:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11401 00002000:00100000:0.0:1789429283.913357:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2b:0x0] (356352->393215) req@ffff946f2f091f80 x1876351634949888/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/440 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.913368:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091f80 with x1876351634949888 ext(356352->393215) 00002000:00010000:0.0:1789429283.913375:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f091f80 00000100:00100000:1.0:1789429283.913469:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634950016 00000100:00100000:1.0:1789429283.913478:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634950016 00000100:00100000:1.0:1789429283.913527:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5705 00000100:00100000:1.0:1789429283.913536:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:33927:x1876351634950016:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.913549:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.913567:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c10b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.913601:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.913621:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(114 266) 00010000:00010000:1.0:1789429283.913626:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 266) 00010000:00010000:1.0:1789429283.913632:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.913673:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.913694:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 20 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.913708:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648331264:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429283.913776:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789429283.920241:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.920281:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.920312:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634950272 00000100:00100000:2.0:1789429283.920321:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634950272 00002000:00100000:2.0:1789429283.920370:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (249856->376831) req@ffff946f02d65f80 x1876351634950272/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.920382:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d65f80 with x1876351634950272 ext(249856->376831) 00010000:00010000:2.0:1789429283.920403:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 21 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.920420:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 21 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429283.920427:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f02d65f80 00000100:00100000:2.0:1789429283.920453:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1389 00000100:00100000:2.0:1789429283.920462:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351634950272:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1789429283.920777:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634950144 00000100:00100000:0.0:1789429283.920782:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634950144 00000100:00100000:0.0:1789429283.920817:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5706 00000100:00100000:0.0:1789429283.920825:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:33938:x1876351634950144:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429283.920835:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429283.920848:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c112 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.920871:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(115 266) 00010000:00010000:0.0:1789429283.920876:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 266) 00010000:00010000:0.0:1789429283.920882:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.920894:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.920907:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429283.920943:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:33938:x1876351634950144:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 119us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429283.920950:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5706 00000100:00100000:1.0:1789429283.921712:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648331264:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429283.921742:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.921761:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:1.0:1789429283.921804:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634950016:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8269us (10825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.921812:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5705 00000100:00100000:0.0:1789429283.927558:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2371:x1876351634950272:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 7085us (7264us total) trans 4294969570 rc 0/0 00000100:00100000:0.0:1789429283.927573:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1389 00002000:00100000:0.0:1789429283.927587:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2b:0x0] (249856->376831) req@ffff946f02d65f80 x1876351634950272/t4294969570(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/448 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.927598:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d65f80 with x1876351634950272 ext(249856->376831) 00010000:00010000:0.0:1789429283.927621:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 24 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429283.927640:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 24 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429283.927648:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f02d65f80 00000100:00100000:2.0:1789429283.932312:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.932415:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634950400 00000100:00100000:1.0:1789429283.932426:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634950400 00010000:00010000:1.0:1789429283.932475:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 24 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.932517:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6133 00000100:00100000:1.0:1789429283.932527:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2369:x1876351634950400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.932545:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429283.932565:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb mtime from disk: 1789429283 -> 1789429284 00002000:00010000:1.0:1789429283.932568:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb ctime from disk: 1789429283 -> 1789429284 00010000:00010000:1.0:1789429283.932575:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 24 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.932589:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 24 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.932612:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [356352->18446744073709551615] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c104 expref: 24 pid: 20986 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.932631:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 266) 00010000:00010000:1.0:1789429283.932636:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 266) 00010000:00010000:1.0:1789429283.932645:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.932654:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.932663:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 266) 00010000:00010000:1.0:1789429283.932666:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 266) 00010000:00010000:1.0:1789429283.932670:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 23 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.932678:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 23 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.932713:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 23 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.932726:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a52680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648331392:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.932819:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.932832:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648331520:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.932856:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.935810:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a52680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648331392:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.935830:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648331520:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.935854:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429283.935908:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2369:x1876351634950400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3382us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.935919:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6133 00000100:00100000:2.0:1789429283.943798:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.943894:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634950528 00000100:00100000:0.0:1789429283.943904:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634950528 00002000:00100000:0.0:1789429283.943954:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f02d67100 x1876351634950528/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.943966:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d67100 with x1876351634950528 ext(356352->360447) 00002000:00010000:0.0:1789429283.943982:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d67100 00000100:00100000:0.0:1789429283.944017:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11402 00000100:00100000:0.0:1789429283.944027:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634950528:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.944414:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634950528:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 388us (625us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429283.944422:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11402 00002000:00100000:0.0:1789429283.944430:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2b:0x0] (356352->360447) req@ffff946f02d67100 x1876351634950528/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.944438:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d67100 with x1876351634950528 ext(356352->360447) 00002000:00010000:0.0:1789429283.944441:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d67100 00000100:00100000:2.0:1789429283.947379:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.947687:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634950656 00000100:00100000:3.0:1789429283.947700:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634950656 00002000:00100000:3.0:1789429283.947763:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff946f02d66300 x1876351634950656/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.947775:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d66300 with x1876351634950656 ext(376832->380927) 00002000:00010000:3.0:1789429283.947781:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d66300 00000100:00100000:3.0:1789429283.947811:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11403 00000100:00100000:3.0:1789429283.947821:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2370:x1876351634950656:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429283.948039:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2370:x1876351634950656:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 219us (671us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429283.948046:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11403 00002000:00100000:3.0:1789429283.948054:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff946f02d66300 x1876351634950656/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429283.948061:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d66300 with x1876351634950656 ext(376832->380927) 00002000:00010000:3.0:1789429283.948065:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d66300 00000100:00100000:3.0:1789429283.952647:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.952748:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634950784 00000100:00100000:2.0:1789429283.952757:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634950784 00002000:00100000:2.0:1789429283.952806:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (380928->385023) req@ffff946f2f093100 x1876351634950784/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.952817:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093100 with x1876351634950784 ext(380928->385023) 00002000:00010000:2.0:1789429283.952823:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f093100 00000100:00100000:2.0:1789429283.952856:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11404 00000100:00100000:2.0:1789429283.952865:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2368:x1876351634950784:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429283.953084:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2368:x1876351634950784:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 219us (445us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429283.953092:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11404 00002000:00100000:2.0:1789429283.953100:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (380928->385023) req@ffff946f2f093100 x1876351634950784/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.953107:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093100 with x1876351634950784 ext(380928->385023) 00002000:00010000:2.0:1789429283.953111:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f093100 00000100:00100000:2.0:1789429283.956767:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.956859:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634950912 00000100:00100000:1.0:1789429283.956869:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634950912 00002000:00100000:1.0:1789429283.956915:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (360448->364543) req@ffff946f02d64e00 x1876351634950912/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.956926:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d64e00 with x1876351634950912 ext(360448->364543) 00002000:00010000:1.0:1789429283.956932:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d64e00 00000100:00100000:1.0:1789429283.956964:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11405 00000100:00100000:1.0:1789429283.956982:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634950912:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429283.957383:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634950912:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 400us (623us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429283.957393:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11405 00002000:00100000:1.0:1789429283.957401:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (360448->364543) req@ffff946f02d64e00 x1876351634950912/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.957409:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d64e00 with x1876351634950912 ext(360448->364543) 00002000:00010000:1.0:1789429283.957413:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d64e00 00000100:00100000:3.0:1789429283.960721:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.960822:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634951040 00000100:00100000:0.0:1789429283.960832:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634951040 00002000:00100000:0.0:1789429283.960879:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff946f2f092680 x1876351634951040/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.960890:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092680 with x1876351634951040 ext(385024->389119) 00002000:00010000:0.0:1789429283.960896:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f092680 00000100:00100000:0.0:1789429283.960929:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11406 00000100:00100000:0.0:1789429283.960939:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2370:x1876351634951040:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.961166:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2370:x1876351634951040:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 227us (452us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429283.961174:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11406 00002000:00100000:0.0:1789429283.961182:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (385024->389119) req@ffff946f2f092680 x1876351634951040/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.961191:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092680 with x1876351634951040 ext(385024->389119) 00002000:00010000:0.0:1789429283.961194:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f092680 00000100:00100000:3.0:1789429283.964836:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.964944:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634951168 00000100:00100000:2.0:1789429283.964953:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634951168 00002000:00100000:2.0:1789429283.965005:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (364544->368639) req@ffff946f2f092d80 x1876351634951168/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.965017:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092d80 with x1876351634951168 ext(364544->368639) 00002000:00010000:2.0:1789429283.965023:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f092d80 00000100:00100000:2.0:1789429283.965054:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11407 00000100:00100000:2.0:1789429283.965063:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634951168:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429283.965294:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634951168:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 231us (467us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429283.965302:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11407 00002000:00100000:2.0:1789429283.965308:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (364544->368639) req@ffff946f2f092d80 x1876351634951168/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.965317:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092d80 with x1876351634951168 ext(364544->368639) 00002000:00010000:2.0:1789429283.965320:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f092d80 00000100:00100000:3.0:1789429283.968759:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429283.968871:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634951296 00000100:00100000:0.0:1789429283.968881:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634951296 00002000:00100000:0.0:1789429283.968928:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (389120->393215) req@ffff946f2f092a00 x1876351634951296/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.968939:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092a00 with x1876351634951296 ext(389120->393215) 00002000:00010000:0.0:1789429283.968945:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f092a00 00000100:00100000:0.0:1789429283.968986:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11408 00000100:00100000:0.0:1789429283.968996:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2370:x1876351634951296:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429283.969194:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2370:x1876351634951296:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 198us (442us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429283.969240:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11408 00002000:00100000:0.0:1789429283.969247:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (389120->393215) req@ffff946f2f092a00 x1876351634951296/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429283.969256:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092a00 with x1876351634951296 ext(389120->393215) 00002000:00010000:0.0:1789429283.969260:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f092a00 00000100:00100000:3.0:1789429283.972553:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.972641:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634951424 00000100:00100000:2.0:1789429283.972653:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634951424 00002000:00100000:2.0:1789429283.972701:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (368640->372735) req@ffff946f2f090700 x1876351634951424/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.972713:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f090700 with x1876351634951424 ext(368640->372735) 00002000:00010000:2.0:1789429283.972718:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f090700 00000100:00100000:2.0:1789429283.972750:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11409 00000100:00100000:2.0:1789429283.972760:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634951424:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429283.972942:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634951424:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 183us (396us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429283.972950:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11409 00002000:00100000:2.0:1789429283.972956:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (368640->372735) req@ffff946f2f090700 x1876351634951424/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.972969:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f090700 with x1876351634951424 ext(368640->372735) 00002000:00010000:2.0:1789429283.972972:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f090700 00000100:00100000:3.0:1789429283.976657:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.976757:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634951552 00000100:00100000:1.0:1789429283.976767:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634951552 00002000:00100000:1.0:1789429283.976827:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (372736->376831) req@ffff946f2f093b80 x1876351634951552/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.976846:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093b80 with x1876351634951552 ext(372736->376831) 00002000:00010000:1.0:1789429283.976852:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f093b80 00000100:00100000:1.0:1789429283.976884:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11410 00000100:00100000:1.0:1789429283.976893:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634951552:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429283.977079:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634951552:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 186us (430us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429283.977086:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11410 00002000:00100000:1.0:1789429283.977093:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (372736->376831) req@ffff946f2f093b80 x1876351634951552/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.977101:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093b80 with x1876351634951552 ext(372736->376831) 00002000:00010000:1.0:1789429283.977105:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f093b80 00000100:00100000:3.0:1789429283.981803:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429283.981851:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.981949:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634951680 00000100:00100000:1.0:1789429283.981960:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634951680 00002000:00100000:1.0:1789429283.982018:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff946f2f093800 x1876351634951680/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.982035:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093800 with x1876351634951680 ext(393216->397311) 00002000:00010000:1.0:1789429283.982041:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f093800 00000100:00100000:1.0:1789429283.982074:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11411 00000100:00100000:1.0:1789429283.982088:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2368:x1876351634951680:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429283.982377:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2368:x1876351634951680:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 293us (586us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429283.982385:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11411 00002000:00100000:1.0:1789429283.982392:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff946f2f093800 x1876351634951680/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 488/4536 e 0 to 0 dl 1789429294 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429283.982400:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093800 with x1876351634951680 ext(393216->397311) 00002000:00010000:1.0:1789429283.982404:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f093800 00000100:00100000:2.0:1789429283.982594:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634951808 00000100:00100000:2.0:1789429283.982600:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634951808 00000100:00100000:2.0:1789429283.982648:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5707 00000100:00100000:2.0:1789429283.982663:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:33927:x1876351634951808:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429283.982673:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429283.982696:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c119 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.982731:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.982745:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(116 266) 00010000:00010000:2.0:1789429283.982750:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 266) 00010000:00010000:2.0:1789429283.982755:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 32 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.982792:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.982805:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 22 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429283.982823:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648331648:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429283.982904:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429283.987057:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429283.988256:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648331648:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429283.988292:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 32 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.988320:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547600, rc 0) 00000100:00100000:2.0:1789429283.988380:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634951808:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5718us (6527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429283.988389:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5707 00000100:00100000:2.0:1789429283.988439:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634951936 00000100:00100000:2.0:1789429283.988446:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634951936 00002000:00100000:2.0:1789429283.988496:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (376832->393215) req@ffff946e15185180 x1876351634951936/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 16872/0 e 0 to 0 dl 1789429294 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.988507:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185180 with x1876351634951936 ext(376832->393215) 00010000:00010000:2.0:1789429283.988514:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 23 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.988530:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 23 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429283.988538:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15185180 00000100:00100000:2.0:1789429283.988611:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1390 00000100:00100000:2.0:1789429283.988621:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2370:x1876351634951936:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429283.988991:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2370:x1876351634951936:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 371us (1943us total) trans 4294969571 rc 0/0 00000100:00100000:2.0:1789429283.989000:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1390 00002000:00100000:2.0:1789429283.989007:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (376832->393215) req@ffff946e15185180 x1876351634951936/t4294969571(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:19/0 lens 16872/448 e 0 to 0 dl 1789429294 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429283.989023:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185180 with x1876351634951936 ext(376832->393215) 00010000:00010000:2.0:1789429283.989030:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 25 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429283.989043:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 25 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429283.989051:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15185180 00000100:00100000:3.0:1789429283.992181:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.992311:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634952064 00000100:00100000:1.0:1789429283.992321:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634952064 00000100:00100000:1.0:1789429283.992381:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5708 00000100:00100000:1.0:1789429283.992391:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:33938:x1876351634952064:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429283.992411:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429283.992431:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c120 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.992462:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(117 266) 00010000:00010000:1.0:1789429283.992467:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 266) 00010000:00010000:1.0:1789429283.992473:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.992485:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 26 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.992498:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:1.0:1789429283.992553:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634952064:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 163us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.992560:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5708 00000100:00100000:3.0:1789429283.994881:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429283.995097:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634952192 00000100:00100000:1.0:1789429283.995105:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634952192 00010000:00010000:1.0:1789429283.995161:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 26 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.995234:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6134 00000100:00100000:1.0:1789429283.995244:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2369:x1876351634952192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429283.995259:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429283.995281:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 26 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.995296:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 26 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.995322:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad7263604c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->18446744073709551615] (req 376832->380927) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c112 expref: 26 pid: 8085 timeout: 1081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.995339:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 266) 00010000:00010000:1.0:1789429283.995344:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 266) 00010000:00010000:1.0:1789429283.995354:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 31 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.995365:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 31 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.995375:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 266) 00010000:00010000:1.0:1789429283.995378:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(118 266) 00010000:00010000:1.0:1789429283.995383:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.995394:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429283.995430:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.995444:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a50700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648331776:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.995517:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 31 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429283.995527:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648331904:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.995550:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429283.997743:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a51f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648331904:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429283.997791:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a50700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648331776:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429283.997813:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429283.997852:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2369:x1876351634952192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2609us (2979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429283.997862:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6134 00000100:00100000:0.0:1789429284.000274:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.000637:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634952320 00000100:00100000:1.0:1789429284.000647:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634952320 00002000:00100000:1.0:1789429284.000694:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff946f34071f80 x1876351634952320/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429284.000713:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071f80 with x1876351634952320 ext(376832->380927) 00002000:00010000:1.0:1789429284.000719:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34071f80 00000100:00100000:1.0:1789429284.000744:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11412 00000100:00100000:1.0:1789429284.000753:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:2368:x1876351634952320:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429284.000932:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:2368:x1876351634952320:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 179us (666us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429284.000939:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11412 00002000:00100000:1.0:1789429284.000946:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (376832->380927) req@ffff946f34071f80 x1876351634952320/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429284.000953:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071f80 with x1876351634952320 ext(376832->380927) 00002000:00010000:1.0:1789429284.000957:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34071f80 00000100:00100000:1.0:1789429284.008898:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.008996:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634952448 00000100:00100000:3.0:1789429284.009006:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634952448 00002000:00100000:3.0:1789429284.009053:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (380928->385023) req@ffff946e15a50700 x1876351634952448/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.009065:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a50700 with x1876351634952448 ext(380928->385023) 00002000:00010000:3.0:1789429284.009071:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15a50700 00000100:00100000:3.0:1789429284.009104:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11413 00000100:00100000:3.0:1789429284.009113:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+32:2369:x1876351634952448:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429284.009348:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+32:2369:x1876351634952448:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 235us (459us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429284.009361:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11413 00002000:00100000:3.0:1789429284.009368:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (380928->385023) req@ffff946e15a50700 x1876351634952448/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.009378:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a50700 with x1876351634952448 ext(380928->385023) 00002000:00010000:3.0:1789429284.009383:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15a50700 00000100:00100000:1.0:1789429284.011648:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.011720:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634952576 00000100:00100000:2.0:1789429284.011729:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634952576 00002000:00100000:2.0:1789429284.011768:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff946e15a51f80 x1876351634952576/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.011780:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51f80 with x1876351634952576 ext(393216->397311) 00002000:00010000:2.0:1789429284.011785:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15a51f80 00000100:00100000:2.0:1789429284.011813:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11414 00000100:00100000:2.0:1789429284.011823:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2371:x1876351634952576:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429284.012076:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2371:x1876351634952576:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 253us (434us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429284.012084:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11414 00002000:00100000:2.0:1789429284.012091:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff946e15a51f80 x1876351634952576/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.012100:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51f80 with x1876351634952576 ext(393216->397311) 00002000:00010000:2.0:1789429284.012104:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15a51f80 00000100:00100000:1.0:1789429284.016721:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.016811:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634952704 00000100:00100000:0.0:1789429284.016821:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634952704 00002000:00100000:0.0:1789429284.016868:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (385024->393215) req@ffff946e15a52680 x1876351634952704/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429284.016881:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a52680 with x1876351634952704 ext(385024->393215) 00002000:00010000:0.0:1789429284.016886:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15a52680 00000100:00100000:0.0:1789429284.016919:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11415 00000100:00100000:0.0:1789429284.016928:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+32:2368:x1876351634952704:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429284.017140:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+32:2368:x1876351634952704:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 204us (419us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1789429284.017157:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11415 00002000:00100000:0.0:1789429284.017163:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (385024->393215) req@ffff946e15a52680 x1876351634952704/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/8632 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429284.017171:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a52680 with x1876351634952704 ext(385024->393215) 00002000:00010000:0.0:1789429284.017175:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15a52680 00000100:00100000:3.0:1789429284.021178:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.021456:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634952832 00000100:00100000:0.0:1789429284.021465:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634952832 00000100:00100000:0.0:1789429284.021563:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5709 00000100:00100000:0.0:1789429284.021573:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:33927:x1876351634952832:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429284.021588:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429284.021606:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c127 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.021640:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.021649:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=1s v=(118 266) 00010000:00010000:0.0:1789429284.021653:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 266) 00010000:00010000:0.0:1789429284.021658:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 33 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.021688:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 24 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.021701:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 24 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.021714:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34072300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648332032:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429284.021791:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429284.026107:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.026237:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634952960 00000100:00100000:3.0:1789429284.026247:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634952960 00002000:00100000:3.0:1789429284.026291:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff946e15a51c00 x1876351634952960/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.026302:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51c00 with x1876351634952960 ext(397312->401407) 00010000:00010000:3.0:1789429284.026311:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 25 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.026328:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 25 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429284.026336:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51c00 00000100:00100000:3.0:1789429284.026369:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1391 00000100:00100000:3.0:1789429284.026379:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2370:x1876351634952960:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429284.026614:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2370:x1876351634952960:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 236us (515us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429284.026621:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1391 00002000:00100000:3.0:1789429284.026635:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff946e15a51c00 x1876351634952960/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.026643:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51c00 with x1876351634952960 ext(397312->401407) 00010000:00010000:3.0:1789429284.026649:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 25 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.026661:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 25 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429284.026667:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51c00 00000100:00100000:0.0:1789429284.026904:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34072300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648332032:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429284.026935:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 33 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.026951:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429284.026989:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+33:33927:x1876351634952832:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5418us (5820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429284.026996:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5709 00000100:00100000:1.0:1789429284.030399:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.030519:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634953088 00000100:00100000:2.0:1789429284.030529:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634953088 00002000:00100000:2.0:1789429284.030575:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff946e15a51880 x1876351634953088/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 4584/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.030587:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51880 with x1876351634953088 ext(393216->397311) 00010000:00010000:2.0:1789429284.030596:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 25 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.030610:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 25 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429284.030618:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51880 00000100:00100000:2.0:1789429284.030650:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1392 00000100:00100000:2.0:1789429284.030659:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2370:x1876351634953088:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429284.031653:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634953088:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 991us (1259us total) trans 4294969572 rc 0/0 00000100:00100000:2.0:1789429284.031664:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1392 00002000:00100000:2.0:1789429284.031672:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff946e15a51880 x1876351634953088/t4294969572(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 4584/448 e 0 to 0 dl 1789429295 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.031683:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51880 with x1876351634953088 ext(393216->397311) 00010000:00010000:2.0:1789429284.031692:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 27 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.031706:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 27 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429284.031715:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51880 00000100:00100000:2.0:1789429284.032683:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.035484:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.035660:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634953216 00000100:00100000:1.0:1789429284.035670:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634953216 00000100:00100000:1.0:1789429284.035723:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5710 00000100:00100000:1.0:1789429284.035733:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634953216:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429284.035751:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429284.035768:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c12e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.035802:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(119 266) 00010000:00010000:1.0:1789429284.035808:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 266) 00010000:00010000:1.0:1789429284.035814:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.035826:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.035839:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:1.0:1789429284.035894:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634953216:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 162us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429284.035902:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5710 00000100:00100000:0.0:1789429284.037314:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634953344 00000100:00100000:0.0:1789429284.037324:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634953344 00010000:00010000:0.0:1789429284.037355:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 28 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.037428:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6135 00000100:00100000:0.0:1789429284.037436:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634953344:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429284.037447:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429284.037478:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 28 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.037490:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 28 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.037519:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad7263604d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [393216->18446744073709551615] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c120 expref: 28 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.037536:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 266) 00010000:00010000:0.0:1789429284.037539:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 266) 00010000:00010000:0.0:1789429284.037548:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 32 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.037556:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 32 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.037565:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 266) 00010000:00010000:0.0:1789429284.037567:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 266) 00010000:00010000:0.0:1789429284.037572:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.037580:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.037614:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 27 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.037626:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34072300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648332160:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429284.037710:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 32 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.037719:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648332288:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429284.037743:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429284.041898:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.041995:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34072300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648332160:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429284.042008:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34072a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648332288:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429284.042034:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429284.042096:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634953344:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4659us (6619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429284.042106:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6135 00000100:00100000:3.0:1789429284.042187:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634953472 00000100:00100000:3.0:1789429284.042195:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634953472 00002000:00100000:3.0:1789429284.042257:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff946f02d67b80 x1876351634953472/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.042268:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d67b80 with x1876351634953472 ext(393216->397311) 00002000:00010000:3.0:1789429284.042274:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d67b80 00000100:00100000:3.0:1789429284.042297:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11416 00000100:00100000:3.0:1789429284.042305:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+33:2371:x1876351634953472:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429284.042457:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+33:2371:x1876351634953472:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 152us (569us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429284.042465:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11416 00002000:00100000:3.0:1789429284.042471:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff946f02d67b80 x1876351634953472/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.042479:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d67b80 with x1876351634953472 ext(393216->397311) 00002000:00010000:3.0:1789429284.042484:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d67b80 00000100:00100000:2.0:1789429284.046589:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.046766:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634953600 00000100:00100000:1.0:1789429284.046776:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634953600 00000100:00100000:1.0:1789429284.046833:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5711 00000100:00100000:1.0:1789429284.046843:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+33:33927:x1876351634953600:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429284.046859:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429284.046875:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c135 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.046904:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.046914:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(120 266) 00010000:00010000:1.0:1789429284.046919:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 266) 00010000:00010000:1.0:1789429284.046924:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.046957:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 26 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.046980:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 26 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429284.046993:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648332416:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429284.047073:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429284.050177:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.050276:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634953728 00000100:00100000:3.0:1789429284.050286:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634953728 00010000:00010000:3.0:1789429284.050320:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 27 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.050365:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6136 00000100:00100000:3.0:1789429284.050374:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634953728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429284.050388:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429284.050408:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 27 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.050421:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 27 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.050445:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 266) 00010000:00010000:3.0:1789429284.050449:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 266) 00010000:00010000:3.0:1789429284.050465:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.050474:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.050512:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.050532:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648332544:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429284.050615:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538900 going to sleep for 11 seconds 00010000:00010000:1.0:1789429284.051091:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abe31dd/0xb4c3dad7263604e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c12e expref: 27 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429284.051109:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648332416:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429284.051150:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.051163:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429284.051244:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+34:33927:x1876351634953600:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4402us (4665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429284.051253:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5711 00000100:00100000:2.0:1789429284.053843:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.053919:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634953856 00000100:00100000:3.0:1789429284.053928:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634953856 00000100:00100000:3.0:1789429284.053987:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5712 00000100:00100000:3.0:1789429284.053997:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634953856:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429284.054013:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429284.054031:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c13c expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.054062:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 33 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.054072:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(121 266) 00010000:00010000:3.0:1789429284.054076:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 266) 00010000:00010000:3.0:1789429284.054081:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.054111:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 33 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.054122:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 33 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.054139:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648332672:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429284.054251:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0898cd80 going to sleep for 11 seconds 00010000:00010000:1.0:1789429284.067481:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429284.067514:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648332544:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429284.067540:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429284.067547:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648332672:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429284.067569:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.067589:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4e00, rc 0) 00000100:00100000:0.0:1789429284.067599:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634953728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 17226us (17430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429284.067609:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6136 00000100:00100000:2.0:1789429284.067610:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634953856:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 13616us (13777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.067616:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5712 00000100:00100000:0.0:1789429284.072273:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.072372:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634953984 00000100:00100000:2.0:1789429284.072382:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634953984 00002000:00100000:2.0:1789429284.072429:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff946f34072a00 x1876351634953984/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.072440:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072a00 with x1876351634953984 ext(397312->409599) 00010000:00010000:2.0:1789429284.072449:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 34 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.072464:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 34 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429284.072472:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34072a00 00000100:00100000:2.0:1789429284.072503:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1393 00000100:00100000:2.0:1789429284.072512:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+34:2370:x1876351634953984:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429284.072716:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+34:2370:x1876351634953984:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 203us (453us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1789429284.072723:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1393 00002000:00100000:2.0:1789429284.072731:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff946f34072a00 x1876351634953984/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/12728 e 0 to 0 dl 1789429295 ref 1 fl Complete:H/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.072739:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072a00 with x1876351634953984 ext(397312->409599) 00010000:00010000:2.0:1789429284.072746:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 34 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.072757:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 34 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429284.072765:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f34072a00 00000100:00100000:1.0:1789429284.077361:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.077412:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.077511:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634954112 00000100:00100000:0.0:1789429284.077522:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634954112 00000100:00100000:0.0:1789429284.077591:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5713 00000100:00100000:0.0:1789429284.077602:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+34:33927:x1876351634954112:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429284.077619:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429284.077640:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c143 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.077674:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(122 266) 00010000:00010000:0.0:1789429284.077684:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.077691:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(123 266) 00010000:00010000:0.0:1789429284.077696:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 35 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.077742:0:8085:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.077756:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 35 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.077769:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429284.077830:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+35:33927:x1876351634954112:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 231us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429284.077837:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5713 00000100:00100000:2.0:1789429284.077992:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634954240 00000100:00100000:2.0:1789429284.077996:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634954240 00010000:00010000:2.0:1789429284.078019:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 35 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.078047:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6137 00000100:00100000:2.0:1789429284.078055:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+35:2368:x1876351634954240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429284.078065:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429284.078085:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 35 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.078098:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 35 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.078117:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f125a213/0xb4c3dad7263604ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 33 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c135 expref: 35 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.078132:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 266) 00010000:00010000:2.0:1789429284.078136:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 266) 00010000:00010000:2.0:1789429284.078153:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.078162:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.078194:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.078246:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 26 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.078260:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648332928:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429284.078318:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789429284.081970:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.082343:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634954368 00000100:00100000:3.0:1789429284.082353:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634954368 00002000:00100000:3.0:1789429284.082399:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff946e15a51180 x1876351634954368/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.082410:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51180 with x1876351634954368 ext(397312->401407) 00010000:00010000:3.0:1789429284.082419:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 27 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.082435:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 27 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429284.082443:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51180 00000100:00100000:2.0:1789429284.082466:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648332928:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429284.082487:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429284.082517:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1394 00000100:00100000:3.0:1789429284.082526:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634954368:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429284.082544:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+34:2368:x1876351634954240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4489us (5191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.082552:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6137 00000100:00100000:3.0:1789429284.082685:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634954368:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 160us (728us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429284.082692:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1394 00002000:00100000:3.0:1789429284.082699:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff946e15a51180 x1876351634954368/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.082707:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51180 with x1876351634954368 ext(397312->401407) 00010000:00010000:3.0:1789429284.082714:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 27 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.082724:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 27 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429284.082731:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e15a51180 00000100:00100000:1.0:1789429284.090162:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.090911:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634954496 00000100:00100000:3.0:1789429284.090924:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634954496 00000100:00100000:2.0:1789429284.091138:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.091183:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634954624 00000100:00100000:2.0:1789429284.091188:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634954624 00010000:00010000:2.0:1789429284.091249:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 28 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.091285:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6138 00000100:00100000:2.0:1789429284.091295:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634954624:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429284.091311:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429284.091333:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 28 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.091350:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 28 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.091377:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17e6046/0xb4c3dad7263604f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c13c expref: 28 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.091396:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 266) 00010000:00010000:2.0:1789429284.091402:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 266) 00010000:00010000:2.0:1789429284.091411:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 33 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.091422:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 33 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.091480:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 33 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.091494:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648333056:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429284.091578:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789429284.091987:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5714 00000100:00100000:3.0:1789429284.091997:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634954496:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429284.092010:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429284.092024:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c14a expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.092045:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 33 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.092054:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(124 266) 00010000:00010000:3.0:1789429284.092057:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 266) 00010000:00010000:3.0:1789429284.092061:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.092084:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 33 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.092102:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 33 pid: 8085 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.092112:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648333184:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429284.092156:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0898cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429284.095673:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.095760:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648333056:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429284.095783:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429284.095839:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351634954624:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4545us (4711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.095850:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6138 00000100:00100000:2.0:1789429284.095878:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634954752 00000100:00100000:2.0:1789429284.095883:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634954752 00010000:00010000:2.0:1789429284.095911:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 34 pid: 8085 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.095938:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6139 00000100:00100000:2.0:1789429284.095946:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+34:2370:x1876351634954752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429284.095957:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429284.095991:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 34 pid: 8085 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.096004:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 34 pid: 8085 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.096028:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 266) 00010000:00010000:2.0:1789429284.096033:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 266) 00010000:00010000:2.0:1789429284.096041:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.096051:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.096098:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.096112:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648333312:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429284.096178:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d6f00 going to sleep for 11 seconds 00010000:00010000:3.0:1789429284.097196:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263604f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c143 expref: 34 pid: 8085 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.097314:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648333184:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429284.097340:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 27 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.097353:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:3.0:1789429284.099116:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648333312:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429284.099154:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429284.099225:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+33:2370:x1876351634954752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3278us (3561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429284.099237:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6139 00000100:00100000:2.0:1789429284.100650:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634954496:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 8648us (10499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.100661:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5714 00000100:00100000:1.0:1789429284.107151:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.107325:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634954880 00000100:00100000:2.0:1789429284.107337:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634954880 00000100:00100000:2.0:1789429284.107399:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5715 00000100:00100000:2.0:1789429284.107409:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+33:33927:x1876351634954880:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429284.107427:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429284.107446:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c151 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.107484:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.107494:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(125 266) 00010000:00010000:2.0:1789429284.107499:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 266) 00010000:00010000:2.0:1789429284.107506:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.107539:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 26 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.107552:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 26 pid: 13238 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.107566:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648333440:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429284.107650:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429284.111912:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.112000:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634955008 00000100:00100000:3.0:1789429284.112010:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634955008 00010000:00010000:3.0:1789429284.112050:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 27 pid: 13238 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.112101:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6140 00000100:00100000:3.0:1789429284.112110:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634955008:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429284.112125:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429284.112164:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 27 pid: 13238 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.112178:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 27 pid: 13238 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.112238:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 266) 00010000:00010000:3.0:1789429284.112243:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 266) 00010000:00010000:3.0:1789429284.112253:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.112264:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.112301:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.112315:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648333568:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429284.112385:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0898cd80 going to sleep for 11 seconds 00010000:00010000:2.0:1789429284.112775:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fc76224/0xb4c3dad7263604ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c14a expref: 27 pid: 13238 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.112790:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648333440:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429284.112815:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.112826:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546800, rc 0) 00000100:00100000:2.0:1789429284.112869:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+34:33927:x1876351634954880:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5460us (5735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.112877:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5715 00000100:00100000:3.0:1789429284.117496:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648333568:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429284.117528:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429284.117592:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2370:x1876351634955008:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5482us (5687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429284.117604:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6140 00000100:00100000:1.0:1789429284.119168:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.119497:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634955136 00000100:00100000:3.0:1789429284.119505:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634955136 00002000:00100000:3.0:1789429284.119546:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff946f3f1c7480 x1876351634955136/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.119557:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7480 with x1876351634955136 ext(397312->409599) 00002000:00010000:3.0:1789429284.119572:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c7480 00000100:00100000:3.0:1789429284.119596:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11417 00000100:00100000:3.0:1789429284.119604:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+34:2370:x1876351634955136:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429284.119788:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+34:2370:x1876351634955136:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 183us (623us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1789429284.119795:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11417 00002000:00100000:3.0:1789429284.119801:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (397312->409599) req@ffff946f3f1c7480 x1876351634955136/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/12728 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.119809:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7480 with x1876351634955136 ext(397312->409599) 00002000:00010000:3.0:1789429284.119813:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c7480 00000100:00100000:1.0:1789429284.123372:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.123791:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634955264 00000100:00100000:2.0:1789429284.123801:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634955264 00000100:00100000:2.0:1789429284.123858:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5716 00000100:00100000:2.0:1789429284.123868:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:33938:x1876351634955264:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429284.123885:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429284.123904:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72636050d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c158 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.123936:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 33 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.123946:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(126 266) 00010000:00010000:2.0:1789429284.123950:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 266) 00010000:00010000:2.0:1789429284.123955:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72636050d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c158 expref: 27 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.126084:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 33 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.126191:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 33 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.126225:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648333696:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429284.126375:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429284.129835:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648333696:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429284.129872:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72636050d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->401407] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c158 expref: 27 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.129894:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547400, rc 0) 00000100:00100000:2.0:1789429284.129951:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634955264:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6084us (6587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.129961:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5716 00000100:00100000:1.0:1789429284.132104:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.132197:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634955392 00000100:00100000:2.0:1789429284.132232:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634955392 00002000:00100000:2.0:1789429284.132279:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (356352->409599) req@ffff946f3f1c7800 x1876351634955392/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.132290:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7800 with x1876351634955392 ext(356352->409599) 00010000:00010000:2.0:1789429284.132308:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 34 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.132324:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 34 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429284.132333:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f1c7800 00000100:00100000:2.0:1789429284.132366:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1395 00000100:00100000:2.0:1789429284.132376:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+34:2371:x1876351634955392:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429284.138292:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+36:2371:x1876351634955392:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 5906us (6185us total) trans 4294969573 rc 0/0 00000100:00100000:2.0:1789429284.138305:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1395 00002000:00100000:2.0:1789429284.138318:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2b:0x0] (356352->409599) req@ffff946f3f1c7800 x1876351634955392/t4294969573(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:20/0 lens 488/448 e 0 to 0 dl 1789429295 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.138329:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7800 with x1876351634955392 ext(356352->409599) 00010000:00010000:2.0:1789429284.138349:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 36 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.138366:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 36 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429284.138374:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3f1c7800 00000100:00100000:1.0:1789429284.141847:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.142008:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634955520 00000100:00100000:0.0:1789429284.142019:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634955520 00010000:00010000:0.0:1789429284.142056:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 36 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.142100:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6141 00000100:00100000:0.0:1789429284.142110:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+36:2369:x1876351634955520:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429284.142125:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429284.142163:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 36 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.142179:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 36 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.142236:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726360506 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c151 expref: 36 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.142253:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 266) 00010000:00010000:0.0:1789429284.142257:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 266) 00010000:00010000:0.0:1789429284.142265:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72636050d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c158 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.142276:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72636050d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c158 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.142313:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72636050d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c158 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.142328:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34072300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648333824:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429284.142412:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429284.146246:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.146365:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34072300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648333824:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429284.146390:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429284.146434:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+35:2369:x1876351634955520:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4326us (4595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429284.146447:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6141 00000100:00100000:3.0:1789429284.146654:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634955648 00000100:00100000:3.0:1789429284.146661:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634955648 00002000:00100000:3.0:1789429284.146701:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff946f3f1c7100 x1876351634955648/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.146712:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7100 with x1876351634955648 ext(397312->401407) 00002000:00010000:3.0:1789429284.146717:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c7100 00000100:00100000:3.0:1789429284.146736:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11418 00000100:00100000:3.0:1789429284.146745:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634955648:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429284.146907:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2370:x1876351634955648:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 162us (669us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429284.146914:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11418 00002000:00100000:3.0:1789429284.146921:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (397312->401407) req@ffff946f3f1c7100 x1876351634955648/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.146930:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7100 with x1876351634955648 ext(397312->401407) 00002000:00010000:3.0:1789429284.146933:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c7100 00000100:00100000:1.0:1789429284.152785:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.152864:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634955776 00000100:00100000:3.0:1789429284.152874:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634955776 00002000:00100000:3.0:1789429284.152921:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (401408->405503) req@ffff946f3f1c5500 x1876351634955776/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.152933:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5500 with x1876351634955776 ext(401408->405503) 00002000:00010000:3.0:1789429284.152939:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c5500 00000100:00100000:3.0:1789429284.152977:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11419 00000100:00100000:3.0:1789429284.152986:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634955776:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429284.153187:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634955776:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 200us (408us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429284.153194:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11419 00002000:00100000:3.0:1789429284.153231:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (401408->405503) req@ffff946f3f1c5500 x1876351634955776/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.153247:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5500 with x1876351634955776 ext(401408->405503) 00002000:00010000:3.0:1789429284.153250:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c5500 00000100:00100000:1.0:1789429284.157279:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.157647:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634955904 00000100:00100000:2.0:1789429284.157658:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634955904 00002000:00100000:2.0:1789429284.157708:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (405504->409599) req@ffff946f3f2e2d80 x1876351634955904/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.157718:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e2d80 with x1876351634955904 ext(405504->409599) 00002000:00010000:2.0:1789429284.157724:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e2d80 00000100:00100000:2.0:1789429284.157759:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11420 00000100:00100000:2.0:1789429284.157769:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634955904:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429284.157962:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2371:x1876351634955904:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 194us (692us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429284.157982:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11420 00002000:00100000:2.0:1789429284.157989:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (405504->409599) req@ffff946f3f2e2d80 x1876351634955904/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.157998:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e2d80 with x1876351634955904 ext(405504->409599) 00002000:00010000:2.0:1789429284.158002:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e2d80 00000100:00100000:0.0:1789429284.165295:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.165411:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634956032 00000100:00100000:1.0:1789429284.165421:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634956032 00000100:00100000:1.0:1789429284.165478:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5717 00000100:00100000:1.0:1789429284.165488:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:33938:x1876351634956032:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429284.165505:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429284.165526:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360514 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c15f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.165557:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000022d5d796/0xb4c3dad72635f856 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4af expref: 34 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.165566:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(127 266) 00010000:00010000:1.0:1789429284.165571:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 266) 00010000:00010000:1.0:1789429284.165576:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360514 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [81920->86015] (req 81920->86015) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c15f expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.165617:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000022d5d796/0xb4c3dad72635f856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4af expref: 34 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.165630:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000022d5d796/0xb4c3dad72635f856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4af expref: 34 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429284.165642:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648333952:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429284.165725:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429284.169717:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.169805:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634956160 00000100:00100000:0.0:1789429284.169814:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634956160 00010000:00010000:0.0:1789429284.169853:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000022d5d796/0xb4c3dad72635f856 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4af expref: 35 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.169892:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6142 00000100:00100000:0.0:1789429284.169902:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+35:2371:x1876351634956160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429284.169916:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429284.169938:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000022d5d796/0xb4c3dad72635f856 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4af expref: 35 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.169951:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000022d5d796/0xb4c3dad72635f856 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4af expref: 35 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.170146:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 266) 00010000:00010000:0.0:1789429284.170153:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 266) 00010000:00010000:0.0:1789429284.170161:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360514 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c15f expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.170171:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360514 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c15f expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.170244:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360514 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c15f expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.170265:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648334080:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429284.170338:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789429284.170476:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022d5d796/0xb4c3dad72635f856 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4af expref: 35 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.170490:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648333952:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429284.170513:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360514 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c15f expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.170522:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:2.0:1789429284.170551:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634956032:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5066us (5264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.170559:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5717 00000100:00100000:0.0:1789429284.173501:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648334080:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429284.173527:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429284.173583:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+34:2371:x1876351634956160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3681us (3873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429284.173594:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6142 00000100:00100000:1.0:1789429284.179353:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.179736:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634956288 00000100:00100000:3.0:1789429284.179747:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634956288 00002000:00100000:3.0:1789429284.179798:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f3f2e0e00 x1876351634956288/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.179809:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e0e00 with x1876351634956288 ext(81920->118783) 00002000:00010000:3.0:1789429284.179815:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e0e00 00000100:00100000:3.0:1789429284.179852:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11421 00000100:00100000:3.0:1789429284.179860:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634956288:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429284.188479:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2370:x1876351634956288:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 8608us (9124us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429284.188492:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11421 00002000:00100000:0.0:1789429284.188506:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (81920->118783) req@ffff946f3f2e0e00 x1876351634956288/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/440 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429284.188517:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e0e00 with x1876351634956288 ext(81920->118783) 00002000:00010000:0.0:1789429284.188523:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e0e00 00000100:00100000:2.0:1789429284.193480:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.193582:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634956416 00000100:00100000:0.0:1789429284.193592:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634956416 00000100:00100000:0.0:1789429284.193679:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5718 00000100:00100000:0.0:1789429284.193689:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:33938:x1876351634956416:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429284.193705:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429284.193722:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636051b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c166 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.193753:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f872 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4cb expref: 33 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.193762:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(128 266) 00010000:00010000:0.0:1789429284.193767:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 266) 00010000:00010000:0.0:1789429284.193772:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636051b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c166 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.193803:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4cb expref: 33 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.193817:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f872 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4cb expref: 33 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.193829:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648334208:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429284.193908:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429284.197445:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.197549:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648334208:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429284.197581:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636051b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [118784->122879] (req 118784->122879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c166 expref: 29 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.197601:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:0.0:1789429284.197659:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634956416:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3971us (4188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429284.197669:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5718 00000100:00100000:3.0:1789429284.198228:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634956544 00000100:00100000:3.0:1789429284.198236:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634956544 00010000:00010000:3.0:1789429284.198267:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f872 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4cb expref: 34 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.198294:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6143 00000100:00100000:3.0:1789429284.198302:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+34:2370:x1876351634956544:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429284.198315:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429284.198337:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f872 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4cb expref: 34 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.198349:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f872 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4cb expref: 34 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.198380:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6f856bc/0xb4c3dad72635f872 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4cb expref: 34 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.198395:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 266) 00010000:00010000:3.0:1789429284.198400:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 266) 00010000:00010000:3.0:1789429284.198407:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636051b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c166 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.198418:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636051b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c166 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.198452:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636051b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c166 expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.198466:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648334336:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429284.198529:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429284.202315:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648334336:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429284.202344:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429284.202407:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+33:2370:x1876351634956544:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4104us (4971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429284.202416:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6143 00000100:00100000:1.0:1789429284.206180:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.206416:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634956672 00000100:00100000:3.0:1789429284.206426:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634956672 00002000:00100000:3.0:1789429284.206473:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (118784->135167) req@ffff946f3462ca80 x1876351634956672/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.206491:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462ca80 with x1876351634956672 ext(118784->135167) 00002000:00010000:3.0:1789429284.206495:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462ca80 00000100:00100000:3.0:1789429284.206527:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11422 00000100:00100000:3.0:1789429284.206536:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634956672:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429284.206765:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2370:x1876351634956672:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 229us (594us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1789429284.206773:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11422 00002000:00100000:3.0:1789429284.206780:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (118784->135167) req@ffff946f3462ca80 x1876351634956672/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/16824 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.206787:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462ca80 with x1876351634956672 ext(118784->135167) 00002000:00010000:3.0:1789429284.206791:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462ca80 00000100:00100000:1.0:1789429284.211640:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.211720:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634956800 00000100:00100000:2.0:1789429284.211730:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634956800 00000100:00100000:2.0:1789429284.211786:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5719 00000100:00100000:2.0:1789429284.211796:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:33938:x1876351634956800:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429284.211813:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429284.211831:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360522 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c16d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.211869:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 32 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.211878:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(129 266) 00010000:00010000:2.0:1789429284.211882:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 266) 00010000:00010000:2.0:1789429284.211887:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360522 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c16d expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.211918:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 32 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.211932:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 32 pid: 6682 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.211947:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648334464:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429284.212176:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429284.215894:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648334464:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429284.215930:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360522 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [135168->139263] (req 135168->139263) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c16d expref: 30 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.215953:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546600, rc 0) 00000100:00100000:1.0:1789429284.216123:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634956800:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4328us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429284.216149:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5719 00000100:00100000:0.0:1789429284.217730:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.217863:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634956928 00000100:00100000:3.0:1789429284.217874:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634956928 00010000:00010000:3.0:1789429284.217919:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 33 pid: 6682 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.217959:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6144 00000100:00100000:3.0:1789429284.217981:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+33:2370:x1876351634956928:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429284.217997:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429284.218021:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 33 pid: 6682 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.218034:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 33 pid: 6682 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.218059:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad72635f879 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b4d2 expref: 33 pid: 6682 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.218079:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 266) 00010000:00010000:3.0:1789429284.218084:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 266) 00010000:00010000:3.0:1789429284.218092:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360522 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c16d expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.218102:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360522 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c16d expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.218273:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360522 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c16d expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.218289:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648334592:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429284.218361:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429284.225438:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648334592:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429284.225479:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429284.225577:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:2370:x1876351634956928:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7604us (7853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429284.225601:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6144 00000100:00100000:2.0:1789429284.230282:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.230367:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634957056 00000100:00100000:0.0:1789429284.230377:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634957056 00002000:00100000:0.0:1789429284.230429:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (135168->143359) req@ffff946f02d67800 x1876351634957056/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429284.230440:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d67800 with x1876351634957056 ext(135168->143359) 00002000:00010000:0.0:1789429284.230446:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d67800 00000100:00100000:0.0:1789429284.230523:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11423 00000100:00100000:0.0:1789429284.230532:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2371:x1876351634957056:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429284.230734:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2371:x1876351634957056:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 202us (460us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1789429284.230742:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11423 00002000:00100000:0.0:1789429284.230750:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2b:0x0] (135168->143359) req@ffff946f02d67800 x1876351634957056/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/8632 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429284.230759:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d67800 with x1876351634957056 ext(135168->143359) 00002000:00010000:0.0:1789429284.230762:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d67800 00000100:00100000:1.0:1789429284.236881:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.237075:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634957184 00000100:00100000:2.0:1789429284.237085:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634957184 00000100:00100000:2.0:1789429284.237293:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5720 00000100:00100000:2.0:1789429284.237305:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:33938:x1876351634957184:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429284.237323:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429284.237341:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360529 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c174 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.237379:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 31 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.237388:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(130 266) 00010000:00010000:2.0:1789429284.237393:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 266) 00010000:00010000:2.0:1789429284.237398:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360529 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c174 expref: 31 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.237432:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 31 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.237446:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 31 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.237462:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648334720:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429284.237620:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429284.240861:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.241104:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634957312 00000100:00100000:0.0:1789429284.241114:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634957312 00010000:00010000:0.0:1789429284.241168:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 32 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.241233:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6145 00000100:00100000:0.0:1789429284.241243:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:2370:x1876351634957312:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429284.241260:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429284.241286:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 32 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.241307:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 32 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.241337:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 266) 00010000:00010000:0.0:1789429284.241342:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 266) 00010000:00010000:0.0:1789429284.241351:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360529 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c174 expref: 31 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.241360:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360529 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c174 expref: 31 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.241398:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360529 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c174 expref: 31 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.241411:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34072d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648334848:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429284.241482:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515900 going to sleep for 11 seconds 00010000:00010000:3.0:1789429284.241986:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad72635f967 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b5c0 expref: 32 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.242010:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648334720:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429284.242034:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360529 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c174 expref: 31 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.242046:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:3.0:1789429284.242092:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+31:33938:x1876351634957184:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4791us (5221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429284.242101:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5720 00000100:00100000:3.0:1789429284.244793:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34072d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648334848:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429284.244820:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429284.244876:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351634957312:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3633us (4024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429284.244888:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6145 00000100:00100000:0.0:1789429284.248705:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.248783:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634957440 00000100:00100000:3.0:1789429284.248795:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634957440 00002000:00100000:3.0:1789429284.248845:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f34073100 x1876351634957440/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.248857:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073100 with x1876351634957440 ext(143360->147455) 00002000:00010000:3.0:1789429284.248863:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34073100 00000100:00100000:3.0:1789429284.248898:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11424 00000100:00100000:3.0:1789429284.248907:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+31:2370:x1876351634957440:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429284.249267:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+31:2370:x1876351634957440:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 358us (571us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429284.249275:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11424 00002000:00100000:3.0:1789429284.249282:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (143360->147455) req@ffff946f34073100 x1876351634957440/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.249290:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073100 with x1876351634957440 ext(143360->147455) 00002000:00010000:3.0:1789429284.249293:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34073100 00000100:00100000:2.0:1789429284.257572:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.257681:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634957568 00000100:00100000:1.0:1789429284.257691:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634957568 00000100:00100000:1.0:1789429284.257746:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5721 00000100:00100000:1.0:1789429284.257756:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+31:33938:x1876351634957568:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429284.257774:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429284.257791:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad726360530 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c17b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.257824:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.257833:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(131 266) 00010000:00010000:1.0:1789429284.257838:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 266) 00010000:00010000:1.0:1789429284.257843:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad726360530 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c17b expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.257876:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.257891:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 30 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429284.257904:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648334976:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429284.258007:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429284.261488:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.261585:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634957696 00000100:00100000:2.0:1789429284.261595:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634957696 00010000:00010000:2.0:1789429284.261636:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 31 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.261682:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6146 00000100:00100000:2.0:1789429284.261692:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351634957696:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429284.261708:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429284.261732:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 31 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.261745:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 31 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.261770:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 266) 00010000:00010000:2.0:1789429284.261775:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 266) 00010000:00010000:2.0:1789429284.261782:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad726360530 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c17b expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.261792:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad726360530 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c17b expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.261830:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad726360530 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c17b expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.261845:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648335104:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429284.262011:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72635fa63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ae expref: 31 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429284.262033:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648334976:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429284.262058:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad726360530 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c17b expref: 32 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.262069:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1000, rc 0) 00000100:00100000:2.0:1789429284.262184:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429284.262513:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+32:33938:x1876351634957568:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4758us (4949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429284.262522:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5721 00000100:00100000:0.0:1789429284.268184:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.268344:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648335104:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429284.268368:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429284.268426:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351634957696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6734us (6947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.268437:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6146 00000100:00100000:0.0:1789429284.270300:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634957824 00000100:00100000:0.0:1789429284.270314:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634957824 00002000:00100000:0.0:1789429284.270368:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (204800->217087) req@ffff946f34070a80 x1876351634957824/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429284.270379:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070a80 with x1876351634957824 ext(204800->217087) 00002000:00010000:0.0:1789429284.270386:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34070a80 00000100:00100000:0.0:1789429284.270420:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11425 00000100:00100000:0.0:1789429284.270430:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+32:2371:x1876351634957824:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429284.270637:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+32:2371:x1876351634957824:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 207us (2463us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1789429284.270645:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11425 00002000:00100000:0.0:1789429284.270652:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (204800->217087) req@ffff946f34070a80 x1876351634957824/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/12728 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429284.270661:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070a80 with x1876351634957824 ext(204800->217087) 00002000:00010000:0.0:1789429284.270665:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34070a80 00000100:00100000:0.0:1789429284.274726:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.274817:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634957952 00000100:00100000:2.0:1789429284.274826:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634957952 00000100:00100000:2.0:1789429284.274878:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5722 00000100:00100000:2.0:1789429284.274888:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+32:33938:x1876351634957952:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429284.274904:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429284.274919:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360537 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c182 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.274955:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 29 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.275108:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(132 266) 00010000:00010000:2.0:1789429284.275112:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 266) 00010000:00010000:2.0:1789429284.275118:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360537 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c182 expref: 33 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.275259:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 29 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.275274:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 29 pid: 6682 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.275289:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648335232:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429284.275358:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1789429284.278319:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.278340:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648335232:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429284.278374:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360537 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [217088->221183] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c182 expref: 33 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.278396:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547200, rc 0) 00000100:00100000:1.0:1789429284.278489:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634958080 00000100:00100000:1.0:1789429284.278496:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634958080 00010000:00010000:1.0:1789429284.278531:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 30 pid: 6682 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429284.278568:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6147 00000100:00100000:1.0:1789429284.278577:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351634958080:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429284.278589:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429284.278611:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 30 pid: 6682 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.278624:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 30 pid: 6682 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.278645:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff09838f/0xb4c3dad72635fa71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6bc expref: 30 pid: 6682 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.278665:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 266) 00010000:00010000:1.0:1789429284.278670:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 266) 00010000:00010000:1.0:1789429284.278678:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360537 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c182 expref: 33 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.278688:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360537 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c182 expref: 33 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.278718:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360537 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c182 expref: 33 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429284.278732:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648335360:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429284.278822:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+33:33938:x1876351634957952:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3934us (4104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.278830:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5722 00000100:00100000:1.0:1789429284.279288:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789429284.285286:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.285368:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634958208 00000100:00100000:3.0:1789429284.285378:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634958208 00002000:00100000:3.0:1789429284.285426:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->229375) req@ffff946f34071500 x1876351634958208/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.285437:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071500 with x1876351634958208 ext(217088->229375) 00002000:00010000:3.0:1789429284.285443:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34071500 00000100:00100000:3.0:1789429284.285474:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11426 00000100:00100000:3.0:1789429284.285484:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+33:2371:x1876351634958208:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429284.285703:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+33:2371:x1876351634958208:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 219us (425us total) trans 0 rc 12288/12288 00000100:00100000:3.0:1789429284.285710:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11426 00002000:00100000:3.0:1789429284.285717:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2b:0x0] (217088->229375) req@ffff946f34071500 x1876351634958208/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/12728 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 12288/12288 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.285725:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071500 with x1876351634958208 ext(217088->229375) 00002000:00010000:3.0:1789429284.285729:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34071500 00000100:00100000:1.0:1789429284.289222:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648335360:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429284.289255:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429284.289373:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351634958080:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10795us (11061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429284.289385:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6147 00000100:00100000:0.0:1789429284.290716:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.292360:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634958336 00000100:00100000:1.0:1789429284.292372:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634958336 00000100:00100000:1.0:1789429284.292479:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5723 00000100:00100000:1.0:1789429284.292488:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+33:33938:x1876351634958336:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429284.292505:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429284.292524:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636053e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c189 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.292558:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.292568:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(133 266) 00010000:00010000:1.0:1789429284.292572:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 266) 00010000:00010000:1.0:1789429284.292578:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636053e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c189 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.292609:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 28 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.292624:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 28 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429284.292639:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648335488:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429284.292732:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429284.295573:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648335488:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429284.295618:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636053e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c189 expref: 34 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.295641:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:1.0:1789429284.295700:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+34:33938:x1876351634958336:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3212us (4990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429284.295709:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5723 00000100:00100000:0.0:1789429284.297504:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.298310:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634958464 00000100:00100000:3.0:1789429284.298320:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634958464 00010000:00010000:3.0:1789429284.298361:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 29 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.298406:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6148 00000100:00100000:3.0:1789429284.298415:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351634958464:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429284.298430:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429284.298452:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 29 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.298477:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 29 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.298501:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000060a7f3/0xb4c3dad72635fa7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b6ca expref: 29 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.298520:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 266) 00010000:00010000:3.0:1789429284.298524:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 266) 00010000:00010000:3.0:1789429284.298532:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636053e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c189 expref: 33 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.298543:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636053e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c189 expref: 33 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.298582:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636053e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c189 expref: 33 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.298596:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648335616:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429284.298781:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429284.303240:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.303338:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634958592 00000100:00100000:2.0:1789429284.303347:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634958592 00002000:00100000:2.0:1789429284.303396:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff946f34070e00 x1876351634958592/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.303407:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070e00 with x1876351634958592 ext(229376->233471) 00002000:00010000:2.0:1789429284.303413:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34070e00 00000100:00100000:2.0:1789429284.303443:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11427 00000100:00100000:2.0:1789429284.303453:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+34:2370:x1876351634958592:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429284.303629:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+34:2370:x1876351634958592:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 177us (399us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429284.303637:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11427 00002000:00100000:2.0:1789429284.303644:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2b:0x0] (229376->233471) req@ffff946f34070e00 x1876351634958592/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.303653:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070e00 with x1876351634958592 ext(229376->233471) 00002000:00010000:2.0:1789429284.303656:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34070e00 00000100:00100000:3.0:1789429284.306922:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648335616:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429284.306950:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429284.307460:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.307587:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634958720 00000100:00100000:3.0:1789429284.307595:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634958720 00000100:00100000:3.0:1789429284.307656:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5724 00000100:00100000:3.0:1789429284.307665:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+34:33938:x1876351634958720:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429284.307680:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429284.307697:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad726360545 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c190 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.307728:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fb51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b79c expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.307736:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(134 266) 00010000:00010000:3.0:1789429284.307740:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 266) 00010000:00010000:3.0:1789429284.307745:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad726360545 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c190 expref: 35 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.307774:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fb51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b79c expref: 28 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.307787:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fb51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b79c expref: 28 pid: 13238 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.307800:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648335744:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429284.307920:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429284.308595:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:2371:x1876351634958464:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10177us (11097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.308607:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6148 00000100:00100000:3.0:1789429284.312648:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648335744:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429284.312684:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad726360545 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c190 expref: 35 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.312706:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5200, rc 0) 00000100:00100000:3.0:1789429284.312759:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:33938:x1876351634958720:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5094us (5300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429284.312768:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5724 00000100:00100000:1.0:1789429284.314952:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.315116:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634958848 00000100:00100000:3.0:1789429284.315125:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634958848 00010000:00010000:3.0:1789429284.315181:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fb51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b79c expref: 28 pid: 13238 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.315256:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6149 00000100:00100000:3.0:1789429284.315266:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+28:2370:x1876351634958848:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429284.315281:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429284.315305:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fb51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b79c expref: 28 pid: 13238 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.315320:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fb51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b79c expref: 28 pid: 13238 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.315345:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad72635fb51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b79c expref: 28 pid: 13238 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.315370:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 266) 00010000:00010000:3.0:1789429284.315375:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 266) 00010000:00010000:3.0:1789429284.315384:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad726360545 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c190 expref: 34 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.315395:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad726360545 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c190 expref: 34 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.315435:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad726360545 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c190 expref: 34 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.315450:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648335872:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429284.315749:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429284.320811:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.320811:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15185c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648335872:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429284.320836:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429284.320887:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634958976 00000100:00100000:3.0:1789429284.320888:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351634958848:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5623us (5945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.320894:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634958976 00000100:00100000:3.0:1789429284.320899:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6149 00002000:00100000:2.0:1789429284.320936:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f34072d80 x1876351634958976/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.320946:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072d80 with x1876351634958976 ext(233472->237567) 00002000:00010000:2.0:1789429284.320950:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34072d80 00000100:00100000:2.0:1789429284.320985:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11428 00000100:00100000:2.0:1789429284.320995:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2370:x1876351634958976:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429284.321173:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2370:x1876351634958976:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 178us (366us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429284.321180:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11428 00002000:00100000:2.0:1789429284.321186:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2b:0x0] (233472->237567) req@ffff946f34072d80 x1876351634958976/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429284.321195:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072d80 with x1876351634958976 ext(233472->237567) 00002000:00010000:2.0:1789429284.321222:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34072d80 00000100:00100000:0.0:1789429284.329930:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.331910:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634959104 00000100:00100000:1.0:1789429284.331923:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634959104 00000100:00100000:0.0:1789429284.332431:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5725 00000100:00100000:0.0:1789429284.332444:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:33938:x1876351634959104:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429284.332461:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429284.332478:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72636054c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c197 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.332515:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.332525:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(135 266) 00010000:00010000:0.0:1789429284.332529:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 266) 00010000:00010000:0.0:1789429284.332535:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72636054c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c197 expref: 36 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.332565:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 26 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.332580:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 26 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.332594:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648336000:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429284.333358:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03515900 going to sleep for 11 seconds 00000100:00100000:0.0:1789429284.340012:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648336000:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429284.340048:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72636054c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c197 expref: 36 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.340069:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429284.340129:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+36:33938:x1876351634959104:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7688us (10209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429284.340149:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5725 00000100:00100000:3.0:1789429284.342613:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.342703:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634959232 00000100:00100000:2.0:1789429284.342712:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634959232 00010000:00010000:2.0:1789429284.342750:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 27 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.342794:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6150 00000100:00100000:2.0:1789429284.342804:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351634959232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429284.342818:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429284.342840:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 27 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.342855:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 27 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.342876:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4419425/0xb4c3dad72635fc7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8c9 expref: 27 pid: 20745 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.342895:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 266) 00010000:00010000:2.0:1789429284.342899:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 266) 00010000:00010000:2.0:1789429284.342908:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72636054c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c197 expref: 35 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.342918:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72636054c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c197 expref: 35 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.342956:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72636054c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c197 expref: 35 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429284.343084:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648336128:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429284.343626:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429284.348469:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.348617:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648336128:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429284.348641:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429284.348702:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634959232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5899us (6096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429284.348714:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6150 00000100:00100000:3.0:1789429284.350698:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634959360 00000100:00100000:3.0:1789429284.350711:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634959360 00002000:00100000:0.0:1789429284.350832:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f02d65c00 x1876351634959360/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429284.350845:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d65c00 with x1876351634959360 ext(237568->241663) 00002000:00010000:0.0:1789429284.350851:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d65c00 00000100:00100000:0.0:1789429284.350886:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11429 00000100:00100000:0.0:1789429284.350895:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+36:2370:x1876351634959360:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429284.351087:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+36:2370:x1876351634959360:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 193us (2627us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429284.351095:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11429 00002000:00100000:0.0:1789429284.351106:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2b:0x0] (237568->241663) req@ffff946f02d65c00 x1876351634959360/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429284.351114:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d65c00 with x1876351634959360 ext(237568->241663) 00002000:00010000:0.0:1789429284.351118:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d65c00 00000100:00100000:2.0:1789429284.357808:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.357872:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634959488 00000100:00100000:0.0:1789429284.357882:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634959488 00000100:00100000:0.0:1789429284.357940:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5726 00000100:00100000:0.0:1789429284.357950:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+36:33938:x1876351634959488:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429284.357968:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429284.358095:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad726360553 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c19e expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.358131:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.358150:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(136 266) 00010000:00010000:0.0:1789429284.358154:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 266) 00010000:00010000:0.0:1789429284.358160:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad726360553 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c19e expref: 37 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.358196:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.358239:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 25 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.358252:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648336256:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429284.358331:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429284.365673:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648336256:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429284.365711:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad726360553 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [241664->245759] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c19e expref: 37 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.365732:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad600, rc 0) 00000100:00100000:0.0:1789429284.365789:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+37:33938:x1876351634959488:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 7839us (7989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429284.365798:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5726 00000100:00100000:2.0:1789429284.366603:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.366685:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634959616 00000100:00100000:1.0:1789429284.366693:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634959616 00010000:00010000:1.0:1789429284.366727:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 26 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429284.366764:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6151 00000100:00100000:1.0:1789429284.366773:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:2371:x1876351634959616:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429284.366789:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429284.366810:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 26 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.366824:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 26 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.366848:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b6bb2ed/0xb4c3dad72635fca8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b8f3 expref: 26 pid: 20986 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.366866:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 266) 00010000:00010000:1.0:1789429284.366870:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 266) 00010000:00010000:1.0:1789429284.366879:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad726360553 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c19e expref: 36 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.366889:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad726360553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c19e expref: 36 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.366929:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad726360553 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c19e expref: 36 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429284.366944:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648336384:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429284.367116:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429284.374260:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.374574:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648336384:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429284.374603:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429284.374660:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634959616:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7886us (8059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429284.374670:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6151 00000100:00100000:3.0:1789429284.376656:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634959744 00000100:00100000:3.0:1789429284.376668:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634959744 00002000:00100000:3.0:1789429284.376720:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (241664->249855) req@ffff946f02d64380 x1876351634959744/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.376740:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d64380 with x1876351634959744 ext(241664->249855) 00002000:00010000:3.0:1789429284.376746:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d64380 00000100:00100000:3.0:1789429284.376780:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11430 00000100:00100000:3.0:1789429284.376791:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+37:2371:x1876351634959744:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429284.377118:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+37:2371:x1876351634959744:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 327us (2865us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1789429284.377134:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11430 00002000:00100000:3.0:1789429284.377150:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2b:0x0] (241664->249855) req@ffff946f02d64380 x1876351634959744/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/8632 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.377166:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d64380 with x1876351634959744 ext(241664->249855) 00002000:00010000:3.0:1789429284.377170:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d64380 00000100:00100000:2.0:1789429284.394406:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.394505:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634959872 00000100:00100000:1.0:1789429284.394516:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634959872 00000100:00100000:1.0:1789429284.394578:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5727 00000100:00100000:1.0:1789429284.394590:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+37:33938:x1876351634959872:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429284.394610:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429284.394628:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636055a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1a5 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.394662:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.394672:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(137 266) 00010000:00010000:1.0:1789429284.394676:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 266) 00010000:00010000:1.0:1789429284.394681:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636055a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1a5 expref: 38 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.394715:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 24 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.394729:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 24 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429284.394744:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648336512:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429284.394834:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429284.404409:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648336512:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429284.404453:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636055a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [356352->360447] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1a5 expref: 38 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429284.404474:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:1.0:1789429284.404551:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+38:33938:x1876351634959872:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9962us (10155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429284.404561:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5727 00000100:00100000:2.0:1789429284.411367:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.411513:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634960000 00000100:00100000:0.0:1789429284.411524:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634960000 00010000:00010000:0.0:1789429284.411566:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 25 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.411616:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6152 00000100:00100000:0.0:1789429284.411625:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351634960000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429284.411640:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429284.411664:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 25 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.411680:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 25 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.411707:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263604c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c10b expref: 25 pid: 6681 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.411730:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 266) 00010000:00010000:0.0:1789429284.411736:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 266) 00010000:00010000:0.0:1789429284.411745:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636055a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1a5 expref: 37 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.411756:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636055a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1a5 expref: 37 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.411811:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636055a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1a5 expref: 37 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.411834:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648336640:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429284.411929:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429284.416276:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648336640:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429284.416303:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429284.416365:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+24:2370:x1876351634960000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4740us (5006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429284.416377:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6152 00000100:00100000:2.0:1789429284.421942:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.422281:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634960128 00000100:00100000:3.0:1789429284.422293:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634960128 00002000:00100000:3.0:1789429284.422346:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (356352->376831) req@ffff946f3f178700 x1876351634960128/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.422357:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f178700 with x1876351634960128 ext(356352->376831) 00002000:00010000:3.0:1789429284.422363:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f178700 00000100:00100000:3.0:1789429284.422406:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11431 00000100:00100000:3.0:1789429284.422415:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+38:2369:x1876351634960128:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429284.431017:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+38:2369:x1876351634960128:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 8591us (9073us total) trans 0 rc 20480/20480 00000100:00100000:1.0:1789429284.431031:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11431 00002000:00100000:1.0:1789429284.431045:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2b:0x0] (356352->376831) req@ffff946f3f178700 x1876351634960128/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/440 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 20480/20480 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429284.431055:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f178700 with x1876351634960128 ext(356352->376831) 00002000:00010000:1.0:1789429284.431063:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f178700 00000100:00100000:2.0:1789429284.440049:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.440191:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634960256 00000100:00100000:3.0:1789429284.440239:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634960256 00000100:00100000:3.0:1789429284.440298:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5728 00000100:00100000:3.0:1789429284.440309:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+38:33938:x1876351634960256:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429284.440326:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429284.440345:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360561 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1ac expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.440382:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.440394:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(138 266) 00010000:00010000:3.0:1789429284.440399:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 266) 00010000:00010000:3.0:1789429284.440406:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360561 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1ac expref: 39 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.440444:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 23 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.440458:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 23 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.440472:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648336768:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429284.440548:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429284.445718:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648336768:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429284.445762:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360561 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->380927] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1ac expref: 39 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.445785:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:2.0:1789429284.446526:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:33938:x1876351634960256:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 6216us (6485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.446537:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5728 00000100:00100000:3.0:1789429284.446753:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.451655:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634960384 00000100:00100000:0.0:1789429284.451669:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634960384 00010000:00010000:0.0:1789429284.451716:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 24 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.451760:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6153 00000100:00100000:0.0:1789429284.451770:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+24:2371:x1876351634960384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429284.451854:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429284.451878:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 24 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.451893:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 24 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.451915:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4c0c95/0xb4c3dad7263604ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c119 expref: 24 pid: 6680 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.451940:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 266) 00010000:00010000:0.0:1789429284.451945:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 266) 00010000:00010000:0.0:1789429284.451953:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360561 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1ac expref: 38 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.452026:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360561 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1ac expref: 38 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.452066:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360561 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1ac expref: 38 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.452080:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648336896:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429284.452367:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429284.462799:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648336896:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429284.462825:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429284.462888:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634960384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11117us (16134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429284.462902:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6153 00000100:00100000:0.0:1789429284.463051:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429284.463466:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634960512 00000100:00100000:3.0:1789429284.463473:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634960512 00002000:00100000:3.0:1789429284.463515:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (376832->393215) req@ffff946f34498000 x1876351634960512/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.463527:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34498000 with x1876351634960512 ext(376832->393215) 00002000:00010000:3.0:1789429284.463532:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34498000 00000100:00100000:3.0:1789429284.463565:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11432 00000100:00100000:3.0:1789429284.463575:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634960512:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429284.463769:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634960512:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 195us (718us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1789429284.463776:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11432 00002000:00100000:3.0:1789429284.463782:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2b:0x0] (376832->393215) req@ffff946f34498000 x1876351634960512/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/16824 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 16384/16384 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429284.463790:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34498000 with x1876351634960512 ext(376832->393215) 00002000:00010000:3.0:1789429284.463793:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34498000 00000100:00100000:3.0:1789429284.476733:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.476916:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634960640 00000100:00100000:0.0:1789429284.476925:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634960640 00000100:00100000:0.0:1789429284.476993:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5729 00000100:00100000:0.0:1789429284.477003:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:33938:x1876351634960640:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429284.477022:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429284.477040:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360568 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1b3 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.477072:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.477086:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2b:0x0].0x0 since=0s v=(139 266) 00010000:00010000:0.0:1789429284.477090:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 266) 00010000:00010000:0.0:1789429284.477095:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360568 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1b3 expref: 40 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.477147:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429284.477170:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 22 pid: 8085 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429284.477183:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648337024:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429284.477294:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e035150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429284.480859:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429284.480983:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648337024:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429284.481016:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360568 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1b3 expref: 40 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429284.481038:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:2.0:1789429284.481098:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+40:33938:x1876351634960640:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4096us (4375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.481107:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5729 00000100:00100000:3.0:1789429284.481192:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634960768 00000100:00100000:3.0:1789429284.481230:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634960768 00010000:00010000:3.0:1789429284.481260:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 23 pid: 8085 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.481290:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6154 00000100:00100000:3.0:1789429284.481298:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634960768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429284.481311:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429284.481330:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 23 pid: 8085 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.481341:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 23 pid: 8085 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.481361:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e9abd8a/0xb4c3dad7263604dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 32 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c127 expref: 23 pid: 8085 timeout: 1082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.481376:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 266) 00010000:00010000:3.0:1789429284.481380:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(140 266) 00010000:00010000:3.0:1789429284.481388:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360568 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1b3 expref: 39 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.481398:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1b3 expref: 39 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429284.481431:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360568 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1b3 expref: 39 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429284.481444:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15186d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648337152:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429284.481494:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f09815cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429284.491159:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429284.491288:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634960896 00000100:00100000:0.0:1789429284.491298:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634960896 00002000:00100000:0.0:1789429284.491348:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff946e15185880 x1876351634960896/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/0 e 0 to 0 dl 1789429295 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429284.491361:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185880 with x1876351634960896 ext(393216->397311) 00002000:00010000:0.0:1789429284.491367:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15185880 00000100:00100000:0.0:1789429284.491404:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11433 00000100:00100000:0.0:1789429284.491415:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+40:2370:x1876351634960896:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429284.491719:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+40:2370:x1876351634960896:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 305us (569us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429284.491728:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11433 00002000:00100000:0.0:1789429284.491735:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2b:0x0] (393216->397311) req@ffff946e15185880 x1876351634960896/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:20/0 lens 488/4536 e 0 to 0 dl 1789429295 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429284.491744:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185880 with x1876351634960896 ext(393216->397311) 00002000:00010000:0.0:1789429284.491748:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15185880 00000100:00100000:2.0:1789429284.491845:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15186d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648337152:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429284.491868:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429284.493306:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+22:2370:x1876351634960768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11998us (12448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.493321:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6154 00000100:00100000:3.0:1789429284.503536:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.503779:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634961152 00000100:00100000:1.0:1789429284.503790:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634961152 00000100:00100000:1.0:1789429284.503918:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 232 00000100:00100000:1.0:1789429284.503929:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33938:x1876351634961152:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789429284.504760:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33938:x1876351634961152:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 829us (1230us total) trans 4294977070 rc 0/0 00000100:00100000:1.0:1789429284.504771:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 232 00000100:00080000:3.0:1789429284.505352:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429284.630788:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.630838:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.630874:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.630907:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429284.630937:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634961536 00000100:00100000:1.0:1789429284.630949:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634961536 00000100:00100000:1.0:1789429284.631014:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634961664 00000100:00100000:1.0:1789429284.631018:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634961664 00000100:00100000:1.0:1789429284.631041:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 740 00000100:00100000:1.0:1789429284.631050:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634961536:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429284.631123:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634961536:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 73us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429284.631242:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 740 00000100:00100000:1.0:1789429284.631260:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 741 00000100:00100000:1.0:1789429284.631267:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351634961664:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429284.631293:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351634961664:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429284.631299:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 741 00000100:00100000:3.0:1789429284.632401:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634961408 00000100:00100000:3.0:1789429284.632409:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634961408 00000100:00100000:2.0:1789429284.632514:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634961280 00000100:00100000:2.0:1789429284.632519:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634961280 00000100:00100000:2.0:1789429284.632562:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 521 00000100:00100000:2.0:1789429284.632570:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351634961280:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429284.632618:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351634961280:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 49us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.632625:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 521 00000100:00080000:2.0:1789429284.632736:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429284.632740:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429284.633534:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 688 00000100:00100000:2.0:1789429284.633549:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+40:2371:x1876351634961408:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429284.633611:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+40:2371:x1876351634961408:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 66us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429284.633618:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 688 00000100:00100000:3.0:1789429285.027757:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648337280:0@lo:400:kworker.0 00000100:00100000:3.0:1789429285.027835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429285.027890:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648337792:0@lo:400:kworker.0 00000100:00100000:3.0:1789429285.027920:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429285.027944:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789429285.027950:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648337408:0@lo:400:kworker.0 00000100:00100000:3.0:1789429285.027971:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429285.027986:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648337920:0@lo:400:kworker.0 00000100:00100000:3.0:1789429285.028008:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429285.028091:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648337536:0@lo:400:kworker.0 00000100:00100000:0.0:1789429285.028120:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429285.028156:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789429285.028162:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648337664:0@lo:400:kworker.0 00000100:00100000:0.0:1789429285.028183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429285.028240:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648337792 00000100:00100000:0.0:1789429285.028247:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648337792 00000100:00100000:0.0:1789429285.028295:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648337408 00000100:00100000:0.0:1789429285.028298:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648337408 00000100:00100000:0.0:1789429285.028314:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648337536 00000100:00100000:0.0:1789429285.028317:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648337536 00000100:00100000:0.0:1789429285.028338:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1789429285.028347:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648337792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429285.028396:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648337792:12345-0@lo:400:kworker.0 Request processed in 50us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429285.028404:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1789429285.028421:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1789429285.028427:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648337408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429285.028454:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648337408:12345-0@lo:400:kworker.0 Request processed in 27us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429285.028463:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1789429285.028474:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1789429285.028480:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648337536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429285.028509:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648337536:12345-0@lo:400:kworker.0 Request processed in 29us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429285.028515:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00080000:0.0:1789429285.028537:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429285.028567:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648337536:0@lo:400:kworker.0 00000100:00100000:3.0:1789429285.028719:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648337408:0@lo:400:kworker.0 00000100:00100000:3.0:1789429285.028731:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648337792:0@lo:400:kworker.0 00000100:00100000:2.0:1789429285.028801:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648337280 00000100:00100000:2.0:1789429285.028806:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648337280 00000100:00100000:2.0:1789429285.028842:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1789429285.028850:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648337280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429285.028898:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648337280:12345-0@lo:400:kworker.0 Request processed in 50us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429285.028906:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1789429285.028932:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648337920 00000100:00100000:2.0:1789429285.028936:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648337920 00000100:00100000:2.0:1789429285.028967:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648337664 00000100:00100000:2.0:1789429285.028970:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648337664 00000100:00100000:2.0:1789429285.028989:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1789429285.028994:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648337920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429285.029025:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648337920:12345-0@lo:400:kworker.0 Request processed in 31us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429285.029031:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1789429285.029041:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1789429285.029046:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648337664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429285.029077:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648337664:12345-0@lo:400:kworker.0 Request processed in 31us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429285.029083:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00080000:2.0:1789429285.029097:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429285.029100:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429285.029116:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969242 gen 2 00000004:00080000:2.0:1789429285.029122:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f119d6d80, transno 4294969242 00000100:00100000:2.0:1789429285.029131:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648337664:0@lo:400:kworker.0 00000100:00100000:0.0:1789429285.029561:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969550 gen 2 00000004:00080000:0.0:1789429285.029567:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f3462c000, transno 4294969550 00000100:00100000:0.0:1789429285.029582:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648337920:0@lo:400:kworker.0 00000100:00100000:0.0:1789429285.029591:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648337280:0@lo:400:kworker.0 00010000:00010000:3.0:1789429285.095828:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429285.539598:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429285.539619:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648338048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429285.539820:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789429285.539833:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648338176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429285.539943:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429285.540007:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648338176 00000100:00100000:1.0:1789429285.540014:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648338176 00000100:00100000:2.0:1789429285.547415:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429285.556885:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648338048 00000100:00100000:1.0:1789429285.556900:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648338048 00000100:00100000:2.0:1789429285.556907:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789429285.556924:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648338176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429285.556965:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 330366976 pending 1703936 free 3856662528 avail 3854565376 00000100:00100000:2.0:1789429285.557057:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648338176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (17112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429285.557064:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789429285.557089:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789429285.557097:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648338048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429285.557115:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 47710208 granted 864878592 pending 42598400 free 3827302400 avail 3825205248 00000100:00100000:2.0:1789429285.557165:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648338048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (9757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429285.557172:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789429285.557271:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648338176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429285.557526:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648338048:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1789429285.598980:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969570 is committed 00000001:00080000:3.0:1789429285.599000:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969564 is committed 00000001:00080000:3.0:1789429285.599013:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969569 is committed 00000001:00080000:3.0:1789429285.599025:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969573 is committed 00000001:00080000:3.0:1789429285.599030:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969572 is committed 00010000:00010000:0.0:1789429286.119615:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789429286.128324:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969243 is committed 00000001:00080000:3.0:1789429286.131677:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977070 is committed 00000100:00100000:2.0:1789429286.132458:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429286.132796:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634961920 00000100:00100000:3.0:1789429286.132806:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634961920 00000100:00100000:3.0:1789429286.133030:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 233 00000100:00100000:3.0:1789429286.133040:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+40:33927:x1876351634961920:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1789429286.133513:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+41:33927:x1876351634961920:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 472us (1056us total) trans 4294977071 rc 0/0 00000100:00100000:3.0:1789429286.133522:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 233 00000100:00080000:2.0:1789429286.134764:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429286.138460:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.138566:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634962048 00000100:00100000:0.0:1789429286.138576:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634962048 00000100:00100000:0.0:1789429286.138641:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21060 00000100:00100000:0.0:1789429286.138652:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+41:33927:x1876351634962048:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429286.138675:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429286.138695:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636056f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.138759:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360576 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.138789:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.138802:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429286.138842:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429286.138845:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429286.138865:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360576 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.138890:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636056f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1ba expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.138909:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360576 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1ba expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.138918:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:0.0:1789429286.138921:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429286.138924:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad000, rc 0) 00000100:00100000:0.0:1789429286.139496:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634962048:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 843us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429286.139504:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21060 00000100:00100000:1.0:1789429286.145033:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.145193:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634962176 00000100:00100000:0.0:1789429286.145220:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634962176 00000100:00100000:0.0:1789429286.145280:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21061 00000100:00100000:0.0:1789429286.145290:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634962176:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429286.145310:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429286.145331:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636057d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1c1 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.145401:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726360584 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.145415:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726360584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.145426:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726360584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.145441:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636058b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.145448:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636058b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.145454:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636058b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147101:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147188:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147275:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429286.147313:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x6c:0x0]: returning size 409600 00000004:00200000:1.0:1789429286.147317:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429286.147336:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147347:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147356:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726360584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147363:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726360584 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147374:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726360584 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147381:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ade00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429286.147385:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726360584 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147392:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726360584 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147403:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:1.0:1789429286.147407:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429286.147412:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726360584 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147418:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726360584 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147431:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636058b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147437:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636058b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147443:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636058b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147448:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429286.147451:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636058b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147461:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636058b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147467:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1b4ce6b (ffff946f120fdd00) 00010000:00010000:1.0:1789429286.147470:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429286.147472:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636058b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147478:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636058b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147510:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636057d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1c1 expref: 44 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147523:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1c1 expref: 43 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.147530:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff946f2076a700) 00010000:00010000:1.0:1789429286.147532:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429286.147598:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:1.0:1789429286.147718:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+43:33927:x1876351634962176:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2428us (2691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429286.147726:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21061 00000100:00100000:3.0:1789429286.151260:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.151380:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634962432 00000100:00100000:0.0:1789429286.151390:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634962432 00000100:00100000:0.0:1789429286.151448:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21062 00000100:00100000:0.0:1789429286.151458:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+43:33927:x1876351634962432:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1789429286.151513:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789429286.151550:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360592 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1c1 expref: 43 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.151574:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad72635f6d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b351 expref: 42 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.151589:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff946f2076a700) 00010000:00010000:0.0:1789429286.151601:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360576 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1ba expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.151609:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:0.0:1789429286.151612:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429286.151642:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.151655:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b35f expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.151663:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.151694:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b35f expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.151703:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b35f expref: 15 pid: 5840 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429286.151715:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648338304:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429286.151795:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c2723c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429286.155714:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.155880:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648338304:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429286.155908:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429286.156075:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634962560 00000100:00100000:3.0:1789429286.156082:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634962560 00010000:00010000:3.0:1789429286.156188:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b35f expref: 16 pid: 5840 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429286.156252:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6155 00000100:00100000:3.0:1789429286.156262:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351634962560:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429286.156281:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429286.156289:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b35f expref: 16 pid: 5840 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789429286.156291:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789429286.156302:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b35f expref: 16 pid: 5840 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.156322:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72635f6ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b35f expref: 16 pid: 5840 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.156335:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429286.156341:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.156350:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.156361:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.156394:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429286.156449:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634962560:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 189us (743us total) trans 0 rc 0/0 00010000:00010000:1.0:1789429286.157148:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.157158:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.157184:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263605a0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.157195:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263605a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.157233:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263605a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.157550:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.157563:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd9e00/0xb4c3dad72635f706 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b366 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.157570:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.157599:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd9e00/0xb4c3dad72635f706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b366 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.157614:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd9e00/0xb4c3dad72635f706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b366 expref: 15 pid: 5839 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429286.157628:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648338432:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429286.157691:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f341a2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429286.159409:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6155 00000100:00100000:1.0:1789429286.162446:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.162643:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648338432:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429286.162680:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429286.163316:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634962688 00000100:00100000:2.0:1789429286.163324:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634962688 00010000:00010000:2.0:1789429286.163360:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd9e00/0xb4c3dad72635f706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b366 expref: 15 pid: 5839 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429286.163400:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6156 00000100:00100000:2.0:1789429286.163409:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351634962688:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429286.163422:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429286.163429:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd9e00/0xb4c3dad72635f706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b366 expref: 15 pid: 5839 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.163442:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd9e00/0xb4c3dad72635f706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b366 expref: 15 pid: 5839 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.163474:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd9e00/0xb4c3dad72635f706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b366 expref: 15 pid: 5839 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.163489:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff946f2076a700) 00010000:00010000:2.0:1789429286.163495:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.163505:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.163517:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.163543:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429286.163598:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351634962688:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 190us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429286.163606:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6156 00010000:00010000:0.0:1789429286.163661:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.163669:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789429286.164603:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 64 off9664 00000004:00080000:0.0:1789429286.164614:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 984144412973ns, next at 985144410755ns, rc = 0 00010000:00010000:0.0:1789429286.164676:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263605ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164688:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263605ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164697:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263605ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164705:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263605ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164712:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263605ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164718:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263605ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164732:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789429286.164749:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164756:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164762:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164767:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429286.164772:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164779:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164788:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff946f2076a700) 00010000:00010000:0.0:1789429286.164791:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789429286.164796:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164801:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263605a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164817:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164823:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164827:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164832:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429286.164836:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164841:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164848:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:0.0:1789429286.164850:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429286.164853:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.164857:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360599 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429286.164871:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b560819c reply state 0000000006096d58 transno 4294977072 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263605a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429286.164879:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429286.164934:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634962432:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 13477us (13680us total) trans 4294977072 rc 0/0 00000100:00100000:0.0:1789429286.164941:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21062 00010000:00010000:2.0:1789429286.165865:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789429286.165874:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263605ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.165883:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad000 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429286.165887:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263605ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.165894:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263605ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.165906:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c:0x0].0x0 (ffff946f2076a700) 00010000:00010000:2.0:1789429286.165909:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789429286.165912:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263605ae lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.165919:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263605ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.165936:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429286.165938:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429286.165940:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429286.168662:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263605a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.168678:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263605a0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.168685:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263605a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.168691:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429286.168696:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263605a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.168704:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263605a0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.168719:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1b4ce6b (ffff946f2076ae00) 00010000:00010000:0.0:1789429286.168722:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429286.168726:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263605a0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.168733:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263605a0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429286.170532:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429286.171009:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634962816 00000100:00100000:2.0:1789429286.171020:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634962816 00000100:00100000:2.0:1789429286.171097:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21063 00000100:00100000:2.0:1789429286.171104:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+41:33927:x1876351634962816:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429286.171139:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429286.171161:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263605b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.171247:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263605bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.171259:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263605bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.171267:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263605bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429286.171295:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429286.171297:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429286.171311:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263605bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.171328:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263605b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1c8 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.171340:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263605bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1c8 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.171345:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef100) 00010000:00010000:2.0:1789429286.171347:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429286.171350:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547e00, rc 0) 00000100:00100000:2.0:1789429286.171391:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634962816:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 288us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429286.171395:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21063 00000100:00100000:2.0:1789429286.173713:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.173780:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634962944 00000100:00100000:0.0:1789429286.173789:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634962944 00000100:00100000:0.0:1789429286.173886:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21064 00000100:00100000:0.0:1789429286.173896:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634962944:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429286.173913:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429286.173931:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263605c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1cf expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174007:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263605ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174020:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263605ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174030:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263605ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174086:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174094:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174101:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174174:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263605ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174181:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263605ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174188:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263605ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174195:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2aca00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429286.174364:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263605ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174374:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263605ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174386:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef100) 00010000:00010000:0.0:1789429286.174389:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429286.174394:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263605ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174401:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263605ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174414:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174421:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174426:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174431:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ada00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429286.174434:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174441:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174447:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x397ecf4c (ffff946f120fdb00) 00010000:00010000:0.0:1789429286.174450:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429286.174452:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174471:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174500:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263605c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1cf expref: 43 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174510:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef100) 00010000:00010000:0.0:1789429286.174512:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429286.174516:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263605c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1cf expref: 43 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.174525:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429286.174622:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634962944:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 727us (918us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429286.174630:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21064 00000100:00100000:1.0:1789429286.177734:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429286.177817:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634963072 00000100:00100000:3.0:1789429286.177828:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634963072 00000100:00100000:3.0:1789429286.177884:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21065 00000100:00100000:3.0:1789429286.177894:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634963072:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429286.177913:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429286.177931:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263605d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1d6 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.177997:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263605df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178011:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263605df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178022:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263605df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178036:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263605e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178043:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263605e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178055:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263605e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178108:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263605df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178116:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263605df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178123:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263605df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178144:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c4000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429286.178148:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263605df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178157:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263605df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178168:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef100) 00010000:00010000:3.0:1789429286.178171:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429286.178175:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263605df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178180:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263605df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178191:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263605e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178359:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263605e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178369:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263605e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178375:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c4e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429286.178378:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263605e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178384:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263605e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178393:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3edd8f70 (ffff946f04fb8300) 00010000:00010000:3.0:1789429286.178395:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429286.178398:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263605e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178403:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263605e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178434:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263605d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1d6 expref: 43 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178443:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef100) 00010000:00010000:3.0:1789429286.178446:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429286.178449:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263605d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1d6 expref: 43 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.178459:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5000, rc 0) 00000100:00100000:3.0:1789429286.178623:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634963072:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 729us (897us total) trans 0 rc 301/301 00000100:00100000:3.0:1789429286.178642:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21065 00000100:00100000:3.0:1789429286.182670:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.182860:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634963328 00000100:00100000:0.0:1789429286.182870:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634963328 00000100:00100000:0.0:1789429286.182925:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21066 00000100:00100000:0.0:1789429286.182934:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634963328:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429286.182963:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429286.182967:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789429286.182996:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263605bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1c8 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.183015:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef100) 00010000:00010000:0.0:1789429286.183025:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429286.183039:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263605ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1dd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.183166:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.183180:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.183191:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.183600:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263605fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.183610:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263605fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.183618:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263605fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429286.184413:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d:0x0], index 0: 0 00010000:00010000:1.0:1789429286.184579:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360602 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.184591:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.184601:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.184637:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.184644:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.184652:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.184657:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ada00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429286.184662:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.184670:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.184682:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:1.0:1789429286.184685:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429286.184689:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.184695:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263605f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429286.184707:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a953b95e reply state 00000000123e28ec transno 4294977073 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263605fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429286.184715:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429286.184748:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263605ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1dd expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.184767:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360602 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1dd expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.184775:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff946f2076a800) 00010000:00010000:1.0:1789429286.184777:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429286.184779:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429286.184908:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+44:33927:x1876351634963328:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 1973us (2247us total) trans 4294977073 rc 0/0 00000100:00100000:1.0:1789429286.184917:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21066 00010000:00010000:3.0:1789429286.187497:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263605fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.187512:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263605fb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.187518:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263605fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.187523:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429286.187527:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263605fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.187533:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263605fb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.187548:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3edd8f70 (ffff946f120fde00) 00010000:00010000:3.0:1789429286.187551:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429286.187556:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263605fb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.187561:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263605fb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429286.189823:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429286.189894:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634963584 00000100:00100000:1.0:1789429286.189904:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634963584 00000100:00100000:1.0:1789429286.189968:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21067 00000100:00100000:1.0:1789429286.189978:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+43:33927:x1876351634963584:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789429286.190031:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429286.190054:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360602 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1dd expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.190070:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff946f2076a800) 00010000:00010000:1.0:1789429286.190079:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429286.190335:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360610 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.190348:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.190357:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789429286.190400:0:15700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977074 00000004:00010000:1.0:1789429286.190422:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000f60bfb0 reply state 00000000418941c5 transno 4294977075 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429286.190431:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429286.190507:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+45:33927:x1876351634963584:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 530us (692us total) trans 4294977075 rc 0/0 00000100:00100000:1.0:1789429286.190514:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21067 00000020:00080000:1.0:1789429286.190518:0:15700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789429286.192700:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.192718:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360610 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.192725:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360610 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.192731:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429286.192736:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360610 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.192744:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360610 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.192760:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff946f2076a600) 00010000:00010000:0.0:1789429286.192762:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429286.192767:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360610 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.192772:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360610 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429286.194168:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.194279:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634963712 00000100:00100000:0.0:1789429286.194289:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634963712 00000100:00100000:0.0:1789429286.194350:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21068 00000100:00100000:0.0:1789429286.194359:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+44:33927:x1876351634963712:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429286.194383:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429286.194405:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360617 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.194461:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1e4 expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.194479:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1e4 expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.194497:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff946f120fd100) 00010000:00010000:0.0:1789429286.194500:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789429286.194503:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429286.194553:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+45:33927:x1876351634963712:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 195us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429286.194561:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21068 00000100:00100000:2.0:1789429286.197753:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429286.197895:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634963840 00000100:00100000:1.0:1789429286.197906:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634963840 00000100:00100000:1.0:1789429286.197987:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5730 00000100:00100000:1.0:1789429286.197997:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+7:33927:x1876351634963840:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429286.198015:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429286.198037:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1eb expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429286.198064:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789429286.198084:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=984s v=(0 0) 00010000:00010000:1.0:1789429286.198089:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429286.198097:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.198113:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.198136:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:1.0:1789429286.198193:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+8:33927:x1876351634963840:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 197us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429286.198227:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5730 00000100:00080000:0.0:1789429286.198665:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429286.200869:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429286.201135:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634963968 00000100:00100000:3.0:1789429286.201144:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634963968 00002000:00010000:3.0:1789429286.201182:0:18658:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/45 (409600->18446744073709551615) 00002000:00100000:3.0:1789429286.201187:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17b100 with x1876351634963968 ext(409600->18446744073709551615) 00002000:00010000:3.0:1789429286.201198:0:18658:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f17b100. 00000100:00100000:3.0:1789429286.201259:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11434 00000100:00100000:3.0:1789429286.201268:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634963968:12345-192.168.203.39@tcp:10:mmap_sanity.0 00002000:00010000:3.0:1789429286.201576:0:18658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:3.0:1789429286.201580:0:18658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb mtime from disk: 0 -> 1789429286 00002000:00010000:3.0:1789429286.201583:0:18658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789429286.201585:0:18658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb ctime from disk: 0 -> 1789429286 00002000:00010000:3.0:1789429286.201587:0:18658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789429286.201646:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634963968:12345-192.168.203.39@tcp:10:mmap_sanity.0 Request processed in 378us (785us total) trans 4294969244 rc 0/0 00000100:00100000:3.0:1789429286.201653:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11434 00002000:00010000:3.0:1789429286.201656:0:18658:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/45 (409600->18446744073709551615) 00002000:00100000:3.0:1789429286.201659:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f17b100 with x1876351634963968 ext(409600->18446744073709551615) 00002000:00010000:3.0:1789429286.201664:0:18658:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f17b100. 00000100:00100000:3.0:1789429286.206993:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429286.207091:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634964096 00000100:00100000:2.0:1789429286.207101:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634964096 00000100:00100000:2.0:1789429286.207171:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21069 00000100:00100000:2.0:1789429286.207181:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+45:33927:x1876351634964096:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429286.207230:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429286.207253:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.207320:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636062c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.207333:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636062c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.207344:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636062c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429286.207377:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429286.207380:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429286.207399:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636062c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.207422:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1f2 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.207446:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636062c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1f2 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.207455:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef500) 00010000:00010000:2.0:1789429286.207458:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429286.207461:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546800, rc 0) 00000100:00100000:2.0:1789429286.207521:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+46:33927:x1876351634964096:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 342us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429286.207528:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21069 00000100:00100000:1.0:1789429286.210739:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429286.210819:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634964352 00000100:00100000:2.0:1789429286.210831:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634964352 00000100:00100000:2.0:1789429286.210886:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21070 00000100:00100000:2.0:1789429286.210896:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+46:33927:x1876351634964352:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429286.210914:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429286.210917:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789429286.210941:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636062c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1f2 expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.210968:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef500) 00010000:00010000:2.0:1789429286.210978:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429286.210991:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360633 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c1f9 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211096:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad72636063a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211132:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad72636063a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211143:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad72636063a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211157:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360641 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211164:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360641 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211171:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360641 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789429286.211625:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c:0x0], index 1: 0 00010000:00010000:2.0:1789429286.211773:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360648 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211784:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211793:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211823:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad72636063a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211829:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad72636063a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211836:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad72636063a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211841:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429286.211845:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad72636063a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211852:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad72636063a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211861:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef800) 00010000:00010000:2.0:1789429286.211864:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429286.211867:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad72636063a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211872:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad72636063a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789429286.211883:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003710c337 reply state 00000000c84c945c transno 4294977076 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360641 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429286.211891:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789429286.211916:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360633 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1f9 expref: 48 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211933:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1f9 expref: 47 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.211940:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff946f051ef000) 00010000:00010000:2.0:1789429286.211943:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789429286.211945:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429286.212013:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+48:33927:x1876351634964352:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 1118us (1282us total) trans 4294977076 rc 0/0 00000100:00100000:2.0:1789429286.212020:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21070 00010000:00010000:2.0:1789429286.214473:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360641 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.214488:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360641 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.214495:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360641 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.214500:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429286.214505:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360641 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.214512:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360641 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.214526:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x397ecf4c (ffff946f051eff00) 00010000:00010000:2.0:1789429286.214530:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429286.214534:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360641 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.214540:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360641 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429286.216846:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.217685:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634964608 00000100:00100000:0.0:1789429286.217697:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634964608 00000100:00100000:0.0:1789429286.217797:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21071 00000100:00100000:0.0:1789429286.217808:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+47:33927:x1876351634964608:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1789429286.217864:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429286.217890:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360648 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1f9 expref: 47 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.217908:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff946f051ef000) 00010000:00010000:0.0:1789429286.217918:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429286.218337:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360656 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.218351:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.218362:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789429286.218414:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977077 00000004:00010000:0.0:1789429286.218442:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000afd55da5 reply state 0000000073da4b0d transno 4294977078 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429286.218450:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429286.218838:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+49:33927:x1876351634964608:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 1030us (1998us total) trans 4294977078 rc 0/0 00000100:00100000:0.0:1789429286.218847:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21071 00000020:00080000:0.0:1789429286.218852:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789429286.221617:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1789429286.222104:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.222177:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360656 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.222186:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.222193:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429286.222197:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429286.222300:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634964736 00000100:00100000:2.0:1789429286.222310:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634964736 00000100:00100000:2.0:1789429286.222365:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21072 00000100:00100000:2.0:1789429286.222375:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+49:33927:x1876351634964736:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429286.222397:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429286.222414:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636065d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c200 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.222538:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360656 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.222553:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:0.0:1789429286.222556:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429286.222561:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360656 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.222571:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360656 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.222661:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636065d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c200 expref: 49 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.222675:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636065d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c200 expref: 49 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.222697:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:2.0:1789429286.222700:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789429286.222702:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546e00, rc 0) 00000100:00100000:2.0:1789429286.222801:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+49:33927:x1876351634964736:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 427us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429286.222808:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21072 00000100:00100000:1.0:1789429286.225586:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.225670:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634964864 00000100:00100000:0.0:1789429286.225680:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634964864 00000100:00100000:0.0:1789429286.225791:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5731 00000100:00100000:0.0:1789429286.225801:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:33927:x1876351634964864:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429286.225819:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429286.225838:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360664 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c207 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429286.225862:0:13238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789429286.225880:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=984s v=(0 0) 00010000:00010000:0.0:1789429286.225885:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429286.225892:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360664 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c207 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.225907:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360664 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c207 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.225919:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429286.225979:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:33927:x1876351634964864:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 179us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429286.225986:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5731 00000100:00080000:1.0:1789429286.226798:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429286.228386:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429286.228471:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634964992 00000100:00100000:3.0:1789429286.228480:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634964992 00002000:00010000:3.0:1789429286.228517:0:15069:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/44 (409600->18446744073709551615) 00002000:00100000:3.0:1789429286.228521:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f097b80 with x1876351634964992 ext(409600->18446744073709551615) 00002000:00010000:3.0:1789429286.228533:0:15069:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f097b80. 00000100:00100000:3.0:1789429286.228566:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11435 00000100:00100000:3.0:1789429286.228575:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351634964992:12345-192.168.203.39@tcp:10:mmap_sanity.0 00002000:00010000:3.0:1789429286.228892:0:15069:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:3.0:1789429286.228896:0:15069:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb mtime from disk: 0 -> 1789429286 00002000:00010000:3.0:1789429286.228899:0:15069:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789429286.228901:0:15069:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb ctime from disk: 0 -> 1789429286 00002000:00010000:3.0:1789429286.228903:0:15069:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789429286.228967:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634964992:12345-192.168.203.39@tcp:10:mmap_sanity.0 Request processed in 376us (572us total) trans 4294969574 rc 0/0 00000100:00100000:3.0:1789429286.228975:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11435 00002000:00010000:3.0:1789429286.228979:0:15069:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/44 (409600->18446744073709551615) 00002000:00100000:3.0:1789429286.228983:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f097b80 with x1876351634964992 ext(409600->18446744073709551615) 00002000:00010000:3.0:1789429286.228988:0:15069:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f097b80. 00000100:00100000:3.0:1789429286.234994:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429286.235037:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429286.235064:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634965248 00000100:00100000:3.0:1789429286.235070:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634965120 00000100:00100000:2.0:1789429286.235076:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634965248 00000100:00100000:3.0:1789429286.235076:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634965120 00002000:00100000:3.0:1789429286.235144:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2d:0x0] (0->4095) req@ffff946e0265f480 x1876351634965120/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1789429286.235149:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21073 00002000:00100000:3.0:1789429286.235160:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265f480 with x1876351634965120 ext(0->4095) 00000100:00100000:2.0:1789429286.235165:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:33941:x1876351634965248:12345-192.168.203.39@tcp:101:mmap_sanity.0 00002000:00010000:3.0:1789429286.235168:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265f480 00000100:00100000:3.0:1789429286.235191:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11436 00010000:00010000:2.0:1789429286.235197:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789429286.235218:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634965120:12345-192.168.203.39@tcp:3:kworker.0 00010000:00010000:2.0:1789429286.235257:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636066b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c20e expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.235325:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.235340:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.235362:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429286.235406:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429286.235410:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429286.235428:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429286.235448:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634965120:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 249us (409us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1789429286.235453:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636066b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c20e expref: 16 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429286.235462:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11436 00002000:00100000:3.0:1789429286.235472:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2d:0x0] (0->4095) req@ffff946e0265f480 x1876351634965120/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/4536 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1789429286.235477:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c20e expref: 15 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789429286.235495:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265f480 with x1876351634965120 ext(0->4095) 00010000:00010000:2.0:1789429286.235498:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00002000:00010000:3.0:1789429286.235500:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265f480 00010000:00010000:2.0:1789429286.235504:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429286.235510:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546c00, rc 0) 00000100:00100000:2.0:1789429286.235556:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33941:x1876351634965248:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 394us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429286.236068:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21073 00000100:00100000:3.0:1789429286.242935:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.243059:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634965376 00000100:00100000:0.0:1789429286.243070:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634965376 00002000:00100000:0.0:1789429286.243116:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2d:0x0] (4096->8191) req@ffff946e0265d180 x1876351634965376/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.243139:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d180 with x1876351634965376 ext(4096->8191) 00002000:00010000:0.0:1789429286.243145:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265d180 00000100:00100000:0.0:1789429286.243175:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11437 00000100:00100000:0.0:1789429286.243185:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634965376:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429286.243428:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634965376:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 244us (504us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429286.243436:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11437 00002000:00100000:0.0:1789429286.243443:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2d:0x0] (4096->8191) req@ffff946e0265d180 x1876351634965376/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/4536 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.243451:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d180 with x1876351634965376 ext(4096->8191) 00002000:00010000:0.0:1789429286.243454:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265d180 00000100:00100000:2.0:1789429286.246923:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429286.247047:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634965632 00000100:00100000:3.0:1789429286.247057:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634965632 00000100:00100000:3.0:1789429286.247106:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21074 00000100:00100000:3.0:1789429286.247121:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:33941:x1876351634965632:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429286.247148:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429286.247168:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad726360679 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c215 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247267:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad726360680 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247281:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad726360680 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247292:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad726360680 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247308:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360687 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247315:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247321:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247439:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636068e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247447:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636068e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247454:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636068e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429286.247462:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x6e:0x0]: returning size 409600 00010000:00010000:3.0:1789429286.247552:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad726360680 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247559:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad726360680 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247566:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad726360680 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247572:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429286.247576:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad726360680 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247583:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad726360680 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247595:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:3.0:1789429286.247598:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429286.247602:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad726360680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247613:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad726360680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247625:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247632:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360687 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247637:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360687 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247643:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c4000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429286.247646:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360687 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247652:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360687 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247660:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x397ecf4c (ffff946f04fb8300) 00010000:00010000:3.0:1789429286.247663:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429286.247666:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360687 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247672:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360687 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247710:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad726360679 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c215 expref: 18 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247729:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636068e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c215 expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429286.247737:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:3.0:1789429286.247739:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429286.247742:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429286.247800:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33941:x1876351634965632:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 686us (887us total) trans 4294977079 rc 0/0 00000100:00100000:3.0:1789429286.247808:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21074 00000100:00100000:1.0:1789429286.252407:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429286.252476:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634965760 00000100:00100000:3.0:1789429286.252487:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634965760 00002000:00100000:3.0:1789429286.252533:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2d:0x0] (8192->12287) req@ffff946f2f095f80 x1876351634965760/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.252544:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095f80 with x1876351634965760 ext(8192->12287) 00002000:00010000:3.0:1789429286.252549:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f095f80 00000100:00100000:3.0:1789429286.252577:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11438 00000100:00100000:3.0:1789429286.252586:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634965760:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429286.252802:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634965760:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 216us (403us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429286.252811:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11438 00002000:00100000:3.0:1789429286.252817:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2d:0x0] (8192->12287) req@ffff946f2f095f80 x1876351634965760/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/4536 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.252826:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095f80 with x1876351634965760 ext(8192->12287) 00002000:00010000:3.0:1789429286.252829:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f095f80 00000100:00100000:2.0:1789429286.255386:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429286.256790:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634966016 00000100:00100000:1.0:1789429286.256802:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634966016 00000100:00100000:1.0:1789429286.256866:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21075 00000100:00100000:1.0:1789429286.256875:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33941:x1876351634966016:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429286.256899:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429286.256920:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636069c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c21c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.256990:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263606a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257004:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263606a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257017:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263606a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257033:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263606aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257040:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263606aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257047:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263606aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257171:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263606b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257180:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263606b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257188:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263606b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429286.257242:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x6d:0x0]: returning size 409600 00010000:00010000:1.0:1789429286.257339:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263606a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257351:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263606a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257359:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263606a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257365:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429286.257370:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263606a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257377:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263606a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257389:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:1.0:1789429286.257392:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429286.257397:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263606a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257403:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263606a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257417:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263606aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257423:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263606aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257429:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263606aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257434:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429286.257438:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263606aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257444:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263606aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257452:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3edd8f70 (ffff946f2076ab00) 00010000:00010000:1.0:1789429286.257461:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429286.257465:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263606aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257471:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263606aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257511:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636069c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c21c expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257525:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263606b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c21c expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.257533:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff946f120fd100) 00010000:00010000:1.0:1789429286.257535:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429286.257538:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1800, rc 0) 00000100:00100000:1.0:1789429286.257602:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33941:x1876351634966016:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 727us (2224us total) trans 4294977080 rc 0/0 00000100:00100000:1.0:1789429286.257609:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21075 00000100:00100000:1.0:1789429286.259532:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.259625:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634966144 00000100:00100000:0.0:1789429286.259634:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634966144 00002000:00100000:0.0:1789429286.259678:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2d:0x0] (12288->69631) req@ffff946f2f096680 x1876351634966144/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.259689:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f096680 with x1876351634966144 ext(12288->69631) 00002000:00010000:0.0:1789429286.259695:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f096680 00000100:00100000:0.0:1789429286.259758:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11439 00000100:00100000:0.0:1789429286.259768:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634966144:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429286.263325:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429286.263830:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634966272 00000100:00100000:2.0:1789429286.263840:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634966272 00000100:00100000:2.0:1789429286.263915:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5732 00000100:00100000:2.0:1789429286.263925:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+34:2370:x1876351634966272:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429286.263941:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429286.263972:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263606bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c223 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429286.264030:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648338560:192.168.203.39@tcp:106: 00000100:00080000:1.0:1789429286.264162:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429286.264757:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f29ee4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429286.265302:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634966144:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5532us (5774us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1789429286.265315:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11439 00002000:00100000:1.0:1789429286.265326:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2d:0x0] (12288->69631) req@ffff946f2f096680 x1876351634966144/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/440 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429286.265337:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f096680 with x1876351634966144 ext(12288->69631) 00002000:00010000:1.0:1789429286.265342:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f096680 00002000:00010000:2.0:1789429286.266777:0:8085:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb atime: 0 -> 1789429286 00000100:00100000:2.0:1789429286.266801:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648338560:192.168.203.39@tcp:106: 00010000:00010000:2.0:1789429286.266834:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263606bf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c223 expref: 35 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.266921:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263606bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c223 expref: 35 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429286.266933:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547000, rc 0) 00000100:00100000:2.0:1789429286.266981:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+34:2370:x1876351634966272:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 3057us (3664us total) trans 0 rc 301/301 00000100:00100000:2.0:1789429286.266988:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5732 00000100:00100000:3.0:1789429286.269432:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429286.269495:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634966400 00000100:00100000:1.0:1789429286.269505:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634966400 00000100:00100000:1.0:1789429286.269562:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5733 00000100:00100000:1.0:1789429286.269572:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+34:33941:x1876351634966400:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429286.269589:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429286.269606:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c22a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.269637:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360664 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c207 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.269647:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429286.269651:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789429286.269657:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 35 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.269690:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360664 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c207 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.269704:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360664 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c207 expref: 7 pid: 13238 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429286.269718:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f095c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648338688:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429286.269796:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f113d60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429286.273675:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.273752:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634966528 00000100:00100000:0.0:1789429286.273761:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634966528 00010000:00010000:0.0:1789429286.273827:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360664 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c207 expref: 8 pid: 13238 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429286.273902:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6157 00000100:00100000:0.0:1789429286.273923:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351634966528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429286.273947:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429286.273982:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360664 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c207 expref: 8 pid: 13238 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.273996:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360664 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c207 expref: 8 pid: 13238 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.274056:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789429286.274079:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789429286.274088:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 35 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.274109:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 35 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429286.274183:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 35 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429286.274259:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648338816:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429286.274360:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c272480 going to sleep for 11 seconds 00010000:00010000:1.0:1789429286.279736:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a1dbc3/0xb4c3dad726360664 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c207 expref: 8 pid: 13238 timeout: 1084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429286.279763:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f095c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648338688:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429286.279798:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 35 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429286.279814:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:0.0:1789429286.280136:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:33941:x1876351634966400:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 10555us (10701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429286.280146:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5733 00000100:00100000:3.0:1789429286.280813:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.280874:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634966656 00000100:00100000:0.0:1789429286.280881:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634966656 00002000:00100000:0.0:1789429286.280922:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2d:0x0] (69632->106495) req@ffff946e0265e300 x1876351634966656/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.280933:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265e300 with x1876351634966656 ext(69632->106495) 00002000:00010000:0.0:1789429286.280938:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265e300 00000100:00100000:0.0:1789429286.280967:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11440 00000100:00100000:0.0:1789429286.280978:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634966656:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429286.285034:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634966656:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4047us (4213us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429286.285048:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11440 00002000:00100000:3.0:1789429286.285061:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2d:0x0] (69632->106495) req@ffff946e0265e300 x1876351634966656/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/440 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.285071:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265e300 with x1876351634966656 ext(69632->106495) 00002000:00010000:3.0:1789429286.285089:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265e300 00000100:00100000:0.0:1789429286.286052:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648338816:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429286.286280:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429286.286415:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351634966528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12501us (12748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429286.286426:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6157 00000100:00100000:2.0:1789429286.290895:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429286.290988:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429286.291591:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634966784 00000100:00100000:3.0:1789429286.291603:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634966784 00002000:00100000:3.0:1789429286.291653:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2c:0x0] (0->4095) req@ffff946f3f179880 x1876351634966784/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.291664:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179880 with x1876351634966784 ext(0->4095) 00002000:00010000:3.0:1789429286.291671:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f179880 00000100:00100000:3.0:1789429286.291703:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634966912 00000100:00100000:3.0:1789429286.291706:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634966912 00002000:00100000:3.0:1789429286.291724:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2d:0x0] (106496->143359) req@ffff946f3f179180 x1876351634966912/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.291732:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179180 with x1876351634966912 ext(106496->143359) 00002000:00010000:3.0:1789429286.291736:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f179180 00000100:00100000:3.0:1789429286.291799:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11441 00000100:00100000:3.0:1789429286.291809:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2371:x1876351634966784:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429286.292055:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2371:x1876351634966784:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 246us (1168us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429286.292063:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11441 00002000:00100000:3.0:1789429286.292070:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2c:0x0] (0->4095) req@ffff946f3f179880 x1876351634966784/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/4536 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:1.0:1789429286.292086:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11442 00002000:00100000:3.0:1789429286.292088:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179880 with x1876351634966784 ext(0->4095) 00002000:00010000:3.0:1789429286.292091:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f179880 00000100:00100000:1.0:1789429286.292096:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634966912:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429286.297875:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634966912:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5773us (6878us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429286.297887:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11442 00002000:00100000:3.0:1789429286.297898:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2d:0x0] (106496->143359) req@ffff946f3f179180 x1876351634966912/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/440 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.297909:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f179180 with x1876351634966912 ext(106496->143359) 00002000:00010000:3.0:1789429286.297915:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f179180 00000100:00100000:1.0:1789429286.305708:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429286.305762:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.305828:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634967040 00000100:00100000:0.0:1789429286.305839:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634967040 00000100:00100000:3.0:1789429286.305850:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634967168 00000100:00100000:3.0:1789429286.305854:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634967168 00002000:00100000:0.0:1789429286.305884:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2c:0x0] (4096->8191) req@ffff946f2f095c00 x1876351634967040/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.305884:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2d:0x0] (143360->180223) req@ffff946f05470000 x1876351634967168/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.305896:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095c00 with x1876351634967040 ext(4096->8191) 00002000:00100000:3.0:1789429286.305897:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05470000 with x1876351634967168 ext(143360->180223) 00002000:00010000:0.0:1789429286.305902:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f095c00 00002000:00010000:3.0:1789429286.305902:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f05470000 00000100:00100000:0.0:1789429286.305935:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11443 00000100:00100000:3.0:1789429286.305940:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11444 00000100:00100000:0.0:1789429286.305945:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2371:x1876351634967040:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429286.305946:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634967168:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429286.306154:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2371:x1876351634967040:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 209us (455us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429286.306162:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11443 00002000:00100000:0.0:1789429286.306168:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2c:0x0] (4096->8191) req@ffff946f2f095c00 x1876351634967040/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/4536 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.306177:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095c00 with x1876351634967040 ext(4096->8191) 00002000:00010000:0.0:1789429286.306181:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f095c00 00000100:00100000:3.0:1789429286.310420:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05470000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634967168:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4462us (4647us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429286.310435:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11444 00002000:00100000:3.0:1789429286.310447:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2d:0x0] (143360->180223) req@ffff946f05470000 x1876351634967168/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/440 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.310457:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05470000 with x1876351634967168 ext(143360->180223) 00002000:00010000:3.0:1789429286.310463:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f05470000 00000100:00100000:1.0:1789429286.311554:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.311588:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634967296 00000100:00100000:0.0:1789429286.311597:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634967296 00002000:00100000:0.0:1789429286.311647:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2c:0x0] (8192->12287) req@ffff946f05473100 x1876351634967296/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.311658:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05473100 with x1876351634967296 ext(8192->12287) 00002000:00010000:0.0:1789429286.311662:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f05473100 00000100:00100000:0.0:1789429286.311693:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11445 00000100:00100000:0.0:1789429286.311703:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2371:x1876351634967296:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429286.311962:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05473100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2371:x1876351634967296:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 260us (412us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429286.311969:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11445 00002000:00100000:0.0:1789429286.311976:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2c:0x0] (8192->12287) req@ffff946f05473100 x1876351634967296/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/4536 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.311984:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05473100 with x1876351634967296 ext(8192->12287) 00002000:00010000:0.0:1789429286.311987:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f05473100 00000100:00100000:1.0:1789429286.318877:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429286.319516:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634967424 00000100:00100000:3.0:1789429286.319528:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634967424 00002000:00100000:3.0:1789429286.319577:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2c:0x0] (12288->69631) req@ffff946f05471c00 x1876351634967424/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.319590:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05471c00 with x1876351634967424 ext(12288->69631) 00002000:00010000:3.0:1789429286.319595:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f05471c00 00000100:00100000:3.0:1789429286.319636:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11446 00000100:00100000:3.0:1789429286.319645:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2368:x1876351634967424:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429286.327026:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429286.327447:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05471c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2368:x1876351634967424:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 7800us (8579us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1789429286.327458:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11446 00002000:00100000:3.0:1789429286.327472:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2c:0x0] (12288->69631) req@ffff946f05471c00 x1876351634967424/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/440 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.327482:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05471c00 with x1876351634967424 ext(12288->69631) 00002000:00010000:3.0:1789429286.327488:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f05471c00 00000100:00100000:3.0:1789429286.327514:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634967552 00000100:00100000:3.0:1789429286.327522:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634967552 00002000:00100000:3.0:1789429286.327555:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2d:0x0] (180224->217087) req@ffff946f34499c00 x1876351634967552/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.327563:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499c00 with x1876351634967552 ext(180224->217087) 00002000:00010000:3.0:1789429286.327568:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34499c00 00000100:00100000:3.0:1789429286.328155:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11447 00000100:00100000:3.0:1789429286.328168:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634967552:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429286.333537:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634967552:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5361us (6507us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429286.333550:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11447 00002000:00100000:3.0:1789429286.333563:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2d:0x0] (180224->217087) req@ffff946f34499c00 x1876351634967552/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:22/0 lens 488/440 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.333574:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499c00 with x1876351634967552 ext(180224->217087) 00002000:00010000:3.0:1789429286.333580:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34499c00 00000100:00100000:2.0:1789429286.359584:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.359682:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634967680 00000100:00100000:0.0:1789429286.359697:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634967680 00002000:00100000:0.0:1789429286.359749:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2c:0x0] (69632->106495) req@ffff946f34073800 x1876351634967680/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.359773:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073800 with x1876351634967680 ext(69632->106495) 00002000:00010000:0.0:1789429286.359781:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34073800 00000100:00100000:0.0:1789429286.359813:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11448 00000100:00100000:0.0:1789429286.359824:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2370:x1876351634967680:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429286.366154:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2370:x1876351634967680:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 6322us (6569us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429286.366169:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11448 00002000:00100000:0.0:1789429286.366180:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2c:0x0] (69632->106495) req@ffff946f34073800 x1876351634967680/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/440 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.366191:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073800 with x1876351634967680 ext(69632->106495) 00002000:00010000:0.0:1789429286.366232:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34073800 00000100:00100000:1.0:1789429286.376927:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429286.377006:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634967808 00000100:00100000:3.0:1789429286.377015:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634967808 00002000:00100000:3.0:1789429286.377055:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2c:0x0] (106496->143359) req@ffff946f3b323100 x1876351634967808/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.377068:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b323100 with x1876351634967808 ext(106496->143359) 00002000:00010000:3.0:1789429286.377084:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b323100 00000100:00100000:3.0:1789429286.377111:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11449 00000100:00100000:3.0:1789429286.377120:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2369:x1876351634967808:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429286.385967:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2369:x1876351634967808:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 8836us (9037us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429286.385985:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11449 00002000:00100000:3.0:1789429286.385998:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2c:0x0] (106496->143359) req@ffff946f3b323100 x1876351634967808/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/440 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429286.386009:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b323100 with x1876351634967808 ext(106496->143359) 00002000:00010000:3.0:1789429286.386014:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3b323100 00000100:00100000:2.0:1789429286.410843:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.411019:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634967936 00000100:00100000:0.0:1789429286.411029:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634967936 00002000:00100000:0.0:1789429286.411089:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2c:0x0] (143360->180223) req@ffff946f02d67480 x1876351634967936/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.411101:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d67480 with x1876351634967936 ext(143360->180223) 00002000:00010000:0.0:1789429286.411108:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d67480 00000100:00100000:0.0:1789429286.411148:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11450 00000100:00100000:0.0:1789429286.411158:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2368:x1876351634967936:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429286.415043:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2368:x1876351634967936:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3876us (4199us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429286.415057:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11450 00002000:00100000:0.0:1789429286.415069:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2c:0x0] (143360->180223) req@ffff946f02d67480 x1876351634967936/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/440 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.415097:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d67480 with x1876351634967936 ext(143360->180223) 00002000:00010000:0.0:1789429286.415103:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d67480 00000100:00100000:2.0:1789429286.426342:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429286.426443:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634968064 00000100:00100000:0.0:1789429286.426453:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634968064 00002000:00100000:0.0:1789429286.426506:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2c:0x0] (180224->217087) req@ffff946f02d64700 x1876351634968064/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/0 e 0 to 0 dl 1789429297 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.426517:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d64700 with x1876351634968064 ext(180224->217087) 00002000:00010000:0.0:1789429286.426523:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d64700 00000100:00100000:0.0:1789429286.426559:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11451 00000100:00100000:0.0:1789429286.426569:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2371:x1876351634968064:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429286.430284:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2371:x1876351634968064:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3705us (3941us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429286.430297:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11451 00002000:00100000:0.0:1789429286.430310:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2c:0x0] (180224->217087) req@ffff946f02d64700 x1876351634968064/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:22/0 lens 488/440 e 0 to 0 dl 1789429297 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429286.430321:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d64700 with x1876351634968064 ext(180224->217087) 00002000:00010000:0.0:1789429286.430328:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f02d64700 00010000:00010000:0.0:1789429287.139439:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429288.163461:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429288.355944:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429288.361911:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634968192 00000100:00100000:3.0:1789429288.363391:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634968192 00002000:00100000:3.0:1789429288.363476:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2d:0x0] (217088->253951) req@ffff946f054d8700 x1876351634968192/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.363489:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d8700 with x1876351634968192 ext(217088->253951) 00002000:00010000:3.0:1789429288.363494:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d8700 00000100:00100000:3.0:1789429288.363534:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11452 00000100:00100000:3.0:1789429288.363554:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634968192:12345-192.168.203.39@tcp:3:kworker.0 00000100:00080000:1.0:1789429288.364122:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429288.374375:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634968192:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 10813us (18441us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429288.374389:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11452 00002000:00100000:3.0:1789429288.374402:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2d:0x0] (217088->253951) req@ffff946f054d8700 x1876351634968192/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.374413:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d8700 with x1876351634968192 ext(217088->253951) 00002000:00010000:3.0:1789429288.374420:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d8700 00000100:00100000:2.0:1789429288.391828:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429288.396644:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634968320 00000100:00100000:0.0:1789429288.396661:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634968320 00002000:00100000:0.0:1789429288.396721:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2d:0x0] (253952->290815) req@ffff946f054daa00 x1876351634968320/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429288.396733:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054daa00 with x1876351634968320 ext(253952->290815) 00002000:00010000:0.0:1789429288.396740:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054daa00 00000100:00100000:0.0:1789429288.396836:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11453 00000100:00100000:0.0:1789429288.396846:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634968320:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429288.405940:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634968320:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 9073us (14159us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429288.405954:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11453 00002000:00100000:0.0:1789429288.405969:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2d:0x0] (253952->290815) req@ffff946f054daa00 x1876351634968320/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429288.405979:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054daa00 with x1876351634968320 ext(253952->290815) 00002000:00010000:0.0:1789429288.405986:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054daa00 00000100:00100000:2.0:1789429288.416019:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429288.418454:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634968448 00000100:00100000:0.0:1789429288.418468:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634968448 00002000:00100000:1.0:1789429288.421662:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x2d:0x0] (290816->327679) req@ffff946f054d9500 x1876351634968448/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.421678:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d9500 with x1876351634968448 ext(290816->327679) 00002000:00010000:1.0:1789429288.421685:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d9500 00000100:00100000:1.0:1789429288.421775:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11454 00000100:00100000:1.0:1789429288.421785:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634968448:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429288.425916:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634968448:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4117us (9900us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429288.425941:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11454 00002000:00100000:1.0:1789429288.425954:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x2d:0x0] (290816->327679) req@ffff946f054d9500 x1876351634968448/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.425963:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d9500 with x1876351634968448 ext(290816->327679) 00002000:00010000:1.0:1789429288.425970:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d9500 00000100:00100000:0.0:1789429288.437391:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429288.437507:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634968576 00000100:00100000:1.0:1789429288.437519:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634968576 00002000:00100000:1.0:1789429288.437568:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2d:0x0] (327680->364543) req@ffff946f3449ad80 x1876351634968576/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.437580:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449ad80 with x1876351634968576 ext(327680->364543) 00002000:00010000:1.0:1789429288.437585:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3449ad80 00000100:00100000:1.0:1789429288.437677:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11455 00000100:00100000:1.0:1789429288.437688:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351634968576:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429288.440980:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429288.441629:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351634968576:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3939us (4244us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429288.441639:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11455 00002000:00100000:1.0:1789429288.441652:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x2d:0x0] (327680->364543) req@ffff946f3449ad80 x1876351634968576/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.441661:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449ad80 with x1876351634968576 ext(327680->364543) 00002000:00010000:1.0:1789429288.441668:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3449ad80 00000100:00100000:1.0:1789429288.441691:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634968704 00000100:00100000:1.0:1789429288.441697:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634968704 00002000:00100000:1.0:1789429288.441743:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2c:0x0] (217088->253951) req@ffff946f3449b800 x1876351634968704/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.441751:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449b800 with x1876351634968704 ext(217088->253951) 00002000:00010000:1.0:1789429288.441755:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3449b800 00000100:00100000:1.0:1789429288.441774:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11456 00000100:00100000:1.0:1789429288.441782:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2368:x1876351634968704:12345-192.168.203.39@tcp:3:kworker.0 00000100:00080000:2.0:1789429288.442946:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429288.452313:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2368:x1876351634968704:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 10521us (11331us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429288.452326:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11456 00002000:00100000:1.0:1789429288.452339:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2c:0x0] (217088->253951) req@ffff946f3449b800 x1876351634968704/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.452350:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449b800 with x1876351634968704 ext(217088->253951) 00002000:00010000:1.0:1789429288.452357:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3449b800 00000100:00100000:1.0:1789429288.457760:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429288.459413:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634968832 00000100:00100000:0.0:1789429288.459426:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634968832 00002000:00100000:0.0:1789429288.459480:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x2d:0x0] (364544->401407) req@ffff946f3b320a80 x1876351634968832/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429288.459491:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320a80 with x1876351634968832 ext(364544->401407) 00002000:00010000:0.0:1789429288.459496:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3b320a80 00000100:00100000:0.0:1789429288.459585:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11457 00000100:00100000:0.0:1789429288.459596:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634968832:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429288.461987:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429288.462072:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634968960 00000100:00100000:3.0:1789429288.462082:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634968960 00002000:00100000:3.0:1789429288.462134:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2c:0x0] (253952->290815) req@ffff946f34498e00 x1876351634968960/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.462146:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34498e00 with x1876351634968960 ext(253952->290815) 00002000:00010000:3.0:1789429288.462151:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34498e00 00000100:00100000:3.0:1789429288.462247:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11458 00000100:00100000:3.0:1789429288.462257:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2370:x1876351634968960:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429288.463494:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634968832:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3894us (5738us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429288.463504:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11457 00002000:00100000:1.0:1789429288.463514:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x2d:0x0] (364544->401407) req@ffff946f3b320a80 x1876351634968832/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.463524:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b320a80 with x1876351634968832 ext(364544->401407) 00002000:00010000:1.0:1789429288.463528:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3b320a80 00000100:00100000:3.0:1789429288.468240:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2370:x1876351634968960:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5936us (6213us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429288.468254:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11458 00002000:00100000:3.0:1789429288.468267:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x2c:0x0] (253952->290815) req@ffff946f34498e00 x1876351634968960/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.468278:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34498e00 with x1876351634968960 ext(253952->290815) 00002000:00010000:3.0:1789429288.468285:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34498e00 00000100:00100000:2.0:1789429288.474331:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429288.474420:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634969088 00000100:00100000:1.0:1789429288.474430:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634969088 00002000:00100000:1.0:1789429288.474473:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x2d:0x0] (401408->409599) req@ffff946f054d9f80 x1876351634969088/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.474484:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d9f80 with x1876351634969088 ext(401408->409599) 00002000:00010000:1.0:1789429288.474490:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d9f80 00000100:00100000:1.0:1789429288.474519:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11459 00000100:00100000:1.0:1789429288.474527:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634969088:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429288.474755:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634969088:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 228us (433us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1789429288.474763:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11459 00002000:00100000:1.0:1789429288.474769:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x2d:0x0] (401408->409599) req@ffff946f054d9f80 x1876351634969088/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/8632 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.474777:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d9f80 with x1876351634969088 ext(401408->409599) 00002000:00010000:1.0:1789429288.474780:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d9f80 00000100:00100000:2.0:1789429288.489293:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429288.489540:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634969216 00000100:00100000:1.0:1789429288.489550:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634969216 00000100:00100000:1.0:1789429288.489617:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5734 00000100:00100000:1.0:1789429288.489635:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:33927:x1876351634969216:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429288.489652:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429288.489671:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c231 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429288.489702:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 34 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429288.489716:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2c:0x0].0x0 since=2s v=(1 0) 00010000:00010000:1.0:1789429288.489720:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1789429288.489725:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429288.489756:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 34 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429288.489768:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 34 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429288.489781:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b322a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648338944:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429288.489903:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f341a2f00 going to sleep for 11 seconds 00000100:00080000:2.0:1789429288.490005:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429288.498494:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429288.498611:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b322a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648338944:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429288.498659:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429288.498681:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6a00, rc 0) 00000100:00100000:1.0:1789429288.498735:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+8:33927:x1876351634969216:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 9108us (9450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429288.498744:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5734 00000100:00100000:3.0:1789429288.499797:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634969344 00000100:00100000:3.0:1789429288.499806:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634969344 00002000:00100000:3.0:1789429288.499848:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2c:0x0] (0->278527) req@ffff946f054d8e00 x1876351634969344/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.499858:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d8e00 with x1876351634969344 ext(0->278527) 00010000:00010000:3.0:1789429288.499865:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 35 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429288.499880:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 35 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429288.499889:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d8e00 00000100:00100000:3.0:1789429288.499922:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1396 00000100:00100000:3.0:1789429288.499937:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2371:x1876351634969344:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1789429288.519926:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+37:2371:x1876351634969344:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 19986us (21432us total) trans 4294969575 rc 0/0 00000100:00100000:2.0:1789429288.519943:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1396 00002000:00100000:2.0:1789429288.519956:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2c:0x0] (0->278527) req@ffff946f054d8e00 x1876351634969344/t4294969575(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/448 e 0 to 0 dl 1789429299 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429288.519966:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d8e00 with x1876351634969344 ext(0->278527) 00010000:00010000:2.0:1789429288.519977:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 37 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429288.519997:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 37 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429288.520004:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054d8e00 00000100:00100000:2.0:1789429288.530354:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429288.530435:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634969472 00000100:00100000:3.0:1789429288.530445:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634969472 00002000:00100000:3.0:1789429288.530494:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2c:0x0] (278528->282623) req@ffff946f054da680 x1876351634969472/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 4584/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.530506:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054da680 with x1876351634969472 ext(278528->282623) 00010000:00010000:3.0:1789429288.530514:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 37 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429288.530530:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 37 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429288.530539:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054da680 00000100:00100000:3.0:1789429288.530616:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1397 00000100:00100000:3.0:1789429288.530637:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+37:2370:x1876351634969472:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1789429288.531616:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634969472:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 988us (1268us total) trans 4294969576 rc 0/0 00000100:00100000:3.0:1789429288.531634:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1397 00002000:00100000:3.0:1789429288.531643:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2c:0x0] (278528->282623) req@ffff946f054da680 x1876351634969472/t4294969576(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 4584/448 e 0 to 0 dl 1789429299 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.531653:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054da680 with x1876351634969472 ext(278528->282623) 00010000:00010000:3.0:1789429288.531659:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 39 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429288.531681:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 39 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429288.531688:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f054da680 00000100:00100000:1.0:1789429288.534348:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429288.535733:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634969600 00000100:00100000:0.0:1789429288.535747:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634969600 00000100:00100000:0.0:1789429288.535807:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5735 00000100:00100000:0.0:1789429288.535817:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:33941:x1876351634969600:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429288.535834:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429288.535851:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad7263606d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c238 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.535880:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2c:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789429288.535888:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.535896:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2c:0x0].0x0 since=0s v=(3 0) 00010000:00010000:0.0:1789429288.535902:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad7263606d4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c238 expref: 40 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.535951:0:13238:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.535966:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad7263606d4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [278528->282623] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c238 expref: 40 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.535978:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad200, rc 0) 00000100:00100000:0.0:1789429288.537038:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+40:33941:x1876351634969600:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 1216us (2692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429288.537050:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5735 00000100:00100000:2.0:1789429288.543262:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429288.543311:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634969728 00000100:00100000:0.0:1789429288.543321:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634969728 00010000:00010000:0.0:1789429288.543361:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 40 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429288.543408:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6158 00000100:00100000:0.0:1789429288.543418:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+40:2370:x1876351634969728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429288.543431:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789429288.543448:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb mtime from disk: 1789429286 -> 1789429288 00002000:00010000:0.0:1789429288.543451:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb ctime from disk: 1789429286 -> 1789429288 00010000:00010000:0.0:1789429288.543457:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 40 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.543470:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 40 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.543492:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad7263606c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c22a expref: 40 pid: 6682 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.543508:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(4 0) 00010000:00010000:0.0:1789429288.543512:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(4 0) 00010000:00010000:0.0:1789429288.543521:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.543530:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.543567:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.543580:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 7 pid: 6680 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429288.543593:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648339200:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429288.543691:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c272480 going to sleep for 11 seconds 00000100:00100000:0.0:1789429288.547942:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648339200:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429288.547968:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429288.548028:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634969728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4611us (4774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429288.548038:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6158 00000100:00100000:1.0:1789429288.555337:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429288.555543:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634969856 00000100:00100000:2.0:1789429288.555554:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634969856 00002000:00100000:2.0:1789429288.555601:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2c:0x0] (0->409599) req@ffff946f3b321180 x1876351634969856/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429288.555623:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b321180 with x1876351634969856 ext(0->409599) 00010000:00010000:2.0:1789429288.555634:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 8 pid: 6680 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429288.555652:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 8 pid: 6680 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429288.555659:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b321180 00000100:00100000:2.0:1789429288.555687:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1398 00000100:00100000:2.0:1789429288.555695:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351634969856:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:2.0:1789429288.569674:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+10:2370:x1876351634969856:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 13968us (14335us total) trans 4294969577 rc 0/0 00000100:00100000:2.0:1789429288.569689:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1398 00002000:00100000:2.0:1789429288.569711:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2c:0x0] (0->409599) req@ffff946f3b321180 x1876351634969856/t4294969577(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/448 e 0 to 0 dl 1789429299 ref 1 fl Complete:H/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429288.569722:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b321180 with x1876351634969856 ext(0->409599) 00010000:00010000:2.0:1789429288.569732:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 10 pid: 6680 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429288.569749:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 10 pid: 6680 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429288.569758:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f3b321180 00000100:00100000:2.0:1789429288.577659:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429288.577879:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634969984 00000100:00100000:3.0:1789429288.577890:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634969984 00010000:00010000:2.0:1789429288.578059:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 10 pid: 6680 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429288.578219:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6159 00000100:00100000:2.0:1789429288.578231:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+10:2369:x1876351634969984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429288.578247:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429288.578269:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 10 pid: 6680 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429288.578283:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 10 pid: 6680 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429288.578305:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad7263606cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c231 expref: 10 pid: 6680 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429288.578320:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789429288.578324:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1789429288.578333:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad7263606d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c238 expref: 38 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429288.578344:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad7263606d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c238 expref: 38 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429288.578392:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad7263606d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->282623) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c238 expref: 38 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429288.578411:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648339328:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429288.578495:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f29ee4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429288.584243:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648339328:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429288.584271:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429288.584393:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351634969984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6162us (6740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429288.584404:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6159 00000100:00100000:0.0:1789429288.595437:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429288.595561:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634970112 00000100:00100000:3.0:1789429288.595571:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634970112 00002000:00100000:3.0:1789429288.595619:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2c:0x0] (249856->315391) req@ffff946f34499500 x1876351634970112/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.595632:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499500 with x1876351634970112 ext(249856->315391) 00002000:00010000:3.0:1789429288.595638:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34499500 00000100:00100000:3.0:1789429288.595666:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11460 00000100:00100000:3.0:1789429288.595675:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634970112:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429288.609751:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634970112:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 14065us (14311us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1789429288.609766:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11460 00002000:00100000:3.0:1789429288.609779:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2c:0x0] (249856->315391) req@ffff946f34499500 x1876351634970112/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.609790:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499500 with x1876351634970112 ext(249856->315391) 00002000:00010000:3.0:1789429288.609805:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34499500 00000100:00100000:0.0:1789429288.618753:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429288.618848:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634970240 00000100:00100000:3.0:1789429288.618858:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634970240 00002000:00100000:3.0:1789429288.618910:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2c:0x0] (315392->352255) req@ffff946f34499880 x1876351634970240/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.618921:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499880 with x1876351634970240 ext(315392->352255) 00002000:00010000:3.0:1789429288.618927:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34499880 00000100:00100000:3.0:1789429288.618965:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11461 00000100:00100000:3.0:1789429288.618974:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2371:x1876351634970240:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429288.623715:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2371:x1876351634970240:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4729us (4959us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429288.623728:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11461 00002000:00100000:3.0:1789429288.623742:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x2c:0x0] (315392->352255) req@ffff946f34499880 x1876351634970240/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.623753:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499880 with x1876351634970240 ext(315392->352255) 00002000:00010000:3.0:1789429288.623759:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34499880 00000100:00100000:2.0:1789429288.632410:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429288.632524:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634970368 00000100:00100000:3.0:1789429288.632533:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634970368 00002000:00100000:3.0:1789429288.632578:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2c:0x0] (352256->389119) req@ffff946f3fbcad80 x1876351634970368/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.632589:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcad80 with x1876351634970368 ext(352256->389119) 00002000:00010000:3.0:1789429288.632594:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3fbcad80 00000100:00100000:3.0:1789429288.632624:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11462 00000100:00100000:3.0:1789429288.632633:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634970368:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429288.642391:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634970368:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 9747us (9979us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429288.642408:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11462 00002000:00100000:3.0:1789429288.642420:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2c:0x0] (352256->389119) req@ffff946f3fbcad80 x1876351634970368/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.642431:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcad80 with x1876351634970368 ext(352256->389119) 00002000:00010000:3.0:1789429288.642437:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3fbcad80 00000100:00100000:0.0:1789429288.652130:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429288.652264:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634970496 00000100:00100000:1.0:1789429288.652276:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634970496 00002000:00100000:1.0:1789429288.652322:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2c:0x0] (389120->409599) req@ffff946f3449b100 x1876351634970496/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.652333:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449b100 with x1876351634970496 ext(389120->409599) 00002000:00010000:1.0:1789429288.652339:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3449b100 00000100:00100000:1.0:1789429288.652378:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11463 00000100:00100000:1.0:1789429288.652387:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2369:x1876351634970496:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429288.657311:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2369:x1876351634970496:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4915us (5192us total) trans 0 rc 20480/20480 00000100:00100000:1.0:1789429288.657325:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11463 00002000:00100000:1.0:1789429288.657337:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2c:0x0] (389120->409599) req@ffff946f3449b100 x1876351634970496/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 20480/20480 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.657349:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449b100 with x1876351634970496 ext(389120->409599) 00002000:00010000:1.0:1789429288.657365:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3449b100 00000100:00100000:2.0:1789429288.665428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429288.665563:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634970624 00000100:00100000:0.0:1789429288.665574:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634970624 00000100:00100000:0.0:1789429288.665653:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5736 00000100:00100000:0.0:1789429288.665664:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:33941:x1876351634970624:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429288.665682:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429288.665711:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263606db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c23f expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.665745:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.665760:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789429288.665764:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789429288.665769:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263606db lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c23f expref: 8 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.665803:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.665815:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 8 pid: 6681 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429288.665829:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8085:1876351648339456:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429288.665916:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c272480 going to sleep for 11 seconds 00000100:00080000:2.0:1789429288.665972:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429288.675655:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429288.675775:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634970752 00000100:00100000:1.0:1789429288.675784:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634970752 00002000:00100000:1.0:1789429288.675830:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x2d:0x0] (0->409599) req@ffff946f3fbcaa00 x1876351634970752/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.675841:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcaa00 with x1876351634970752 ext(0->409599) 00010000:00010000:1.0:1789429288.675851:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 9 pid: 6681 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429288.675869:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 9 pid: 6681 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429288.675883:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f3fbcaa00 00000100:00100000:1.0:1789429288.675918:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1399 00000100:00100000:1.0:1789429288.675928:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351634970752:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1789429288.677310:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8085:1876351648339456:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429288.677341:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263606db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c23f expref: 8 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429288.677371:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429288.677411:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:33941:x1876351634970624:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 11749us (11992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429288.677420:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5736 00000100:00100000:1.0:1789429288.699713:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351634970752:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 23777us (24057us total) trans 4294969245 rc 0/0 00000100:00100000:1.0:1789429288.699729:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1399 00002000:00100000:1.0:1789429288.699741:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x2d:0x0] (0->409599) req@ffff946f3fbcaa00 x1876351634970752/t4294969245(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:24/0 lens 488/448 e 0 to 0 dl 1789429299 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.699751:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcaa00 with x1876351634970752 ext(0->409599) 00010000:00010000:1.0:1789429288.699762:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 11 pid: 6681 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429288.699782:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 11 pid: 6681 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429288.699790:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f3fbcaa00 00000100:00100000:0.0:1789429288.704899:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429288.705052:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634970880 00000100:00100000:3.0:1789429288.705062:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634970880 00010000:00010000:3.0:1789429288.705172:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 11 pid: 6681 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429288.705283:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6160 00000100:00100000:3.0:1789429288.705294:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351634970880:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429288.705317:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789429288.705336:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb mtime from disk: 1789429286 -> 1789429288 00002000:00010000:3.0:1789429288.705339:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb ctime from disk: 1789429286 -> 1789429288 00010000:00010000:3.0:1789429288.705346:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 11 pid: 6681 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429288.705368:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 11 pid: 6681 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429288.705390:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad72636061e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1eb expref: 11 pid: 6681 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429288.705413:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789429288.705417:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789429288.705425:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263606db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c23f expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429288.705436:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263606db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c23f expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429288.705486:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263606db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c23f expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429288.705500:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648339584:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429288.705572:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f2bdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429288.711516:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429288.711624:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648339584:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429288.711647:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429288.711698:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+10:2371:x1876351634970880:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6406us (6807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429288.711709:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6160 00000100:00100000:1.0:1789429288.712636:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634971008 00000100:00100000:1.0:1789429288.712646:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634971008 00002000:00100000:1.0:1789429288.712695:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2c:0x0] (0->65535) req@ffff946f3462f100 x1876351634971008/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.712706:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462f100 with x1876351634971008 ext(0->65535) 00002000:00010000:1.0:1789429288.712712:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462f100 00000100:00100000:1.0:1789429288.712740:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11464 00000100:00100000:1.0:1789429288.712750:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2371:x1876351634971008:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429288.724481:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2371:x1876351634971008:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 11721us (12964us total) trans 0 rc 65536/65536 00000100:00100000:1.0:1789429288.724496:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11464 00002000:00100000:1.0:1789429288.724510:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2c:0x0] (0->65535) req@ffff946f3462f100 x1876351634971008/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.724522:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462f100 with x1876351634971008 ext(0->65535) 00002000:00010000:1.0:1789429288.724528:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3462f100 00000100:00100000:0.0:1789429288.731281:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429288.731370:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634971136 00000100:00100000:2.0:1789429288.731380:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634971136 00002000:00100000:2.0:1789429288.731426:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2c:0x0] (65536->102399) req@ffff946f1c0a9f80 x1876351634971136/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429288.731437:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a9f80 with x1876351634971136 ext(65536->102399) 00002000:00010000:2.0:1789429288.731443:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c0a9f80 00000100:00100000:2.0:1789429288.731482:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11465 00000100:00100000:2.0:1789429288.731492:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634971136:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429288.734621:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634971136:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3121us (3339us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429288.734632:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11465 00002000:00100000:3.0:1789429288.734644:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x2c:0x0] (65536->102399) req@ffff946f1c0a9f80 x1876351634971136/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429288.734660:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a9f80 with x1876351634971136 ext(65536->102399) 00002000:00010000:3.0:1789429288.734666:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c0a9f80 00000100:00100000:2.0:1789429288.738791:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429288.738888:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634971264 00000100:00100000:1.0:1789429288.738900:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634971264 00002000:00100000:1.0:1789429288.738969:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2c:0x0] (102400->139263) req@ffff946f3fbcb800 x1876351634971264/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.738982:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcb800 with x1876351634971264 ext(102400->139263) 00002000:00010000:1.0:1789429288.738988:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3fbcb800 00000100:00100000:1.0:1789429288.739020:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11466 00000100:00100000:1.0:1789429288.739030:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2368:x1876351634971264:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429288.744597:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2368:x1876351634971264:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 5558us (5806us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429288.744611:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11466 00002000:00100000:1.0:1789429288.744623:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2c:0x0] (102400->139263) req@ffff946f3fbcb800 x1876351634971264/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.744634:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcb800 with x1876351634971264 ext(102400->139263) 00002000:00010000:1.0:1789429288.744641:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3fbcb800 00000100:00100000:0.0:1789429288.749328:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429288.749485:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634971392 00000100:00100000:1.0:1789429288.749496:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634971392 00002000:00100000:1.0:1789429288.749544:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2c:0x0] (139264->176127) req@ffff946f1c0a8000 x1876351634971392/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.749557:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a8000 with x1876351634971392 ext(139264->176127) 00002000:00010000:1.0:1789429288.749563:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c0a8000 00000100:00100000:1.0:1789429288.749595:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11467 00000100:00100000:1.0:1789429288.749605:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2371:x1876351634971392:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429288.754343:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2371:x1876351634971392:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4730us (5015us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429288.754356:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11467 00002000:00100000:1.0:1789429288.754370:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2c:0x0] (139264->176127) req@ffff946f1c0a8000 x1876351634971392/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.754381:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a8000 with x1876351634971392 ext(139264->176127) 00002000:00010000:1.0:1789429288.754387:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c0a8000 00000100:00100000:2.0:1789429288.758330:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429288.758418:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634971520 00000100:00100000:1.0:1789429288.758428:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634971520 00002000:00100000:1.0:1789429288.758475:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2c:0x0] (176128->212991) req@ffff946f3fbcb100 x1876351634971520/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.758488:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcb100 with x1876351634971520 ext(176128->212991) 00002000:00010000:1.0:1789429288.758494:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3fbcb100 00000100:00100000:1.0:1789429288.758528:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11468 00000100:00100000:1.0:1789429288.758538:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2369:x1876351634971520:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429288.762411:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2369:x1876351634971520:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3861us (4079us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1789429288.762424:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11468 00002000:00100000:1.0:1789429288.762438:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2c:0x0] (176128->212991) req@ffff946f3fbcb100 x1876351634971520/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429288.762449:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcb100 with x1876351634971520 ext(176128->212991) 00002000:00010000:1.0:1789429288.762455:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3fbcb100 00000100:00100000:0.0:1789429288.766426:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429288.766518:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634971648 00000100:00100000:2.0:1789429288.766528:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634971648 00002000:00100000:2.0:1789429288.766573:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2c:0x0] (212992->249855) req@ffff946f1c0ab800 x1876351634971648/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/0 e 0 to 0 dl 1789429299 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429288.766585:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0ab800 with x1876351634971648 ext(212992->249855) 00002000:00010000:2.0:1789429288.766590:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c0ab800 00000100:00100000:2.0:1789429288.766619:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11469 00000100:00100000:2.0:1789429288.766629:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634971648:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429288.769245:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634971648:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 2606us (2816us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1789429288.769259:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11469 00002000:00100000:2.0:1789429288.769270:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2c:0x0] (212992->249855) req@ffff946f1c0ab800 x1876351634971648/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:24/0 lens 488/440 e 0 to 0 dl 1789429299 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429288.769280:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0ab800 with x1876351634971648 ext(212992->249855) 00002000:00010000:2.0:1789429288.769285:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c0ab800 00000100:00100000:3.0:1789429288.775680:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429288.775769:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634971904 00000100:00100000:0.0:1789429288.775780:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634971904 00000100:00100000:0.0:1789429288.775851:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 234 00000100:00100000:0.0:1789429288.775862:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05b63050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33941:x1876351634971904:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1789429288.776195:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05b63050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33941:x1876351634971904:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 334us (524us total) trans 4294977081 rc 0/0 00000100:00100000:0.0:1789429288.776226:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 234 00000100:00080000:2.0:1789429288.776368:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429288.785618:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429288.785698:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634972160 00000100:00100000:3.0:1789429288.785708:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634972160 00000100:00100000:3.0:1789429288.785761:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 235 00000100:00100000:3.0:1789429288.785770:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:33941:x1876351634972160:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1789429288.786114:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33941:x1876351634972160:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 337us (497us total) trans 4294977082 rc 0/0 00000100:00100000:3.0:1789429288.786122:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 235 00010000:00010000:0.0:1789429289.192747:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429289.750005:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429289.750065:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429289.750120:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429289.750150:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429289.750176:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634972544 00000100:00100000:1.0:1789429289.750184:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634972544 00000100:00100000:1.0:1789429289.750260:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634973056 00000100:00100000:1.0:1789429289.750263:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634973056 00000100:00100000:1.0:1789429289.750288:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 744 00000100:00100000:1.0:1789429289.750298:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+10:2368:x1876351634972544:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429289.750363:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+10:2368:x1876351634972544:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 66us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429289.750370:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 744 00000100:00100000:1.0:1789429289.750386:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 745 00000100:00100000:1.0:1789429289.750392:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2368:x1876351634973056:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429289.750415:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2368:x1876351634973056:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429289.750421:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 745 00000100:00100000:1.0:1789429289.750457:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429289.750499:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429289.750513:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634972672 00000100:00100000:1.0:1789429289.750517:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634972672 00000100:00100000:1.0:1789429289.750539:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 746 00000100:00100000:1.0:1789429289.750543:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634972672:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429289.750563:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351634972672:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 20us (64us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429289.750569:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 746 00000100:00100000:3.0:1789429289.750801:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634972800 00000100:00100000:3.0:1789429289.750806:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634972800 00000100:00100000:3.0:1789429289.750831:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634972416 00000100:00100000:3.0:1789429289.750833:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634972416 00000100:00100000:3.0:1789429289.750856:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 692 00000100:00100000:3.0:1789429289.750862:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2368:x1876351634972800:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429289.750893:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2368:x1876351634972800:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429289.750899:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 692 00000100:00100000:3.0:1789429289.750910:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 693 00000100:00100000:3.0:1789429289.750915:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+49:2368:x1876351634972416:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429289.750947:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+49:2368:x1876351634972416:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429289.750953:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 693 00000100:00080000:2.0:1789429289.751078:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429289.751093:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634972288 00000100:00100000:0.0:1789429289.751107:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634972288 00000100:00100000:0.0:1789429289.751140:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 523 00000100:00100000:0.0:1789429289.751148:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351634972288:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429289.751176:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351634972288:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429289.751185:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429289.751189:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 523 00000100:00100000:2.0:1789429289.751243:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634972928 00000100:00100000:2.0:1789429289.751248:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634972928 00000100:00100000:1.0:1789429289.758594:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 747 00000100:00100000:1.0:1789429289.758621:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351634972928:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429289.758793:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351634972928:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 185us (7611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429289.758801:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 747 00000100:00100000:0.0:1789429290.148054:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648339712:0@lo:400:kworker.0 00000100:00100000:0.0:1789429290.148140:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429290.148239:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648339712 00000100:00100000:3.0:1789429290.148248:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648339712 00000100:00100000:3.0:1789429290.148296:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1789429290.148305:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648339712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429290.148364:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648339840:0@lo:400:kworker.0 00000100:00100000:1.0:1789429290.148398:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429290.148432:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648339840 00000100:00100000:1.0:1789429290.148436:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648339840 00000100:00100000:1.0:1789429290.148465:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1789429290.148471:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648339840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429290.148509:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648339840:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429290.148515:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1789429290.148556:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648339840:0@lo:400:kworker.0 00000100:00100000:1.0:1789429290.159955:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648339968:0@lo:400:kworker.0 00000100:00100000:1.0:1789429290.160033:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429290.160080:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789429290.160087:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648340096:0@lo:400:kworker.0 00000100:00100000:1.0:1789429290.160125:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429290.160163:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648340096 00000100:00100000:1.0:1789429290.160171:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648340096 00000100:00100000:1.0:1789429290.160255:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1789429290.160264:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648340096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429290.160275:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648339712:12345-0@lo:400:kworker.0 Request processed in 11970us (12134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429290.160285:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:1.0:1789429290.160311:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648340096:12345-0@lo:400:kworker.0 Request processed in 48us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429290.160322:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648339968 00000100:00100000:3.0:1789429290.160325:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648339968 00000100:00100000:3.0:1789429290.160352:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1789429290.160358:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648339968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429290.160389:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648339968:12345-0@lo:400:kworker.0 Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429290.160395:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00080000:3.0:1789429290.160424:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429290.160428:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429290.160538:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1789429290.160577:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648340096:0@lo:400:kworker.0 00000100:00100000:1.0:1789429290.160586:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648339968:0@lo:400:kworker.0 00000100:00100000:0.0:1789429290.166632:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648339712:0@lo:400:kworker.0 00000100:00100000:0.0:1789429290.166672:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648340224:0@lo:400:kworker.0 00000100:00100000:0.0:1789429290.166735:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429290.166840:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429290.166848:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648340352:0@lo:400:kworker.0 00000100:00100000:0.0:1789429290.166874:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429290.166973:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648340352 00000100:00100000:3.0:1789429290.166980:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648340352 00000100:00100000:3.0:1789429290.167062:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1789429290.167071:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648340352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429290.167402:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648340352:12345-0@lo:400:kworker.0 Request processed in 330us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429290.167409:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:1.0:1789429290.167423:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648340352:0@lo:400:kworker.0 00000100:00080000:0.0:1789429290.167469:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429290.167518:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648340224 00000100:00100000:2.0:1789429290.167523:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648340224 00000100:00100000:2.0:1789429290.167608:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1789429290.167616:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648340224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429290.167666:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648340224:12345-0@lo:400:kworker.0 Request processed in 51us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429290.167672:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00080000:0.0:1789429290.167745:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429290.167817:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648340224:0@lo:400:kworker.0 00010000:00010000:2.0:1789429290.211655:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429290.555878:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429290.556143:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634973312 00000100:00100000:1.0:1789429290.556154:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634973312 00000100:00100000:1.0:1789429290.556243:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 236 00000100:00100000:1.0:1789429290.556254:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+49:33927:x1876351634973312:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789429290.556503:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+50:33927:x1876351634973312:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 250us (635us total) trans 4294977083 rc 0/0 00000100:00100000:1.0:1789429290.556510:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 236 00000100:00100000:3.0:1789429290.567331:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429290.567508:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634973568 00000100:00100000:0.0:1789429290.567518:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634973568 00000100:00100000:0.0:1789429290.567580:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 237 00000100:00100000:0.0:1789429290.567681:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+50:33927:x1876351634973568:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1789429290.567930:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+51:33927:x1876351634973568:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 250us (607us total) trans 4294977084 rc 0/0 00000100:00100000:0.0:1789429290.567937:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 237 00000100:00100000:0.0:1789429290.579981:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429290.580174:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634973696 00000100:00100000:1.0:1789429290.580184:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634973696 00000100:00100000:1.0:1789429290.580266:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21076 00000100:00100000:1.0:1789429290.580277:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+51:33927:x1876351634973696:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429290.580302:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429290.580323:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263606e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c246 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.580392:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad7263606e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.580404:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad7263606e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.580416:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad7263606e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429290.580451:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429290.580455:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429290.580473:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad7263606e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.580496:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263606e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c246 expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.580513:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad7263606e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c246 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.580521:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:1.0:1789429290.580524:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429290.580527:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7400, rc 0) 00000100:00100000:1.0:1789429290.580590:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634973696:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 313us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429290.580597:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21076 00000100:00100000:2.0:1789429290.591750:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429290.591829:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634973824 00000100:00100000:3.0:1789429290.591839:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634973824 00000100:00100000:3.0:1789429290.591932:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21077 00000100:00100000:3.0:1789429290.591943:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634973824:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429290.591963:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429290.591982:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263606f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c24d expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592040:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263606f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592053:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263606f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592064:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263606f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592075:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263606fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592102:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263606fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592109:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263606fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592222:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360705 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592231:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592239:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429290.592270:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x6e:0x0]: returning size 409600 00000004:00200000:3.0:1789429290.592275:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429290.592291:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592302:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592310:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263606f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592317:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263606f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592324:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263606f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592330:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c4000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429290.592334:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263606f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592341:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263606f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592361:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:3.0:1789429290.592365:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429290.592369:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263606f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592376:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad7263606f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592388:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263606fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592399:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263606fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592405:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263606fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592410:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429290.592413:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263606fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592418:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263606fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592425:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x397ecf4c (ffff946f04fb8300) 00010000:00010000:3.0:1789429290.592427:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429290.592429:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263606fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592435:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad7263606fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592460:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad7263606f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c24d expref: 54 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592472:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c24d expref: 53 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.592480:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:3.0:1789429290.592482:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429290.592485:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc 0) 00000100:00100000:3.0:1789429290.592546:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+53:33927:x1876351634973824:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 604us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429290.592554:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21077 00000100:00100000:3.0:1789429290.612672:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.612961:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634974080 00000100:00100000:2.0:1789429290.612970:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634974080 00000100:00100000:2.0:1789429290.613033:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21078 00000100:00100000:2.0:1789429290.613043:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+53:33927:x1876351634974080:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789429290.613115:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789429290.613143:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360705 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c24d expref: 53 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.613169:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636065d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c200 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.613180:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:2.0:1789429290.613191:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad7263606e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c246 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.613296:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:2.0:1789429290.613301:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429290.613323:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.613336:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c20e expref: 20 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.613343:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.613395:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c20e expref: 20 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.613407:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c20e expref: 20 pid: 15700 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429290.613421:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1876351648340480:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429290.613516:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f29ee4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789429290.616443:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.616717:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1876351648340480:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429290.616749:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429290.616995:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634974208 00000100:00100000:3.0:1789429290.617003:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634974208 00010000:00010000:3.0:1789429290.617113:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c20e expref: 21 pid: 15700 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429290.617283:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6161 00000100:00100000:3.0:1789429290.617294:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351634974208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429290.617309:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429290.617318:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c20e expref: 21 pid: 15700 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.617330:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c20e expref: 21 pid: 15700 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.617349:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360672 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c20e expref: 21 pid: 15700 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.617377:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:3.0:1789429290.617382:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.617392:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.617404:0:11354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.617429:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429290.617482:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351634974208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 190us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429290.617489:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6161 00010000:00010000:1.0:1789429290.617624:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.617633:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.617656:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360713 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.617665:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360713 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.617672:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360713 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.617772:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.617783:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636068e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c215 expref: 19 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.617791:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.617817:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636068e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c215 expref: 19 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.617831:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636068e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c215 expref: 19 pid: 15669 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429290.617844:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1876351648340608:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429290.617891:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f341a2cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1789429290.620653:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429290.624772:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1876351648340608:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429290.624811:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429290.630403:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429290.630823:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634974336 00000100:00100000:0.0:1789429290.630835:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634974336 00010000:00010000:0.0:1789429290.630876:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636068e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c215 expref: 20 pid: 15669 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429290.630930:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6162 00000100:00100000:0.0:1789429290.630940:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351634974336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429290.630954:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429290.630962:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636068e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c215 expref: 20 pid: 15669 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.630975:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636068e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c215 expref: 20 pid: 15669 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.631001:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636068e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c215 expref: 20 pid: 15669 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.631017:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:0.0:1789429290.631023:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.631032:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.631039:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.631074:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429290.631140:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634974336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 202us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429290.631148:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6162 00010000:00010000:1.0:1789429290.631269:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.631278:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789429290.634045:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].24, 64 off9728 00000004:00080000:1.0:1789429290.634059:0:6704:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 988613857674ns, next at 989613854444ns, rc = 0 00010000:00010000:1.0:1789429290.634157:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360721 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634175:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360721 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634186:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360721 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634194:0:6704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360721 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634220:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360721 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634227:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360721 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634248:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789429290.634268:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634275:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634282:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634288:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429290.634292:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634299:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634310:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:1.0:1789429290.634313:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789429290.634318:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634324:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636071a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634342:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634347:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634353:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634357:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429290.634360:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634367:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634373:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:1.0:1789429290.634376:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429290.634379:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.634385:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad72636070c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429290.634400:0:6704:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a28b76b1 reply state 00000000520bc454 transno 4294977085 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360713 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429290.634410:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789429290.634755:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789429290.634763:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360721 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.634769:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7000 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429290.634772:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360721 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.634778:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360721 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.634786:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:2.0:1789429290.634788:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789429290.634791:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360721 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.634799:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360721 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.634812:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429290.634813:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429290.634815:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429290.634969:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634974080:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 21923us (22301us total) trans 4294977085 rc 0/0 00000100:00100000:1.0:1789429290.634979:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21078 00010000:00010000:2.0:1789429290.641787:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360713 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.641805:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360713 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.641813:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360713 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.641819:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429290.641825:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360713 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.641832:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360713 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.641851:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x397ecf4c (ffff946f2076ab00) 00010000:00010000:2.0:1789429290.641854:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429290.641859:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360713 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.641866:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360713 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429290.655864:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.656195:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634974464 00000100:00100000:2.0:1789429290.656240:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634974464 00000100:00100000:2.0:1789429290.656302:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21079 00000100:00100000:2.0:1789429290.656314:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+51:33927:x1876351634974464:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429290.656341:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429290.656364:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360728 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c254 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.656429:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad72636072f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.656442:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad72636072f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.656454:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad72636072f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429290.656502:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429290.656506:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429290.656526:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad72636072f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.656550:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360728 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c254 expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.656570:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad72636072f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c254 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.656578:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef800) 00010000:00010000:2.0:1789429290.656581:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429290.656585:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547600, rc 0) 00000100:00100000:2.0:1789429290.656643:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634974464:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 330us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429290.656651:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21079 00000100:00100000:0.0:1789429290.660330:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.661167:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429290.661187:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648340736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429290.661263:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429290.661311:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648340736 00000100:00100000:2.0:1789429290.661318:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648340736 00000100:00100000:2.0:1789429290.661358:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789429290.661365:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648340736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429290.661397:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 51118080 granted 832503808 pending 5111808 free 3827302400 avail 3825205248 00000100:00100000:2.0:1789429290.661440:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648340736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429290.661446:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789429290.661632:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648340736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429290.662442:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634974592 00000100:00100000:3.0:1789429290.662449:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634974592 00000100:00100000:3.0:1789429290.662500:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21080 00000100:00100000:3.0:1789429290.662509:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634974592:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429290.662523:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429290.662544:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad726360736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c25b expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662604:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72636073d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662618:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72636073d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662630:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72636073d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662644:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360744 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662651:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662663:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662747:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636074b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662756:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636074b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662763:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636074b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429290.662794:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x6d:0x0]: returning size 409600 00000004:00200000:3.0:1789429290.662799:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429290.662817:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636074b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662829:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636074b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662836:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72636073d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662843:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72636073d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662848:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72636073d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662854:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429290.662858:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72636073d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662866:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72636073d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662877:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef800) 00010000:00010000:3.0:1789429290.662880:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429290.662885:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72636073d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662892:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5000/0xb4c3dad72636073d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662904:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662910:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360744 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662926:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662933:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c4000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429290.662936:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662942:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360744 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662949:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3edd8f70 (ffff946f04fb8300) 00010000:00010000:3.0:1789429290.662951:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429290.662954:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360744 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662963:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad726360744 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.662994:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4e00/0xb4c3dad726360736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c25b expref: 54 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.663007:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636074b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c25b expref: 53 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.663014:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff946f120fd100) 00010000:00010000:3.0:1789429290.663017:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429290.663019:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5c00, rc 0) 00000100:00100000:3.0:1789429290.663071:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+53:33927:x1876351634974592:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 563us (2750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429290.664739:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21080 00000100:00100000:0.0:1789429290.665654:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789429290.665673:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648340864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429290.665728:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429290.670309:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648340864 00000100:00100000:3.0:1789429290.670324:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648340864 00000100:00100000:3.0:1789429290.670400:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789429290.670410:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648340864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429290.670446:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 332070912 pending 1703936 free 3856662528 avail 3854565376 00000100:00100000:3.0:1789429290.670522:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648340864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (4793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429290.670528:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789429290.670578:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648340864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429290.676502:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429290.676538:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634974848 00000100:00100000:3.0:1789429290.676548:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634974848 00000100:00100000:3.0:1789429290.676597:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21081 00000100:00100000:3.0:1789429290.676606:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+53:33927:x1876351634974848:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1789429290.676668:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789429290.676693:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5c00/0xb4c3dad72636074b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c25b expref: 53 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.676713:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360617 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1e4 expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.676723:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff946f120fd100) 00010000:00010000:3.0:1789429290.676731:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad72636072f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c254 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.676738:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef800) 00010000:00010000:3.0:1789429290.676747:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429290.676770:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360752 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.676783:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360752 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.676793:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360752 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.676804:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad726360759 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.676811:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad726360759 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.676818:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad726360759 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.676908:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.677021:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263606b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c21c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.677029:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.677061:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263606b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c21c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.677075:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263606b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c21c expref: 18 pid: 5840 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429290.677109:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648340992:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429290.679013:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f2bd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429290.683289:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648340992:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429290.683320:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429290.686636:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429290.686666:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634974976 00000100:00100000:0.0:1789429290.686674:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634974976 00010000:00010000:0.0:1789429290.686706:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263606b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c21c expref: 19 pid: 5840 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429290.686740:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6163 00000100:00100000:0.0:1789429290.686749:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351634974976:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429290.686764:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429290.686770:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263606b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c21c expref: 19 pid: 5840 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.686782:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263606b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c21c expref: 19 pid: 5840 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.686803:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263606b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c21c expref: 19 pid: 5840 timeout: 1088 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.686818:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff946f120fd100) 00010000:00010000:0.0:1789429290.687105:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.687116:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.687124:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.687151:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429290.687197:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351634974976:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 448us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429290.687221:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6163 00010000:00010000:3.0:1789429290.687821:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.687842:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789429290.689871:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 64 off9472 00000004:00080000:3.0:1789429290.689883:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 988669681572ns, next at 989669679150ns, rc = 0 00010000:00010000:3.0:1789429290.690038:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360767 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690054:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690064:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690073:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360767 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690087:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360767 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690103:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360767 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690118:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789429290.690136:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690142:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690149:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690154:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429290.690159:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690166:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690178:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff946f120fd100) 00010000:00010000:3.0:1789429290.690180:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789429290.690184:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690190:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360760 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690223:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360752 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690230:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360752 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690236:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360752 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690240:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c4c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429290.690243:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360752 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690248:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360752 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690255:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:3.0:1789429290.690257:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429290.690260:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360752 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.690266:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726360752 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429290.690279:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008345d501 reply state 000000007811ae95 transno 4294977086 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad726360759 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429290.690286:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789429290.690356:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634974848:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 13748us (13861us total) trans 4294977086 rc 0/0 00000100:00100000:3.0:1789429290.690365:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21081 00010000:00010000:1.0:1789429290.692883:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789429290.692895:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360767 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.692911:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:1.0:1789429290.692922:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360767 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.692931:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360767 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.692947:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d:0x0].0x0 (ffff946f120fd100) 00010000:00010000:1.0:1789429290.692950:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789429290.692954:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360767 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.692960:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360767 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.692979:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429290.692981:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429290.692983:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429290.696462:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad726360759 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.696480:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad726360759 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.696488:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad726360759 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.696494:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429290.696498:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad726360759 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.696505:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad726360759 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.696519:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3edd8f70 (ffff946f04fb8d00) 00010000:00010000:0.0:1789429290.696522:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429290.696527:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad726360759 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.696532:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad726360759 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429290.709016:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429290.709286:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634975104 00000100:00100000:3.0:1789429290.709297:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634975104 00000100:00100000:3.0:1789429290.709368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21082 00000100:00100000:3.0:1789429290.709378:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+51:33927:x1876351634975104:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429290.709404:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429290.709425:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636076e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c262 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.709489:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360775 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.709502:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.709513:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429290.709546:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429290.709549:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429290.709568:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.709590:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636076e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c262 expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.709610:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360775 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c262 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.709618:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8300) 00010000:00010000:3.0:1789429290.709620:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429290.709624:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:3.0:1789429290.709676:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634975104:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 299us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429290.709683:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21082 00000001:00080000:3.0:1789429290.714621:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969577 is committed 00000001:00080000:3.0:1789429290.714641:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969576 is committed 00000100:00100000:1.0:1789429290.720041:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429290.720227:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634975232 00000100:00100000:0.0:1789429290.720238:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634975232 00000100:00100000:0.0:1789429290.720304:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21083 00000100:00100000:0.0:1789429290.720313:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634975232:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429290.720332:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429290.720350:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636077c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c269 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720409:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360783 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720424:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360783 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720434:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360783 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720496:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636078a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720504:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636078a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720511:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636078a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720563:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360783 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720571:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360783 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720578:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360783 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720584:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429290.720588:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360783 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720595:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360783 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720607:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8300) 00010000:00010000:0.0:1789429290.720611:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429290.720616:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360783 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720622:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360783 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720634:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636078a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720640:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636078a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720645:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636078a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720649:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2aca00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429290.720652:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636078a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720658:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636078a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720665:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc442db46 (ffff946f120fdb00) 00010000:00010000:0.0:1789429290.720667:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429290.720670:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636078a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720675:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636078a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720717:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636077c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c269 expref: 53 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720726:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8300) 00010000:00010000:0.0:1789429290.720728:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429290.720732:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636077c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c269 expref: 53 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.720740:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429290.720793:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634975232:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 481us (762us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429290.720801:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21083 00000100:00100000:3.0:1789429290.724067:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429290.724152:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634975488 00000100:00100000:1.0:1789429290.724163:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634975488 00000100:00100000:1.0:1789429290.724268:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21084 00000100:00100000:1.0:1789429290.724280:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634975488:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429290.724301:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429290.724305:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789429290.724338:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360775 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c262 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.724357:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8300) 00010000:00010000:1.0:1789429290.724368:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429290.724383:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360791 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c270 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.724495:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360798 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.724509:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360798 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.724520:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360798 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.724533:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636079f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.724539:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636079f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.724545:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636079f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429290.725010:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e:0x0], index 0: 0 00010000:00010000:1.0:1789429290.725181:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263607a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.725191:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263607a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.725225:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263607a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.725260:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360798 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.725266:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360798 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.725272:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360798 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.725278:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429290.725281:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360798 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.725293:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360798 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.725301:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a100) 00010000:00010000:1.0:1789429290.725304:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429290.725307:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360798 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.725312:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360798 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429290.725322:0:6704:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e6097b0a reply state 0000000005e634b8 transno 4294977087 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636079f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429290.725330:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429290.725356:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360791 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c270 expref: 54 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.725372:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263607a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c270 expref: 53 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.725383:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f:0x0].0x0 (ffff946f2076ab00) 00010000:00010000:1.0:1789429290.725385:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429290.725387:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6000, rc 0) 00000100:00100000:1.0:1789429290.725776:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+54:33927:x1876351634975488:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 1497us (1717us total) trans 4294977087 rc 0/0 00000100:00100000:1.0:1789429290.725785:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21084 00010000:00010000:3.0:1789429290.730177:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636079f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.730196:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636079f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.730232:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636079f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.730239:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429290.730244:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636079f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.730254:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636079f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.730273:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc442db46 (ffff946f2076af00) 00010000:00010000:3.0:1789429290.730277:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429290.730283:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636079f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.730290:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636079f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429290.731166:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.731470:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634975744 00000100:00100000:2.0:1789429290.731482:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634975744 00000100:00100000:2.0:1789429290.731539:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21085 00000100:00100000:2.0:1789429290.731549:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+53:33927:x1876351634975744:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1789429290.731608:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429290.731630:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263607a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c270 expref: 53 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.731645:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f:0x0].0x0 (ffff946f2076ab00) 00010000:00010000:2.0:1789429290.731655:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429290.732589:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263607b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.732606:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263607b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.732614:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263607b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789429290.732677:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977088 00000004:00010000:2.0:1789429290.732709:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070635cae reply state 0000000031ea9acb transno 4294977089 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263607b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429290.732717:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789429290.732816:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+55:33927:x1876351634975744:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 1267us (1655us total) trans 4294977089 rc 0/0 00000100:00100000:2.0:1789429290.732824:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21085 00000020:00080000:2.0:1789429290.732830:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789429290.736669:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263607b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.736687:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263607b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.736695:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263607b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.736701:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429290.736706:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263607b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.736713:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263607b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.736737:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f:0x0].0x0 (ffff946f051ef700) 00010000:00010000:0.0:1789429290.736740:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429290.736745:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263607b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.736759:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad7263607b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429290.741335:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429290.741459:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634975872 00000100:00100000:0.0:1789429290.741469:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634975872 00000100:00100000:0.0:1789429290.741533:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21086 00000100:00100000:0.0:1789429290.741543:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+54:33927:x1876351634975872:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429290.741566:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429290.741589:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263607bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c277 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.741650:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263607bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c277 expref: 55 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.741665:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263607bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c277 expref: 55 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.741682:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:0.0:1789429290.741684:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789429290.741688:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429290.741765:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+55:33927:x1876351634975872:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 223us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429290.741772:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21086 00000100:00100000:1.0:1789429290.743804:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.743878:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634976000 00000100:00100000:2.0:1789429290.743887:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634976000 00000100:00100000:2.0:1789429290.743959:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5737 00000100:00100000:2.0:1789429290.743968:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+10:33927:x1876351634976000:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429290.743982:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429290.744001:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078d7dcfc/0xb4c3dad7263607c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c27e expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789429290.744011:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789429290.744027:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789429290.744046:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=988s v=(0 0) 00010000:00010000:2.0:1789429290.744051:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429290.744059:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078d7dcfc/0xb4c3dad7263607c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c27e expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.744080:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078d7dcfc/0xb4c3dad7263607c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c27e expref: 11 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.744101:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547e00, rc 0) 00000100:00100000:2.0:1789429290.744227:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+11:33927:x1876351634976000:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 230us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429290.744234:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5737 00000100:00100000:1.0:1789429290.757463:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429290.757563:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634976128 00000100:00100000:3.0:1789429290.757572:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634976128 00002000:00010000:3.0:1789429290.757608:0:18658:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/46 (163840->18446744073709551615) 00002000:00100000:3.0:1789429290.757612:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9880 with x1876351634976128 ext(163840->18446744073709551615) 00002000:00010000:3.0:1789429290.757623:0:18658:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29de9880. 00000100:00100000:3.0:1789429290.757651:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11470 00000100:00100000:3.0:1789429290.757659:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351634976128:12345-192.168.203.39@tcp:10:mmap_sanity.0 00002000:00010000:3.0:1789429290.757909:0:18658:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb size from disk: 0 -> 163840 00002000:00010000:3.0:1789429290.757923:0:18658:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb mtime from disk: 0 -> 1789429291 00002000:00010000:3.0:1789429290.757926:0:18658:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789429290.757928:0:18658:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb ctime from disk: 0 -> 1789429291 00002000:00010000:3.0:1789429290.757931:0:18658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789429290.757988:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634976128:12345-192.168.203.39@tcp:10:mmap_sanity.0 Request processed in 329us (533us total) trans 4294969246 rc 0/0 00000100:00100000:3.0:1789429290.757999:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11470 00002000:00010000:3.0:1789429290.758002:0:18658:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/46 (163840->18446744073709551615) 00002000:00100000:3.0:1789429290.758005:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9880 with x1876351634976128 ext(163840->18446744073709551615) 00002000:00010000:3.0:1789429290.758010:0:18658:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29de9880. 00000100:00100000:2.0:1789429290.764342:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429290.764429:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634976256 00000100:00100000:3.0:1789429290.764440:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634976256 00002000:00100000:3.0:1789429290.764486:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2e:0x0] (0->4095) req@ffff946f3f8d8380 x1876351634976256/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/0 e 0 to 0 dl 1789429301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429290.764497:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8380 with x1876351634976256 ext(0->4095) 00002000:00010000:3.0:1789429290.764504:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8d8380 00000100:00100000:3.0:1789429290.764536:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11471 00000100:00100000:3.0:1789429290.764546:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634976256:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429290.764776:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634976256:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 231us (442us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429290.764784:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11471 00002000:00100000:3.0:1789429290.764791:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2e:0x0] (0->4095) req@ffff946f3f8d8380 x1876351634976256/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/4536 e 0 to 0 dl 1789429301 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429290.764799:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8380 with x1876351634976256 ext(0->4095) 00002000:00010000:3.0:1789429290.764802:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8d8380 00000100:00100000:0.0:1789429290.769354:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.769606:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634976384 00000100:00100000:2.0:1789429290.769616:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634976384 00002000:00100000:2.0:1789429290.769661:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2e:0x0] (4096->8191) req@ffff946f1c0aa680 x1876351634976384/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/0 e 0 to 0 dl 1789429301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429290.769673:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0aa680 with x1876351634976384 ext(4096->8191) 00002000:00010000:2.0:1789429290.769678:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0aa680 00000100:00100000:2.0:1789429290.769709:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11472 00000100:00100000:2.0:1789429290.769717:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634976384:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429290.769937:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634976384:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 220us (591us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429290.769945:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11472 00002000:00100000:2.0:1789429290.769952:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x2e:0x0] (4096->8191) req@ffff946f1c0aa680 x1876351634976384/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/4536 e 0 to 0 dl 1789429301 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429290.769961:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0aa680 with x1876351634976384 ext(4096->8191) 00002000:00010000:2.0:1789429290.769964:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0aa680 00000100:00100000:0.0:1789429290.779497:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429290.779580:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634976512 00000100:00100000:3.0:1789429290.779590:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634976512 00002000:00100000:3.0:1789429290.779638:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2e:0x0] (8192->12287) req@ffff946f1c0a9500 x1876351634976512/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/0 e 0 to 0 dl 1789429301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429290.779656:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a9500 with x1876351634976512 ext(8192->12287) 00002000:00010000:3.0:1789429290.779661:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0a9500 00000100:00100000:3.0:1789429290.779696:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11473 00000100:00100000:3.0:1789429290.779705:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634976512:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429290.779926:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634976512:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 220us (437us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429290.779934:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11473 00002000:00100000:3.0:1789429290.779941:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x2e:0x0] (8192->12287) req@ffff946f1c0a9500 x1876351634976512/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/4536 e 0 to 0 dl 1789429301 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429290.779948:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a9500 with x1876351634976512 ext(8192->12287) 00002000:00010000:3.0:1789429290.779952:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0a9500 00000100:00100000:3.0:1789429290.790341:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.797237:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634976640 00000100:00100000:2.0:1789429290.797253:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634976640 00002000:00100000:2.0:1789429290.797312:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2e:0x0] (12288->69631) req@ffff946e0265ed80 x1876351634976640/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/0 e 0 to 0 dl 1789429301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429290.797325:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265ed80 with x1876351634976640 ext(12288->69631) 00002000:00010000:2.0:1789429290.797331:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265ed80 00000100:00100000:2.0:1789429290.797370:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11474 00000100:00100000:2.0:1789429290.797379:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634976640:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429290.802026:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634976640:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4637us (11684us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1789429290.802040:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11474 00002000:00100000:2.0:1789429290.802052:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x2e:0x0] (12288->69631) req@ffff946e0265ed80 x1876351634976640/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/440 e 0 to 0 dl 1789429301 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429290.802063:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265ed80 with x1876351634976640 ext(12288->69631) 00002000:00010000:2.0:1789429290.802069:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265ed80 00000100:00100000:0.0:1789429290.810762:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429290.810953:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634976768 00000100:00100000:3.0:1789429290.810964:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634976768 00002000:00100000:3.0:1789429290.811011:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2e:0x0] (69632->106495) req@ffff946f1c0aad80 x1876351634976768/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/0 e 0 to 0 dl 1789429301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429290.811022:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0aad80 with x1876351634976768 ext(69632->106495) 00002000:00010000:3.0:1789429290.811029:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0aad80 00000100:00100000:3.0:1789429290.811060:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11475 00000100:00100000:3.0:1789429290.811069:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634976768:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429290.814119:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634976768:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3040us (3355us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1789429290.814133:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11475 00002000:00100000:0.0:1789429290.814145:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2e:0x0] (69632->106495) req@ffff946f1c0aad80 x1876351634976768/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/440 e 0 to 0 dl 1789429301 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429290.814154:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0aad80 with x1876351634976768 ext(69632->106495) 00002000:00010000:0.0:1789429290.814162:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0aad80 00000100:00100000:1.0:1789429290.822078:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429290.822226:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634976896 00000100:00100000:3.0:1789429290.822237:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634976896 00002000:00100000:3.0:1789429290.822286:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2e:0x0] (106496->143359) req@ffff946f29de8e00 x1876351634976896/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/0 e 0 to 0 dl 1789429301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429290.822298:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de8e00 with x1876351634976896 ext(106496->143359) 00002000:00010000:3.0:1789429290.822303:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29de8e00 00000100:00100000:3.0:1789429290.822336:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11476 00000100:00100000:3.0:1789429290.822345:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634976896:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429290.826567:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351634976896:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 4210us (4486us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1789429290.826580:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11476 00002000:00100000:3.0:1789429290.826593:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2e:0x0] (106496->143359) req@ffff946f29de8e00 x1876351634976896/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/440 e 0 to 0 dl 1789429301 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429290.826603:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de8e00 with x1876351634976896 ext(106496->143359) 00002000:00010000:3.0:1789429290.826609:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29de8e00 00000100:00100000:2.0:1789429290.836283:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429290.836655:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634977024 00000100:00100000:3.0:1789429290.836666:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634977024 00002000:00100000:3.0:1789429290.836716:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2e:0x0] (143360->163839) req@ffff946f3f8da680 x1876351634977024/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/0 e 0 to 0 dl 1789429301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429290.836728:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8da680 with x1876351634977024 ext(143360->163839) 00002000:00010000:3.0:1789429290.836734:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8da680 00000100:00100000:3.0:1789429290.836774:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11477 00000100:00100000:3.0:1789429290.836783:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+12:2369:x1876351634977024:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:3.0:1789429290.840042:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+12:2369:x1876351634977024:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 3249us (3757us total) trans 0 rc 20480/20480 00000100:00100000:3.0:1789429290.840060:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11477 00002000:00100000:3.0:1789429290.840072:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x2e:0x0] (143360->163839) req@ffff946f3f8da680 x1876351634977024/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/440 e 0 to 0 dl 1789429301 ref 1 fl Complete:/600/0 rc 20480/20480 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429290.840100:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8da680 with x1876351634977024 ext(143360->163839) 00002000:00010000:3.0:1789429290.840106:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8da680 00000100:00100000:1.0:1789429290.856026:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429290.856070:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429290.856178:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634977280 00000100:00100000:0.0:1789429290.856188:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634977280 00002000:00100000:0.0:1789429290.856284:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2d:0x0] (0->409599) req@ffff946f29de9c00 x1876351634977280/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:26/0 lens 488/0 e 0 to 0 dl 1789429301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429290.856297:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9c00 with x1876351634977280 ext(0->409599) 00002000:00010000:0.0:1789429290.856303:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29de9c00 00000100:00100000:0.0:1789429290.856339:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11478 00000100:00100000:0.0:1789429290.856348:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351634977280:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:3.0:1789429290.857269:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634977152 00000100:00100000:3.0:1789429290.857276:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634977152 00000100:00100000:3.0:1789429290.857320:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21087 00000100:00100000:3.0:1789429290.857329:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+55:33927:x1876351634977152:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429290.857342:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429290.857365:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263607c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c285 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.857423:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263607d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.857436:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263607d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.857448:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263607d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429290.857494:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429290.857497:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429290.857515:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263607d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.857538:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263607c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c285 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.857555:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263607d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c285 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.857564:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:3.0:1789429290.857567:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429290.857570:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:3.0:1789429290.857667:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+56:33927:x1876351634977152:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 337us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429290.857673:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21087 00000100:00080000:1.0:1789429290.857783:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429290.871013:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429290.871191:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634977408 00000100:00100000:0.0:1789429290.871225:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634977408 00000100:00100000:0.0:1789429290.871283:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21088 00000100:00100000:0.0:1789429290.871293:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+56:33927:x1876351634977408:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429290.871313:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429290.871335:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263607d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c28c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871393:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263607de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871411:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263607de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871423:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263607de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871438:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263607e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871444:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263607e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871451:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263607e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871538:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263607ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871546:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263607ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871553:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263607ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429290.871584:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x6f:0x0]: returning size 163840 00000004:00200000:0.0:1789429290.871589:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429290.871607:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263607ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871617:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263607ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871628:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263607de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871634:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263607de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871640:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263607de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871644:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429290.871649:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263607de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871656:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263607de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871667:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:0.0:1789429290.871669:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429290.871673:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263607de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871678:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263607de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871690:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263607e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871695:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263607e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871701:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263607e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871706:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429290.871709:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263607e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871714:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263607e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871721:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc442db46 (ffff946f120fde00) 00010000:00010000:0.0:1789429290.871723:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429290.871726:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263607e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871731:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263607e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871773:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263607d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c28c expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871787:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263607ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c28c expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.871794:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:0.0:1789429290.871796:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429290.871798:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:0.0:1789429290.871860:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+57:33927:x1876351634977408:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 569us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429290.871868:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21088 00000100:00100000:2.0:1789429290.879965:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429290.880146:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634977664 00000100:00100000:1.0:1789429290.880158:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634977664 00000100:00100000:1.0:1789429290.880256:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21089 00000100:00100000:1.0:1789429290.880266:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+57:33927:x1876351634977664:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789429290.880321:0:15669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789429290.880348:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263607ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c28c expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.880370:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263607bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c277 expref: 56 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.880381:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:1.0:1789429290.880396:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263607d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c285 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.880406:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:1.0:1789429290.880413:0:15669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429290.880437:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad7263607f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.880448:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad7263607f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.880458:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad7263607f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.880469:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad7263607fa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.880475:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad7263607fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.880482:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad7263607fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.880570:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360801 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.880579:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360801 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.880586:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360801 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429290.881124:0:15669:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x6f:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1789429290.881266:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360801 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881275:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360801 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881282:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360801 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881288:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429290.881291:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360801 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881298:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360801 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881308:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f:0x0].0x0 (ffff946f2076ae00) 00010000:00010000:1.0:1789429290.881311:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789429290.881315:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360801 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881322:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360801 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881341:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad7263607f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881347:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad7263607f3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881352:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad7263607f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881356:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429290.881359:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad7263607f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881364:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad7263607f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881370:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a100) 00010000:00010000:1.0:1789429290.881372:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429290.881374:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad7263607f3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.881380:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad7263607f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429290.881389:0:15669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000011260c63 reply state 00000000c92d0e20 transno 4294977090 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad7263607fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429290.881397:0:15669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429290.881469:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+56:33927:x1876351634977664:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 1203us (1512us total) trans 4294977090 rc 0/0 00000100:00100000:1.0:1789429290.881477:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21089 00000100:00100000:3.0:1789429290.903597:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351634977280:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 47237us (47514us total) trans 4294969247 rc 0/0 00000100:00100000:3.0:1789429290.903613:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11478 00002000:00100000:3.0:1789429290.903630:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2d:0x0] (0->409599) req@ffff946f29de9c00 x1876351634977280/t4294969247(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:26/0 lens 488/448 e 0 to 0 dl 1789429301 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429290.903641:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9c00 with x1876351634977280 ext(0->409599) 00002000:00010000:3.0:1789429290.903648:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29de9c00 00010000:00010000:3.0:1789429290.904152:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad7263607fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.904164:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad7263607fa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.904172:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad7263607fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.904178:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429290.904183:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad7263607fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.904190:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad7263607fa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.904219:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc442db46 (ffff946f2076a600) 00010000:00010000:3.0:1789429290.904222:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429290.904226:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad7263607fa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.904232:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad7263607fa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429290.906713:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.910729:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634977792 00000100:00100000:2.0:1789429290.910745:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634977792 00000100:00100000:2.0:1789429290.911061:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21090 00000100:00100000:2.0:1789429290.911072:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+55:33927:x1876351634977792:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429290.911120:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429290.911142:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c293 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.911227:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636080f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.911240:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636080f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.911252:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636080f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429290.911289:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429290.911293:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429290.911312:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636080f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.911336:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c293 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.911353:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636080f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c293 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.911361:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051efd00) 00010000:00010000:2.0:1789429290.911364:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429290.911367:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429290.913388:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+56:33927:x1876351634977792:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2307us (6675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429290.913398:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21090 00000100:00100000:0.0:1789429290.914406:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.915881:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634977920 00000100:00100000:2.0:1789429290.915895:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634977920 00000100:00100000:2.0:1789429290.915982:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 255 00000100:00100000:2.0:1789429290.915992:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:5607:x1876351634977920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429290.916008:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00002000:00010000:2.0:1789429290.916028:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb mtime from disk: 1789429288 -> 1789429289 00002000:00010000:2.0:1789429290.916032:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2d:0x0] updating lvb ctime from disk: 1789429288 -> 1789429289 00010000:00010000:2.0:1789429290.916055:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263606db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c23f expref: 10 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429290.916107:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789429290.916110:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb mtime from disk: 0 -> 1789429265 00002000:00010000:2.0:1789429290.916112:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb atime from disk: 0 -> 1789429267 00002000:00010000:2.0:1789429290.916114:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb ctime from disk: 0 -> 1789429265 00002000:00010000:2.0:1789429290.916116:0:5825:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2a:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1789429290.916126:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b4e7a42/0xb4c3dad72635f474 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b28d expref: 9 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.916152:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000836316e6/0xb4c3dad72635f458 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x29:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b278 expref: 8 pid: 13238 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.916161:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429290.916230:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:5607:x1876351634977920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 239us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429290.916237:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 255 00000100:00100000:2.0:1789429290.931714:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429290.931799:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634978176 00000100:00100000:3.0:1789429290.931810:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634978176 00002000:00100000:3.0:1789429290.931858:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2e:0x0] (0->163839) req@ffff946f3f8da300 x1876351634978176/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/0 e 0 to 0 dl 1789429301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429290.931869:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8da300 with x1876351634978176 ext(0->163839) 00002000:00010000:3.0:1789429290.931875:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8da300 00000100:00100000:3.0:1789429290.931908:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11479 00000100:00100000:3.0:1789429290.931917:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351634978176:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:2.0:1789429290.941900:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429290.942253:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634978048 00000100:00100000:0.0:1789429290.942265:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634978048 00000100:00100000:0.0:1789429290.942324:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21091 00000100:00100000:0.0:1789429290.942333:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+56:33927:x1876351634978048:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429290.942354:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429290.942374:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726360816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c29a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942450:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad72636081d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942464:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad72636081d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942475:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad72636081d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942544:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360824 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942551:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360824 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942558:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360824 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942596:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad72636081d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942603:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad72636081d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942614:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad72636081d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942619:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429290.942623:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad72636081d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942630:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad72636081d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942640:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051efd00) 00010000:00010000:0.0:1789429290.942643:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429290.942648:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad72636081d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942654:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad72636081d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942665:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360824 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942671:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360824 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942677:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360824 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942682:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429290.942685:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360824 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942694:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360824 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942701:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdddd5b93 (ffff946f120fde00) 00010000:00010000:0.0:1789429290.942704:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429290.942707:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360824 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942713:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360824 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942745:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726360816 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c29a expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942755:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051efd00) 00010000:00010000:0.0:1789429290.942757:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429290.942761:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726360816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c29a expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429290.942771:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429290.942824:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+56:33927:x1876351634978048:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 492us (933us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429290.942831:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21091 00000100:00100000:3.0:1789429290.944744:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:2370:x1876351634978176:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 12820us (13033us total) trans 4294969248 rc 0/0 00000100:00100000:3.0:1789429290.944768:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11479 00002000:00100000:3.0:1789429290.944780:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x2e:0x0] (0->163839) req@ffff946f3f8da300 x1876351634978176/t4294969248(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:26/0 lens 488/448 e 0 to 0 dl 1789429301 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429290.944797:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8da300 with x1876351634978176 ext(0->163839) 00002000:00010000:3.0:1789429290.944803:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8da300 00000100:00100000:0.0:1789429290.958503:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.958670:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634978432 00000100:00100000:2.0:1789429290.958680:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634978432 00000100:00100000:2.0:1789429290.958754:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 256 00000100:00100000:2.0:1789429290.958765:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+14:14502:x1876351634978432:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429290.958779:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789429290.958820:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078d7dcfc/0xb4c3dad7263607c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c27e expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429290.958857:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2b:0x0] updating lvb size from disk: 0 -> 94160 00002000:00010000:2.0:1789429290.958861:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2b:0x0] updating lvb mtime from disk: 0 -> 1789429273 00002000:00010000:2.0:1789429290.958863:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2b:0x0] updating lvb ctime from disk: 0 -> 1789429273 00002000:00010000:2.0:1789429290.958865:0:5824:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2b:0x0] updating lvb blocks from disk: 1 -> 259 00010000:00010000:2.0:1789429290.958874:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000282fa1cf/0xb4c3dad72635f538 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2d3 expref: 13 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.958898:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d42bc775/0xb4c3dad72635f4ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b29b expref: 12 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.958911:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429290.958981:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:14502:x1876351634978432:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 218us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429290.958988:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 256 00000100:00100000:1.0:1789429290.963027:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.963174:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634978560 00000100:00100000:2.0:1789429290.963184:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634978560 00000100:00100000:2.0:1789429290.963277:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21092 00000100:00100000:2.0:1789429290.963288:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+56:33927:x1876351634978560:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429290.963310:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429290.963313:0:15669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789429290.963340:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636080f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c293 expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.963359:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051efd00) 00010000:00010000:2.0:1789429290.963369:0:15669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429290.963384:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636082b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2a1 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.963508:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360832 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.963521:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360832 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.963530:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360832 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.963543:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360839 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.963549:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360839 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.963555:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360839 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789429290.965445:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2d:0x0], index 1: 0 00010000:00010000:2.0:1789429290.965651:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360840 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x70:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.965668:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.965680:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.965721:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360832 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.965728:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360832 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.965734:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360832 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.965740:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429290.965744:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360832 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.965751:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360832 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.965764:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef600) 00010000:00010000:2.0:1789429290.965767:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429290.965770:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360832 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.965776:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360832 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789429290.965789:0:15669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000026d51554 reply state 000000006efe5669 transno 4294977091 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360839 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429290.965798:0:15669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789429290.966771:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636082b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2a1 expref: 58 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.966803:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360840 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2a1 expref: 57 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429290.966811:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70:0x0].0x0 (ffff946f051ef800) 00010000:00010000:2.0:1789429290.966814:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789429290.966818:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546e00, rc 0) 00000100:00100000:2.0:1789429290.968046:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+58:33927:x1876351634978560:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 4752us (5020us total) trans 4294977091 rc 0/0 00000100:00100000:2.0:1789429290.968057:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21092 00000100:00100000:0.0:1789429290.970858:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.970939:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634978688 00000100:00100000:2.0:1789429290.970950:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634978688 00002000:00100000:2.0:1789429290.971009:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2c:0x0] (278528->409599) req@ffff946e15185c00 x1876351634978688/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:26/0 lens 488/0 e 0 to 0 dl 1789429301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429290.971021:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185c00 with x1876351634978688 ext(278528->409599) 00002000:00010000:2.0:1789429290.971027:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15185c00 00000100:00100000:2.0:1789429290.971057:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11480 00000100:00100000:2.0:1789429290.971067:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2371:x1876351634978688:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00080000:1.0:1789429290.971337:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789429290.972960:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360839 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.972977:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360839 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.972985:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360839 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.972994:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429290.972999:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360839 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.973006:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360839 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.973022:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdddd5b93 (ffff946f051ef700) 00010000:00010000:1.0:1789429290.973026:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429290.973031:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360839 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.973037:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360839 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429290.975311:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429290.975401:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634978944 00000100:00100000:1.0:1789429290.975413:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634978944 00000100:00100000:1.0:1789429290.975613:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21093 00000100:00100000:1.0:1789429290.975625:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+57:33927:x1876351634978944:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789429290.975682:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429290.975710:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360840 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2a1 expref: 57 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.975740:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70:0x0].0x0 (ffff946f051ef800) 00010000:00010000:1.0:1789429290.975752:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429290.976293:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad72636084e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x70:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.976308:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad72636084e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.976318:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad72636084e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789429290.976373:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977092 00000004:00010000:1.0:1789429290.976400:0:6704:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c32e5ab9 reply state 000000003df4b06f transno 4294977093 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad72636084e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429290.976409:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429290.976660:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+59:33927:x1876351634978944:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 1036us (1354us total) trans 4294977093 rc 0/0 00000100:00100000:1.0:1789429290.976668:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21093 00000020:00080000:1.0:1789429290.976673:0:6704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789429290.983354:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429290.983997:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+37:2371:x1876351634978688:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 12929us (13146us total) trans 4294969578 rc 0/0 00000100:00100000:2.0:1789429290.984011:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11480 00002000:00100000:2.0:1789429290.984023:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2c:0x0] (278528->409599) req@ffff946e15185c00 x1876351634978688/t4294969578(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:26/0 lens 488/448 e 0 to 0 dl 1789429301 ref 1 fl Complete:/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429290.984032:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185c00 with x1876351634978688 ext(278528->409599) 00002000:00010000:2.0:1789429290.984038:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15185c00 00010000:00010000:3.0:1789429290.984355:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad72636084e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.984366:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad72636084e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.984374:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad72636084e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.984380:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429290.984385:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad72636084e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.984391:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad72636084e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.984405:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70:0x0].0x0 (ffff946f2076a100) 00010000:00010000:3.0:1789429290.984408:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429290.984413:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad72636084e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429290.984419:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad72636084e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x70:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429290.985613:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634979072 00000100:00100000:1.0:1789429290.985626:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634979072 00000100:00100000:1.0:1789429290.985684:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21094 00000100:00100000:1.0:1789429290.985694:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+58:33927:x1876351634979072:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429290.985714:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429290.985735:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360855 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x70:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2a8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.985791:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360855 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x70:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2a8 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.985804:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360855 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x70:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2a8 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429290.985820:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70:0x0].0x0 (ffff946f2076ae00) 00010000:00010000:1.0:1789429290.985833:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789429290.985836:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6e00, rc 0) 00000100:00100000:1.0:1789429290.985885:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+59:33927:x1876351634979072:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 192us (2540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429290.985891:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21094 00000100:00100000:2.0:1789429290.995803:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429290.997815:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634979200 00000100:00100000:3.0:1789429290.997831:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634979200 00002000:00100000:3.0:1789429290.997888:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (0->409599) req@ffff946f415c4e00 x1876351634979200/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:26/0 lens 488/0 e 0 to 0 dl 1789429301 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429290.997907:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4e00 with x1876351634979200 ext(0->409599) 00002000:00010000:3.0:1789429290.997929:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f415c4e00 00000100:00100000:3.0:1789429290.997969:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11481 00000100:00100000:3.0:1789429290.997978:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+37:2370:x1876351634979200:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1789429291.005354:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.005443:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634979328 00000100:00100000:2.0:1789429291.005454:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634979328 00000100:00100000:2.0:1789429291.005530:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5738 00000100:00100000:2.0:1789429291.005540:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:33927:x1876351634979328:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429291.005558:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429291.005579:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636085c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2af expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429291.005617:0:8085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789429291.005639:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=988s v=(0 0) 00010000:00010000:2.0:1789429291.005644:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429291.005652:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636085c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2af expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.005669:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636085c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2af expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.005682:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546800, rc 0) 00000100:00080000:1.0:1789429291.006303:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429291.008005:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2370:x1876351634979200:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 10019us (12203us total) trans 4294969579 rc 0/0 00000100:00100000:1.0:1789429291.008018:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11481 00002000:00100000:1.0:1789429291.008029:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2b:0x0] (0->409599) req@ffff946f415c4e00 x1876351634979200/t4294969579(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:26/0 lens 488/448 e 0 to 0 dl 1789429301 ref 1 fl Complete:/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429291.008038:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4e00 with x1876351634979200 ext(0->409599) 00002000:00010000:1.0:1789429291.008071:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f415c4e00 00000100:00100000:2.0:1789429291.010701:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:33927:x1876351634979328:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5153us (5346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429291.010715:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5738 00000100:00100000:1.0:1789429291.016116:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429291.016244:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429291.016380:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634979584 00000100:00100000:3.0:1789429291.016390:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634979584 00002000:00010000:3.0:1789429291.016432:0:20672:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/45 (4096->18446744073709551615) 00002000:00100000:3.0:1789429291.016482:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10308a80 with x1876351634979584 ext(4096->18446744073709551615) 00002000:00010000:3.0:1789429291.016495:0:20672:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e10308a80. 00000100:00100000:3.0:1789429291.016531:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11482 00000100:00100000:3.0:1789429291.016542:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+7:2368:x1876351634979584:12345-192.168.203.39@tcp:10:mmap_sanity.0 00002000:00010000:3.0:1789429291.016831:0:20672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2d:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1789429291.016835:0:20672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2d:0x0] updating lvb mtime from disk: 0 -> 1789429291 00002000:00010000:3.0:1789429291.016837:0:20672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789429291.016840:0:20672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2d:0x0] updating lvb ctime from disk: 0 -> 1789429291 00002000:00010000:3.0:1789429291.016842:0:20672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789429291.016892:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+8:2368:x1876351634979584:12345-192.168.203.39@tcp:10:mmap_sanity.0 Request processed in 352us (648us total) trans 4294969580 rc 0/0 00000100:00100000:3.0:1789429291.016900:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11482 00002000:00010000:3.0:1789429291.016904:0:20672:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/45 (4096->18446744073709551615) 00002000:00100000:3.0:1789429291.016907:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10308a80 with x1876351634979584 ext(4096->18446744073709551615) 00002000:00010000:3.0:1789429291.016911:0:20672:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e10308a80. 00000100:00100000:2.0:1789429291.017736:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634979456 00000100:00100000:2.0:1789429291.017744:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634979456 00000100:00100000:2.0:1789429291.017800:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 257 00000100:00100000:2.0:1789429291.017809:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:11155:x1876351634979456:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429291.017822:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 30 locks, starting at 0 00002000:00010000:2.0:1789429291.017836:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb mtime from disk: 1789429288 -> 1789429289 00002000:00010000:2.0:1789429291.017839:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb ctime from disk: 1789429288 -> 1789429289 00002000:00010000:2.0:1789429291.017841:0:5825:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2c:0x0] updating lvb blocks from disk: 1 -> 1027 00010000:00010000:2.0:1789429291.017863:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021b7f35e/0xb4c3dad7263606d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 278528->282623) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c238 expref: 39 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429291.017889:0:5825:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2b:0x0] updating lvb blocks from disk: 775 -> 1031 00010000:00010000:2.0:1789429291.017898:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac33494/0xb4c3dad726360377 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 31 type: EXT [344064->348159] (req 344064->348159) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bfc2 expref: 38 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.017909:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263602a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 30 type: EXT [339968->344063] (req 339968->344063) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bef0 expref: 37 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.017920:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360297 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 29 type: EXT [335872->339967] (req 335872->339967) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bee2 expref: 36 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.017932:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263601c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 28 type: EXT [331776->335871] (req 331776->335871) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1be10 expref: 35 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.017948:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726360171 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 27 type: EXT [327680->331775] (req 327680->331775) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bdbc expref: 34 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.017960:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000948d0d02/0xb4c3dad72635ff41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 26 type: EXT [323584->327679] (req 323584->327679) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1bb8c expref: 33 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.017971:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad72635fe1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 25 type: EXT [315392->323583] (req 315392->319487) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba66 expref: 32 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.017980:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5a26bc9/0xb4c3dad72635fe0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 24 type: EXT [311296->315391] (req 311296->315391) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ba58 expref: 31 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.017991:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a2b478/0xb4c3dad72635fccb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 23 type: EXT [286720->311295] (req 286720->290815) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b916 expref: 30 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018003:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c9c49c0/0xb4c3dad72635fcbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 22 type: EXT [249856->286719] (req 249856->253951) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b908 expref: 29 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018015:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000032fffbc/0xb4c3dad72635fa08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 21 type: EXT [184320->204799] (req 184320->188415) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b653 expref: 28 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018026:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad72635f9ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 20 type: EXT [147456->184319] (req 147456->151551) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b645 expref: 27 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018044:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c15f3247/0xb4c3dad72635f729 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 19 type: EXT [69632->81919] (req 69632->73727) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b382 expref: 26 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018055:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000487b6bed/0xb4c3dad72635f71b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 18 type: EXT [0->69631] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b374 expref: 25 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018067:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a90d82a/0xb4c3dad726360568 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 17 type: EXT [393216->397311] (req 393216->397311) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1b3 expref: 24 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018079:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfb45d7d/0xb4c3dad72636050d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 16 type: EXT [397312->18446744073709551615] (req 397312->401407) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c158 expref: 23 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018106:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977ec969/0xb4c3dad726360561 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 15 type: EXT [376832->393215] (req 376832->380927) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1ac expref: 22 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018119:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847d626/0xb4c3dad72636055a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 14 type: EXT [356352->376831] (req 356352->360447) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c1a5 expref: 21 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018130:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efadffc6/0xb4c3dad72636041f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 13 type: EXT [348160->356351] (req 348160->352255) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c06a expref: 20 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018142:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad726360553 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 12 type: EXT [241664->249855] (req 241664->245759) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c19e expref: 19 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018157:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad72636054c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 11 type: EXT [237568->241663] (req 237568->241663) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c197 expref: 18 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018166:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d53c170b/0xb4c3dad726360545 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 10 type: EXT [233472->237567] (req 233472->237567) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c190 expref: 17 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018176:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad72636053e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 9 type: EXT [229376->233471] (req 229376->233471) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c189 expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018185:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad726360537 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 8 type: EXT [217088->229375] (req 217088->221183) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c182 expref: 15 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018195:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086639b0c/0xb4c3dad726360530 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 7 type: EXT [204800->217087] (req 204800->208895) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c17b expref: 14 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018255:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad726360529 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 6 type: EXT [143360->147455] (req 143360->147455) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c174 expref: 13 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018266:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360522 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 5 type: EXT [135168->143359] (req 135168->139263) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c16d expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018276:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bff8d190/0xb4c3dad72636051b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 4 type: EXT [118784->135167] (req 118784->122879) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c166 expref: 11 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018291:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb6c3010/0xb4c3dad726360514 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 3 type: EXT [81920->118783] (req 81920->86015) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c15f expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.018303:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429291.018352:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:11155:x1876351634979456:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 544us (2245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429291.018360:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 257 00000100:00100000:3.0:1789429291.019783:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429291.019840:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634979712 00000100:00100000:0.0:1789429291.019848:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634979712 00000100:00100000:0.0:1789429291.019896:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21095 00000100:00100000:0.0:1789429291.019905:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:33927:x1876351634979712:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429291.019923:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429291.019945:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360863 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2b6 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.020008:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.020033:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.020045:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429291.020099:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429291.020104:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429291.020123:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.020147:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360863 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2b6 expref: 20 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.020165:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2b6 expref: 19 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.020174:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fde00) 00010000:00010000:0.0:1789429291.020177:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429291.020181:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429291.020256:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33927:x1876351634979712:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 351us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429291.020264:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21095 00000100:00100000:1.0:1789429291.026184:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429291.026253:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.026695:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634980096 00000100:00100000:2.0:1789429291.026705:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634980096 00000100:00100000:2.0:1789429291.026773:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 258 00000100:00100000:2.0:1789429291.026783:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+8:14501:x1876351634980096:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429291.026799:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789429291.026841:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad72636085c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2af expref: 8 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429291.026872:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x29:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789429291.026876:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x29:0x0] updating lvb mtime from disk: 0 -> 1789429267 00002000:00010000:2.0:1789429291.026878:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x29:0x0] updating lvb atime from disk: 0 -> 1789429267 00002000:00010000:2.0:1789429291.026880:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x29:0x0] updating lvb ctime from disk: 0 -> 1789429267 00002000:00010000:2.0:1789429291.026882:0:5824:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x29:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1789429291.026891:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a05c90/0xb4c3dad72635f4d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2b0 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.026904:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429291.026972:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:14501:x1876351634980096:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 191us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429291.026980:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 258 00000100:00100000:3.0:1789429291.027771:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634979968 00000100:00100000:3.0:1789429291.027778:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634979968 00000100:00100000:3.0:1789429291.027867:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21096 00000100:00100000:3.0:1789429291.027876:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:33927:x1876351634979968:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429291.027894:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429291.027912:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360871 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2bd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.027979:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360878 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.027992:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360878 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028005:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360878 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028020:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636087f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028027:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636087f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028034:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636087f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028168:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x70:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028177:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028185:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429291.028195:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x70:0x0]: returning size 4096 00010000:00010000:3.0:1789429291.028314:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360878 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028322:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360878 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028328:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360878 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028333:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429291.028337:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360878 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028344:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360878 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028354:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fde00) 00010000:00010000:3.0:1789429291.028357:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429291.028362:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360878 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028368:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360878 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028381:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636087f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028386:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636087f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028396:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636087f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028401:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429291.028403:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636087f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028410:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636087f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028416:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdddd5b93 (ffff946f04fb8400) 00010000:00010000:3.0:1789429291.028419:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429291.028421:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636087f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028426:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636087f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028464:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360871 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2bd expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028479:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2bd expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.028486:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70:0x0].0x0 (ffff946f2076ae00) 00010000:00010000:3.0:1789429291.028489:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429291.028491:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:3.0:1789429291.028551:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:33927:x1876351634979968:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 675us (2375us total) trans 4294977094 rc 0/0 00000100:00100000:3.0:1789429291.028561:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21096 00000100:00100000:1.0:1789429291.040381:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429291.040645:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.041107:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634980480 00000100:00100000:2.0:1789429291.041118:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634980480 00000100:00100000:2.0:1789429291.041177:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5739 00000100:00100000:2.0:1789429291.041187:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351634980480:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429291.041234:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429291.041255:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360894 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2c4 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429291.041283:0:20745:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 4096, mtime: 0x6aa8862b, atime: 0x0, ctime: 0x6aa8862b, blocks: 0x1 00010000:00010000:2.0:1789429291.041304:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=989s v=(0 0) 00010000:00010000:2.0:1789429291.041309:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429291.041318:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360894 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2c4 expref: 7 pid: 20745 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.041336:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360894 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2c4 expref: 7 pid: 20745 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.041350:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546600, rc 0) 00000100:00100000:2.0:1789429291.041412:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+7:2368:x1876351634980480:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 226us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429291.041419:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5739 00000100:00100000:3.0:1789429291.049748:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634980352 00000100:00100000:3.0:1789429291.049764:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634980352 00000100:00100000:3.0:1789429291.049904:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 238 00000100:00100000:3.0:1789429291.049925:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+59:33943:x1876351634980352:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000004:00080000:3.0:1789429291.050275:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789429291.050351:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].21, 64 off9536 00010000:00010000:3.0:1789429291.050433:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636089b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.050450:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636089b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.050464:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636089b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.050473:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636089b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.050479:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636089b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.050485:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636089b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.050507:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789429291.050611:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+60:33943:x1876351634980352:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 685us (10226us total) trans 4294977095 rc 0/0 00000100:00100000:3.0:1789429291.050620:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 238 00010000:00010000:3.0:1789429291.050651:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789429291.050657:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636089b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.050664:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1600 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:3.0:1789429291.050668:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636089b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.050675:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636089b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.050688:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f:0x0].0x0 (ffff946f04fb8d00) 00010000:00010000:3.0:1789429291.050690:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789429291.050695:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636089b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.050701:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636089b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.050717:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429291.050719:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429291.050720:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789429291.051007:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429291.070686:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429291.071596:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634980608 00000100:00100000:3.0:1789429291.071611:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634980608 00000100:00100000:3.0:1789429291.071717:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5740 00000100:00100000:3.0:1789429291.071729:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2371:x1876351634980608:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429291.071749:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429291.071766:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002808f649/0xb4c3dad7263608a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2cb expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.071794:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429291.071799:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429291.071808:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002808f649/0xb4c3dad7263608a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2cb expref: 10 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.071825:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002808f649/0xb4c3dad7263608a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2cb expref: 10 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.071839:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1800, rc 0) 00000100:00100000:3.0:1789429291.071903:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634980608:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 176us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429291.071910:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5740 00000100:00100000:0.0:1789429291.081263:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.081430:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634980736 00000100:00100000:2.0:1789429291.081441:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634980736 00000100:00100000:2.0:1789429291.081496:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5741 00000100:00100000:2.0:1789429291.081505:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+7:33927:x1876351634980736:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429291.081522:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429291.081541:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2d2 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.081573:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360894 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2c4 expref: 8 pid: 20745 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.081583:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002808f649/0xb4c3dad7263608a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2cb expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.081607:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429291.081612:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429291.081617:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 8 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.081650:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002808f649/0xb4c3dad7263608a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2cb expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.081664:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002808f649/0xb4c3dad7263608a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2cb expref: 9 pid: 6681 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429291.081677:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648341120:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429291.081782:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360894 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2c4 expref: 8 pid: 20745 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.081797:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360894 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2c4 expref: 8 pid: 20745 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429291.081807:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648341248:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429291.081832:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f29ee46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429291.082242:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429291.082277:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634980864 00000100:00100000:0.0:1789429291.082282:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634980864 00010000:00010000:0.0:1789429291.082304:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002808f649/0xb4c3dad7263608a2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2cb expref: 10 pid: 6681 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429291.082328:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6164 00000100:00100000:0.0:1789429291.082335:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:5606:x1876351634980864:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429291.082344:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429291.082465:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002808f649/0xb4c3dad7263608a2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2cb expref: 10 pid: 6681 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.082479:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002808f649/0xb4c3dad7263608a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2cb expref: 10 pid: 6681 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.082499:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429291.082526:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:5606:x1876351634980864:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 192us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429291.082534:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6164 00000100:00100000:1.0:1789429291.086411:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:2.0:1789429291.086614:0:20986:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.39@tcp) returned -22 from blocking AST (req@0000000075a2771e x1876351648341120) - normal race ns: filter-lustre-OST0001_UUID lock: 000000002808f649/0xb4c3dad7263608a2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2cb expref: 9 pid: 6681 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.086653:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002808f649/0xb4c3dad7263608a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2cb expref: 9 pid: 6681 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429291.086668:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648341120:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429291.086681:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648341248:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429291.086715:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 8 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.086726:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429291.087321:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+8:33927:x1876351634980736:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 5814us (6065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429291.087331:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5741 00000100:00100000:0.0:1789429291.088487:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634980992 00000100:00100000:0.0:1789429291.088499:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634980992 00010000:00010000:0.0:1789429291.088537:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360894 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2c4 expref: 8 pid: 20745 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429291.088583:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6165 00000100:00100000:0.0:1789429291.088593:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634980992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429291.088607:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429291.088626:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360894 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2c4 expref: 8 pid: 20745 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.088641:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360894 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2c4 expref: 8 pid: 20745 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.088665:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025801196/0xb4c3dad726360894 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2c4 expref: 8 pid: 20745 timeout: 1089 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.088679:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429291.088683:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429291.088691:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.088702:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.088739:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429291.088897:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648341376:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429291.088982:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce480 going to sleep for 11 seconds 00000100:00100000:1.0:1789429291.095038:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.095156:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634981120 00000100:00100000:2.0:1789429291.095165:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634981120 00002000:00100000:2.0:1789429291.095243:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946e10308e00 x1876351634981120/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/0 e 0 to 0 dl 1789429302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429291.095255:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10308e00 with x1876351634981120 ext(0->4095) 00002000:00010000:2.0:1789429291.095261:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e10308e00 00000100:00100000:2.0:1789429291.095285:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11483 00000100:00100000:2.0:1789429291.095294:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634981120:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429291.095486:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648341376:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429291.095507:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429291.095552:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634980992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6960us (9205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429291.095561:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6165 00000100:00100000:2.0:1789429291.096252:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351634981120:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 956us (1220us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429291.096261:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11483 00002000:00100000:2.0:1789429291.096268:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946e10308e00 x1876351634981120/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/4536 e 0 to 0 dl 1789429302 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429291.096279:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10308e00 with x1876351634981120 ext(0->4095) 00002000:00010000:2.0:1789429291.096283:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e10308e00 00000100:00100000:1.0:1789429291.107817:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.108049:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634981248 00000100:00100000:2.0:1789429291.108060:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634981248 00000100:00100000:2.0:1789429291.108128:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5742 00000100:00100000:2.0:1789429291.108139:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:33927:x1876351634981248:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429291.108155:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429291.108172:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2d9 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.108716:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.108727:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429291.108731:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789429291.108737:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 10 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.108831:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.108845:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 6 pid: 20986 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429291.108859:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648341504:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429291.108998:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f29ee46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429291.130739:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8085:1876351648341504:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429291.130781:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 10 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.130802:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547200, rc 0) 00000100:00100000:2.0:1789429291.130852:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:33927:x1876351634981248:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 22716us (23046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429291.130862:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5742 00000100:00100000:2.0:1789429291.140818:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429291.140920:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634981376 00000100:00100000:1.0:1789429291.140930:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634981376 00002000:00100000:1.0:1789429291.140976:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946f415c5880 x1876351634981376/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 4584/0 e 0 to 0 dl 1789429302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429291.140989:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c5880 with x1876351634981376 ext(0->4095) 00010000:00010000:1.0:1789429291.140999:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 7 pid: 20986 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.141016:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 7 pid: 20986 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429291.141024:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c5880 00000100:00100000:1.0:1789429291.141057:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1400 00000100:00100000:1.0:1789429291.141068:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351634981376:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1789429291.142418:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351634981376:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 1345us (1602us total) trans 4294969581 rc 0/0 00000100:00100000:1.0:1789429291.142428:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1400 00002000:00100000:1.0:1789429291.142437:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946f415c5880 x1876351634981376/t4294969581(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 4584/448 e 0 to 0 dl 1789429302 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429291.142446:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c5880 with x1876351634981376 ext(0->4095) 00010000:00010000:1.0:1789429291.142454:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 9 pid: 20986 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.142471:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 9 pid: 20986 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429291.142479:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f415c5880 00000100:00100000:1.0:1789429291.156101:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429291.158897:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634981504 00000100:00100000:0.0:1789429291.158913:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634981504 00010000:00010000:0.0:1789429291.158962:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 9 pid: 20986 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429291.159018:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6166 00000100:00100000:0.0:1789429291.159028:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634981504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429291.159042:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429291.159064:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 9 pid: 20986 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.159079:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 9 pid: 20986 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.159114:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012f1099e/0xb4c3dad7263608a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d2 expref: 9 pid: 20986 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.159131:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789429291.159135:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789429291.159144:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 9 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.159155:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 9 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.159194:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 9 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429291.159264:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648341632:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429291.159367:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0efce480 going to sleep for 11 seconds 00000100:00100000:0.0:1789429291.163863:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648341632:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429291.163890:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429291.163945:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634981504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4917us (7859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429291.163956:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6166 00000100:00100000:3.0:1789429291.171668:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.175029:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634981632 00000100:00100000:2.0:1789429291.175044:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634981632 00002000:00100000:2.0:1789429291.175137:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946f3f1c5f80 x1876351634981632/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:27/0 lens 488/0 e 0 to 0 dl 1789429302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429291.175161:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5f80 with x1876351634981632 ext(0->4095) 00002000:00010000:2.0:1789429291.175168:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c5f80 00000100:00100000:2.0:1789429291.175228:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11484 00000100:00100000:2.0:1789429291.175239:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634981632:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:2.0:1789429291.175498:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634981632:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 249us (3827us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429291.175507:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11484 00002000:00100000:2.0:1789429291.175515:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946f3f1c5f80 x1876351634981632/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:27/0 lens 488/4536 e 0 to 0 dl 1789429302 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1789429291.175918:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5f80 with x1876351634981632 ext(0->4095) 00002000:00010000:2.0:1789429291.175940:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f1c5f80 00000100:00100000:2.0:1789429291.200630:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.200676:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634981760 00000100:00100000:2.0:1789429291.200685:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634981760 00000100:00100000:2.0:1789429291.200732:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5743 00000100:00100000:2.0:1789429291.200742:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:33927:x1876351634981760:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429291.200760:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429291.200777:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2e0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.200806:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 9 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.200814:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789429291.200818:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1789429291.200823:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 9 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.208320:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 9 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.208356:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 9 pid: 8085 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429291.208374:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648341760:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429291.208459:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f29ee46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429291.215130:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648341760:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429291.215161:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 9 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.215180:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546a00, rc 0) 00000100:00100000:3.0:1789429291.215242:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c08e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+9:33927:x1876351634981760:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 14501us (14620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429291.215251:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5743 00000100:00100000:1.0:1789429291.218507:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429291.220298:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634981888 00000100:00100000:3.0:1789429291.220313:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634981888 00002000:00100000:3.0:1789429291.220376:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946f29da9180 x1876351634981888/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:27/0 lens 4584/0 e 0 to 0 dl 1789429302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429291.220389:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da9180 with x1876351634981888 ext(0->4095) 00010000:00010000:3.0:1789429291.220399:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 10 pid: 8085 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.220427:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 10 pid: 8085 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429291.220435:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29da9180 00000100:00100000:3.0:1789429291.220466:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1401 00000100:00100000:3.0:1789429291.220476:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634981888:12345-192.168.203.39@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1789429291.225174:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634981888:12345-192.168.203.39@tcp:4:ldlm_bl.0 Request processed in 4690us (6666us total) trans 4294969582 rc 0/0 00000100:00100000:3.0:1789429291.225189:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1401 00002000:00100000:3.0:1789429291.225739:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946f29da9180 x1876351634981888/t4294969582(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:27/0 lens 4584/448 e 0 to 0 dl 1789429302 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:3.0:1789429291.225752:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da9180 with x1876351634981888 ext(0->4095) 00010000:00010000:3.0:1789429291.225763:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 12 pid: 8085 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.225782:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 12 pid: 8085 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429291.225791:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946f29da9180 00010000:00010000:3.0:1789429291.239991:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429291.240057:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429291.240106:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634982016 00000100:00100000:3.0:1789429291.240116:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634982016 00010000:00010000:3.0:1789429291.240152:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 12 pid: 8085 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429291.240187:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6167 00000100:00100000:3.0:1789429291.240197:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351634982016:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429291.240228:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429291.240248:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 12 pid: 8085 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.240262:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 12 pid: 8085 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.240283:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001af919e1/0xb4c3dad7263608b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2d9 expref: 12 pid: 8085 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.240299:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1789429291.240303:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1789429291.240310:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.240320:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.240356:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429291.240376:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648341888:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429291.240448:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f2bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429291.244178:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429291.245266:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5824:1876351648341888:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429291.245292:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429291.245340:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2370:x1876351634982016:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5145us (5289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429291.245351:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6167 00000001:00080000:2.0:1789429291.246156:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977084 is committed 00000001:00080000:2.0:1789429291.246167:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977081 is committed 00000004:00080000:2.0:1789429291.246178:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 36 committed 00000001:00080000:2.0:1789429291.246190:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977093 is committed 00000004:00080000:2.0:1789429291.246226:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 37 committed 00000001:00080000:2.0:1789429291.246247:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977095 is committed 00000001:00080000:2.0:1789429291.246252:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977094 is committed 00000004:00080000:2.0:1789429291.246256:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 30 committed 00000100:00100000:2.0:1789429291.247494:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648342144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789429291.247569:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429291.247617:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789429291.247624:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648342016:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789429291.247645:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429291.247683:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648342144 00000100:00100000:2.0:1789429291.247690:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648342144 00000100:00100000:2.0:1789429291.247729:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648342016 00000100:00100000:2.0:1789429291.247732:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648342016 00000100:00100000:2.0:1789429291.247877:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5744 00000100:00100000:2.0:1789429291.247887:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648342144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789429291.247921:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:44 count 1 00002000:00010000:2.0:1789429291.247955:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 409600, mtime: 0x6aa88629, atime: 0x6aa88626, ctime: 0x6aa88629, blocks: 0x403 00010000:00010000:2.0:1789429291.247963:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263608be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.247978:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=989s v=(0 0) 00010000:00010000:2.0:1789429291.247983:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429291.247990:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263608be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.248004:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263608be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.248013:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263608be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.248020:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263608be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.248039:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789429291.248631:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1876351648342144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 744us (1061us total) trans 4294969583 rc 0/0 00000100:00100000:2.0:1789429291.248639:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5744 00000100:00100000:2.0:1789429291.248658:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5745 00000100:00100000:2.0:1789429291.248664:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648342016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789429291.248681:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:43 count 1 00002000:00010000:2.0:1789429291.248699:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 409600, mtime: 0x6aa88624, atime: 0x6aa8861a, ctime: 0x6aa88624, blocks: 0x407 00010000:00010000:2.0:1789429291.248705:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263608c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.248716:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=989s v=(0 0) 00010000:00010000:2.0:1789429291.248719:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429291.248724:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263608c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.248733:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263608c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.248740:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263608c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.248748:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263608c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.248763:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1789429291.249159:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1876351648342016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 494us (1511us total) trans 4294969584 rc 0/0 00000100:00100000:2.0:1789429291.249165:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5745 00000100:00100000:0.0:1789429291.249320:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634982144 00000100:00100000:0.0:1789429291.249326:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634982144 00002000:00100000:0.0:1789429291.249356:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946f2f093480 x1876351634982144/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/0 e 0 to 0 dl 1789429302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429291.249366:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093480 with x1876351634982144 ext(0->4095) 00002000:00010000:0.0:1789429291.249372:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f093480 00000100:00100000:0.0:1789429291.249392:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11485 00000100:00100000:0.0:1789429291.249400:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634982144:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:0.0:1789429291.249540:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634982144:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 140us (5369us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429291.249547:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11485 00002000:00100000:0.0:1789429291.249553:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_015: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946f2f093480 x1876351634982144/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/4536 e 0 to 0 dl 1789429302 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1789429291.249562:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093480 with x1876351634982144 ext(0->4095) 00002000:00010000:0.0:1789429291.249565:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f093480 00000100:00100000:0.0:1789429291.249589:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648342272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789429291.249626:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429291.250134:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648342272 00000100:00100000:3.0:1789429291.250141:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648342272 00000100:00100000:3.0:1789429291.250174:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5746 00000100:00100000:3.0:1789429291.250182:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648342272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789429291.250197:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:45 count 1 00002000:00010000:3.0:1789429291.250241:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 409600, mtime: 0x6aa88629, atime: 0x0, ctime: 0x6aa88629, blocks: 0x403 00010000:00010000:3.0:1789429291.250248:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003343eb9d/0xb4c3dad7263608cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.250262:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=989s v=(0 0) 00010000:00010000:3.0:1789429291.250266:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429291.250271:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003343eb9d/0xb4c3dad7263608cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.250285:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003343eb9d/0xb4c3dad7263608cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.250293:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003343eb9d/0xb4c3dad7263608cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.250301:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003343eb9d/0xb4c3dad7263608cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.250316:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1789429291.250779:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648342272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 598us (1151us total) trans 4294969249 rc 0/0 00000100:00100000:3.0:1789429291.250787:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5746 00000004:00080000:0.0:1789429291.252480:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f3fbcd880/2, rc 0, transno 4294969249 00000100:00100000:0.0:1789429291.252503:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648342272:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789429291.252862:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789429291.252871:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263608be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.252890:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547800 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429291.252894:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263608be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.252905:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263608be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.252934:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263608be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.252942:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d830d2/0xb4c3dad7263608be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.252964:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789429291.252967:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263608c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.252974:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547000 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429291.252977:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263608c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.252984:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263608c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.252993:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263608c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.253000:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad7263608c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.253012:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789429291.253016:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003343eb9d/0xb4c3dad7263608cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.253023:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1600 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429291.253026:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003343eb9d/0xb4c3dad7263608cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.253033:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003343eb9d/0xb4c3dad7263608cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.253043:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003343eb9d/0xb4c3dad7263608cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.253050:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003343eb9d/0xb4c3dad7263608cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.253063:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429291.253064:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429291.253066:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429291.253228:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789429291.253261:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f415c4000/2, rc 0, transno 4294969584 00000100:00100000:2.0:1789429291.253268:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648342016:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1789429291.253279:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f415c7800/2, rc 0, transno 4294969583 00000100:00100000:2.0:1789429291.253282:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648342144:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789429291.255220:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000001:00080000:2.0:1789429291.255637:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969245 is committed 00000001:00080000:2.0:1789429291.255661:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969248 is committed 00000001:00080000:2.0:1789429291.255667:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969247 is committed 00000100:00100000:3.0:1789429291.255994:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634982272 00000100:00100000:3.0:1789429291.256003:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634982272 00000100:00100000:3.0:1789429291.256056:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5747 00000100:00100000:3.0:1789429291.256067:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:33927:x1876351634982272:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429291.256154:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429291.256173:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263608d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2e7 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.256220:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.256230:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1789429291.256234:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(3 0) 00010000:00010000:3.0:1789429291.256239:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263608d3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e7 expref: 12 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.256274:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.256287:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 8 pid: 13238 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429291.256305:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f091180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648342400:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429291.256378:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f2bd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429291.258756:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f091180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648342400:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429291.258788:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263608d3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e7 expref: 12 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.258808:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:3.0:1789429291.258853:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:33927:x1876351634982272:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2788us (3659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429291.258862:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5747 00000100:00100000:3.0:1789429291.261900:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.262054:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634982400 00000100:00100000:2.0:1789429291.262062:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634982400 00010000:00010000:2.0:1789429291.262118:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 9 pid: 13238 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429291.262151:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6168 00000100:00100000:2.0:1789429291.262160:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351634982400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429291.262174:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429291.262196:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 9 pid: 13238 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.262236:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 9 pid: 13238 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.262258:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f11bd92c/0xb4c3dad7263608b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e0 expref: 9 pid: 13238 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.262275:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1789429291.262279:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(3 0) 00010000:00010000:2.0:1789429291.262287:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263608d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e7 expref: 11 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.262297:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263608d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e7 expref: 11 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.262332:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263608d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e7 expref: 11 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429291.262346:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648342528:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429291.262427:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f12143a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429291.265182:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648342528:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429291.265236:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429291.265291:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351634982400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3131us (3399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429291.265303:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6168 00000100:00100000:3.0:1789429291.267186:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429291.267399:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634982528 00000100:00100000:1.0:1789429291.267408:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634982528 00002000:00100000:1.0:1789429291.267455:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946f2f092300 x1876351634982528/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:27/0 lens 488/0 e 0 to 0 dl 1789429302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429291.267466:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092300 with x1876351634982528 ext(0->4095) 00002000:00010000:1.0:1789429291.267471:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f092300 00000100:00100000:1.0:1789429291.267500:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11486 00000100:00100000:1.0:1789429291.267510:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634982528:12345-192.168.203.39@tcp:3:kworker.0 00000100:00100000:1.0:1789429291.267707:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351634982528:12345-192.168.203.39@tcp:3:kworker.0 Request processed in 198us (527us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429291.267716:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11486 00002000:00100000:1.0:1789429291.267724:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x2d:0x0] (0->4095) req@ffff946f2f092300 x1876351634982528/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:27/0 lens 488/4536 e 0 to 0 dl 1789429302 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:1.0:1789429291.267733:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092300 with x1876351634982528 ext(0->4095) 00002000:00010000:1.0:1789429291.267736:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f092300 00000100:00100000:3.0:1789429291.271869:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429291.271979:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634982784 00000100:00100000:1.0:1789429291.271992:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634982784 00000100:00100000:1.0:1789429291.272053:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 239 00000100:00100000:1.0:1789429291.272064:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:33927:x1876351634982784:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789429291.272392:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:33927:x1876351634982784:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 329us (534us total) trans 4294977096 rc 0/0 00000100:00100000:1.0:1789429291.272401:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 239 00000100:00100000:3.0:1789429291.275469:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.275871:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634983040 00000100:00100000:2.0:1789429291.275882:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634983040 00000100:00100000:2.0:1789429291.276043:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 240 00000100:00100000:2.0:1789429291.276054:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05b60850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+40:33927:x1876351634983040:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1789429291.277303:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05b60850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+41:33927:x1876351634983040:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 1246us (1848us total) trans 4294977097 rc 0/0 00000100:00100000:3.0:1789429291.277315:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 240 00000100:00100000:2.0:1789429291.280025:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429291.280394:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634983168 00000100:00100000:1.0:1789429291.280404:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634983168 00000100:00100000:1.0:1789429291.280571:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21097 00000100:00100000:1.0:1789429291.280584:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+41:33927:x1876351634983168:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1789429291.280608:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429291.280628:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad7263608da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.280690:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad7263608e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.280704:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad7263608e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.280716:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad7263608e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429291.280748:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429291.280752:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429291.280770:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad7263608e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.280792:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad7263608da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2ee expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.280809:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad7263608e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2ee expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.280817:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fde00) 00010000:00010000:1.0:1789429291.280820:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429291.280824:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6400, rc 0) 00000100:00100000:1.0:1789429291.280883:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634983168:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 302us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429291.283730:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429291.283820:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634983296 00000100:00100000:3.0:1789429291.283830:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634983296 00000100:00100000:1.0:1789429291.284485:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21097 00000100:00100000:3.0:1789429291.284888:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21098 00000100:00100000:3.0:1789429291.284901:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634983296:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429291.284931:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429291.284952:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263608e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2f5 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285016:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263608ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285030:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263608ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285042:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263608ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285056:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263608f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285063:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263608f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285070:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263608f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285599:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad7263608fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x70:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285609:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad7263608fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285616:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad7263608fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429291.285648:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x70:0x0]: returning size 4096 00000004:00200000:3.0:1789429291.285652:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429291.285670:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad7263608fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285685:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad7263608fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285693:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263608ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285701:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263608ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285709:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263608ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285716:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429291.285720:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263608ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285727:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263608ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285739:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fde00) 00010000:00010000:3.0:1789429291.285743:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429291.285748:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263608ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285753:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263608ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285768:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263608f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285774:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263608f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285780:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263608f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285785:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429291.285788:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263608f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285793:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263608f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285801:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdddd5b93 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429291.285803:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429291.285806:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263608f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285811:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263608f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285841:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263608e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2f5 expref: 44 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285853:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad7263608fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2f5 expref: 43 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.285860:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70:0x0].0x0 (ffff946f2076ae00) 00010000:00010000:3.0:1789429291.285862:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429291.285864:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1e00, rc 0) 00000100:00100000:3.0:1789429291.285996:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+43:33927:x1876351634983296:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 1099us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429291.286008:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21098 00000100:00100000:0.0:1789429291.289821:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429291.290153:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634983552 00000100:00100000:1.0:1789429291.290163:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634983552 00000100:00100000:1.0:1789429291.290285:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21099 00000100:00100000:1.0:1789429291.290296:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+43:33927:x1876351634983552:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1789429291.290352:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789429291.290378:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad7263608fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2f5 expref: 43 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.290399:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360855 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x70:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2a8 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.290410:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70:0x0].0x0 (ffff946f2076ae00) 00010000:00010000:1.0:1789429291.290419:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad7263608e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2ee expref: 41 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.290427:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fde00) 00010000:00010000:1.0:1789429291.290430:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429291.290450:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.290474:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2b6 expref: 16 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.290483:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.290516:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2b6 expref: 16 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.290530:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2b6 expref: 16 pid: 15700 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429291.290544:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29da8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1876351648342656:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429291.290614:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429291.293712:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429291.293779:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634983680 00000100:00100000:3.0:1789429291.293787:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634983680 00010000:00010000:3.0:1789429291.293822:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2b6 expref: 17 pid: 15700 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429291.293852:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6169 00000100:00100000:3.0:1789429291.293859:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634983680:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429291.293871:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429291.293875:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2b6 expref: 17 pid: 15700 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.293884:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2b6 expref: 17 pid: 15700 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.293900:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fde00) 00010000:00010000:3.0:1789429291.293905:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.293918:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.293926:0:11354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429291.293944:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429291.294033:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351634983680:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 174us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429291.294044:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6169 00010000:00010000:1.0:1789429291.294324:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad72636086a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2b6 expref: 16 pid: 15700 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429291.294340:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29da8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1876351648342656:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429291.294357:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.294366:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.294371:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.294393:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636090b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.294403:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636090b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.294411:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636090b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.294719:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x70:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.294731:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360886 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2bd expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.294740:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.294770:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2bd expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.294786:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2bd expref: 15 pid: 5839 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429291.294799:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29da8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1876351648342784:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429291.294855:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c0830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429291.301961:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.302029:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634983808 00000100:00100000:2.0:1789429291.302038:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634983808 00010000:00010000:2.0:1789429291.302085:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360886 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2bd expref: 16 pid: 5839 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429291.302138:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6170 00000100:00100000:2.0:1789429291.302147:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634983808:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429291.302161:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429291.302168:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360886 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2bd expref: 16 pid: 5839 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.302180:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2bd expref: 16 pid: 5839 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.302228:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70:0x0].0x0 (ffff946f2076ae00) 00010000:00010000:2.0:1789429291.302235:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.302244:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.302252:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.302270:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429291.302317:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351634983808:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 171us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429291.302325:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6170 00010000:00010000:1.0:1789429291.302496:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2bd expref: 15 pid: 5839 timeout: 1089 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429291.302512:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29da8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1876351648342784:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429291.302531:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.302539:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.302545:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789429291.303485:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].25, 64 off9792 00010000:00010000:1.0:1789429291.303555:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360919 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x70:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303568:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303579:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303588:0:6704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360919 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303593:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360919 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303599:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360919 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303618:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789429291.303637:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303644:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303649:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303655:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429291.303660:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303667:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303677:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70:0x0].0x0 (ffff946f2076ae00) 00010000:00010000:1.0:1789429291.303680:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789429291.303684:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303690:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360912 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x70:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303707:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303713:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303718:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303722:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429291.303725:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303729:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303736:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fde00) 00010000:00010000:1.0:1789429291.303738:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429291.303741:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429291.303749:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360904 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429291.303764:0:6704:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b7ae1542 reply state 0000000091b5f2f1 transno 4294977098 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636090b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429291.303772:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429291.303829:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634983552:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 13533us (14015us total) trans 4294977098 rc 0/0 00000100:00100000:1.0:1789429291.303837:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21099 00010000:00010000:2.0:1789429291.304072:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789429291.304080:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360919 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.304102:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7000 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429291.304106:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360919 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.304112:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360919 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x70:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.304121:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70:0x0].0x0 (ffff946f2076ae00) 00010000:00010000:2.0:1789429291.304124:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789429291.304127:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360919 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x70:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.304133:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360919 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x70:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.304146:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429291.304148:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429291.304149:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429291.310309:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636090b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.310327:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636090b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.310335:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636090b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.310345:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429291.310350:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636090b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.310358:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636090b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.310373:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdddd5b93 (ffff946f2076a700) 00010000:00010000:0.0:1789429291.310377:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429291.310381:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636090b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.310387:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad72636090b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429291.313287:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.313409:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634983936 00000100:00100000:2.0:1789429291.313420:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634983936 00000100:00100000:2.0:1789429291.313485:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21100 00000100:00100000:2.0:1789429291.313495:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+41:33927:x1876351634983936:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1789429291.313519:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429291.313539:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360920 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c2fc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.313595:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360927 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.313612:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.313623:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429291.313658:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429291.313662:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429291.313680:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.313704:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360920 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2fc expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.313720:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360927 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2fc expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.313727:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef200) 00010000:00010000:2.0:1789429291.313730:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429291.313734:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547600, rc 0) 00000100:00100000:2.0:1789429291.313797:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634983936:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 304us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429291.313805:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21100 00000100:00100000:2.0:1789429291.317069:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429291.317149:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634984192 00000100:00100000:0.0:1789429291.317160:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634984192 00000100:00100000:0.0:1789429291.317260:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21101 00000100:00100000:0.0:1789429291.317270:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+42:33927:x1876351634984192:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429291.317290:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429291.317293:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789429291.317318:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360927 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2fc expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.317335:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef200) 00010000:00010000:0.0:1789429291.317345:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429291.317359:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad72636092e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c303 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.317464:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360935 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.317477:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360935 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.317487:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360935 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.317538:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636093c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.317547:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636093c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.317554:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636093c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789429291.318107:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f:0x0], index 0: 0 00010000:00010000:0.0:1789429291.318293:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360943 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x71:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.318303:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x71:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.318312:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360943 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x71:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.318345:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360935 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.318357:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360935 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.318363:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360935 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.318368:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429291.318372:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360935 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.318378:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360935 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.318388:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429291.318391:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429291.318396:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360935 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.318402:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360935 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429291.318412:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000014cab56c reply state 00000000647fdd1a transno 4294977099 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636093c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429291.318421:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789429291.318447:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad72636092e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c303 expref: 44 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.318465:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360943 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x71:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c303 expref: 43 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.318478:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71:0x0].0x0 (ffff946f120fd600) 00010000:00010000:0.0:1789429291.318480:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429291.318483:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429291.318549:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+44:33927:x1876351634984192:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 1280us (1489us total) trans 4294977099 rc 0/0 00000100:00100000:0.0:1789429291.318557:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21101 00010000:00010000:2.0:1789429291.320720:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636093c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.320737:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636093c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.320746:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636093c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.320752:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429291.320757:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636093c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.320766:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636093c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.320782:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5e55773a (ffff946f120fdd00) 00010000:00010000:2.0:1789429291.320785:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429291.320790:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636093c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429291.320796:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636093c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429291.326370:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429291.326598:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634984320 00000100:00100000:0.0:1789429291.326609:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634984320 00000100:00100000:0.0:1789429291.326667:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5748 00000100:00100000:0.0:1789429291.326677:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:33927:x1876351634984320:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429291.326695:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429291.326717:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000050ec1c3/0xb4c3dad726360951 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c30a expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429291.326746:0:8085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789429291.326770:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=989s v=(0 0) 00010000:00010000:0.0:1789429291.326775:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429291.326785:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050ec1c3/0xb4c3dad726360951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c30a expref: 6 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.326802:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000050ec1c3/0xb4c3dad726360951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c30a expref: 6 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429291.326816:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad000, rc 0) 00000100:00100000:0.0:1789429291.326879:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:33927:x1876351634984320:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 201us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429291.326889:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5748 00000100:00100000:3.0:1789429291.430467:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429291.430562:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634984448 00000100:00100000:2.0:1789429291.430572:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634984448 00002000:00100000:2.0:1789429291.430617:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2f:0x0] (0->1048575) req@ffff946f2f091880 x1876351634984448/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/0 e 0 to 0 dl 1789429302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429291.430629:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091880 with x1876351634984448 ext(0->1048575) 00002000:00010000:2.0:1789429291.430635:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f091880 00000100:00100000:2.0:1789429291.430665:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11487 00000100:00100000:2.0:1789429291.430674:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351634984448:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:2.0:1789429291.455849:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634984448:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 25150us (25366us total) trans 4294969250 rc 0/0 00000100:00100000:2.0:1789429291.455865:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11487 00002000:00100000:2.0:1789429291.455891:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2f:0x0] (0->1048575) req@ffff946f2f091880 x1876351634984448/t4294969250(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/448 e 0 to 0 dl 1789429302 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429291.455912:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091880 with x1876351634984448 ext(0->1048575) 00002000:00010000:2.0:1789429291.455919:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f091880 00000100:00100000:3.0:1789429291.577041:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429291.577121:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634984576 00000100:00100000:1.0:1789429291.577131:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634984576 00002000:00100000:1.0:1789429291.577181:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x2f:0x0] (1048576->2097151) req@ffff946f2f091180 x1876351634984576/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/0 e 0 to 0 dl 1789429302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429291.577194:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091180 with x1876351634984576 ext(1048576->2097151) 00002000:00010000:1.0:1789429291.577237:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f091180 00000100:00100000:1.0:1789429291.577272:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11488 00000100:00100000:1.0:1789429291.577282:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+8:2369:x1876351634984576:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:1.0:1789429291.611407:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+10:2369:x1876351634984576:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 34114us (34362us total) trans 4294969251 rc 0/0 00000100:00100000:1.0:1789429291.611423:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11488 00002000:00100000:1.0:1789429291.611437:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x2f:0x0] (1048576->2097151) req@ffff946f2f091180 x1876351634984576/t4294969251(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/448 e 0 to 0 dl 1789429302 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429291.611449:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091180 with x1876351634984576 ext(1048576->2097151) 00002000:00010000:1.0:1789429291.611456:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f091180 00000100:00100000:3.0:1789429291.755683:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429291.756265:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634984704 00000100:00100000:1.0:1789429291.756276:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634984704 00002000:00100000:1.0:1789429291.756324:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2f:0x0] (2097152->3145727) req@ffff946f3407a680 x1876351634984704/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/0 e 0 to 0 dl 1789429302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429291.756336:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407a680 with x1876351634984704 ext(2097152->3145727) 00002000:00010000:1.0:1789429291.756342:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3407a680 00000100:00100000:1.0:1789429291.756376:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11489 00000100:00100000:1.0:1789429291.756386:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+10:2369:x1876351634984704:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:1.0:1789429291.791452:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:2369:x1876351634984704:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 35055us (35766us total) trans 4294969252 rc 0/0 00000100:00100000:1.0:1789429291.791467:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11489 00002000:00100000:1.0:1789429291.791480:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2f:0x0] (2097152->3145727) req@ffff946f3407a680 x1876351634984704/t4294969252(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/448 e 0 to 0 dl 1789429302 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429291.791491:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407a680 with x1876351634984704 ext(2097152->3145727) 00002000:00010000:1.0:1789429291.791497:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3407a680 00000100:00100000:0.0:1789429291.881684:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429291.881766:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634984832 00000100:00100000:3.0:1789429291.881776:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634984832 00002000:00100000:3.0:1789429291.881826:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2f:0x0] (3145728->4194303) req@ffff946f3fbcea00 x1876351634984832/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/0 e 0 to 0 dl 1789429302 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429291.881849:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcea00 with x1876351634984832 ext(3145728->4194303) 00002000:00010000:3.0:1789429291.881856:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3fbcea00 00000100:00100000:3.0:1789429291.881885:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11490 00000100:00100000:3.0:1789429291.881895:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+12:2369:x1876351634984832:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:2.0:1789429291.958132:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+14:2369:x1876351634984832:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 76226us (76446us total) trans 4294969253 rc 0/0 00000100:00100000:2.0:1789429291.958146:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11490 00002000:00100000:2.0:1789429291.958161:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2f:0x0] (3145728->4194303) req@ffff946f3fbcea00 x1876351634984832/t4294969253(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:27/0 lens 488/448 e 0 to 0 dl 1789429302 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429291.958171:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcea00 with x1876351634984832 ext(3145728->4194303) 00002000:00010000:2.0:1789429291.958177:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3fbcea00 00000100:00100000:0.0:1789429292.050734:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429292.050821:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634984960 00000100:00100000:2.0:1789429292.050831:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634984960 00002000:00100000:2.0:1789429292.050895:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2f:0x0] (4194304->5242879) req@ffff946f3fbcf800 x1876351634984960/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:28/0 lens 488/0 e 0 to 0 dl 1789429303 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429292.050907:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcf800 with x1876351634984960 ext(4194304->5242879) 00002000:00010000:2.0:1789429292.050921:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3fbcf800 00000100:00100000:2.0:1789429292.050954:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11491 00000100:00100000:2.0:1789429292.050964:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351634984960:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00080000:1.0:1789429292.051226:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429292.058966:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634984960:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 7993us (8230us total) trans 4294969254 rc 0/0 00000100:00100000:3.0:1789429292.058981:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11491 00002000:00100000:3.0:1789429292.058995:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2f:0x0] (4194304->5242879) req@ffff946f3fbcf800 x1876351634984960/t4294969254(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:28/0 lens 488/448 e 0 to 0 dl 1789429303 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429292.059006:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcf800 with x1876351634984960 ext(4194304->5242879) 00002000:00010000:3.0:1789429292.059012:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3fbcf800 00000100:00100000:0.0:1789429292.223584:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429292.223704:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634985088 00000100:00100000:3.0:1789429292.223714:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634985088 00002000:00100000:3.0:1789429292.223763:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2f:0x0] (5242880->6291455) req@ffff946f3fbcce00 x1876351634985088/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:28/0 lens 488/0 e 0 to 0 dl 1789429303 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429292.223774:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcce00 with x1876351634985088 ext(5242880->6291455) 00002000:00010000:3.0:1789429292.223781:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3fbcce00 00000100:00100000:3.0:1789429292.223817:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11492 00000100:00100000:3.0:1789429292.223827:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351634985088:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:2.0:1789429292.257099:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351634985088:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 33256us (33507us total) trans 4294969255 rc 0/0 00000100:00100000:2.0:1789429292.257114:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11492 00002000:00100000:2.0:1789429292.257127:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x2f:0x0] (5242880->6291455) req@ffff946f3fbcce00 x1876351634985088/t4294969255(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:28/0 lens 488/448 e 0 to 0 dl 1789429303 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429292.257138:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcce00 with x1876351634985088 ext(5242880->6291455) 00002000:00010000:2.0:1789429292.257153:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3fbcce00 00010000:00010000:2.0:1789429292.259724:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429292.436273:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429292.436366:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634985216 00000100:00100000:0.0:1789429292.436377:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634985216 00002000:00100000:0.0:1789429292.436427:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x2f:0x0] (6291456->7340031) req@ffff946f415c4380 x1876351634985216/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:28/0 lens 488/0 e 0 to 0 dl 1789429303 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429292.436439:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4380 with x1876351634985216 ext(6291456->7340031) 00002000:00010000:0.0:1789429292.436445:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f415c4380 00000100:00100000:0.0:1789429292.436476:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11493 00000100:00100000:0.0:1789429292.436485:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351634985216:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:1.0:1789429292.453576:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351634985216:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 17083us (17303us total) trans 4294969256 rc 0/0 00000100:00100000:1.0:1789429292.453590:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11493 00002000:00100000:1.0:1789429292.453602:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x2f:0x0] (6291456->7340031) req@ffff946f415c4380 x1876351634985216/t4294969256(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:28/0 lens 488/448 e 0 to 0 dl 1789429303 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429292.453613:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4380 with x1876351634985216 ext(6291456->7340031) 00002000:00010000:1.0:1789429292.453619:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f415c4380 00000100:00100000:2.0:1789429292.628655:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429292.628695:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429292.628783:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634985344 00000100:00100000:1.0:1789429292.628794:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634985344 00002000:00100000:1.0:1789429292.628841:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2f:0x0] (7340032->8388607) req@ffff946f054d7800 x1876351634985344/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:28/0 lens 488/0 e 0 to 0 dl 1789429303 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429292.628852:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d7800 with x1876351634985344 ext(7340032->8388607) 00002000:00010000:1.0:1789429292.628858:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d7800 00000100:00100000:1.0:1789429292.628889:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11494 00000100:00100000:1.0:1789429292.628898:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+20:2369:x1876351634985344:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:3.0:1789429292.629287:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634985600 00000100:00100000:3.0:1789429292.629292:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634985600 00000100:00100000:3.0:1789429292.629330:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 241 00000100:00100000:3.0:1789429292.629339:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+43:33927:x1876351634985600:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000001:00080000:3.0:1789429292.629586:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977100 00000100:00100000:3.0:1789429292.629683:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+45:33927:x1876351634985600:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 344us (1036us total) trans 4294977101 rc 0/0 00000100:00100000:3.0:1789429292.629690:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 241 00000020:00080000:3.0:1789429292.629696:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789429292.640774:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351634985344:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 11867us (12067us total) trans 4294969257 rc 0/0 00000100:00100000:1.0:1789429292.640787:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11494 00002000:00100000:1.0:1789429292.640799:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x2f:0x0] (7340032->8388607) req@ffff946f054d7800 x1876351634985344/t4294969257(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:28/0 lens 488/448 e 0 to 0 dl 1789429303 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429292.640809:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d7800 with x1876351634985344 ext(7340032->8388607) 00002000:00010000:1.0:1789429292.640815:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d7800 00000100:00100000:0.0:1789429292.649808:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429292.649886:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634985728 00000100:00100000:3.0:1789429292.649910:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634985728 00000100:00100000:3.0:1789429292.650005:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21102 00000100:00100000:3.0:1789429292.650015:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+45:33927:x1876351634985728:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429292.650039:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429292.650060:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360958 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c311 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.650131:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636095f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.650155:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636095f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.650167:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636095f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429292.650249:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429292.650253:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429292.650272:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636095f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.650297:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c311 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.650316:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636095f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c311 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.650324:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429292.650326:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429292.650329:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:3.0:1789429292.650388:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+46:33927:x1876351634985728:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 375us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429292.650394:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21102 00000100:00100000:2.0:1789429292.659646:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429292.659740:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634985984 00000100:00100000:3.0:1789429292.659750:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634985984 00000100:00100000:3.0:1789429292.659809:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21103 00000100:00100000:3.0:1789429292.659823:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+46:33927:x1876351634985984:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429292.659846:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429292.659866:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c318 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.659971:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad72636096d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x71:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.659986:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad72636096d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x71:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.659997:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad72636096d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x71:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429292.660018:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x71:0x0]: returning size 8388608 00010000:00010000:3.0:1789429292.660149:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c318 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.660167:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad72636096d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x71:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c318 expref: 48 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.660176:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71:0x0].0x0 (ffff946f120fd600) 00010000:00010000:3.0:1789429292.660179:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789429292.660182:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0800, rc 0) 00000100:00100000:3.0:1789429292.660270:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+48:33927:x1876351634985984:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 452us (642us total) trans 4294977102 rc 0/0 00000100:00100000:3.0:1789429292.660278:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21103 00000100:00100000:2.0:1789429292.682886:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429292.682956:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634986240 00000100:00100000:3.0:1789429292.682967:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634986240 00000100:00100000:3.0:1789429292.683037:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 242 00000100:00100000:3.0:1789429292.683047:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+48:33927:x1876351634986240:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1789429292.683333:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+49:33927:x1876351634986240:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 286us (454us total) trans 4294977103 rc 0/0 00000100:00100000:3.0:1789429292.683342:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 242 00000100:00100000:1.0:1789429292.692228:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429292.692307:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634986496 00000100:00100000:0.0:1789429292.692317:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634986496 00000100:00100000:0.0:1789429292.692374:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21104 00000100:00100000:0.0:1789429292.692384:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+49:33927:x1876351634986496:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1789429292.692438:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789429292.692476:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad72636096d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x71:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c318 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.692499:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360943 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c303 expref: 48 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.692510:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71:0x0].0x0 (ffff946f120fd600) 00010000:00010000:0.0:1789429292.692527:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636095f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c311 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.692537:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:0.0:1789429292.692543:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429292.692564:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636097b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.692576:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636097b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.692586:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636097b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.692599:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360982 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.692607:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360982 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.692614:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360982 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.692701:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360989 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x71:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.692709:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.692716:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789429292.693250:0:15700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].22, 64 off9600 00000004:00080000:0.0:1789429292.693260:0:15700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 990673058976ns, next at 991673056774ns, rc = 0 00010000:00010000:0.0:1789429292.693315:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360990 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x71:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693326:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693334:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360990 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693343:0:15700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360990 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693350:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360990 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693356:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360990 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x71:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693385:0:15700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789429292.693402:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360989 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693409:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360989 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693416:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360989 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693424:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429292.693429:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360989 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693441:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360989 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693451:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71:0x0].0x0 (ffff946f120fd100) 00010000:00010000:0.0:1789429292.693455:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789429292.693459:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360989 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693466:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360989 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x71:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693484:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636097b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693491:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636097b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693497:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636097b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693503:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2aca00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429292.693506:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636097b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693512:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636097b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693520:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429292.693522:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429292.693525:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636097b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.693536:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636097b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429292.693549:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003ed7ab6e reply state 00000000e471f45b transno 4294977104 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360982 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429292.693558:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429292.693634:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+48:33927:x1876351634986496:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 1249us (1436us total) trans 4294977104 rc 0/0 00000100:00100000:0.0:1789429292.693642:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21104 00010000:00010000:1.0:1789429292.694236:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789429292.694243:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360990 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429292.694250:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad600 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:1.0:1789429292.694254:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360990 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429292.694262:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360990 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429292.694273:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71:0x0].0x0 (ffff946f120fd100) 00010000:00010000:1.0:1789429292.694276:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789429292.694280:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360990 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429292.694285:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360990 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x71:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429292.694300:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429292.694301:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429292.694303:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429292.699249:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360982 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.699267:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360982 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.699275:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360982 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.699282:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429292.699287:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360982 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.699295:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360982 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.699311:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5e55773a (ffff946f120fdb00) 00010000:00010000:0.0:1789429292.699315:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429292.699319:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360982 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.699331:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360982 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429292.712174:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429292.712319:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634986624 00000100:00100000:0.0:1789429292.712328:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634986624 00000100:00100000:0.0:1789429292.712384:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21105 00000100:00100000:0.0:1789429292.712395:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+47:33927:x1876351634986624:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429292.712418:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429292.712439:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360997 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c31f expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.712498:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636099e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.712513:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636099e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.712523:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636099e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429292.712556:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429292.712560:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429292.712578:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636099e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.712601:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726360997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c31f expref: 49 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.712618:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636099e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c31f expref: 48 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.712628:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:0.0:1789429292.712631:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429292.712634:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429292.712693:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+48:33927:x1876351634986624:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 300us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429292.712703:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21105 00000100:00100000:2.0:1789429292.717595:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429292.717843:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634986880 00000100:00100000:3.0:1789429292.717852:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634986880 00000100:00100000:3.0:1789429292.717922:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21106 00000100:00100000:3.0:1789429292.717932:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+48:33927:x1876351634986880:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429292.717952:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429292.717955:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789429292.717981:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636099e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c31f expref: 48 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.717998:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:3.0:1789429292.718008:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429292.718022:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263609a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c326 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.718145:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad7263609ac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.718158:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad7263609ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.718168:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad7263609ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.718180:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263609b3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.718187:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263609b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.718192:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263609b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789429292.719243:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e:0x0], index 1: 0 00010000:00010000:3.0:1789429292.719408:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263609ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.719420:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263609ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.719430:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263609ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.719683:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad7263609ac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.719692:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad7263609ac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.719698:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad7263609ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.719704:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429292.719708:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad7263609ac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.719716:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad7263609ac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.719727:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:3.0:1789429292.719730:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429292.719734:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad7263609ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.719742:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad7263609ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429292.719754:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000601af87f reply state 0000000011c4c3cd transno 4294977105 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263609b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429292.719761:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789429292.719792:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263609a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c326 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.719812:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263609ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c326 expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.719820:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429292.719822:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429292.719824:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:3.0:1789429292.720061:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+50:33927:x1876351634986880:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 2129us (2474us total) trans 4294977105 rc 0/0 00000100:00100000:3.0:1789429292.720070:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21106 00000100:00100000:2.0:1789429292.728553:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429292.728625:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634987008 00000100:00100000:0.0:1789429292.728633:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634987008 00000100:00100000:0.0:1789429292.728689:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5749 00000100:00100000:0.0:1789429292.728698:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+8:33927:x1876351634987008:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429292.728714:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429292.728734:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263609c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c32d expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429292.728761:0:20986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789429292.728782:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=990s v=(0 0) 00010000:00010000:0.0:1789429292.728786:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429292.728795:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263609c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c32d expref: 9 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.728809:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263609c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c32d expref: 9 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429292.728828:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad400, rc 0) 00000100:00100000:0.0:1789429292.728888:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+9:33927:x1876351634987008:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 190us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429292.728907:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5749 00010000:00010000:3.0:1789429292.731662:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263609b3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.731680:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263609b3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.731689:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263609b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.731696:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429292.731701:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263609b3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.731710:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263609b3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.731726:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x366f449e (ffff946f04fb8300) 00010000:00010000:3.0:1789429292.731730:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429292.731735:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263609b3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429292.731742:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263609b3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429292.973124:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429292.973459:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634987136 00000100:00100000:3.0:1789429292.973480:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634987136 00002000:00100000:3.0:1789429292.973533:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2e:0x0] (0->1048575) req@ffff946f29daad80 x1876351634987136/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:28/0 lens 488/0 e 0 to 0 dl 1789429303 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429292.973545:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29daad80 with x1876351634987136 ext(0->1048575) 00002000:00010000:3.0:1789429292.973551:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29daad80 00000100:00100000:3.0:1789429292.973589:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11495 00000100:00100000:3.0:1789429292.973599:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29daad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351634987136:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:3.0:1789429293.013470:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29daad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351634987136:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 39862us (40346us total) trans 4294969585 rc 0/0 00000100:00100000:3.0:1789429293.013484:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11495 00002000:00100000:3.0:1789429293.013498:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x2e:0x0] (0->1048575) req@ffff946f29daad80 x1876351634987136/t4294969585(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:28/0 lens 488/448 e 0 to 0 dl 1789429303 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429293.013518:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29daad80 with x1876351634987136 ext(0->1048575) 00002000:00010000:3.0:1789429293.013524:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29daad80 00000100:00100000:1.0:1789429293.200497:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429293.201012:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634987264 00000100:00100000:2.0:1789429293.201024:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634987264 00002000:00100000:2.0:1789429293.201096:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2e:0x0] (1048576->2097151) req@ffff946f29dab480 x1876351634987264/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/0 e 0 to 0 dl 1789429304 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429293.201108:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29dab480 with x1876351634987264 ext(1048576->2097151) 00002000:00010000:2.0:1789429293.201114:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29dab480 00000100:00080000:1.0:1789429293.201241:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429293.202722:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11496 00000100:00100000:2.0:1789429293.202740:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351634987264:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:2.0:1789429293.221432:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+13:2370:x1876351634987264:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 18683us (20929us total) trans 4294969586 rc 0/0 00000100:00100000:2.0:1789429293.221447:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11496 00002000:00100000:2.0:1789429293.221459:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x2e:0x0] (1048576->2097151) req@ffff946f29dab480 x1876351634987264/t4294969586(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/448 e 0 to 0 dl 1789429304 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429293.221476:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29dab480 with x1876351634987264 ext(1048576->2097151) 00002000:00010000:2.0:1789429293.221482:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29dab480 00010000:00010000:2.0:1789429293.283956:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429293.407450:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429293.407561:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634987392 00000100:00100000:2.0:1789429293.407570:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634987392 00002000:00100000:2.0:1789429293.407618:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2e:0x0] (2097152->3145727) req@ffff946f29da9f80 x1876351634987392/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/0 e 0 to 0 dl 1789429304 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429293.407629:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da9f80 with x1876351634987392 ext(2097152->3145727) 00002000:00010000:2.0:1789429293.407634:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29da9f80 00000100:00100000:2.0:1789429293.407668:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11497 00000100:00100000:2.0:1789429293.407687:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+13:2369:x1876351634987392:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:1.0:1789429293.438458:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+15:2369:x1876351634987392:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 30762us (31006us total) trans 4294969587 rc 0/0 00000100:00100000:1.0:1789429293.438473:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11497 00002000:00100000:1.0:1789429293.438487:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2e:0x0] (2097152->3145727) req@ffff946f29da9f80 x1876351634987392/t4294969587(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/448 e 0 to 0 dl 1789429304 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429293.438498:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da9f80 with x1876351634987392 ext(2097152->3145727) 00002000:00010000:1.0:1789429293.438504:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29da9f80 00000100:00100000:2.0:1789429293.523316:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429293.523448:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634987520 00000100:00100000:1.0:1789429293.523459:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634987520 00002000:00100000:1.0:1789429293.523509:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2e:0x0] (3145728->4194303) req@ffff946f2f097100 x1876351634987520/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/0 e 0 to 0 dl 1789429304 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429293.523521:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f097100 with x1876351634987520 ext(3145728->4194303) 00002000:00010000:1.0:1789429293.523583:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f097100 00000100:00100000:1.0:1789429293.523657:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11498 00000100:00100000:1.0:1789429293.523669:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351634987520:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:2.0:1789429293.552684:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351634987520:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 28999us (29359us total) trans 4294969588 rc 0/0 00000100:00100000:2.0:1789429293.552700:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11498 00002000:00100000:2.0:1789429293.552720:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x2e:0x0] (3145728->4194303) req@ffff946f2f097100 x1876351634987520/t4294969588(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/448 e 0 to 0 dl 1789429304 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429293.552730:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f097100 with x1876351634987520 ext(3145728->4194303) 00002000:00010000:2.0:1789429293.552749:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f097100 00000100:00100000:2.0:1789429293.668525:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429293.668607:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634987648 00000100:00100000:3.0:1789429293.668618:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634987648 00002000:00100000:3.0:1789429293.668671:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2e:0x0] (4194304->5242879) req@ffff946f2f095500 x1876351634987648/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/0 e 0 to 0 dl 1789429304 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429293.668683:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095500 with x1876351634987648 ext(4194304->5242879) 00002000:00010000:3.0:1789429293.668689:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f095500 00000100:00100000:3.0:1789429293.668720:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11499 00000100:00100000:3.0:1789429293.668729:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351634987648:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:3.0:1789429293.688236:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351634987648:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 19470us (19682us total) trans 4294969589 rc 0/0 00000100:00100000:3.0:1789429293.688267:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11499 00002000:00100000:3.0:1789429293.688288:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x2e:0x0] (4194304->5242879) req@ffff946f2f095500 x1876351634987648/t4294969589(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/448 e 0 to 0 dl 1789429304 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429293.688300:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095500 with x1876351634987648 ext(4194304->5242879) 00002000:00010000:3.0:1789429293.688309:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f2f095500 00000100:00100000:1.0:1789429293.784697:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429293.784890:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634987776 00000100:00100000:2.0:1789429293.784914:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634987776 00002000:00100000:2.0:1789429293.784993:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2e:0x0] (5242880->6291455) req@ffff946f29da8700 x1876351634987776/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/0 e 0 to 0 dl 1789429304 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429293.785014:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8700 with x1876351634987776 ext(5242880->6291455) 00002000:00010000:2.0:1789429293.785022:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29da8700 00000100:00100000:2.0:1789429293.785063:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11500 00000100:00100000:2.0:1789429293.785551:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351634987776:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:3.0:1789429293.806260:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351634987776:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 20700us (21560us total) trans 4294969590 rc 0/0 00000100:00100000:3.0:1789429293.806280:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11500 00002000:00100000:3.0:1789429293.806302:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x2e:0x0] (5242880->6291455) req@ffff946f29da8700 x1876351634987776/t4294969590(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/448 e 0 to 0 dl 1789429304 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429293.806320:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8700 with x1876351634987776 ext(5242880->6291455) 00002000:00010000:3.0:1789429293.806328:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29da8700 00000100:00100000:2.0:1789429293.921691:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429293.922852:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634987904 00000100:00100000:0.0:1789429293.922873:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634987904 00002000:00100000:0.0:1789429293.922966:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2e:0x0] (6291456->7340031) req@ffff946f3f2e1500 x1876351634987904/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/0 e 0 to 0 dl 1789429304 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429293.922980:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e1500 with x1876351634987904 ext(6291456->7340031) 00002000:00010000:0.0:1789429293.922988:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e1500 00000100:00100000:0.0:1789429293.923023:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11501 00000100:00100000:0.0:1789429293.923034:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351634987904:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000100:00100000:0.0:1789429293.943238:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351634987904:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 20189us (21547us total) trans 4294969591 rc 0/0 00000100:00100000:0.0:1789429293.943256:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11501 00002000:00100000:0.0:1789429293.943273:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x2e:0x0] (6291456->7340031) req@ffff946f3f2e1500 x1876351634987904/t4294969591(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:29/0 lens 488/448 e 0 to 0 dl 1789429304 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429293.943285:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e1500 with x1876351634987904 ext(6291456->7340031) 00002000:00010000:0.0:1789429293.943293:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f2e1500 00000100:00100000:2.0:1789429294.088419:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429294.088498:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429294.088589:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634988288 00000100:00100000:0.0:1789429294.088599:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634988032 00000100:00100000:0.0:1789429294.088612:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634988032 00000100:00100000:1.0:1789429294.088612:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634988288 00002000:00100000:0.0:1789429294.088680:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2e:0x0] (7340032->8388607) req@ffff946f1c1a9880 x1876351634988032/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:30/0 lens 488/0 e 0 to 0 dl 1789429305 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429294.088693:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a9880 with x1876351634988032 ext(7340032->8388607) 00000100:00100000:1.0:1789429294.088695:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 243 00002000:00010000:0.0:1789429294.088699:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a9880 00000100:00100000:1.0:1789429294.088706:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+49:33927:x1876351634988288:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1789429294.088721:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11502 00000100:00100000:0.0:1789429294.088727:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351634988032:12345-192.168.203.39@tcp:4:mmap_sanity.0 00000001:00080000:1.0:1789429294.089089:0:21208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977106 00000100:00100000:1.0:1789429294.089188:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+51:33927:x1876351634988288:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 483us (688us total) trans 4294977107 rc 0/0 00000100:00100000:1.0:1789429294.089196:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 243 00000020:00080000:1.0:1789429294.089228:0:21208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1789429294.089505:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429294.100248:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429294.101814:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+25:2371:x1876351634988032:12345-192.168.203.39@tcp:4:mmap_sanity.0 Request processed in 13073us (13398us total) trans 4294969592 rc 0/0 00000100:00100000:0.0:1789429294.101831:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11502 00002000:00100000:0.0:1789429294.101850:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x2e:0x0] (7340032->8388607) req@ffff946f1c1a9880 x1876351634988032/t4294969592(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:30/0 lens 488/448 e 0 to 0 dl 1789429305 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429294.101862:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a9880 with x1876351634988032 ext(7340032->8388607) 00002000:00010000:0.0:1789429294.101870:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f1c1a9880 00000100:00100000:0.0:1789429294.101925:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634988416 00000100:00100000:0.0:1789429294.101934:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634988416 00000100:00100000:0.0:1789429294.101999:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21107 00000100:00100000:0.0:1789429294.102010:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+51:33927:x1876351634988416:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429294.102051:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429294.102093:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c334 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.102178:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263609d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.102197:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263609d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.102242:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263609d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429294.102283:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429294.102288:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429294.102313:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263609d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.102343:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c334 expref: 53 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.102364:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263609d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c334 expref: 52 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.102374:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:0.0:1789429294.102377:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429294.102381:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:0.0:1789429294.102414:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634988416:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 405us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429294.102420:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21107 00000100:00100000:3.0:1789429294.113024:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429294.113133:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634988672 00000100:00100000:0.0:1789429294.113148:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634988672 00000100:00100000:0.0:1789429294.113265:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21108 00000100:00100000:0.0:1789429294.113278:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+52:33927:x1876351634988672:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429294.113308:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429294.113336:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c33b expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.113471:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263609e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.113488:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263609e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x72:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.113508:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263609e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x72:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429294.113527:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x72:0x0]: returning size 8388608 00010000:00010000:0.0:1789429294.113690:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c33b expref: 55 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.113710:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263609e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x72:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c33b expref: 54 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.113720:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:0.0:1789429294.113723:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789429294.113727:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:0.0:1789429294.113808:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+54:33927:x1876351634988672:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 533us (799us total) trans 4294977108 rc 0/0 00000100:00100000:0.0:1789429294.113817:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21108 00000100:00100000:1.0:1789429294.121566:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429294.121730:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634988928 00000100:00100000:3.0:1789429294.121746:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634988928 00000100:00100000:3.0:1789429294.121823:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 244 00000100:00100000:3.0:1789429294.121836:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+54:33927:x1876351634988928:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1789429294.122178:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+55:33927:x1876351634988928:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 343us (626us total) trans 4294977109 rc 0/0 00000100:00100000:3.0:1789429294.122188:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 244 00000100:00100000:2.0:1789429294.125351:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429294.125451:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634989184 00000100:00100000:0.0:1789429294.125475:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634989184 00000100:00100000:0.0:1789429294.125551:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21109 00000100:00100000:0.0:1789429294.125563:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+55:33927:x1876351634989184:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1789429294.125638:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789429294.125676:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263609e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c33b expref: 55 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.125702:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263609ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c326 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.125719:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:0.0:1789429294.125740:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263609d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c334 expref: 53 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.125749:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:0.0:1789429294.125756:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429294.125786:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.125801:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.125814:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.125829:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263609f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.125836:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263609f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.125842:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263609f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.125986:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.125995:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.126007:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789429294.128364:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].26, 64 off9856 00000004:00080000:0.0:1789429294.128384:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 992108183319ns, next at 993108178969ns, rc = 0 00010000:00010000:0.0:1789429294.128492:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360a07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x72:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128515:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128530:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360a07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128541:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360a07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128548:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360a07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128555:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360a07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x72:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128574:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789429294.128602:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128609:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128616:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128623:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ada00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429294.128628:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128636:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128649:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff946f120fdd00) 00010000:00010000:0.0:1789429294.128653:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789429294.128659:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128665:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x72:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128690:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128697:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128704:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128709:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429294.128712:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128718:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128732:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:0.0:1789429294.128734:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429294.128737:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.128743:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263609f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429294.128760:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000072c4864e reply state 00000000c11d56e8 transno 4294977110 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263609f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429294.128771:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429294.128908:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+54:33927:x1876351634989184:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 3341us (3565us total) trans 4294977110 rc 0/0 00000100:00100000:0.0:1789429294.128920:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21109 00010000:00010000:1.0:1789429294.134588:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789429294.134611:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360a07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429294.134625:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2adc00 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:1.0:1789429294.134631:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360a07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429294.134643:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360a07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429294.134667:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72:0x0].0x0 (ffff946f120fdd00) 00010000:00010000:1.0:1789429294.134671:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789429294.134677:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360a07 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429294.134687:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360a07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x72:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429294.134726:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429294.134728:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429294.134730:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429294.135461:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263609f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429294.135475:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263609f9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429294.135483:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263609f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429294.135488:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429294.135493:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263609f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429294.135500:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263609f9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429294.135513:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x366f449e (ffff946f120fd100) 00010000:00010000:2.0:1789429294.135517:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429294.135521:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263609f9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429294.135527:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263609f9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429294.141170:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429294.141628:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634989312 00000100:00100000:3.0:1789429294.141644:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634989312 00000100:00100000:3.0:1789429294.141726:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21110 00000100:00100000:3.0:1789429294.141738:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+53:33927:x1876351634989312:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429294.141773:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429294.141807:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360a0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c342 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429294.141905:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360a15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429294.141923:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429294.141937:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429294.141989:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429294.141994:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429294.142020:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429294.142052:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726360a0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c342 expref: 55 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429294.142495:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c342 expref: 54 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429294.142505:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8300) 00010000:00010000:3.0:1789429294.142508:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429294.142512:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:3.0:1789429294.142651:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+54:33927:x1876351634989312:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 914us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429294.142661:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21110 00000100:00100000:2.0:1789429294.145267:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429294.148041:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634989440 00000100:00100000:3.0:1789429294.148079:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634989440 00000100:00100000:3.0:1789429294.148197:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 259 00000100:00100000:3.0:1789429294.148233:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+22:5607:x1876351634989440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429294.148255:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789429294.148283:0:11354:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:3.0:1789429294.148287:0:11354:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb mtime from disk: 0 -> 1789429292 00002000:00010000:3.0:1789429294.148289:0:11354:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2f:0x0] updating lvb ctime from disk: 0 -> 1789429292 00010000:00010000:3.0:1789429294.148324:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000050ec1c3/0xb4c3dad726360951 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c30a expref: 22 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429294.148359:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429294.148436:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+21:5607:x1876351634989440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 207us (3185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429294.148445:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 259 00000100:00080000:0.0:1789429294.148698:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429294.148848:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429294.150340:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634989696 00000100:00100000:0.0:1789429294.150357:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634989696 00000100:00100000:0.0:1789429294.150469:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21111 00000100:00100000:0.0:1789429294.150481:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+54:33927:x1876351634989696:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1789429294.150507:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429294.150537:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360a1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c349 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.150673:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x69:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.150692:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.150708:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429294.150721:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x69:0x0]: returning size 94160 00010000:00010000:0.0:1789429294.150904:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726360a1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c349 expref: 57 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.150929:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c349 expref: 56 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.150940:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x69:0x0].0x0 (ffff946f120fd200) 00010000:00010000:0.0:1789429294.150943:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429294.150947:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429294.151033:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+56:33927:x1876351634989696:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 555us (2186us total) trans 4294977111 rc 0/0 00000100:00100000:0.0:1789429294.151041:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21111 00000100:00100000:2.0:1789429294.154744:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429294.154938:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634989824 00000100:00100000:0.0:1789429294.154951:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634989824 00000100:00100000:0.0:1789429294.155026:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 260 00000100:00100000:0.0:1789429294.155039:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:5606:x1876351634989824:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429294.155075:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429294.155132:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000186b083/0xb4c3dad7263608d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c2e7 expref: 12 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429294.155166:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429294.155259:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:5606:x1876351634989824:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 222us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429294.155267:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 260 00000100:00080000:0.0:1789429294.155296:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429294.159911:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429294.160004:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634989952 00000100:00100000:2.0:1789429294.160019:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634989952 00000100:00100000:2.0:1789429294.160122:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 261 00000100:00100000:2.0:1789429294.160135:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+56:2369:x1876351634989952:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429294.160157:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429294.160191:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360a23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c349 expref: 56 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429294.160243:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x69:0x0].0x0 (ffff946f120fd200) 00010000:00010000:2.0:1789429294.160249:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429294.160324:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+55:2369:x1876351634989952:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 192us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429294.160332:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 261 00000100:00100000:1.0:1789429294.162700:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429294.162834:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634990080 00000100:00100000:3.0:1789429294.162847:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634990080 00000100:00100000:3.0:1789429294.162926:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5750 00000100:00100000:3.0:1789429294.162938:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351634990080:12345-192.168.203.39@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1789429294.162962:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429294.162991:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726360a31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c350 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429294.163028:0:13238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 94160, mtime: 0x6aa88619, atime: 0x0, ctime: 0x6aa88619, blocks: 0x103 00010000:00010000:3.0:1789429294.163065:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=992s v=(0 0) 00010000:00010000:3.0:1789429294.163078:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429294.163090:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726360a31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c350 expref: 22 pid: 13238 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429294.163112:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726360a31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c350 expref: 22 pid: 13238 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429294.163128:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:3.0:1789429294.163248:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+22:2370:x1876351634990080:12345-192.168.203.39@tcp:101:mmap_sanity.0 Request processed in 311us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429294.163260:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5750 00000100:00100000:0.0:1789429294.165969:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429294.166081:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634990208 00000100:00100000:2.0:1789429294.166094:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634990208 00000100:00100000:2.0:1789429294.166175:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 262 00000100:00100000:2.0:1789429294.166188:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:11155:x1876351634990208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429294.166290:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789429294.166318:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb size from disk: 0 -> 8388608 00002000:00010000:2.0:1789429294.166322:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb mtime from disk: 0 -> 1789429294 00002000:00010000:2.0:1789429294.166325:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2e:0x0] updating lvb ctime from disk: 0 -> 1789429294 00010000:00010000:2.0:1789429294.166354:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000639681c/0xb4c3dad7263609c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c32d expref: 25 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429294.166385:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429294.166591:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+24:11155:x1876351634990208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 405us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429294.166600:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 262 00010000:00010000:2.0:1789429294.307514:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429294.869419:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429294.869469:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429294.869548:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429294.869619:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634990464 00000100:00100000:3.0:1789429294.869630:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634990464 00000100:00100000:3.0:1789429294.869709:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 697 00000100:00100000:3.0:1789429294.869719:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2368:x1876351634990464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429294.869792:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2368:x1876351634990464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 74us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429294.869799:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 697 00000100:00100000:1.0:1789429294.871454:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634990592 00000100:00100000:1.0:1789429294.871482:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634990592 00000100:00100000:1.0:1789429294.871592:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 750 00000100:00100000:1.0:1789429294.871603:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351634990592:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429294.871713:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351634990592:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 110us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429294.871722:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 750 00000100:00080000:2.0:1789429294.871884:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429294.871898:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429294.874152:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634990336 00000100:00100000:0.0:1789429294.874170:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634990336 00000100:00100000:0.0:1789429294.874330:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 525 00000100:00100000:0.0:1789429294.874342:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351634990336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429294.874443:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351634990336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 104us (4973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429294.874451:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 525 00000100:00100000:3.0:1789429295.168750:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429295.168920:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634990720 00000100:00100000:2.0:1789429295.168931:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634990720 00002000:00100000:2.0:1789429295.168982:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2b:0x0] (0->4095) req@ffff946f3407b100 x1876351634990720/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:31/0 lens 488/0 e 0 to 0 dl 1789429306 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429295.168994:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407b100 with x1876351634990720 ext(0->4095) 00002000:00010000:2.0:1789429295.169000:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3407b100 00000100:00100000:2.0:1789429295.169030:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11503 00000100:00100000:2.0:1789429295.169040:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351634990720:12345-192.168.203.39@tcp:3:mmap_sanity.0 00000100:00100000:2.0:1789429295.169415:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351634990720:12345-192.168.203.39@tcp:3:mmap_sanity.0 Request processed in 375us (674us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789429295.169424:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11503 00002000:00100000:2.0:1789429295.169432:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x2b:0x0] (0->4095) req@ffff946f3407b100 x1876351634990720/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:31/0 lens 488/4536 e 0 to 0 dl 1789429306 ref 1 fl Complete:/600/0 rc 4096/4096 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429295.169441:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3407b100 with x1876351634990720 ext(0->4095) 00002000:00010000:2.0:1789429295.169445:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3407b100 00000100:00100000:2.0:1789429295.174809:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429295.178123:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634990848 00000100:00100000:3.0:1789429295.178137:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634990848 00002000:00100000:3.0:1789429295.178192:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x2b:0x0] (4096->8191) req@ffff946f1c1ab800 x1876351634990848/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:31/0 lens 488/0 e 0 to 0 dl 1789429306 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429295.178238:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1ab800 with x1876351634990848 ext(4096->8191) 00002000:00010000:3.0:1789429295.178244:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1ab800 00000100:00100000:3.0:1789429295.178279:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11504 00000100:00100000:3.0:1789429295.178289:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351634990848:12345-192.168.203.39@tcp:3:mmap_sanity.0 00000100:00100000:3.0:1789429295.178492:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351634990848:12345-192.168.203.39@tcp:3:mmap_sanity.0 Request processed in 203us (3702us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789429295.178513:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11504 00002000:00100000:3.0:1789429295.178520:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x2b:0x0] (4096->8191) req@ffff946f1c1ab800 x1876351634990848/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:31/0 lens 488/4536 e 0 to 0 dl 1789429306 ref 1 fl Complete:/600/0 rc 4096/4096 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429295.178529:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1ab800 with x1876351634990848 ext(4096->8191) 00002000:00010000:3.0:1789429295.178533:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1ab800 00000100:00100000:1.0:1789429295.184749:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429295.184845:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634990976 00000100:00100000:0.0:1789429295.184855:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634990976 00002000:00100000:0.0:1789429295.184905:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2b:0x0] (8192->12287) req@ffff946f29da8000 x1876351634990976/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:31/0 lens 488/0 e 0 to 0 dl 1789429306 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429295.184917:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8000 with x1876351634990976 ext(8192->12287) 00002000:00010000:0.0:1789429295.184922:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da8000 00000100:00100000:0.0:1789429295.184949:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11505 00000100:00100000:0.0:1789429295.184958:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351634990976:12345-192.168.203.39@tcp:3:mmap_sanity.0 00000100:00100000:0.0:1789429295.185167:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351634990976:12345-192.168.203.39@tcp:3:mmap_sanity.0 Request processed in 209us (426us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429295.185175:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11505 00002000:00100000:0.0:1789429295.185182:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2b:0x0] (8192->12287) req@ffff946f29da8000 x1876351634990976/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:31/0 lens 488/4536 e 0 to 0 dl 1789429306 ref 1 fl Complete:/600/0 rc 4096/4096 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429295.185197:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8000 with x1876351634990976 ext(8192->12287) 00002000:00010000:0.0:1789429295.185237:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da8000 00000100:00100000:0.0:1789429295.193276:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429295.194239:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634991104 00000100:00100000:2.0:1789429295.194251:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634991104 00002000:00100000:2.0:1789429295.194300:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2b:0x0] (12288->69631) req@ffff946f3f1c5c00 x1876351634991104/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:31/0 lens 488/0 e 0 to 0 dl 1789429306 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429295.194313:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5c00 with x1876351634991104 ext(12288->69631) 00002000:00010000:2.0:1789429295.194319:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c5c00 00000100:00100000:2.0:1789429295.194358:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11506 00000100:00100000:2.0:1789429295.194368:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351634991104:12345-192.168.203.39@tcp:3:mmap_sanity.0 00000100:00100000:2.0:1789429295.209440:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351634991104:12345-192.168.203.39@tcp:3:mmap_sanity.0 Request processed in 15062us (16162us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1789429295.209454:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11506 00002000:00100000:2.0:1789429295.209469:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x2b:0x0] (12288->69631) req@ffff946f3f1c5c00 x1876351634991104/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:31/0 lens 488/440 e 0 to 0 dl 1789429306 ref 1 fl Complete:/600/0 rc 57344/57344 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429295.209480:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5c00 with x1876351634991104 ext(12288->69631) 00002000:00010000:2.0:1789429295.209487:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c5c00 00000100:00100000:3.0:1789429295.223294:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429295.223413:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634991232 00000100:00100000:2.0:1789429295.223424:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634991232 00002000:00100000:2.0:1789429295.223471:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2b:0x0] (69632->94207) req@ffff946f34078e00 x1876351634991232/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:31/0 lens 488/0 e 0 to 0 dl 1789429306 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429295.223483:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34078e00 with x1876351634991232 ext(69632->94207) 00002000:00010000:2.0:1789429295.223488:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34078e00 00000100:00100000:2.0:1789429295.223517:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11507 00000100:00100000:2.0:1789429295.223526:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+22:2368:x1876351634991232:12345-192.168.203.39@tcp:3:mmap_sanity.0 00000100:00100000:2.0:1789429295.227142:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+22:2368:x1876351634991232:12345-192.168.203.39@tcp:3:mmap_sanity.0 Request processed in 3607us (3847us total) trans 0 rc 24576/24576 00000100:00100000:2.0:1789429295.227156:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11507 00002000:00100000:2.0:1789429295.227168:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x2b:0x0] (69632->94207) req@ffff946f34078e00 x1876351634991232/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:31/0 lens 488/440 e 0 to 0 dl 1789429306 ref 1 fl Complete:/600/0 rc 24576/24576 job:'mmap_sanity.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429295.227177:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34078e00 with x1876351634991232 ext(69632->94207) 00002000:00010000:2.0:1789429295.227183:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34078e00 00000100:00100000:3.0:1789429295.233533:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429295.233609:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634991488 00000100:00100000:1.0:1789429295.233617:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634991488 00000100:00100000:1.0:1789429295.233660:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 245 00000100:00100000:1.0:1789429295.233667:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+55:33927:x1876351634991488:12345-192.168.203.39@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1789429295.233972:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+56:33927:x1876351634991488:12345-192.168.203.39@tcp:35:mmap_sanity.0 Request processed in 302us (443us total) trans 4294977112 rc 0/0 00000100:00100000:1.0:1789429295.233979:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 245 00000100:00100000:0.0:1789429295.239691:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429295.240012:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634991744 00000100:00100000:3.0:1789429295.240023:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634991744 00000100:00100000:3.0:1789429295.240105:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21112 00000100:00100000:3.0:1789429295.240116:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+56:33927:x1876351634991744:12345-192.168.203.39@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1789429295.240168:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789429295.240392:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad72635f52a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2cc expref: 56 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429295.240418:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x69:0x0].0x0 (ffff946f120fd200) 00010000:00010000:3.0:1789429295.240440:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360a15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c342 expref: 55 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429295.240449:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8300) 00010000:00010000:3.0:1789429295.240511:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429295.240608:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a38 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.240621:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.240632:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.240646:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a3f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.240653:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.240659:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.241012:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x69:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.241022:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.241029:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789429295.241990:0:15700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].23, 64 off9664 00000004:00080000:0.0:1789429295.242001:0:15700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 993221799906ns, next at 994221797521ns, rc = 0 00010000:00010000:0.0:1789429295.242079:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x69:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.242091:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.242868:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.243154:0:15700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a4d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.243164:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a4d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.243171:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.243357:0:15700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789429295.243383:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.243390:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a46 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.243396:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.243402:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429295.243407:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.243414:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a46 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.243426:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x69:0x0].0x0 (ffff946f120fde00) 00010000:00010000:0.0:1789429295.243429:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789429295.243434:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a46 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.243440:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a46 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x69:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429295.243798:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789429295.243805:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429295.243812:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac400 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:1.0:1789429295.243816:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429295.243823:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429295.243833:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x69:0x0].0x0 (ffff946f120fde00) 00010000:00010000:1.0:1789429295.243836:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789429295.243839:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a4d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429295.243844:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x69:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429295.243862:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429295.243864:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429295.243866:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429295.244128:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.244137:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a38 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.244142:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.244147:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2aca00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429295.244150:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.244155:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a38 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.244164:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:0.0:1789429295.244167:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429295.244170:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a38 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429295.244176:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a38 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429295.244191:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007ded2957 reply state 00000000166dc0c3 transno 4294977113 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429295.244559:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429295.244735:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+56:33927:x1876351634991744:12345-192.168.203.39@tcp:36:mmap_sanity.0 Request processed in 4607us (5040us total) trans 4294977113 rc 0/0 00000100:00100000:0.0:1789429295.244745:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21112 00010000:00010000:2.0:1789429295.252810:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429295.252829:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a3f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429295.252837:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429295.252844:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429295.252850:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429295.252857:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a3f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429295.252876:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xcf1d5a2f (ffff946f120fdf00) 00010000:00010000:2.0:1789429295.252879:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429295.252894:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a3f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429295.252901:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a3f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429295.267558:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648343040:0@lo:400:kworker.0 00000100:00100000:2.0:1789429295.267630:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429295.267698:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648343552:0@lo:400:kworker.0 00000100:00100000:2.0:1789429295.267724:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429295.267757:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429295.267763:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648343168:0@lo:400:kworker.0 00000100:00100000:2.0:1789429295.267784:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429295.267818:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648343552 00000100:00100000:2.0:1789429295.267826:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648343552 00000100:00100000:2.0:1789429295.267897:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1789429295.267908:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1876351648343552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429295.267961:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1876351648343552:12345-0@lo:400:kworker.0 Request processed in 56us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429295.267968:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:2.0:1789429295.267992:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648343040 00000100:00100000:2.0:1789429295.267995:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648343040 00000100:00100000:2.0:1789429295.268016:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648343168 00000100:00100000:2.0:1789429295.268018:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648343168 00000100:00100000:2.0:1789429295.268037:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1789429295.268054:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648343040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429295.268093:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648343040:12345-0@lo:400:kworker.0 Request processed in 50us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429295.268099:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1789429295.268111:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1789429295.268116:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648343168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429295.268139:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648343168:12345-0@lo:400:kworker.0 Request processed in 24us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429295.268145:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00080000:2.0:1789429295.268159:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429295.268164:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429295.268189:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648343168:0@lo:400:kworker.0 00000100:00100000:2.0:1789429295.268197:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648343040:0@lo:400:kworker.0 00000100:00100000:2.0:1789429295.268234:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648343552:0@lo:400:kworker.0 00000100:00100000:3.0:1789429295.268676:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648343296:0@lo:400:kworker.0 00000100:00100000:3.0:1789429295.268710:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429295.268739:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789429295.268746:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648342912:0@lo:400:kworker.0 00000100:00100000:3.0:1789429295.268773:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429295.268804:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648343424:0@lo:400:kworker.0 00000100:00100000:3.0:1789429295.268825:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429295.268855:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648343424 00000100:00100000:3.0:1789429295.268860:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648343424 00000100:00100000:3.0:1789429295.268904:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1789429295.268910:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648343424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429295.268947:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648343424:12345-0@lo:400:kworker.0 Request processed in 38us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429295.268953:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00080000:3.0:1789429295.268968:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429295.268987:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648343424:0@lo:400:kworker.0 00000100:00100000:1.0:1789429295.269330:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648343296 00000100:00100000:1.0:1789429295.269336:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648343296 00000100:00100000:1.0:1789429295.269370:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:1.0:1789429295.269377:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648343296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429295.269419:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648343296:12345-0@lo:400:kworker.0 Request processed in 42us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429295.269425:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:1.0:1789429295.269452:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648343296:0@lo:400:kworker.0 00000100:00080000:3.0:1789429295.269579:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429295.269725:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648342912 00000100:00100000:2.0:1789429295.269729:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648342912 00000100:00100000:2.0:1789429295.269766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1789429295.269773:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648342912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429295.269822:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648342912:12345-0@lo:400:kworker.0 Request processed in 50us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429295.269829:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1789429295.272418:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648342912:0@lo:400:kworker.0 00010000:00010000:2.0:1789429295.331660:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789429295.779536:0:8083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 993759333174ns, next at 994759331187ns, rc = 0 00000100:00100000:2.0:1789429295.780216:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648343680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429295.780283:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429295.780356:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648343680 00000100:00100000:2.0:1789429295.780364:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648343680 00000100:00100000:2.0:1789429295.780405:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789429295.780413:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876351648343680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429295.780435:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 854654976 pending 68157440 free 3827302400 avail 3825205248 00000100:00100000:2.0:1789429295.780484:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1876351648343680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429295.780491:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789429295.780535:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648343680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429295.781192:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429295.781214:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f344b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648343808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429295.781245:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429295.781768:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648343808 00000100:00100000:3.0:1789429295.781775:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648343808 00000100:00100000:3.0:1789429295.781815:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789429295.781824:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648343808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429295.781851:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 361037824 pending 13631488 free 3855613952 avail 3853516800 00000100:00100000:3.0:1789429295.781907:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648343808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429295.781914:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789429295.781949:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f344b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648343808:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789429295.857612:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969592 is committed 00000001:00080000:2.0:1789429295.857645:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969579 is committed 00000001:00080000:2.0:1789429295.857660:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969584 is committed 00000001:00080000:2.0:1789429295.857681:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969582 is committed 00010000:00010000:3.0:1789429296.355497:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429296.393482:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969257 is committed 00000001:00080000:2.0:1789429296.393529:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969249 is committed 00000004:00080000:2.0:1789429296.439506:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 39 committed 00000001:00080000:2.0:1789429296.439537:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977113 is committed 00000004:00080000:2.0:1789429296.439542:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 32 committed 00000004:00080000:2.0:1789429296.439562:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 38 committed 00000004:00080000:2.0:1789429296.439570:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 31 committed 00000100:00100000:2.0:1789429296.439945:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648343936:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789429296.440014:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429296.440251:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648344320:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789429296.440285:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1789429296.440537:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977096 is committed 00000100:00100000:3.0:1789429296.440615:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789429296.440623:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648344448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789429296.440657:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429296.440693:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648344064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789429296.440720:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429296.440738:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429296.440744:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648344192:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789429296.440763:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429296.440791:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648343936 00000100:00100000:3.0:1789429296.440798:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648343936 00000100:00100000:3.0:1789429296.440839:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648344320 00000100:00100000:3.0:1789429296.440842:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648344320 00000100:00100000:3.0:1789429296.440860:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648344448 00000100:00100000:3.0:1789429296.440863:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648344448 00000100:00100000:3.0:1789429296.440887:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648344064 00000100:00100000:3.0:1789429296.440890:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648344064 00000100:00100000:3.0:1789429296.440902:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648344192 00000100:00100000:3.0:1789429296.440904:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648344192 00000100:00100000:3.0:1789429296.440919:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5751 00000100:00100000:3.0:1789429296.440927:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3299:x1876351648343936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789429296.440954:0:8085:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:46 count 1 00002000:00010000:3.0:1789429296.440987:0:8085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 163840, mtime: 0x6aa8862b, atime: 0x0, ctime: 0x6aa8862b, blocks: 0x203 00010000:00010000:3.0:1789429296.440996:0:8085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad726360a54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429296.441012:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=994s v=(0 0) 00010000:00010000:3.0:1789429296.441017:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429296.441023:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad726360a54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429296.441180:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5752 00000100:00100000:0.0:1789429296.441187:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648344320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789429296.441209:0:20745:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:45 count 1 00002000:00010000:0.0:1789429296.441224:0:20745:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 4096, mtime: 0x6aa8862b, atime: 0x0, ctime: 0x6aa8862b, blocks: 0xb 00010000:00010000:0.0:1789429296.441229:0:20745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360a5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.441235:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=994s v=(0 0) 00010000:00010000:0.0:1789429296.441238:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429296.441241:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.441250:0:20745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.441261:0:20745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360a5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.441266:0:20745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360a5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429296.441384:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5753 00000100:00100000:1.0:1789429296.441391:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648344448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789429296.441401:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:46 count 1 00002000:00010000:1.0:1789429296.441413:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 8388608, mtime: 0x6aa8862e, atime: 0x0, ctime: 0x6aa8862e, blocks: 0x4007 00010000:00010000:1.0:1789429296.441418:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad726360a62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429296.441424:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=994s v=(0 0) 00010000:00010000:1.0:1789429296.441426:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429296.441428:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad726360a62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429296.441435:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad726360a62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429296.441440:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad726360a62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429296.441445:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad726360a62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429296.442082:0:8085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad726360a54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429296.442101:0:8085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad726360a54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429296.442108:0:8085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad726360a54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.442643:0:20745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789429296.442888:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789429296.442896:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360a5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443075:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2aca00 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429296.443113:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360a5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443123:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360a5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443639:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360a5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443649:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f53d4231/0xb4c3dad726360a5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443670:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789429296.443674:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad726360a62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443681:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6a00 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429296.443684:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad726360a62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443692:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad726360a62 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443703:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad726360a62 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443712:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789429296.443716:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad726360a54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443722:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0600 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429296.443725:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad726360a54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443731:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad726360a54 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443740:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad726360a54 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.443749:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429296.443750:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429296.443753:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429296.443880:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3298:x1876351648344320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2691us (3591us total) trans 4294969593 rc 0/0 00000100:00100000:0.0:1789429296.443890:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5752 00000100:00100000:0.0:1789429296.443920:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5754 00000100:00100000:0.0:1789429296.443931:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3300:x1876351648344064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789429296.443957:0:20745:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:47 count 1 00002000:00010000:0.0:1789429296.443983:0:20745:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 8388608, mtime: 0x6aa8862c, atime: 0x0, ctime: 0x6aa8862c, blocks: 0x4007 00010000:00010000:0.0:1789429296.443990:0:20745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bff8d190/0xb4c3dad726360a69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.444001:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=994s v=(0 0) 00010000:00010000:0.0:1789429296.444005:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429296.444011:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bff8d190/0xb4c3dad726360a69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.444023:0:20745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bff8d190/0xb4c3dad726360a69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.444038:0:20745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bff8d190/0xb4c3dad726360a69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.444045:0:20745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bff8d190/0xb4c3dad726360a69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.444078:0:20745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789429296.444515:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3300:x1876351648344064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 587us (3794us total) trans 4294969258 rc 0/0 00000100:00100000:0.0:1789429296.444520:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5754 00000100:00100000:0.0:1789429296.444532:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5755 00000100:00100000:0.0:1789429296.444537:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3300:x1876351648344192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789429296.444547:0:20745:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:43 count 1 00010000:00010000:0.0:1789429296.444556:0:20745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.444567:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726360a31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c350 expref: 5 pid: 13238 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.444572:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789429296.444574:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429296.444577:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.444608:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726360a31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c350 expref: 5 pid: 13238 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429296.444623:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726360a31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c350 expref: 5 pid: 13238 timeout: 1094 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429296.444637:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:20745:1876351648344576:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429296.444885:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789429296.444891:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bff8d190/0xb4c3dad726360a69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.444899:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac000 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429296.444902:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bff8d190/0xb4c3dad726360a69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.444916:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bff8d190/0xb4c3dad726360a69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.444930:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bff8d190/0xb4c3dad726360a69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.444938:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bff8d190/0xb4c3dad726360a69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.444954:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429296.444955:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429296.444957:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429296.446520:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f050686c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789429296.447220:0:8085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789429296.447231:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f125a213/0xb4c3dad726360a54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429296.447269:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429296.447328:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969584 gen 2 00000004:00080000:3.0:1789429296.447334:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f415c7800, transno 4294969583 00000004:00080000:3.0:1789429296.447344:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f415c4000, transno 4294969584 00000100:00100000:3.0:1789429296.447352:0:3298:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff946f34020380 x1876351648344320/t4294969593(4294969593) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789429312 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789429296.447363:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f34020380/2, rc 0, transno 4294969593 00000100:00100000:3.0:1789429296.447368:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34020380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648344320:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789429296.447392:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969249 gen 2 00000004:00080000:3.0:1789429296.447394:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f3fbcd880, transno 4294969249 00000100:00100000:3.0:1789429296.447404:0:3300:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff946f1c1a0380 x1876351648344064/t4294969258(4294969258) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789429312 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789429296.447412:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f1c1a0380/2, rc 0, transno 4294969258 00000100:00100000:3.0:1789429296.447415:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648344064:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789429296.447680:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429296.448171:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789429296.448180:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a3f41c1/0xb4c3dad726360a62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789429296.448775:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f34023480/2, rc 0, transno 4294969594 00000100:00100000:0.0:1789429296.448783:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648344448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789429296.450078:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3298:x1876351648344448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7319us (8060us total) trans 4294969594 rc 0/0 00000100:00100000:1.0:1789429296.450091:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5753 00000100:00100000:3.0:1789429296.452073:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3299:x1876351648343936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11141us (12054us total) trans 4294969259 rc 0/0 00000100:00100000:3.0:1789429296.452084:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5751 00000004:00080000:2.0:1789429296.452171:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f1c1a1180/2, rc 0, transno 4294969259 00000100:00100000:2.0:1789429296.452178:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648343936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789429296.452560:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:20745:1876351648344576:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429296.452580:0:20745:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429296.453421:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429296.453541:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634991872 00000100:00100000:2.0:1789429296.453549:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634991872 00010000:00010000:2.0:1789429296.453638:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726360a31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c350 expref: 6 pid: 13238 timeout: 1094 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429296.453677:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6171 00000100:00100000:2.0:1789429296.453686:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351634991872:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429296.453700:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429296.453705:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726360a31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c350 expref: 6 pid: 13238 timeout: 1094 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.453724:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726360a31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c350 expref: 6 pid: 13238 timeout: 1094 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.453747:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726360a31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c350 expref: 6 pid: 13238 timeout: 1094 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.453762:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429296.453766:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429296.453772:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.453783:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.453812:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429296.453857:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351634991872:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 172us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429296.453864:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6171 00010000:00010000:1.0:1789429296.453972:0:20745:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429296.453982:0:20745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429296.453993:0:20745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429296.454001:0:20745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429296.454024:0:20745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789429296.454556:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3300:x1876351648344192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10016us (13790us total) trans 4294969260 rc 0/0 00000100:00100000:1.0:1789429296.454565:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5755 00010000:00010000:2.0:1789429296.455717:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789429296.455726:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.455738:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2acc00 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429296.455742:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.455758:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.455775:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.455783:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726360a70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429296.455805:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429296.455807:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429296.455808:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789429296.455954:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789429296.455998:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f1c1a1f80/2, rc 0, transno 4294969260 00000100:00100000:3.0:1789429296.456005:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648344192:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789429297.379552:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429298.406625:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429299.428807:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429299.994677:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429299.994717:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429299.994744:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429299.994851:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634992128 00000100:00100000:0.0:1789429299.994862:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634992128 00000100:00100000:0.0:1789429299.994932:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 701 00000100:00100000:0.0:1789429299.994944:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+38:2371:x1876351634992128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429299.995036:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+38:2371:x1876351634992128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 94us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429299.995043:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 701 00000100:00100000:2.0:1789429299.995442:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429299.995460:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429299.995496:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634992000 00000100:00100000:0.0:1789429299.995500:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634992000 00000100:00100000:0.0:1789429299.995525:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 527 00000100:00100000:0.0:1789429299.995531:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351634992000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429299.995576:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351634992000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 44us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429299.995582:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 527 00000100:00080000:0.0:1789429299.995667:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429299.999485:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429299.999526:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429300.000589:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634992384 00000100:00100000:1.0:1789429300.000601:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634992384 00000100:00100000:0.0:1789429300.000828:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634992640 00000100:00100000:0.0:1789429300.000834:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634992640 00000100:00100000:1.0:1789429300.000917:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634992256 00000100:00100000:1.0:1789429300.000921:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634992256 00000100:00100000:3.0:1789429300.002988:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 753 00000100:00100000:3.0:1789429300.003007:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351634992384:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429300.003117:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351634992384:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 117us (8399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429300.003126:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 753 00000100:00100000:3.0:1789429300.003160:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634992512 00000100:00100000:3.0:1789429300.003167:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634992512 00000100:00100000:0.0:1789429300.005802:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634992768 00000100:00100000:0.0:1789429300.005815:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634992768 00000100:00100000:0.0:1789429300.005980:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 754 00000100:00100000:0.0:1789429300.005991:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351634992640:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429300.006090:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351634992640:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 101us (11344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429300.006097:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 754 00000100:00100000:0.0:1789429300.006113:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 755 00000100:00100000:0.0:1789429300.006119:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29daaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351634992768:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429300.006142:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29daaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351634992768:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (6616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429300.006148:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 755 00000100:00080000:2.0:1789429300.006528:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429300.006534:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429300.006537:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429300.007766:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 756 00000100:00100000:1.0:1789429300.007778:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351634992256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429300.007845:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351634992256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (12383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429300.007853:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 756 00000100:00100000:3.0:1789429300.008738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 702 00000100:00100000:3.0:1789429300.008748:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f344b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634992512:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429300.008848:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f344b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351634992512:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 102us (9372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429300.008855:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 702 00000100:00100000:3.0:1789429300.388670:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648345088:0@lo:400:kworker.0 00000100:00100000:3.0:1789429300.388741:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429300.388805:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789429300.388811:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648344960:0@lo:400:kworker.0 00000100:00100000:3.0:1789429300.388839:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429300.388870:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648344960 00000100:00100000:3.0:1789429300.388877:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648344960 00000100:00100000:2.0:1789429300.388938:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648344832:0@lo:400:kworker.0 00000100:00100000:3.0:1789429300.388946:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1789429300.388958:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648344960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429300.388980:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429300.389078:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648344832 00000100:00100000:1.0:1789429300.389083:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648344832 00000100:00100000:1.0:1789429300.389117:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1789429300.389124:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648344832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429300.389187:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648344960:12345-0@lo:400:kworker.0 Request processed in 230us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429300.389195:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1789429300.389261:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648344960:0@lo:400:kworker.0 00000100:00080000:3.0:1789429300.389289:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429300.389409:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648344704:0@lo:400:kworker.0 00000100:00100000:0.0:1789429300.389459:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429300.389499:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648345216:0@lo:400:kworker.0 00000100:00100000:0.0:1789429300.389522:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429300.389550:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648345216 00000100:00100000:0.0:1789429300.389553:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648345216 00000100:00100000:0.0:1789429300.389584:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1789429300.389590:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648345216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429300.389625:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648345216:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429300.389640:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00080000:0.0:1789429300.389656:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429300.389673:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648345216:0@lo:400:kworker.0 00000100:00100000:0.0:1789429300.389700:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648345088 00000100:00100000:0.0:1789429300.389704:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648345088 00000100:00100000:0.0:1789429300.389732:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:0.0:1789429300.389738:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3299:x1876351648345088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429300.389778:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3299:x1876351648345088:12345-0@lo:400:kworker.0 Request processed in 39us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429300.389784:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00080000:0.0:1789429300.389797:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429300.390252:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648344704 00000100:00100000:3.0:1789429300.390258:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648344704 00000100:00100000:3.0:1789429300.390293:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1789429300.390301:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648344704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429300.390341:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648344704:12345-0@lo:400:kworker.0 Request processed in 42us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429300.390347:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1789429300.390384:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648344704:0@lo:400:kworker.0 00000100:00100000:3.0:1789429300.390409:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648345088:0@lo:400:kworker.0 00000100:00100000:2.0:1789429300.392672:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648345344:0@lo:400:kworker.0 00000100:00100000:2.0:1789429300.392737:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429300.392927:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648345344 00000100:00100000:3.0:1789429300.392936:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648345344 00000100:00100000:3.0:1789429300.393006:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1789429300.393015:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1876351648345344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429300.393081:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1876351648345344:12345-0@lo:400:kworker.0 Request processed in 67us (343us total) trans 0 rc 0/0 00000100:00080000:0.0:1789429300.393181:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429300.393363:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648345344:0@lo:400:kworker.0 00000100:00100000:3.0:1789429300.393434:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1789429300.399602:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648344832:12345-0@lo:400:kworker.0 Request processed in 10470us (10614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429300.399617:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1789429300.399972:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648344832:0@lo:400:kworker.0 00010000:00010000:2.0:1789429300.451375:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429300.903652:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648345472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429300.903714:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429300.903856:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648345472 00000100:00100000:2.0:1789429300.903864:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648345472 00000100:00100000:2.0:1789429300.903907:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789429300.903917:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3298:x1876351648345472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429300.903948:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 347406336 pending 0 free 3848273920 avail 3846176768 00000100:00100000:2.0:1789429300.903996:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3298:x1876351648345472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429300.904002:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789429300.904057:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648345472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429300.925421:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648345600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429300.925506:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429300.925577:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648345600 00000100:00100000:2.0:1789429300.925585:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648345600 00000100:00100000:2.0:1789429300.925822:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789429300.925832:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876351648345600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429300.926051:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 786497536 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429300.926101:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876351648345600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 271us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429300.926108:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789429300.926155:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648345600:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789429300.969728:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969593 is committed 00000001:00080000:0.0:1789429300.969746:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969594 is committed 00010000:00010000:0.0:1789429301.476766:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429301.501948:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969258 is committed 00000001:00080000:2.0:1789429301.501966:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969260 is committed 00010000:00010000:0.0:1789429302.500305:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429303.064406:0:21686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 19: test concurrent uncached read races ========================================================================= 19:41:41 (1789429301) 00010000:00010000:0.0:1789429303.524379:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429304.548259:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429305.113104:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429305.113418:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429305.113443:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429305.113480:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429305.113504:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429305.113525:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429305.113602:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634993280 00000100:00100000:0.0:1789429305.113621:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634993280 00000100:00100000:0.0:1789429305.113720:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634993536 00000100:00100000:0.0:1789429305.113725:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634993536 00000100:00100000:0.0:1789429305.113755:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634993152 00000100:00100000:0.0:1789429305.113758:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634993152 00000100:00100000:0.0:1789429305.113801:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 759 00000100:00100000:0.0:1789429305.113815:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351634993280:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429305.113924:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351634993280:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 112us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429305.113933:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 759 00000100:00100000:0.0:1789429305.113955:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 760 00000100:00100000:0.0:1789429305.113964:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351634993536:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429305.114007:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351634993536:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 44us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429305.114014:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 760 00000100:00100000:0.0:1789429305.114029:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 761 00000100:00100000:0.0:1789429305.114036:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351634993152:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429305.114066:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351634993152:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429305.114074:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 761 00000100:00080000:0.0:1789429305.114098:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429305.114103:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429305.114349:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634992896 00000100:00100000:0.0:1789429305.114355:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634992896 00000100:00100000:0.0:1789429305.114387:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 529 00000100:00100000:0.0:1789429305.114393:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351634992896:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429305.114427:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351634992896:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 34us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429305.114435:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 529 00000100:00100000:1.0:1789429305.115849:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429305.115889:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634993664 00000100:00100000:1.0:1789429305.115898:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634993664 00000100:00100000:1.0:1789429305.115957:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 762 00000100:00100000:1.0:1789429305.115968:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351634993664:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429305.116048:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351634993664:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429305.116056:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 762 00000100:00080000:1.0:1789429305.116078:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429305.116435:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634993024 00000100:00100000:2.0:1789429305.116440:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634993024 00000100:00100000:2.0:1789429305.116569:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634993408 00000100:00100000:2.0:1789429305.116573:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634993408 00000100:00080000:1.0:1789429305.116600:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429305.116684:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 706 00000100:00100000:2.0:1789429305.116692:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+38:2370:x1876351634993024:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429305.116736:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+38:2370:x1876351634993024:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 44us (3639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429305.116743:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 706 00000100:00100000:2.0:1789429305.116757:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 707 00000100:00100000:2.0:1789429305.116763:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351634993408:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429305.116788:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351634993408:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (3263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429305.116794:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 707 00000100:00100000:1.0:1789429305.511678:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789429305.516090:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648345856:0@lo:400:kworker.0 00000100:00100000:1.0:1789429305.516170:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429305.516245:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648345728:0@lo:400:kworker.0 00000100:00100000:1.0:1789429305.516277:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429305.516775:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648345984:0@lo:400:kworker.0 00000100:00100000:2.0:1789429305.516812:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429305.516842:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789429305.516848:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c00aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648346112:0@lo:400:kworker.0 00000100:00100000:2.0:1789429305.516876:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429305.517785:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648345728 00000100:00100000:0.0:1789429305.517796:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648345728 00000100:00100000:0.0:1789429305.518669:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1789429305.518687:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648345728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429305.518775:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648345728:12345-0@lo:400:kworker.0 Request processed in 94us (2496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429305.518783:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1789429305.520090:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648345856 00000100:00100000:1.0:1789429305.520102:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648345856 00000100:00100000:1.0:1789429305.520165:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648345984 00000100:00100000:1.0:1789429305.520169:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648345984 00000100:00100000:1.0:1789429305.520224:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1789429305.520233:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f111cdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648345856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429305.520299:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f111cdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648345856:12345-0@lo:400:kworker.0 Request processed in 67us (4128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429305.520305:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1789429305.526630:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1789429305.526649:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648345984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429305.526734:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648345984:12345-0@lo:400:kworker.0 Request processed in 92us (9920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429305.526741:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00080000:1.0:1789429305.527050:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429305.527073:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648346368:0@lo:400:kworker.0 00000100:00100000:1.0:1789429305.527116:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429305.527308:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648345856:0@lo:400:kworker.0 00000100:00100000:1.0:1789429305.527320:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648345728:0@lo:400:kworker.0 00000100:00100000:1.0:1789429305.527340:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789429305.527347:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648346240:0@lo:400:kworker.0 00000100:00100000:1.0:1789429305.527372:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429305.527408:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648346240 00000100:00100000:1.0:1789429305.527414:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648346240 00000100:00080000:1.0:1789429305.527434:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429305.527467:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1789429305.527474:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648346240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429305.527512:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648346240:12345-0@lo:400:kworker.0 Request processed in 39us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429305.527521:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:1.0:1789429305.527546:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648346240:0@lo:400:kworker.0 00000100:00100000:0.0:1789429305.528559:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648346112 00000100:00100000:0.0:1789429305.528568:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648346112 00000100:00100000:2.0:1789429305.530606:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648346368 00000100:00100000:2.0:1789429305.530618:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648346368 00000100:00100000:2.0:1789429305.530676:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1789429305.530685:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648346368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429305.530772:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648346368:12345-0@lo:400:kworker.0 Request processed in 88us (3655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429305.530779:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1789429305.530834:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969594 gen 2 00000004:00080000:2.0:1789429305.530840:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f34020380, transno 4294969593 00000004:00080000:2.0:1789429305.530851:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f34023480, transno 4294969594 00000100:00100000:2.0:1789429305.530857:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648346368:0@lo:400:kworker.0 00000100:00100000:2.0:1789429305.531354:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648345984:0@lo:400:kworker.0 00000100:00080000:0.0:1789429305.531438:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429305.535507:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:1.0:1789429305.535521:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648346112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429305.535619:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648346112:12345-0@lo:400:kworker.0 Request processed in 101us (18741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429305.535626:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1789429305.541428:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969260 gen 2 00000004:00080000:3.0:1789429305.541438:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f1c1a0380, transno 4294969258 00000004:00080000:3.0:1789429305.541602:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f1c1a1180, transno 4294969259 00000100:00080000:2.0:1789429305.542711:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789429305.546683:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f1c1a1f80, transno 4294969260 00000100:00100000:3.0:1789429305.546704:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c00aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648346112:0@lo:400:kworker.0 00010000:00010000:1.0:1789429305.572196:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429305.607775:0:21782:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_19 not cache-capable obdfilter 00000100:00100000:3.0:1789429306.019457:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648346496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429306.019535:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429306.019819:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648346496 00000100:00100000:2.0:1789429306.019827:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648346496 00000100:00100000:2.0:1789429306.019880:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789429306.019890:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648346496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429306.019924:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 347406336 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1789429306.019995:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648346496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429306.020002:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789429306.020119:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648346496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429306.020344:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648346624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429306.020375:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429306.020452:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648346624 00000100:00100000:3.0:1789429306.020457:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648346624 00000100:00100000:3.0:1789429306.020491:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789429306.020498:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648346624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429306.020517:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 786497536 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429306.020554:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648346624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429306.020560:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789429306.020600:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648346624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429306.595412:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789429307.048737:0:21832:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 20: test extra readahead page left in cache ============================================================== 19:41:46 (1789429306) 00000100:00100000:1.0:1789429307.199595:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429307.200719:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634993792 00000100:00100000:0.0:1789429307.200733:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634993792 00000100:00100000:0.0:1789429307.202080:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21113 00000100:00100000:0.0:1789429307.202094:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+38:34856:x1876351634993792:12345-192.168.203.39@tcp:101:mkdir.0 00010000:00010000:0.0:1789429307.202116:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429307.202138:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c357 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.202215:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.202230:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.202244:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429307.202276:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429307.202279:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429307.202296:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.202324:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360a77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c357 expref: 40 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.202340:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c357 expref: 39 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.202348:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429307.202351:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429307.202354:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad600, rc 0) 00000100:00100000:0.0:1789429307.202423:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+39:34856:x1876351634993792:12345-192.168.203.39@tcp:101:mkdir.0 Request processed in 333us (2839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429307.202431:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21113 00000100:00080000:1.0:1789429307.203754:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429307.205055:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429307.205094:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429307.208034:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634994176 00000100:00100000:0.0:1789429307.208049:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634994176 00000100:00100000:0.0:1789429307.208142:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634993920 00000100:00100000:0.0:1789429307.208147:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634993920 00000100:00100000:0.0:1789429307.208177:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21114 00000100:00100000:0.0:1789429307.208187:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+40:34856:x1876351634994176:12345-192.168.203.39@tcp:36:mkdir.0 00010000:00010000:0.0:1789429307.208258:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429307.208285:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360a7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c357 expref: 40 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.208303:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429307.208314:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429307.208526:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a85 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.208545:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.208556:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.208569:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a8c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.208576:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.208583:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429307.209589:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x73:0x0]: returning size 16384 00010000:00010000:0.0:1789429307.209602:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a85 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429307.211179:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21115 00000100:00100000:2.0:1789429307.211210:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+40:2369:x1876351634993920:12345-192.168.203.39@tcp:41:mkdir.0 00000004:00000024:2.0:1789429307.211251:0:6704:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1789429307.211333:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+40:2369:x1876351634993920:12345-192.168.203.39@tcp:41:mkdir.0 Request processed in 142us (6236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429307.211343:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21115 00010000:00010000:0.0:1789429307.211817:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a85 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.211826:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.211832:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429307.211837:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a85 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.211846:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a85 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.211866:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd800) 00010000:00010000:0.0:1789429307.211870:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429307.211875:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a85 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.211881:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360a85 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429307.211902:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000044a79b5d reply state 00000000dbed506a transno 4294977114 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429307.211911:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429307.211987:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+40:34856:x1876351634994176:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 3801us (6938us total) trans 4294977114 rc 0/0 00000100:00100000:0.0:1789429307.211995:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21114 00010000:00010000:2.0:1789429307.213978:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a8c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.213991:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a8c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.213999:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.214004:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429307.214008:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a8c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.214016:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a8c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.214031:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa2b31947 (ffff946f120fd000) 00010000:00010000:2.0:1789429307.214034:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429307.214039:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a8c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.214044:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360a8c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429307.244131:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429307.244343:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634994304 00000100:00100000:0.0:1789429307.244352:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634994304 00000100:00100000:0.0:1789429307.244417:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 263 00000100:00100000:0.0:1789429307.244427:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:11155:x1876351634994304:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429307.244441:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 9 locks, starting at 0 00010000:00010000:0.0:1789429307.244463:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72635f42e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b26a expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.244480:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x23:0x0].0x0 (ffff946f04cf6100) 00010000:00010000:0.0:1789429307.244497:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4600/0xb4c3dad72635f451 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b271 expref: 13 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.244507:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff946f04cf6700) 00010000:00010000:0.0:1789429307.244516:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e04e6fa00/0xb4c3dad726359e1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19758 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.244525:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff946f051ef400) 00010000:00010000:0.0:1789429307.244532:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e04e6e400/0xb4c3dad72635884f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe18e9f expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.244541:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff946f051ef300) 00010000:00010000:0.0:1789429307.244588:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd8200/0xb4c3dad7263587d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe18e7c expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.244597:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff946f120fd400) 00010000:00010000:0.0:1789429307.244605:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f416fd800/0xb4c3dad7263586dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe18e1a expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.244614:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff946f120fd500) 00010000:00010000:0.0:1789429307.244621:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e04e6f200/0xb4c3dad726358649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe18de2 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.244629:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff946f04fb8800) 00010000:00010000:0.0:1789429307.244636:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e04e6ea00/0xb4c3dad72635711f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe179a6 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.244643:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff946f04fb8e00) 00010000:00010000:0.0:1789429307.244654:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f416fc000/0xb4c3dad726355ea3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe167cb expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.244667:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff946f04cf6e00) 00010000:00010000:0.0:1789429307.244672:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429307.244724:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:11155:x1876351634994304:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 298us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429307.244732:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 263 00000100:00080000:1.0:1789429307.245072:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429307.245537:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429307.246151:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634994560 00000100:00100000:3.0:1789429307.246160:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634994560 00000100:00100000:3.0:1789429307.246233:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 246 00000100:00100000:3.0:1789429307.246243:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05b62850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+39:14501:x1876351634994560:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789429307.246450:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05b62850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+40:14501:x1876351634994560:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 207us (912us total) trans 4294977115 rc 0/0 00000100:00100000:3.0:1789429307.246457:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 246 00000100:00100000:0.0:1789429307.251491:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429307.251884:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634994688 00000100:00100000:3.0:1789429307.251896:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634994688 00000100:00100000:3.0:1789429307.251957:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 264 00000100:00100000:3.0:1789429307.251967:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+40:14501:x1876351634994688:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429307.251993:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 33 locks, starting at 0 00010000:00010000:3.0:1789429307.252016:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f416fc200/0xb4c3dad72635b0b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19b80 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.252034:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff946f08640000) 00010000:00010000:3.0:1789429307.252044:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f054a5800/0xb4c3dad72635b057 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19b64 expref: 39 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.252053:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff946f22688e00) 00010000:00010000:3.0:1789429307.252062:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e04e6ec00/0xb4c3dad72635afcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19b3a expref: 38 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.252073:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff946f04cf6800) 00010000:00010000:3.0:1789429307.252081:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f416fcc00/0xb4c3dad72635b106 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19baa expref: 37 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.252090:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff946f08640d00) 00010000:00010000:3.0:1789429307.252097:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119d1600/0xb4c3dad72635b129 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19bb8 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.252107:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff946f120fdc00) 00010000:00010000:3.0:1789429307.252115:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd8c00/0xb4c3dad72635f4f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x68:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b2be expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.252127:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad72635f490 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x68:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b24e expref: 34 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.252135:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x68:0x0].0x0 (ffff946f04fb8200) 00010000:00010000:3.0:1789429307.252148:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f416fda00/0xb4c3dad72635f3e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x67:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b247 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.252160:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72635f386 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x67:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b21d expref: 32 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.252170:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x67:0x0].0x0 (ffff946f04cf6700) 00010000:00010000:3.0:1789429307.252181:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5600/0xb4c3dad72635f316 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b1ec expref: 31 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.252188:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff946f08640000) 00010000:00010000:3.0:1789429307.253073:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f416fdc00/0xb4c3dad72635f301 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b1e5 expref: 30 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.253090:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff946f22688e00) 00010000:00010000:3.0:1789429307.253108:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad72635f2bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b1c9 expref: 29 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.253118:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff946f04cf6800) 00010000:00010000:3.0:1789429307.253127:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad72635f221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b18a expref: 28 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.253134:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff946f08640d00) 00010000:00010000:3.0:1789429307.253143:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad72635f22f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1b191 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.253151:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff946f120fdc00) 00010000:00010000:3.0:1789429307.253161:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f054a4c00/0xb4c3dad72635af2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19b09 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.253169:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff946f22688d00) 00010000:00010000:3.0:1789429307.253178:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f054a4600/0xb4c3dad72635af5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19b17 expref: 25 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.253185:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff946f22688600) 00010000:00010000:3.0:1789429307.253194:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f416fd000/0xb4c3dad72635aef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19afb expref: 24 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.253997:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff946f08640600) 00010000:00010000:3.0:1789429307.254018:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119d0e00/0xb4c3dad72635af8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19b25 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254028:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff946f120fda00) 00010000:00010000:3.0:1789429307.254040:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e04e6f800/0xb4c3dad72635aec8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19aed expref: 22 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254050:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff946f04cf6d00) 00010000:00010000:3.0:1789429307.254062:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119d1e00/0xb4c3dad72635ae89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19ad8 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254071:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff946f120fd900) 00010000:00010000:3.0:1789429307.254081:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e04e6f600/0xb4c3dad72635ae4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19ac3 expref: 20 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254090:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff946f04cf6a00) 00010000:00010000:3.0:1789429307.254099:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f054a4a00/0xb4c3dad72635adfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19aa7 expref: 19 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254107:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff946f22688c00) 00010000:00010000:3.0:1789429307.254117:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f416fd600/0xb4c3dad72635adcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19a99 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254125:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff946f08640a00) 00010000:00010000:3.0:1789429307.254135:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f416fd200/0xb4c3dad72635ad9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19a8b expref: 17 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254143:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff946f08640f00) 00010000:00010000:3.0:1789429307.254151:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726359d5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe196c5 expref: 16 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254163:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119d1200/0xb4c3dad72635a3fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19846 expref: 15 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254176:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e04e6e600/0xb4c3dad726359e8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe19766 expref: 14 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254185:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff946f051ef400) 00010000:00010000:3.0:1789429307.254194:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd8800/0xb4c3dad7263587a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe18e6e expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254338:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e0ddd8e00/0xb4c3dad72635882c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe18e98 expref: 12 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254346:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff946f051ef300) 00010000:00010000:3.0:1789429307.254356:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f514c00/0xb4c3dad72635873e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe18e44 expref: 11 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254364:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff946f120fd400) 00010000:00010000:3.0:1789429307.254374:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f416fc400/0xb4c3dad726358618 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe18dd4 expref: 10 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254386:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad7263586c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe18e13 expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254394:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff946f120fd500) 00010000:00010000:3.0:1789429307.254405:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946e04e6f400/0xb4c3dad7263585a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe18daa expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.254413:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff946f04fb8800) 00010000:00010000:3.0:1789429307.254419:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429307.254515:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:14501:x1876351634994688:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2548us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429307.254525:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 264 00000100:00100000:3.0:1789429307.369721:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429307.369923:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634994816 00000100:00100000:2.0:1789429307.369934:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634994816 00000100:00100000:2.0:1789429307.370001:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21116 00000100:00100000:2.0:1789429307.370012:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:34873:x1876351634994816:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:2.0:1789429307.370036:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429307.370060:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360a93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c35e expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.370124:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360a9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.370137:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.370148:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429307.370181:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429307.370185:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429307.370243:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360a9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.370267:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360a93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c35e expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.370283:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360a9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c35e expref: 8 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.370290:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:2.0:1789429307.370293:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429307.370297:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429307.370355:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:34873:x1876351634994816:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 346us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429307.370362:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21116 00000100:00100000:1.0:1789429307.373851:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429307.373981:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634994944 00000100:00100000:2.0:1789429307.373991:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634994944 00000100:00100000:2.0:1789429307.374046:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21117 00000100:00100000:2.0:1789429307.374057:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:34873:x1876351634994944:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:2.0:1789429307.374075:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429307.374094:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360aa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c365 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374154:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360aa8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374167:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360aa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374179:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360aa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374193:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360aaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374221:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360aaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374229:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360aaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374316:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ab6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x73:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374325:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x73:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374332:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x73:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429307.374358:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x73:0x0]: returning size 16384 00000004:00200000:2.0:1789429307.374361:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429307.374380:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x73:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374392:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360aa8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374399:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360aa8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374405:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374411:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429307.374415:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360aa8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374423:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360aa8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374435:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:2.0:1789429307.374438:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429307.374442:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360aa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374448:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360aa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374459:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360aaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374468:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360aaf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374473:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360aaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374477:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429307.374480:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360aaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374485:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360aaf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374492:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa2b31947 (ffff946f051ef000) 00010000:00010000:2.0:1789429307.374494:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429307.374496:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360aaf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374501:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360aaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374530:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360aa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c365 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374543:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x73:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c365 expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.374550:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x73:0x0].0x0 (ffff946f051ef600) 00010000:00010000:2.0:1789429307.374553:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789429307.374555:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546a00, rc 0) 00000100:00100000:2.0:1789429307.374712:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+9:34873:x1876351634994944:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 656us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429307.374720:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21117 00000100:00100000:3.0:1789429307.383480:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429307.385275:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634995200 00000100:00100000:0.0:1789429307.385288:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634995200 00000100:00100000:0.0:1789429307.385396:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21118 00000100:00100000:0.0:1789429307.385407:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:34873:x1876351634995200:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:0.0:1789429307.385428:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429307.385448:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360abd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x73:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c36c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.385569:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360ac4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x73:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.385583:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360ac4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.385595:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360ac4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.385609:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360acb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x73:0x0].0xe7762464 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.385616:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360acb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.385628:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360acb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789429307.386177:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x30:0x0], index 0: 0 00010000:00010000:0.0:1789429307.386370:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360ad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x74:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.386381:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.386389:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.386420:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360ac4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.386426:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360ac4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.386432:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360ac4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.386438:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2aca00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429307.386442:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360ac4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.386449:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360ac4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.386459:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x73:0x0].0x0 (ffff946f051ef600) 00010000:00010000:0.0:1789429307.386462:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429307.386467:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360ac4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.386473:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360ac4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429307.386483:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ca1a8c16 reply state 000000002f2d2a74 transno 4294977116 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360acb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429307.386491:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789429307.386520:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360abd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c36c expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.386533:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c36c expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.386540:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x74:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429307.386542:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429307.386544:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac600, rc 0) 00000100:00100000:0.0:1789429307.386616:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:34873:x1876351634995200:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 1211us (3144us total) trans 4294977116 rc 0/0 00000100:00100000:0.0:1789429307.386624:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21118 00010000:00010000:2.0:1789429307.390395:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360acb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.390413:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360acb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.390420:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360acb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.390427:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2acc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429307.390431:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360acb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.390439:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360acb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.390454:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x73:0x0].0xe7762464 (ffff946f120fd800) 00010000:00010000:2.0:1789429307.390457:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429307.390462:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360acb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.390469:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360acb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429307.391815:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429307.391864:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634995328 00000100:00100000:0.0:1789429307.391875:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634995328 00000100:00080000:1.0:1789429307.391943:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429307.391957:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5756 00000100:00100000:0.0:1789429307.391982:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+5:34873:x1876351634995328:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:0.0:1789429307.391999:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429307.392095:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c373 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429307.392121:0:20986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789429307.392139:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=1005s v=(0 0) 00010000:00010000:0.0:1789429307.392142:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429307.392150:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.392164:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.392173:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac200, rc 0) 00000100:00100000:0.0:1789429307.392238:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:34873:x1876351634995328:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 273us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429307.392244:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5756 00000100:00100000:3.0:1789429307.398331:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429307.398417:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634995584 00000100:00100000:2.0:1789429307.398427:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634995584 00000100:00100000:2.0:1789429307.398482:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 247 00000100:00100000:2.0:1789429307.398493:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+11:34873:x1876351634995584:12345-192.168.203.39@tcp:35:multiop.0 00000100:00100000:2.0:1789429307.398879:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+12:34873:x1876351634995584:12345-192.168.203.39@tcp:35:multiop.0 Request processed in 386us (555us total) trans 4294977117 rc 0/0 00000100:00100000:2.0:1789429307.398887:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 247 00000100:00100000:2.0:1789429307.421589:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429307.421660:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634995712 00000100:00100000:3.0:1789429307.421671:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634995712 00000100:00100000:3.0:1789429307.421728:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21119 00000100:00100000:3.0:1789429307.421738:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:34874:x1876351634995712:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:3.0:1789429307.421757:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429307.421775:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360ae7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c37a expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.421833:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360aee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.421846:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360aee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.421856:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360aee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429307.421889:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429307.421893:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429307.421916:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360aee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.421940:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360ae7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c37a expref: 7 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.421976:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360aee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c37a expref: 6 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.421991:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:3.0:1789429307.421993:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429307.421997:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:3.0:1789429307.422101:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:34874:x1876351634995712:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 364us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429307.422108:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21119 00000100:00100000:0.0:1789429307.425619:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429307.425704:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634995840 00000100:00100000:1.0:1789429307.425715:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634995840 00000100:00100000:1.0:1789429307.425771:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21120 00000100:00100000:1.0:1789429307.425781:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:34874:x1876351634995840:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:1.0:1789429307.425812:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429307.425833:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360af5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c381 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.425889:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360afc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.425904:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360afc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.425916:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360afc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.425931:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.425938:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.425945:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426057:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360b0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x73:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426066:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x73:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426072:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x73:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429307.426097:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x73:0x0]: returning size 16384 00000004:00200000:1.0:1789429307.426100:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429307.426118:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360b0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x73:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426129:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360afc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426135:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360afc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426142:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360afc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426148:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429307.426152:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360afc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426160:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360afc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426171:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:1.0:1789429307.426174:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429307.426180:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360afc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426186:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360afc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426227:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426234:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426244:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426249:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429307.426252:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426258:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426266:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa2b31947 (ffff946f2076ad00) 00010000:00010000:1.0:1789429307.426268:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429307.426271:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426276:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa2b31947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426306:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c381 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426319:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360b0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x73:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c381 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.426326:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x73:0x0].0x0 (ffff946f051ef600) 00010000:00010000:1.0:1789429307.426328:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789429307.426330:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7600, rc 0) 00000100:00100000:1.0:1789429307.426386:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:34874:x1876351634995840:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 606us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429307.426396:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21120 00000100:00100000:1.0:1789429307.429938:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429307.430063:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634996096 00000100:00100000:2.0:1789429307.430081:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634996096 00000100:00100000:2.0:1789429307.430179:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21121 00000100:00100000:2.0:1789429307.430190:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:34874:x1876351634996096:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:2.0:1789429307.430247:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429307.430268:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360b11 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x73:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c388 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430409:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360b18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430423:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360b18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430434:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360b18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430449:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360b1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x73:0x0].0xe7762464 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430456:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430462:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430530:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360b26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x74:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430539:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430545:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429307.430554:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x74:0x0]: returning size 8190 00010000:00010000:2.0:1789429307.430645:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360b18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430652:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360b18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430658:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360b18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430664:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429307.430668:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360b18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430674:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360b18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430685:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x73:0x0].0x0 (ffff946f051ef600) 00010000:00010000:2.0:1789429307.430688:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429307.430691:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360b18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430701:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360b18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430711:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360b1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430717:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360b1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430722:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430726:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429307.430728:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360b1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430733:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360b1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430738:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x73:0x0].0xe7762464 (ffff946f051ef000) 00010000:00010000:2.0:1789429307.430740:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429307.430742:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360b1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430747:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360b1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x73:0x0].0xe7762464 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.430784:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360b11 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c388 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.431353:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360b26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c388 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.431360:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x74:0x0].0x0 (ffff946f120fd300) 00010000:00010000:2.0:1789429307.431363:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789429307.431366:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429307.431482:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:34874:x1876351634996096:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 1293us (1551us total) trans 4294977118 rc 0/0 00000100:00100000:2.0:1789429307.431490:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21121 00000100:00100000:3.0:1789429307.436677:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429307.436777:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634996224 00000100:00100000:1.0:1789429307.436787:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634996224 00000100:00100000:1.0:1789429307.436870:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5757 00000100:00100000:1.0:1789429307.436881:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:34874:x1876351634996224:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:1.0:1789429307.436899:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429307.436917:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c38f expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.436950:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 5 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.436960:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429307.436964:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789429307.437023:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [8192->16383] (req 8192->16383) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 6 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.437060:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 5 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.437075:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 5 pid: 20986 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429307.437088:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:20745:1876351648346752:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429307.437181:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120ed840 going to sleep for 11 seconds 00000100:00080000:2.0:1789429307.437508:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429307.441500:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:20745:1876351648346752:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429307.441535:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [8192->16383] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 6 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.441556:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6200, rc 0) 00000100:00100000:1.0:1789429307.441616:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:34874:x1876351634996224:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 4736us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429307.441626:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5757 00000100:00100000:3.0:1789429307.443683:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429307.443936:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634996352 00000100:00100000:2.0:1789429307.443949:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634996352 00002000:00100000:2.0:1789429307.444033:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x30:0x0] (0->8189) req@ffff946f119c7100 x1876351634996352/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:43/0 lens 8680/0 e 0 to 0 dl 1789429318 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429307.444044:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c7100 with x1876351634996352 ext(0->8189) 00010000:00010000:2.0:1789429307.444053:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 6 pid: 20986 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.444073:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 6 pid: 20986 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429307.444081:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f119c7100 00000100:00100000:2.0:1789429307.444110:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1402 00000100:00100000:2.0:1789429307.444120:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351634996352:12345-192.168.203.39@tcp:4:multiop.0 00000100:00100000:2.0:1789429307.444948:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634996352:12345-192.168.203.39@tcp:4:multiop.0 Request processed in 826us (1268us total) trans 4294969261 rc 0/0 00000100:00100000:2.0:1789429307.444957:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1402 00002000:00100000:2.0:1789429307.444965:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x30:0x0] (0->8189) req@ffff946f119c7100 x1876351634996352/t4294969261(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:43/0 lens 8680/448 e 0 to 0 dl 1789429318 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429307.444982:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c7100 with x1876351634996352 ext(0->8189) 00010000:00010000:2.0:1789429307.444989:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 8 pid: 20986 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.445002:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 8 pid: 20986 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429307.445009:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f119c7100 00000100:00100000:3.0:1789429307.448610:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429307.448786:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634996480 00000100:00100000:0.0:1789429307.448847:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634996480 00010000:00010000:0.0:1789429307.448887:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 8 pid: 20986 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429307.448988:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6172 00000100:00100000:0.0:1789429307.448998:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+8:2369:x1876351634996480:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429307.449013:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789429307.449031:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x30:0x0] updating lvb size from disk: 0 -> 8190 00002000:00010000:0.0:1789429307.449034:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x30:0x0] updating lvb mtime from disk: 0 -> 1789429307 00002000:00010000:0.0:1789429307.449038:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x30:0x0] updating lvb ctime from disk: 0 -> 1789429307 00010000:00010000:0.0:1789429307.449043:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 8 pid: 20986 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.449056:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 8 pid: 20986 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.449078:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000032fffbc/0xb4c3dad726360ae0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c373 expref: 8 pid: 20986 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.449095:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789429307.449099:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789429307.449106:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 5 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.449116:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 5 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.449152:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 5 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429307.449166:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648346880:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429307.449289:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e0ecf96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429307.452764:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429307.452988:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634996736 00000100:00100000:3.0:1789429307.452997:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634996736 00000100:00100000:3.0:1789429307.453053:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 248 00000100:00100000:3.0:1789429307.453062:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:34874:x1876351634996736:12345-192.168.203.39@tcp:35:multiop.0 00000100:00100000:3.0:1789429307.453390:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:34874:x1876351634996736:12345-192.168.203.39@tcp:35:multiop.0 Request processed in 327us (633us total) trans 4294977119 rc 0/0 00000100:00100000:3.0:1789429307.453397:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 248 00000100:00100000:1.0:1789429307.461647:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648346880:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429307.461676:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429307.461745:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351634996480:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12747us (13142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429307.461756:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6172 00000100:00100000:0.0:1789429307.471373:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429307.471450:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634996992 00000100:00100000:3.0:1789429307.471473:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634996992 00000100:00100000:3.0:1789429307.471531:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21122 00000100:00100000:3.0:1789429307.471541:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+12:34875:x1876351634996992:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:3.0:1789429307.471564:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429307.471585:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360b3b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x73:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c396 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.471677:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x74:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.471692:0:15669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360ad2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c36c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.471700:0:15669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360b26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c388 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.471708:0:15669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x74:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.471741:0:15669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360b26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c388 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.471754:0:15669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360b26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c388 expref: 9 pid: 5840 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429307.471765:0:15669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648347008:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429307.472093:0:15669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c36c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.472104:0:15669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360ad2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c36c expref: 13 pid: 5839 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429307.472113:0:15669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648347136:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429307.472138:0:15669:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429307.475435:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429307.475474:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429307.475561:0:15669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648347008:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429307.475572:0:15669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648347136:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429307.475599:0:15669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x74:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429307.475701:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634997120 00000100:00100000:1.0:1789429307.475708:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634997120 00010000:00010000:1.0:1789429307.475741:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360b26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c388 expref: 10 pid: 5840 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429307.475768:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634997248 00000100:00100000:1.0:1789429307.475771:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634997248 00010000:00010000:1.0:1789429307.475781:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360ad2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c36c expref: 14 pid: 5839 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429307.475806:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6173 00000100:00100000:1.0:1789429307.475815:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351634997120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429307.475831:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429307.475838:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360b26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c388 expref: 10 pid: 5840 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.475850:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360b26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c388 expref: 10 pid: 5840 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.475871:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360b26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c388 expref: 10 pid: 5840 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.475890:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x74:0x0].0x0 (ffff946f120fd300) 00010000:00010000:1.0:1789429307.475895:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x74:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.475904:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x74:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.475911:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429307.475959:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2371:x1876351634997120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 144us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429307.475983:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6173 00000100:00100000:1.0:1789429307.476001:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6174 00000100:00100000:1.0:1789429307.476008:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351634997248:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429307.476015:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429307.476020:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360ad2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c36c expref: 14 pid: 5839 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.476035:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c36c expref: 14 pid: 5839 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.476047:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360ad2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x74:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c36c expref: 14 pid: 5839 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.476056:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x74:0x0].0x0 (ffff946f120fd300) 00010000:00010000:1.0:1789429307.476060:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x74:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.476068:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x74:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.476076:0:11354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x74:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.476098:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429307.476117:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351634997248:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 110us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429307.476123:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6174 00010000:00010000:1.0:1789429307.476141:0:15669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x74:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.476148:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x74:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429307.476166:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x74:0x0]: returning size 16384 00010000:00010000:1.0:1789429307.476326:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726360b3b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x73:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c396 expref: 14 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.476348:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x74:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c396 expref: 13 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.476356:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x74:0x0].0x0 (ffff946f120fd300) 00010000:00010000:1.0:1789429307.476358:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789429307.476361:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0a00, rc 0) 00000100:00100000:1.0:1789429307.476385:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34020380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+13:34875:x1876351634996992:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 4846us (5020us total) trans 4294977120 rc 0/0 00000100:00100000:1.0:1789429307.476392:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21122 00000100:00100000:0.0:1789429307.481561:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429307.481656:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634997376 00000100:00100000:1.0:1789429307.481666:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634997376 00000100:00100000:1.0:1789429307.481758:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21123 00000100:00100000:1.0:1789429307.481769:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:34875:x1876351634997376:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:1.0:1789429307.481847:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429307.481869:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360b50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x74:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c39d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.481926:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360b50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x74:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c39d expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.481941:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360b50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x74:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c39d expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.481959:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x74:0x0].0x0 (ffff946f120fd300) 00010000:00010000:1.0:1789429307.481978:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789429307.481983:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6600, rc 0) 00000100:00100000:1.0:1789429307.482043:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:34875:x1876351634997376:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 276us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429307.482050:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21123 00000100:00100000:1.0:1789429307.485445:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429307.485905:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634997504 00000100:00100000:0.0:1789429307.485915:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634997504 00000100:00100000:0.0:1789429307.486018:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5758 00000100:00100000:0.0:1789429307.486029:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:34875:x1876351634997504:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:0.0:1789429307.486047:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429307.486064:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948d0d02/0xb4c3dad726360b57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3a4 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.486095:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 5 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.486104:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x30:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789429307.486109:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789429307.486114:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948d0d02/0xb4c3dad726360b57 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3a4 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.486146:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 5 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.486160:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 5 pid: 20745 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429307.486175:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34020000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648347264:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429307.486296:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e0ecf9780 going to sleep for 11 seconds 00000100:00100000:0.0:1789429307.489104:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34020000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648347264:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429307.489139:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000948d0d02/0xb4c3dad726360b57 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3a4 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429307.489159:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:0.0:1789429307.489243:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:34875:x1876351634997504:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 3215us (3806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429307.489251:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5758 00000100:00100000:0.0:1789429307.490786:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429307.490877:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634997632 00000100:00100000:2.0:1789429307.490885:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634997632 00002000:00100000:2.0:1789429307.490926:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x30:0x0] (8192->16383) req@ffff946f34020000 x1876351634997632/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:43/0 lens 8680/0 e 0 to 0 dl 1789429318 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429307.490936:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34020000 with x1876351634997632 ext(8192->16383) 00010000:00010000:2.0:1789429307.490945:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 6 pid: 20745 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.490977:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 6 pid: 20745 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429307.490991:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f34020000 00000100:00100000:2.0:1789429307.491022:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1403 00000100:00100000:2.0:1789429307.491032:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351634997632:12345-192.168.203.39@tcp:4:multiop.0 00000100:00100000:2.0:1789429307.491419:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351634997632:12345-192.168.203.39@tcp:4:multiop.0 Request processed in 388us (637us total) trans 4294969262 rc 0/0 00000100:00100000:2.0:1789429307.491426:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1403 00002000:00100000:2.0:1789429307.491433:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x30:0x0] (8192->16383) req@ffff946f34020000 x1876351634997632/t4294969262(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:43/0 lens 8680/448 e 0 to 0 dl 1789429318 ref 1 fl Complete:H/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429307.491440:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34020000 with x1876351634997632 ext(8192->16383) 00010000:00010000:2.0:1789429307.491446:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 8 pid: 20745 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.491458:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 8 pid: 20745 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429307.491464:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f34020000 00000100:00100000:1.0:1789429307.495056:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429307.495188:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634997760 00000100:00100000:3.0:1789429307.495232:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634997760 00010000:00010000:3.0:1789429307.495269:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 8 pid: 20745 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429307.495311:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6175 00000100:00100000:3.0:1789429307.495322:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351634997760:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429307.495345:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789429307.495365:0:11354:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x30:0x0] updating lvb size from disk: 8190 -> 16384 00010000:00010000:3.0:1789429307.495372:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 8 pid: 20745 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.495386:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 8 pid: 20745 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.495407:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726360b34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c38f expref: 8 pid: 20745 timeout: 1105 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.495423:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1789429307.495427:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1789429307.495434:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000948d0d02/0xb4c3dad726360b57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3a4 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.495444:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948d0d02/0xb4c3dad726360b57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3a4 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429307.495481:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000948d0d02/0xb4c3dad726360b57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3a4 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429307.495495:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648347392:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429307.495566:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429307.499517:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429307.499604:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634997888 00000100:00100000:0.0:1789429307.499614:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634997888 00002000:00100000:0.0:1789429307.499660:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x30:0x0] (0->8191) req@ffff946f119c5880 x1876351634997888/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:43/0 lens 488/0 e 0 to 0 dl 1789429318 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429307.499670:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c5880 with x1876351634997888 ext(0->8191) 00002000:00010000:0.0:1789429307.499676:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f119c5880 00000100:00100000:0.0:1789429307.499708:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11508 00000100:00100000:0.0:1789429307.499717:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634997888:12345-192.168.203.39@tcp:3:multiop.0 00000100:00100000:0.0:1789429307.499928:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351634997888:12345-192.168.203.39@tcp:3:multiop.0 Request processed in 210us (418us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1789429307.499937:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11508 00002000:00100000:0.0:1789429307.499944:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x30:0x0] (0->8191) req@ffff946f119c5880 x1876351634997888/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:43/0 lens 488/8632 e 0 to 0 dl 1789429318 ref 1 fl Complete:/600/0 rc 8192/8192 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429307.499952:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c5880 with x1876351634997888 ext(0->8191) 00002000:00010000:0.0:1789429307.499965:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f119c5880 00000100:00100000:1.0:1789429307.500619:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648347392:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429307.500643:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429307.500687:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351634997760:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5366us (5638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429307.500696:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6175 00000100:00100000:3.0:1789429307.518061:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429307.518242:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634998016 00000100:00100000:2.0:1789429307.518252:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634998016 00000100:00100000:2.0:1789429307.518316:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 265 00000100:00100000:2.0:1789429307.518326:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:5606:x1876351634998016:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429307.518341:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789429307.518365:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360b0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x73:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c381 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.518390:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x73:0x0].0x0 (ffff946f051ef600) 00010000:00010000:2.0:1789429307.518402:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360aee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c37a expref: 8 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.518409:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:2.0:1789429307.518412:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429307.518479:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:5606:x1876351634998016:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 154us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429307.518487:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 265 00000100:00100000:3.0:1789429307.520035:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429307.520163:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634998272 00000100:00100000:2.0:1789429307.520171:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634998272 00000100:00100000:2.0:1789429307.520245:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 249 00000100:00100000:2.0:1789429307.520255:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:14501:x1876351634998272:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789429307.520478:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:14501:x1876351634998272:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 224us (448us total) trans 4294977121 rc 0/0 00000100:00100000:2.0:1789429307.520486:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 249 00000100:00100000:3.0:1789429307.523102:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429307.523193:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634998400 00000100:00100000:1.0:1789429307.523238:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634998400 00000100:00100000:1.0:1789429307.523302:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 266 00000100:00100000:1.0:1789429307.523312:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:14501:x1876351634998400:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429307.523327:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789429307.523351:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360b42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x74:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c396 expref: 15 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.523375:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360b50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x74:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c39d expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.523387:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x74:0x0].0x0 (ffff946f120fd300) 00010000:00010000:1.0:1789429307.523402:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360a9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c35e expref: 13 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.523412:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:1.0:1789429307.523424:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ab6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x73:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c365 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429307.523432:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x73:0x0].0x0 (ffff946f051ef600) 00010000:00010000:1.0:1789429307.523437:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429307.523496:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+11:14501:x1876351634998400:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 184us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429307.523503:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 266 00000100:00100000:1.0:1789429307.524991:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429307.525052:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634998528 00000100:00100000:2.0:1789429307.525060:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634998528 00000100:00100000:2.0:1789429307.525113:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 267 00000100:00100000:2.0:1789429307.525122:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+8:5606:x1876351634998528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429307.525135:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429307.525175:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948d0d02/0xb4c3dad726360b57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x30:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3a4 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429307.525240:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429307.525287:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:5606:x1876351634998528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 166us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429307.525295:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 267 00010000:00010000:1.0:1789429307.620328:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429308.646219:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429309.669806:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429310.242165:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429310.242224:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429310.242249:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429310.242276:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429310.242295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429310.242314:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429310.242336:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429310.242363:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634999040 00000100:00100000:2.0:1789429310.242374:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634999040 00000100:00100000:2.0:1789429310.242427:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634999296 00000100:00100000:2.0:1789429310.242431:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634999296 00000100:00100000:2.0:1789429310.242455:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634998912 00000100:00100000:2.0:1789429310.242458:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634998912 00000100:00100000:2.0:1789429310.242721:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634999424 00000100:00100000:2.0:1789429310.242725:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634999424 00000100:00100000:2.0:1789429310.242747:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 765 00000100:00100000:2.0:1789429310.242756:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351634999040:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429310.242829:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351634999040:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 74us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429310.242837:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 765 00000100:00100000:2.0:1789429310.242855:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 766 00000100:00100000:2.0:1789429310.242862:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351634999296:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429310.242887:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351634999296:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429310.242893:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 766 00000100:00100000:2.0:1789429310.242904:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 767 00000100:00100000:2.0:1789429310.242910:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2368:x1876351634998912:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429310.242933:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2368:x1876351634998912:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429310.242939:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 767 00000100:00100000:2.0:1789429310.242962:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 768 00000100:00100000:2.0:1789429310.242969:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351634999424:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429310.243004:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351634999424:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 36us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429310.243009:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 768 00000100:00100000:2.0:1789429310.243032:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634998656 00000100:00100000:2.0:1789429310.243036:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634998656 00000100:00100000:2.0:1789429310.243062:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 531 00000100:00100000:2.0:1789429310.243068:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351634998656:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429310.243091:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351634998656:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429310.243097:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 531 00000100:00100000:2.0:1789429310.243146:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634998784 00000100:00100000:2.0:1789429310.243155:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634998784 00000100:00100000:2.0:1789429310.243182:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634999168 00000100:00100000:2.0:1789429310.243185:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634999168 00000100:00100000:2.0:1789429310.243229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 711 00000100:00100000:2.0:1789429310.243236:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+11:2368:x1876351634998784:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429310.243266:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+11:2368:x1876351634998784:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429310.243271:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 711 00000100:00100000:2.0:1789429310.243283:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 712 00000100:00100000:2.0:1789429310.243290:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351634999168:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429310.243317:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351634999168:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429310.243322:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 712 00000100:00080000:2.0:1789429310.243341:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429310.243345:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429310.243347:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429310.628039:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648347520:0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.628121:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429310.628172:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648348032:0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.628224:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429310.628253:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789429310.628259:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648347648:0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.628279:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429310.628297:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648348160:0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.628319:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429310.628350:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648347776:0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.628374:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429310.628394:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789429310.628399:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648347904:0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.628419:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429310.628461:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648347520 00000100:00100000:0.0:1789429310.628469:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648347520 00000100:00100000:0.0:1789429310.628518:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:0.0:1789429310.628526:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648347520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.628575:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648347520:12345-0@lo:400:kworker.0 Request processed in 49us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429310.628582:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:0.0:1789429310.628630:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648348032 00000100:00100000:0.0:1789429310.628634:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648348032 00000100:00100000:0.0:1789429310.628675:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648347648 00000100:00100000:0.0:1789429310.628678:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648347648 00000100:00100000:0.0:1789429310.628694:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648347776 00000100:00100000:0.0:1789429310.628697:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648347776 00000100:00100000:0.0:1789429310.628715:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1789429310.628721:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648348032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.628752:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648348032:12345-0@lo:400:kworker.0 Request processed in 31us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429310.628758:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1789429310.628769:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1789429310.628774:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648347648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.628797:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648347648:12345-0@lo:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429310.628802:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:0.0:1789429310.628813:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1789429310.628819:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648347776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.628847:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648347776:12345-0@lo:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429310.628852:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1789429310.628873:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648348160 00000100:00100000:0.0:1789429310.628876:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648348160 00000100:00100000:0.0:1789429310.628901:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648347904 00000100:00100000:0.0:1789429310.628904:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648347904 00000100:00100000:0.0:1789429310.628924:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1789429310.628930:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648348160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.628971:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648348160:12345-0@lo:400:kworker.0 Request processed in 41us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429310.628977:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1789429310.628988:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:0.0:1789429310.628994:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648347904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.629021:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648347904:12345-0@lo:400:kworker.0 Request processed in 28us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429310.629030:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00080000:0.0:1789429310.629055:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429310.629059:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429310.629062:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429310.629103:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648347904:0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.629114:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648347776:0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.629145:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648347648:0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.629154:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648348160:0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.629161:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648347520:0@lo:400:kworker.0 00000100:00100000:0.0:1789429310.629170:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648348032:0@lo:400:kworker.0 00010000:00010000:0.0:1789429310.692863:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429311.139590:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789429311.139614:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648348288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429311.139683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429311.139867:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648348288 00000100:00100000:0.0:1789429311.139876:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648348288 00000100:00100000:0.0:1789429311.139931:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789429311.139950:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648348288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429311.139983:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 786497536 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429311.140035:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648348288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429311.140042:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789429311.140088:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648348288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429311.141756:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789429311.141778:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648348416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429311.141827:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429311.141869:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648348416 00000100:00100000:2.0:1789429311.141875:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648348416 00000100:00100000:2.0:1789429311.141912:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789429311.141919:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648348416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429311.141955:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 354222080 pending 3407872 free 3856662528 avail 3854565376 00000100:00100000:2.0:1789429311.141995:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648348416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429311.142002:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789429311.142039:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f509180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648348416:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789429311.717285:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789429311.719273:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969262 is committed 00000001:00080000:1.0:1789429311.719295:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969261 is committed 00000001:00080000:1.0:1789429311.734794:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977116 is committed 00000001:00080000:1.0:1789429311.735102:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977120 is committed 00000001:00080000:1.0:1789429311.735294:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977121 is committed 00000001:00080000:1.0:1789429311.735303:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977118 is committed 00000001:00080000:1.0:1789429311.738989:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977119 is committed 00010000:00010000:0.0:1789429312.740100:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429313.439511:0:22030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 19:41:52 (1789429312) 00000100:00100000:3.0:1789429313.503149:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429313.503447:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634999552 00000100:00100000:0.0:1789429313.503457:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634999552 00000100:00100000:0.0:1789429313.503529:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21124 00000100:00100000:0.0:1789429313.503539:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:35457:x1876351634999552:12345-192.168.203.39@tcp:101:mkdir.0 00010000:00010000:0.0:1789429313.503557:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429313.503580:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360b5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3ab expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789429313.503972:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789429313.504041:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360b65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.504056:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.504070:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429313.504104:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429313.504108:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429313.504124:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.504148:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360b5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ab expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.504165:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360b65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ab expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.504173:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd400) 00010000:00010000:0.0:1789429313.504176:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429313.504179:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac200, rc 0) 00000100:00100000:0.0:1789429313.505062:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:35457:x1876351634999552:12345-192.168.203.39@tcp:101:mkdir.0 Request processed in 1521us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429313.505072:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21124 00000100:00100000:2.0:1789429313.507494:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429313.507757:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634999808 00000100:00100000:1.0:1789429313.507766:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634999808 00000100:00100000:1.0:1789429313.507822:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21125 00000100:00100000:1.0:1789429313.507832:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:35457:x1876351634999808:12345-192.168.203.39@tcp:36:mkdir.0 00010000:00010000:1.0:1789429313.507893:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429313.507935:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360b65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ab expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.507957:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd400) 00010000:00010000:1.0:1789429313.507968:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429313.508318:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b6c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.508332:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.508343:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.508355:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360b73 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.508363:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360b73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.508369:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360b73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429313.509702:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x75:0x0]: returning size 16384 00010000:00010000:1.0:1789429313.509718:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b6c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.509727:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b6c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.509734:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.509740:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429313.509746:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b6c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.509753:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b6c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.509766:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a000) 00010000:00010000:1.0:1789429313.509769:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429313.509773:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b6c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.509779:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b6c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429313.509796:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e968f85c reply state 0000000049dc1c03 transno 4294977122 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360b73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429313.509803:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429313.509902:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+7:35457:x1876351634999808:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 2069us (2411us total) trans 4294977122 rc 0/0 00000100:00100000:1.0:1789429313.509911:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21125 00010000:00010000:3.0:1789429313.511587:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360b73 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.511602:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360b73 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.511609:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360b73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.511615:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429313.511619:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360b73 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.511626:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360b73 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.511640:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc28130bf (ffff946f2076a300) 00010000:00010000:3.0:1789429313.511643:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429313.511647:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360b73 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.511654:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360b73 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429313.530562:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429313.530634:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351634999936 00000100:00100000:0.0:1789429313.530644:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351634999936 00000100:00100000:0.0:1789429313.530708:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21126 00000100:00100000:0.0:1789429313.530718:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:35458:x1876351634999936:12345-192.168.203.39@tcp:101:mount.0 00010000:00010000:0.0:1789429313.530740:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429313.530764:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360b7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3b2 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.530824:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.530837:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.530847:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429313.530877:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429313.530881:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429313.532408:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.532448:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360b7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b2 expref: 8 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.532465:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b2 expref: 7 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.532480:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd900) 00010000:00010000:0.0:1789429313.532482:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429313.532486:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429313.532557:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:35458:x1876351634999936:12345-192.168.203.39@tcp:101:mount.0 Request processed in 1839us (2002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429313.532566:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21126 00000100:00100000:3.0:1789429313.537322:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429313.537410:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635000064 00000100:00100000:1.0:1789429313.537420:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635000064 00000100:00100000:1.0:1789429313.537480:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21127 00000100:00100000:1.0:1789429313.537490:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:35458:x1876351635000064:12345-192.168.203.39@tcp:101:mount.0 00010000:00010000:1.0:1789429313.537511:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429313.537531:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3b9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537595:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360b8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537609:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360b8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537619:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360b8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537633:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360b96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537640:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360b96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537646:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360b96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537743:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x75:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537751:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537758:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429313.537785:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x75:0x0]: returning size 16384 00000004:00200000:1.0:1789429313.537788:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429313.537808:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537818:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360b8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537828:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360b8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537835:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360b8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537851:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429313.537855:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360b8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537863:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360b8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537873:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd900) 00010000:00010000:1.0:1789429313.537876:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429313.537881:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360b8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537887:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360b8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537897:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360b96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537903:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360b96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537908:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360b96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537912:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429313.537915:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360b96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537930:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360b96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537938:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc28130bf (ffff946f2076a000) 00010000:00010000:1.0:1789429313.537941:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429313.537944:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360b96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537950:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360b96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537976:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360b88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b9 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537989:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b9 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.537996:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x75:0x0].0x0 (ffff946f2076a900) 00010000:00010000:1.0:1789429313.537998:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429313.538001:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7c00, rc 0) 00000100:00100000:1.0:1789429313.538063:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+8:35458:x1876351635000064:12345-192.168.203.39@tcp:101:mount.0 Request processed in 574us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429313.538070:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21127 00000100:00100000:2.0:1789429313.592765:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429313.593420:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635000192 00000100:00100000:3.0:1789429313.593432:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635000192 00000100:00100000:3.0:1789429313.593529:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21128 00000100:00100000:3.0:1789429313.593539:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:35460:x1876351635000192:12345-192.168.203.39@tcp:101:rmdir.0 00010000:00010000:3.0:1789429313.593558:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429313.593578:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360ba4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3c0 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.593729:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360bab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.593744:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.593756:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429313.593792:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429313.593796:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429313.593837:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360bab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.593862:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360ba4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3c0 expref: 7 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.593879:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360bab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3c0 expref: 6 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.593888:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd900) 00010000:00010000:3.0:1789429313.593890:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429313.593894:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1a00, rc 0) 00000100:00100000:3.0:1789429313.593966:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:35460:x1876351635000192:12345-192.168.203.39@tcp:101:rmdir.0 Request processed in 428us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429313.593974:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21128 00000100:00080000:1.0:1789429313.595827:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429313.601086:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429313.601154:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635000320 00000100:00100000:2.0:1789429313.601164:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635000320 00000100:00100000:2.0:1789429313.601244:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21129 00000100:00100000:2.0:1789429313.601253:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:35460:x1876351635000320:12345-192.168.203.39@tcp:101:rmdir.0 00010000:00010000:2.0:1789429313.601273:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429313.601296:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360bb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3c7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.601360:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360bb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.601375:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.601386:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.601401:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360bc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.601408:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.601414:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.601499:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360bc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x75:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.601508:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.601515:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429313.601543:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x75:0x0]: returning size 16384 00000004:00200000:2.0:1789429313.601546:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429313.601566:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.601577:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602276:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360bb9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602284:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602291:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429313.602295:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602303:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602317:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd900) 00010000:00010000:2.0:1789429313.602320:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429313.602324:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360bb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602651:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360bb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602737:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602805:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360bc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602816:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602824:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429313.602827:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602834:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602843:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc28130bf (ffff946f051efe00) 00010000:00010000:2.0:1789429313.602845:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429313.602848:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360bc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602855:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360bc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602898:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360bb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3c7 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.602991:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3c7 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.603001:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x75:0x0].0x0 (ffff946f2076a900) 00010000:00010000:2.0:1789429313.603004:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429313.603009:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429313.603347:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:35460:x1876351635000320:12345-192.168.203.39@tcp:101:rmdir.0 Request processed in 1948us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429313.603356:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21129 00000100:00100000:3.0:1789429313.606944:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429313.607103:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635000576 00000100:00100000:1.0:1789429313.607113:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635000576 00000100:00100000:1.0:1789429313.607172:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21130 00000100:00100000:1.0:1789429313.607182:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:35460:x1876351635000576:12345-192.168.203.39@tcp:36:rmdir.0 00010000:00010000:1.0:1789429313.607257:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789429313.607283:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360bc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3c7 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.607303:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x75:0x0].0x0 (ffff946f2076a900) 00010000:00010000:1.0:1789429313.607314:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360bab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3c0 expref: 6 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.607323:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd900) 00010000:00010000:1.0:1789429313.607327:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429313.607347:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.607360:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b2 expref: 7 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.607368:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.607401:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b2 expref: 7 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429313.607414:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b2 expref: 7 pid: 15669 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429313.607427:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648348544:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429313.607510:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f06f9e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429313.615264:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429313.615533:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648348544:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429313.615563:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429313.615628:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635000704 00000100:00100000:0.0:1789429313.615635:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635000704 00010000:00010000:0.0:1789429313.615682:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b2 expref: 8 pid: 15669 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429313.615719:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6176 00000100:00100000:0.0:1789429313.615729:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635000704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429313.615751:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429313.615757:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b2 expref: 8 pid: 15669 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.615769:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b2 expref: 8 pid: 15669 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.615789:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360b81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b2 expref: 8 pid: 15669 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.615803:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd900) 00010000:00010000:0.0:1789429313.615809:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.615818:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.615826:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.615852:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429313.615903:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635000704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 173us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429313.615910:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6176 00010000:00010000:2.0:1789429313.616042:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.616050:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.616074:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360bd5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.616084:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.616091:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.616187:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x75:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.616224:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b9 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.616233:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.616262:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b9 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.616275:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b9 expref: 6 pid: 5841 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429313.616288:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f50ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648348672:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429313.616348:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c083600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429313.621403:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429313.621554:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635000832 00000100:00100000:0.0:1789429313.621564:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635000832 00010000:00010000:0.0:1789429313.621605:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b9 expref: 7 pid: 5841 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429313.621649:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6177 00000100:00100000:0.0:1789429313.621663:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635000832:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429313.621675:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429313.621681:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b9 expref: 7 pid: 5841 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.621693:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b9 expref: 7 pid: 5841 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.621717:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x75:0x0].0x0 (ffff946f2076a900) 00010000:00010000:0.0:1789429313.621723:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.621733:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.621740:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.621757:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429313.621808:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635000832:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 151us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429313.621814:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6177 00010000:00010000:2.0:1789429313.621983:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360b9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x75:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3b9 expref: 6 pid: 5841 timeout: 1111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429313.622002:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f50ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648348672:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429313.622040:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622049:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622055:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429313.622680:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x75:0x0]: returning size 16384 00010000:00010000:2.0:1789429313.622700:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622711:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622717:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622722:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429313.622726:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622733:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622744:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x75:0x0].0x0 (ffff946f2076a900) 00010000:00010000:2.0:1789429313.622747:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789429313.622751:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622757:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360bdc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x75:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622780:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622786:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622792:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622796:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429313.622800:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622806:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622814:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd900) 00010000:00010000:2.0:1789429313.622817:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429313.622820:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.622826:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360bce lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789429313.622838:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b7efd1f2 reply state 00000000dd78ce3f transno 4294977123 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429313.622845:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789429313.622919:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:35460:x1876351635000576:12345-192.168.203.39@tcp:36:rmdir.0 Request processed in 15736us (15993us total) trans 4294977123 rc 0/0 00000100:00100000:2.0:1789429313.622938:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21130 00010000:00010000:2.0:1789429313.624732:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.624745:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360bd5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.624762:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360bd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.624768:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429313.624773:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360bd5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.624781:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360bd5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.624794:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc28130bf (ffff946f051efb00) 00010000:00010000:2.0:1789429313.624798:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429313.624802:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360bd5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429313.624808:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360bd5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429313.627814:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429313.627965:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635000960 00000100:00100000:0.0:1789429313.627975:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635000960 00000100:00100000:0.0:1789429313.628034:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21131 00000100:00100000:0.0:1789429313.628044:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:35311:x1876351635000960:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1789429313.628064:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429313.628086:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360be3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3ce expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.628149:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360bea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.628162:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.628173:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429313.628246:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429313.628250:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429313.628270:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.628294:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360be3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ce expref: 8 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.628318:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360bea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ce expref: 7 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.628326:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:0.0:1789429313.628328:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429313.628332:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:0.0:1789429313.628389:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+7:35311:x1876351635000960:12345-192.168.203.39@tcp:101:bash.0 Request processed in 346us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429313.628396:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21131 00000100:00100000:1.0:1789429313.662699:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429313.662786:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635001088 00000100:00100000:0.0:1789429313.662797:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635001088 00000100:00100000:0.0:1789429313.662856:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21132 00000100:00100000:0.0:1789429313.662866:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:35311:x1876351635001088:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1789429313.662890:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429313.662913:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360bf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3d5 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.662987:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.663000:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.663015:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429313.663049:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429313.663053:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429313.663073:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.663097:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360bf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3d5 expref: 8 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.663115:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3d5 expref: 7 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.663122:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:0.0:1789429313.663125:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429313.663128:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429313.663192:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:35311:x1876351635001088:12345-192.168.203.39@tcp:101:bash.0 Request processed in 326us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429313.663242:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21132 00000100:00100000:2.0:1789429313.668168:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429313.668312:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635001216 00000100:00100000:3.0:1789429313.668327:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635001216 00000100:00100000:3.0:1789429313.668400:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21133 00000100:00100000:3.0:1789429313.668413:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:35311:x1876351635001216:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1789429313.668448:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429313.668481:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360bff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3dc expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668563:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360c06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668579:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360c06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668599:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360c06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668615:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668621:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668628:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668692:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360c06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668699:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360c06 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668706:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360c06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668786:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429313.668792:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360c06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668801:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360c06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668816:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:3.0:1789429313.668820:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429313.668827:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360c06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668834:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360c06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668851:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668857:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668864:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668869:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429313.668872:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668878:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668886:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc28130bf (ffff946f04fb8800) 00010000:00010000:3.0:1789429313.668888:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429313.668891:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668897:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668945:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360bff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3dc expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668961:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:3.0:1789429313.668964:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429313.668968:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360bff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3dc expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429313.668979:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:3.0:1789429313.669062:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:35311:x1876351635001216:12345-192.168.203.39@tcp:101:bash.0 Request processed in 651us (907us total) trans 0 rc 301/301 00000100:00100000:3.0:1789429313.669070:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21133 00000100:00100000:3.0:1789429313.671733:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429313.672092:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635001344 00000100:00100000:0.0:1789429313.672108:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635001344 00000100:00100000:0.0:1789429313.672280:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21134 00000100:00100000:0.0:1789429313.672292:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+7:35311:x1876351635001344:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1789429313.672312:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429313.672332:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360c14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3e3 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672398:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726360c1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672412:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726360c1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672423:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726360c1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672437:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360c22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672444:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672451:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672503:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726360c1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672510:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726360c1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672517:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726360c1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672523:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429313.672528:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726360c1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672540:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726360c1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672551:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:0.0:1789429313.672554:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429313.672560:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726360c1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672566:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726360c1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672578:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672595:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360c22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672601:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360c22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672606:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2acc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429313.672609:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360c22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672615:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360c22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672622:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc28130bf (ffff946f120fdc00) 00010000:00010000:0.0:1789429313.672625:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429313.672628:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360c22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672637:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726360c22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc28130bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672667:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360c14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3e3 expref: 8 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672678:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:0.0:1789429313.672680:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429313.672685:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad726360c14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3e3 expref: 8 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429313.672694:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429313.672774:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+7:35311:x1876351635001344:12345-192.168.203.39@tcp:101:bash.0 Request processed in 484us (1064us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429313.672781:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21134 00010000:00010000:1.0:1789429313.763476:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429314.790964:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429315.369712:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429315.369769:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429315.369803:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429315.369822:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429315.369838:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429315.369853:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429315.369873:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429315.370104:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635001728 00000100:00100000:3.0:1789429315.370115:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635001728 00000100:00100000:3.0:1789429315.370194:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635002112 00000100:00100000:3.0:1789429315.370229:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635002112 00000100:00100000:3.0:1789429315.370249:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635001856 00000100:00100000:3.0:1789429315.370264:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635001856 00000100:00100000:3.0:1789429315.370283:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635002240 00000100:00100000:3.0:1789429315.370286:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635002240 00000100:00100000:3.0:1789429315.370304:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 771 00000100:00100000:3.0:1789429315.370314:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351635001728:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429315.370385:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351635001728:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 72us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429315.370394:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 771 00000100:00100000:3.0:1789429315.370411:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 772 00000100:00100000:3.0:1789429315.370417:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635002112:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429315.370442:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635002112:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429315.370448:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 772 00000100:00100000:3.0:1789429315.370460:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5759 00000100:00100000:3.0:1789429315.370466:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2367:x1876351635001856:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:3.0:1789429315.370483:0:20745:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad7263570d9 00000100:00080000:3.0:1789429315.370493:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946e0268b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789429315.370527:0:20745:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969594 00000100:00100000:3.0:1789429315.370770:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+2:2367:x1876351635001856:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 303us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429315.370777:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5759 00000100:00100000:3.0:1789429315.370791:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5760 00000100:00100000:3.0:1789429315.370799:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2367:x1876351635002240:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:3.0:1789429315.370810:0:20745:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad726357126 00000100:00080000:3.0:1789429315.370816:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946f06fb4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789429315.370837:0:20745:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969594 00000100:00100000:3.0:1789429315.370929:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+2:2367:x1876351635002240:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 130us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429315.370936:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5760 00010000:00010000:3.0:1789429315.371052:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429315.371419:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635001472 00000100:00100000:0.0:1789429315.371426:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635001472 00000100:00100000:0.0:1789429315.371467:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 533 00000100:00100000:0.0:1789429315.371474:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635001472:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429315.371515:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635001472:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 41us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429315.371521:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 533 00000100:00100000:0.0:1789429315.371564:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635001600 00000100:00100000:0.0:1789429315.371568:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635001600 00000100:00100000:0.0:1789429315.371613:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635001984 00000100:00100000:0.0:1789429315.371616:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635001984 00000100:00100000:0.0:1789429315.371639:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 716 00000100:00100000:0.0:1789429315.371645:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:2368:x1876351635001600:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429315.371676:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:2368:x1876351635001600:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429315.371683:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 716 00000100:00100000:0.0:1789429315.371695:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 717 00000100:00100000:0.0:1789429315.371701:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635001984:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429315.371725:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635001984:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (1885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429315.371730:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 717 00000100:00080000:1.0:1789429315.371972:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429315.371977:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429315.371980:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789429315.371987:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429315.749763:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648348800:0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.749827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429315.749870:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648349312:0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.749896:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429315.749950:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789429315.749957:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648348928:0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.749978:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429315.750033:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648349440:0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.750057:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429315.750083:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648349056:0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.750104:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429315.750133:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789429315.750139:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648349184:0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.750161:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429315.750190:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648348800 00000100:00100000:0.0:1789429315.750229:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648348800 00000100:00100000:0.0:1789429315.750274:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1789429315.750283:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648348800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.750332:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648348800:12345-0@lo:400:kworker.0 Request processed in 50us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429315.750339:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1789429315.750369:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648349312 00000100:00100000:0.0:1789429315.750372:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648349312 00000100:00100000:0.0:1789429315.750536:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648348928 00000100:00100000:0.0:1789429315.750540:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648348928 00000100:00100000:0.0:1789429315.750556:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648349056 00000100:00100000:0.0:1789429315.750559:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648349056 00000100:00100000:0.0:1789429315.750579:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1789429315.750598:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648349312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.750632:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648349312:12345-0@lo:400:kworker.0 Request processed in 47us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429315.750639:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1789429315.750651:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1789429315.750656:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648348928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.750680:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648348928:12345-0@lo:400:kworker.0 Request processed in 24us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429315.750685:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:0.0:1789429315.750695:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1789429315.750700:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648349056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.750729:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648349056:12345-0@lo:400:kworker.0 Request processed in 29us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429315.750737:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1789429315.750761:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648349440 00000100:00100000:0.0:1789429315.750765:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648349440 00000100:00100000:0.0:1789429315.750788:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648349184 00000100:00100000:0.0:1789429315.750791:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648349184 00000100:00100000:0.0:1789429315.750811:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:0.0:1789429315.750816:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648349440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.750845:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648349440:12345-0@lo:400:kworker.0 Request processed in 29us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429315.750851:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:0.0:1789429315.750863:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1789429315.750868:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648349184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.750893:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648349184:12345-0@lo:400:kworker.0 Request processed in 25us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429315.750899:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00080000:0.0:1789429315.750927:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429315.750930:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429315.750933:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429315.750976:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34021500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648349184:0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.750987:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648349056:0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.751017:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34021f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648348928:0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.751026:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648349440:0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.751033:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648348800:0@lo:400:kworker.0 00000100:00100000:0.0:1789429315.751042:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648349312:0@lo:400:kworker.0 00010000:00010000:3.0:1789429315.811365:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429316.261383:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789429316.261405:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648349568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429316.261472:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429316.261547:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648349568 00000100:00100000:3.0:1789429316.261555:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648349568 00000100:00100000:3.0:1789429316.261596:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789429316.261605:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648349568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429316.261640:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 350814208 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1789429316.261683:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648349568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429316.261689:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789429316.261735:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648349568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429316.262323:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789429316.262336:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648349696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429316.262374:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429316.263409:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648349696 00000100:00100000:0.0:1789429316.263419:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648349696 00000100:00100000:0.0:1789429316.263460:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789429316.263469:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648349696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429316.263507:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429316.263567:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648349696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429316.263573:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789429316.263629:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648349696:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1789429316.306804:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:3.0:1789429316.306814:0:7635:0:(genops.c:885:class_export_put()) final put ffff946f06fb1800/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000001:00100000:3.0:1789429316.306834:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:3.0:1789429316.306836:0:7635:0:(genops.c:885:class_export_put()) final put ffff946f3f3d0800/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:3.0:1789429316.306853:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946f06fb1800/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 for lustre-OST0001 00000020:00000080:3.0:1789429316.306894:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946f3f3d0800/12e09781-3d24-4c67-9972-bb781900e20d for lustre-OST0001 00000020:00000080:3.0:1789429316.306929:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946f06fb4800 for lustre-OST0001 00000020:00000080:3.0:1789429316.306933:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946e0268b000 for lustre-OST0001 00000001:00080000:2.0:1789429316.835567:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977122 is committed 00000001:00080000:2.0:1789429316.835582:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977123 is committed 00010000:00010000:2.0:1789429316.835760:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429317.859613:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429318.884999:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429319.023704:0:22228:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 23: others should see updated atime while another read============================================================== 19:41:58 (1789429318) 00000100:00100000:3.0:1789429319.856026:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429319.856343:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635002496 00000100:00100000:1.0:1789429319.856353:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635002496 00000100:00080000:2.0:1789429319.856411:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429319.856431:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21135 00000100:00100000:1.0:1789429319.856516:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:35887:x1876351635002496:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1789429319.856537:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429319.856540:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789429319.856569:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360bea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ce expref: 6 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429319.856586:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:1.0:1789429319.856591:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429319.856604:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360c29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429319.857136:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429319.857154:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3d5 expref: 5 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429319.857164:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429319.857230:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3d5 expref: 5 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429319.857246:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3d5 expref: 5 pid: 15669 timeout: 1117 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429319.857261:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f090000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648349824:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429319.857360:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865840 going to sleep for 11 seconds 00000100:00100000:1.0:1789429319.865695:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f090000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648349824:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429319.865704:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1789429319.865728:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429319.865767:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635002624 00000100:00100000:0.0:1789429319.865794:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635002624 00010000:00010000:0.0:1789429319.865846:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3d5 expref: 6 pid: 15669 timeout: 1117 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429319.865895:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6178 00000100:00100000:0.0:1789429319.865905:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635002624:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429319.865918:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429319.865925:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3d5 expref: 6 pid: 15669 timeout: 1117 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429319.865938:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3d5 expref: 6 pid: 15669 timeout: 1117 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429319.865963:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360bf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3d5 expref: 6 pid: 15669 timeout: 1117 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429319.865976:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:0.0:1789429319.865981:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429319.865991:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429319.866000:0:11354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429319.866033:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429319.866081:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635002624:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 178us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429319.866090:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6178 00010000:00010000:3.0:1789429319.866092:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.866102:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.866170:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c37 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.866181:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.866189:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789429319.867087:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f:0x0], index 1: 0 00010000:00010000:3.0:1789429319.867346:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360c3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x76:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.867358:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.867368:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360c3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.867401:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.867409:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.867415:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.867421:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429319.867426:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.867433:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.867443:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:3.0:1789429319.867446:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429319.867451:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.867462:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360c30 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429319.867473:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008f2ec8c9 reply state 000000008fd6d97a transno 4294977124 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429319.867480:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789429319.867510:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360c29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ea expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.867530:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360c3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ea expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.867538:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x76:0x0].0x0 (ffff946f04fb8200) 00010000:00010000:3.0:1789429319.867539:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429319.867542:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:3.0:1789429319.867599:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+8:35887:x1876351635002496:12345-192.168.203.39@tcp:101:bash.0 Request processed in 11159us (11595us total) trans 4294977124 rc 0/0 00000100:00100000:3.0:1789429319.867607:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21135 00000100:00080000:2.0:1789429319.868023:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789429319.872294:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.872311:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c37 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.872318:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.872325:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429319.872330:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.872338:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c37 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.872354:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa05e6683 (ffff946f04fb8d00) 00010000:00010000:3.0:1789429319.872357:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429319.872362:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c37 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.872369:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360c37 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429319.874367:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429319.874530:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635002752 00000100:00100000:1.0:1789429319.874539:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635002752 00000100:00100000:1.0:1789429319.874585:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5761 00000100:00100000:1.0:1789429319.874592:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2367:x1876351635002752:12345-192.168.203.39@tcp:8:bash.0 00010000:00080000:1.0:1789429319.874623:0:8085:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t0 exp 0000000000000000 cur 1017 last 0 00000020:00000080:1.0:1789429319.874652:0:8085:0:(genops.c:1384:class_connect()) connect: client 12e09781-3d24-4c67-9972-bb781900e20d, cookie 0xb4c3dad726360c4c 00002000:00100000:1.0:1789429319.874663:0:8085:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 12e09781-3d24-4c67-9972-bb781900e20d/ffff946f416a7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 485097472 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789429319.874687:0:8085:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789429319.875306:0:8085:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789429319.875336:0:8085:0:(import.c:65:import_set_state_nolock()) ffff946f416a4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789429319.875431:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2367:x1876351635002752:12345-192.168.203.39@tcp:8:bash.0 Request processed in 837us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429319.875441:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5761 00000100:00100000:2.0:1789429319.877368:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429319.877439:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635002880 00000100:00100000:3.0:1789429319.877448:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635002880 00000100:00100000:3.0:1789429319.877513:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5762 00000100:00100000:3.0:1789429319.877524:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:35887:x1876351635002880:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1789429319.877538:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429319.877559:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360c53 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3f1 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429319.877585:0:13238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789429319.877606:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=1017s v=(0 0) 00010000:00010000:3.0:1789429319.877611:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429319.877631:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360c53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3f1 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.877655:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360c53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3f1 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429319.877667:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:3.0:1789429319.877711:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:35887:x1876351635002880:12345-192.168.203.39@tcp:101:bash.0 Request processed in 190us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429319.877718:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5762 00000100:00080000:2.0:1789429319.877972:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429319.880438:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429319.880504:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635003136 00000100:00100000:3.0:1789429319.880513:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635003136 00000100:00100000:3.0:1789429319.880566:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 250 00000100:00100000:3.0:1789429319.880577:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:35887:x1876351635003136:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:3.0:1789429319.881178:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+8:35887:x1876351635003136:12345-192.168.203.39@tcp:35:bash.0 Request processed in 602us (747us total) trans 4294977125 rc 0/0 00000100:00100000:3.0:1789429319.881187:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 250 00000100:00100000:0.0:1789429319.908186:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429319.908405:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635003264 00000100:00100000:1.0:1789429319.908415:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635003264 00002000:00100000:1.0:1789429319.908464:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2f:0x0] (0->42) req@ffff946e01275180 x1876351635003264/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:55/0 lens 536/0 e 0 to 0 dl 1789429330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429319.908475:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01275180 with x1876351635003264 ext(0->42) 00002000:00010000:1.0:1789429319.908481:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e01275180 00000100:00100000:1.0:1789429319.908519:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11509 00000100:00100000:1.0:1789429319.908529:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635003264:12345-192.168.203.39@tcp:4:bash.0 00010000:00010000:2.0:1789429319.916840:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789429319.976589:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000001:00080000:1.0:1789429320.033026:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969595 is committed 00000100:00100000:0.0:1789429320.033377:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635003264:12345-192.168.203.39@tcp:4:bash.0 Request processed in 124843us (125193us total) trans 4294969595 rc 0/0 00000100:00100000:0.0:1789429320.033389:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11509 00002000:00100000:0.0:1789429320.033403:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x2f:0x0] (0->42) req@ffff946e01275180 x1876351635003264/t4294969595(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:55/0 lens 536/448 e 0 to 0 dl 1789429330 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429320.033414:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01275180 with x1876351635003264 ext(0->42) 00002000:00010000:0.0:1789429320.033420:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e01275180 00000100:00100000:2.0:1789429320.040399:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429320.041660:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635003392 00000100:00100000:1.0:1789429320.041674:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635003392 00000100:00100000:1.0:1789429320.041802:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 268 00000100:00100000:1.0:1789429320.041813:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:14502:x1876351635003392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429320.041838:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429320.041859:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2f:0x0] updating lvb size from disk: 0 -> 43 00002000:00010000:1.0:1789429320.041862:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2f:0x0] updating lvb mtime from disk: 0 -> 1789429320 00002000:00010000:1.0:1789429320.041865:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2f:0x0] updating lvb ctime from disk: 0 -> 1789429320 00002000:00010000:1.0:1789429320.041868:0:5826:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2f:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789429320.041902:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650b91fb/0xb4c3dad726360c53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3f1 expref: 6 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429320.041929:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429320.042029:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:14502:x1876351635003392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 217us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429320.042037:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 268 00000100:00100000:3.0:1789429320.469007:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429320.469374:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429320.469410:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429320.469501:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635003776 00000100:00100000:1.0:1789429320.469511:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635003776 00000100:00100000:1.0:1789429320.469572:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 775 00000100:00100000:1.0:1789429320.469585:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351635003776:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429320.469655:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351635003776:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429320.469664:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 775 00000100:00080000:1.0:1789429320.469685:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429320.470907:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429320.472649:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635003520 00000100:00100000:0.0:1789429320.472660:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635003520 00000100:00100000:0.0:1789429320.472719:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 535 00000100:00100000:0.0:1789429320.472727:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635003520:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429320.472802:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635003520:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 74us (3802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429320.472812:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 535 00000100:00100000:3.0:1789429320.475863:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429320.475917:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429320.475968:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635003904 00000100:00100000:3.0:1789429320.475968:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635004160 00000100:00100000:1.0:1789429320.475979:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635003904 00000100:00100000:3.0:1789429320.475979:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635004160 00000100:00100000:1.0:1789429320.476033:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 776 00000100:00100000:1.0:1789429320.476046:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351635003904:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429320.476052:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 777 00000100:00100000:3.0:1789429320.476064:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635004160:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429320.476113:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351635003904:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429320.476124:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 776 00000100:00100000:3.0:1789429320.476126:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635004160:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429320.476136:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 777 00000100:00080000:1.0:1789429320.476149:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429320.477573:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635004032 00000100:00100000:2.0:1789429320.477581:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635004032 00000100:00100000:2.0:1789429320.477637:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635003648 00000100:00100000:2.0:1789429320.477640:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635003648 00000100:00100000:2.0:1789429320.477671:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 721 00000100:00100000:2.0:1789429320.477680:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635004032:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429320.477803:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635004032:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 59us (8327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429320.477813:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 721 00000100:00100000:2.0:1789429320.477831:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 722 00000100:00100000:2.0:1789429320.477838:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635003648:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429320.478480:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635003648:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 641us (7574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429320.478487:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 722 00000100:00100000:3.0:1789429320.868246:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648350208:0@lo:400:kworker.0 00000100:00100000:3.0:1789429320.868316:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429320.868375:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789429320.868382:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648350336:0@lo:400:kworker.0 00000100:00100000:3.0:1789429320.868407:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429320.868444:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648350208 00000100:00100000:3.0:1789429320.868450:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648350208 00000100:00100000:3.0:1789429320.868500:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1789429320.868509:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648350208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429320.868556:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648350208:12345-0@lo:400:kworker.0 Request processed in 48us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429320.868563:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1789429320.868584:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648350336 00000100:00100000:3.0:1789429320.868588:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648350336 00000100:00100000:3.0:1789429320.868611:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1789429320.868616:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648350336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429320.868644:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648350336:12345-0@lo:400:kworker.0 Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429320.868650:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1789429320.868686:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648350336:0@lo:400:kworker.0 00000100:00100000:3.0:1789429320.868695:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648350208:0@lo:400:kworker.0 00000100:00100000:2.0:1789429320.870833:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648350080:0@lo:400:kworker.0 00000100:00100000:2.0:1789429320.870916:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429320.870964:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648350592:0@lo:400:kworker.0 00000100:00100000:2.0:1789429320.870989:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429320.871019:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789429320.871025:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648349952:0@lo:400:kworker.0 00000100:00100000:2.0:1789429320.871053:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429320.871075:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648350464:0@lo:400:kworker.0 00000100:00100000:2.0:1789429320.871093:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429320.871132:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648349952 00000100:00100000:2.0:1789429320.871139:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648349952 00000100:00100000:2.0:1789429320.871535:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1789429320.871544:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648349952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429320.871595:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648349952:12345-0@lo:400:kworker.0 Request processed in 53us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429320.871606:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1789429320.871648:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648349952:0@lo:400:kworker.0 00000100:00100000:0.0:1789429320.871805:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648350080 00000100:00100000:0.0:1789429320.871811:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648350080 00000100:00100000:0.0:1789429320.871847:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648350464 00000100:00100000:0.0:1789429320.871851:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648350464 00000100:00100000:0.0:1789429320.871890:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1789429320.871897:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648350080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429320.871935:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648350080:12345-0@lo:400:kworker.0 Request processed in 39us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429320.871942:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:0.0:1789429320.871955:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1789429320.871961:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648350464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429320.871986:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648350464:12345-0@lo:400:kworker.0 Request processed in 26us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429320.871991:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1789429320.872242:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648350464:0@lo:400:kworker.0 00000100:00100000:2.0:1789429320.872253:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648350080:0@lo:400:kworker.0 00000100:00100000:1.0:1789429320.872474:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648350592 00000100:00100000:1.0:1789429320.872480:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648350592 00000100:00100000:1.0:1789429320.872520:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1789429320.872531:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648350592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429320.872577:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648350592:12345-0@lo:400:kworker.0 Request processed in 49us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429320.872583:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00080000:1.0:1789429320.872601:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429320.872604:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429320.872607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429320.872659:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648350592:0@lo:400:kworker.0 00010000:00010000:0.0:1789429320.931373:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429321.379627:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429321.379672:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648350720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429321.379751:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429321.379932:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648350720 00000100:00100000:2.0:1789429321.379940:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648350720 00000100:00100000:2.0:1789429321.379989:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789429321.379998:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648350720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429321.380030:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429321.380088:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648350720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429321.380096:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789429321.380186:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648350720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429321.381110:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648350848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429321.381170:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429321.382048:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648350848 00000100:00100000:3.0:1789429321.382058:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648350848 00000100:00100000:3.0:1789429321.382124:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789429321.382134:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648350848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429321.382166:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 350814208 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1789429321.392697:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648350848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10555us (11517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429321.392711:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789429321.393224:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648350848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789429321.962383:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429321.963553:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977125 is committed 00010000:00010000:0.0:1789429322.979986:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429324.003479:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429325.027651:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429325.589645:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429325.589689:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429325.589712:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429325.589738:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429325.589755:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429325.589774:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429325.589796:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635004672 00000100:00100000:3.0:1789429325.589804:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635004672 00000100:00100000:3.0:1789429325.589864:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635004928 00000100:00100000:3.0:1789429325.589866:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635004928 00000100:00100000:3.0:1789429325.589883:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635004544 00000100:00100000:3.0:1789429325.589885:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635004544 00000100:00100000:3.0:1789429325.589901:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 780 00000100:00100000:3.0:1789429325.589910:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635004672:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429325.589990:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635004672:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 68us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429325.589998:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 780 00000100:00100000:3.0:1789429325.590013:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 781 00000100:00100000:1.0:1789429325.590147:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 782 00000100:00100000:1.0:1789429325.590158:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635004544:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429325.590185:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635004544:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429325.590191:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 782 00000100:00080000:1.0:1789429325.590248:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429325.590252:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429325.590260:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635004416 00000100:00100000:1.0:1789429325.590263:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635004416 00000100:00100000:1.0:1789429325.590288:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635004800 00000100:00100000:1.0:1789429325.590290:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635004800 00000100:00100000:1.0:1789429325.590305:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 726 00000100:00100000:1.0:1789429325.590311:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635004416:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429325.590333:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635004416:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429325.590340:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 726 00000100:00100000:1.0:1789429325.590350:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 727 00000100:00100000:1.0:1789429325.590356:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635004800:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429325.590371:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635004800:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 16us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429325.590377:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 727 00000100:00100000:1.0:1789429325.590392:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635004288 00000100:00100000:1.0:1789429325.590395:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635004288 00000100:00100000:1.0:1789429325.590413:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 537 00000100:00100000:1.0:1789429325.590418:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635004288:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429325.590437:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635004288:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 20us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429325.590442:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 537 00000100:00080000:1.0:1789429325.590463:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429325.590901:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635004928:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429325.590949:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635004928:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 929us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429325.590957:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 781 00000100:00100000:2.0:1789429325.989968:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648351104:0@lo:400:kworker.0 00000100:00100000:2.0:1789429325.990036:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429325.990106:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789429325.990113:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648350976:0@lo:400:kworker.0 00000100:00100000:2.0:1789429325.990142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429325.990180:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648350976 00000100:00100000:2.0:1789429325.990186:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648350976 00000100:00100000:2.0:1789429325.990240:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1789429325.990248:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648350976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429325.990293:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648350976:12345-0@lo:400:kworker.0 Request processed in 45us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429325.990300:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1789429325.990342:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648350976:0@lo:400:kworker.0 00000100:00100000:0.0:1789429325.990414:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648351104 00000100:00100000:0.0:1789429325.990419:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648351104 00000100:00100000:0.0:1789429325.990459:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1789429325.990467:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648351104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429325.990507:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648351104:12345-0@lo:400:kworker.0 Request processed in 41us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429325.990512:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1789429325.990550:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648351104:0@lo:400:kworker.0 00000100:00100000:0.0:1789429325.990808:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429325.998743:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648351360:0@lo:400:kworker.0 00000100:00100000:0.0:1789429325.998970:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429325.999017:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648351232:0@lo:400:kworker.0 00000100:00100000:0.0:1789429325.999044:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429325.999371:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648351360 00000100:00100000:1.0:1789429325.999380:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648351360 00000100:00100000:1.0:1789429325.999452:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1789429325.999461:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c08d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648351360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429325.999521:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c08d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648351360:12345-0@lo:400:kworker.0 Request processed in 60us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429325.999540:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1789429325.999748:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648351360:0@lo:400:kworker.0 00000100:00100000:3.0:1789429326.003215:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648351488:0@lo:400:kworker.0 00000100:00100000:3.0:1789429326.003286:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789429326.003339:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429326.003368:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648351616:0@lo:400:kworker.0 00000100:00100000:0.0:1789429326.003399:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429326.003894:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648351616 00000100:00100000:1.0:1789429326.003902:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648351616 00000100:00100000:1.0:1789429326.003966:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:1.0:1789429326.003976:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648351616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429326.004033:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648351616:12345-0@lo:400:kworker.0 Request processed in 58us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429326.004040:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00080000:0.0:1789429326.004628:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429326.004666:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648351616:0@lo:400:kworker.0 00000100:00100000:2.0:1789429326.014842:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648351232 00000100:00100000:2.0:1789429326.014860:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648351232 00000100:00100000:2.0:1789429326.014961:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648351488 00000100:00100000:2.0:1789429326.014965:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648351488 00000100:00100000:2.0:1789429326.014999:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1789429326.015009:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648351232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429326.015111:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648351232:12345-0@lo:400:kworker.0 Request processed in 103us (16065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429326.015118:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1789429326.015136:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1789429326.015142:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648351488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429326.015175:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648351488:12345-0@lo:400:kworker.0 Request processed in 33us (11889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429326.015180:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1789429326.015260:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648351232:0@lo:400:kworker.0 00000100:00080000:1.0:1789429326.015437:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429326.015951:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648351488:0@lo:400:kworker.0 00010000:00010000:2.0:1789429326.051381:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429326.499572:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648351872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429326.499593:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648351744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429326.499638:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429326.499676:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648351872 00000100:00100000:0.0:1789429326.499693:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648351872 00000100:00100000:0.0:1789429326.499737:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789429326.499746:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648351872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429326.499781:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 350814208 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1789429326.499842:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648351872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429326.499848:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1789429326.499974:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429326.500142:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648351744 00000100:00100000:0.0:1789429326.500147:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648351744 00000100:00100000:0.0:1789429326.500186:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789429326.500193:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648351744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429326.500237:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429326.500280:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648351744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429326.500286:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789429326.500454:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648351872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429326.501263:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648351744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429327.077667:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429328.099718:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429329.123468:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429330.149168:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429330.721001:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429330.721045:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429330.721078:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429330.721113:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429330.721131:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429330.721170:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429330.721227:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635005440 00000100:00100000:3.0:1789429330.721237:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635005440 00000100:00100000:3.0:1789429330.721292:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635005312 00000100:00100000:3.0:1789429330.721296:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635005312 00000100:00100000:3.0:1789429330.721313:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635005696 00000100:00100000:3.0:1789429330.721316:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635005696 00000100:00100000:3.0:1789429330.721337:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 785 00000100:00100000:3.0:1789429330.721347:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635005440:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429330.721425:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635005440:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 79us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429330.721433:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 785 00000100:00100000:3.0:1789429330.721451:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5763 00000100:00100000:3.0:1789429330.721457:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2367:x1876351635005312:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:3.0:1789429330.721477:0:6681:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad7263585fc 00000100:00080000:3.0:1789429330.721484:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946f06fb2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789429330.721521:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969262 00000100:00100000:1.0:1789429330.721591:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635005056 00000100:00100000:1.0:1789429330.721596:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635005056 00000100:00100000:1.0:1789429330.721632:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 539 00000100:00100000:1.0:1789429330.721640:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635005056:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429330.721672:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635005056:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429330.721679:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 539 00000100:00100000:1.0:1789429330.721714:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5764 00000100:00100000:1.0:1789429330.721723:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2367:x1876351635005696:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:1.0:1789429330.721735:0:6680:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad72635866c 00000100:00080000:1.0:1789429330.721741:0:6680:0:(import.c:65:import_set_state_nolock()) ffff946f06fb6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789429330.721761:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969262 00000100:00080000:1.0:1789429330.721846:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429330.721851:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429330.722000:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635005184 00000100:00100000:0.0:1789429330.722005:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635005184 00000100:00100000:0.0:1789429330.722073:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635005568 00000100:00100000:0.0:1789429330.722076:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635005568 00000100:00100000:0.0:1789429330.722098:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 731 00000100:00100000:0.0:1789429330.722105:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635005184:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429330.722141:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635005184:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 36us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429330.722148:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 731 00000100:00100000:0.0:1789429330.722162:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 732 00000100:00100000:0.0:1789429330.722168:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635005568:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429330.722192:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635005568:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429330.722218:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 732 00010000:00010000:0.0:1789429330.722242:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789429330.722321:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789429330.722977:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429330.726240:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+2:2367:x1876351635005696:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 4477us (5027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429330.726255:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5764 00000100:00100000:2.0:1789429330.727534:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+2:2367:x1876351635005312:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 5888us (6213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429330.727547:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5763 00000100:00100000:1.0:1789429331.107711:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429331.109442:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429331.109478:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648352128:0@lo:400:kworker.0 00000100:00100000:0.0:1789429331.109585:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429331.110255:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648352000:0@lo:400:kworker.0 00000100:00100000:2.0:1789429331.110342:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648352128 00000100:00100000:2.0:1789429331.110352:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648352128 00000100:00100000:2.0:1789429331.110418:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1789429331.110427:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648352128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429331.110501:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648352128:12345-0@lo:400:kworker.0 Request processed in 74us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429331.110508:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:0.0:1789429331.110937:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648352128:0@lo:400:kworker.0 00000100:00100000:2.0:1789429331.111375:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648352256:0@lo:400:kworker.0 00000100:00100000:2.0:1789429331.111461:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429331.111723:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648352256 00000100:00100000:0.0:1789429331.111733:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648352256 00000100:00100000:0.0:1789429331.111823:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1789429331.111834:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648352256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429331.113438:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648352256:12345-0@lo:400:kworker.0 Request processed in 1590us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429331.113454:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1789429331.113540:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648352512:0@lo:400:kworker.0 00000100:00100000:3.0:1789429331.113597:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648352384:0@lo:400:kworker.0 00000100:00100000:0.0:1789429331.113610:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429331.113685:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429331.113852:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648352512 00000100:00100000:3.0:1789429331.113861:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648352512 00000100:00100000:3.0:1789429331.113917:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:3.0:1789429331.113926:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648352512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429331.113974:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648352512:12345-0@lo:400:kworker.0 Request processed in 49us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429331.113981:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00080000:3.0:1789429331.114597:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429331.114618:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648352384 00000100:00100000:0.0:1789429331.114982:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648352512:0@lo:400:kworker.0 00000100:00100000:0.0:1789429331.115020:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429331.115028:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648352640:0@lo:400:kworker.0 00000100:00100000:0.0:1789429331.115082:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429331.115145:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648352640 00000100:00100000:0.0:1789429331.115152:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648352640 00000100:00100000:0.0:1789429331.115260:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1789429331.115270:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648352640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429331.115323:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648352640:12345-0@lo:400:kworker.0 Request processed in 55us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429331.115331:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00080000:0.0:1789429331.115351:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429331.115371:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648352640:0@lo:400:kworker.0 00000100:00100000:3.0:1789429331.115983:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648352384 00000100:00100000:3.0:1789429331.116034:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1789429331.116044:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648352384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429331.116101:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648352384:12345-0@lo:400:kworker.0 Request processed in 59us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429331.116108:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:3.0:1789429331.116149:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648352384:0@lo:400:kworker.0 00000100:00100000:1.0:1789429331.116449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429331.116982:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648352000 00000100:00100000:3.0:1789429331.116991:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648352000 00000100:00100000:3.0:1789429331.117048:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1789429331.117058:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648352000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429331.117135:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648352000:12345-0@lo:400:kworker.0 Request processed in 79us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429331.117144:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:1.0:1789429331.117168:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648352000:0@lo:400:kworker.0 00000100:00100000:2.0:1789429331.118052:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648352256:0@lo:400:kworker.0 00000100:00080000:0.0:1789429331.118194:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789429331.172296:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429331.619739:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789429331.619770:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648352768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429331.619847:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429331.620648:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648352896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429331.620686:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429331.621606:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648352768 00000100:00100000:2.0:1789429331.621616:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648352768 00000100:00100000:0.0:1789429331.621667:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648352896 00000100:00100000:0.0:1789429331.621674:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648352896 00000100:00100000:2.0:1789429331.621674:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789429331.621688:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648352768:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429331.621706:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789429331.621715:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648352896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429331.621728:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00002000:00000024:0.0:1789429331.621742:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429331.621814:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648352896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429331.621822:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789429331.622489:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648352768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 803us (2640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429331.622497:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789429331.622763:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648352896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429331.622804:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648352768:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789429332.177490:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:0.0:1789429332.177499:0:6707:0:(genops.c:885:class_export_put()) final put ffff946f06fb3000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000001:00100000:0.0:1789429332.177525:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:0.0:1789429332.177528:0:6707:0:(genops.c:885:class_export_put()) final put ffff946f06fb0000/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:3.0:1789429332.177626:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946f06fb3000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 for lustre-OST0000 00000020:00000080:3.0:1789429332.177675:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946f06fb0000/12e09781-3d24-4c67-9972-bb781900e20d for lustre-OST0000 00000020:00000080:3.0:1789429332.177691:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946f06fb6800 for lustre-OST0000 00000020:00000080:3.0:1789429332.177696:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946f06fb2000 for lustre-OST0000 00010000:00010000:2.0:1789429332.196502:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429333.220447:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429334.243744:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429335.267431:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429335.832518:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429335.832710:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635005824 00000100:00100000:2.0:1789429335.832721:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635005824 00000100:00100000:2.0:1789429335.832784:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 541 00000100:00100000:2.0:1789429335.832795:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635005824:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429335.832875:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635005824:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 83us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429335.832883:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 541 00000100:00100000:1.0:1789429335.836330:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429335.836391:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429335.836431:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429335.836585:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635005952 00000100:00100000:0.0:1789429335.836601:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635005952 00000100:00100000:3.0:1789429335.836633:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635006208 00000100:00100000:3.0:1789429335.836645:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635006208 00000100:00100000:3.0:1789429335.836728:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 736 00000100:00100000:3.0:1789429335.836743:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635006208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429335.836768:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 737 00000100:00100000:0.0:1789429335.836785:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635005952:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429335.836888:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635006208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 147us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429335.836896:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 736 00000100:00100000:2.0:1789429335.836994:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635006080 00000100:00100000:2.0:1789429335.837000:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635006080 00000100:00100000:2.0:1789429335.837041:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 788 00000100:00100000:2.0:1789429335.837050:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351635006080:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:1.0:1789429335.837137:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429335.837143:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429335.837352:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635005952:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 570us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429335.837362:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 737 00000100:00100000:2.0:1789429335.840854:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351635006080:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 3787us (4521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429335.840873:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 788 00000100:00100000:1.0:1789429336.227482:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648353408:0@lo:400:kworker.0 00000100:00100000:2.0:1789429336.227567:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648353152:0@lo:400:kworker.0 00000100:00100000:3.0:1789429336.227577:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648353280:0@lo:400:kworker.0 00000100:00100000:1.0:1789429336.227602:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429336.227648:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648353024:0@lo:400:kworker.0 00000100:00100000:2.0:1789429336.228104:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429336.228169:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648353664:0@lo:400:kworker.0 00000100:00100000:2.0:1789429336.228196:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429336.228278:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648353408 00000100:00100000:2.0:1789429336.228286:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648353408 00000100:00100000:2.0:1789429336.228340:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648353664 00000100:00100000:2.0:1789429336.228341:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648353664 00000100:00100000:2.0:1789429336.228370:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:2.0:1789429336.228378:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648353408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429336.228425:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648353408:12345-0@lo:400:kworker.0 Request processed in 47us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429336.228430:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:2.0:1789429336.228443:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1789429336.228447:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648353664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429336.228477:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648353664:12345-0@lo:400:kworker.0 Request processed in 29us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429336.228481:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00080000:2.0:1789429336.228493:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429336.228496:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429336.228765:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648353664:0@lo:400:kworker.0 00000100:00100000:2.0:1789429336.228829:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648353152 00000100:00100000:2.0:1789429336.228835:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648353152 00000100:00100000:2.0:1789429336.228886:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1789429336.228894:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648353152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429336.228973:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648353152:12345-0@lo:400:kworker.0 Request processed in 79us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429336.228980:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1789429336.229013:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648353152:0@lo:400:kworker.0 00000100:00100000:3.0:1789429336.240245:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429336.240833:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648353280 00000100:00100000:2.0:1789429336.240843:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648353280 00000100:00100000:2.0:1789429336.240911:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1789429336.240922:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648353280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429336.240992:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648353280:12345-0@lo:400:kworker.0 Request processed in 72us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429336.240999:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00080000:3.0:1789429336.242252:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429336.242305:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648353280:0@lo:400:kworker.0 00000100:00100000:1.0:1789429336.242428:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648353408:0@lo:400:kworker.0 00000100:00100000:0.0:1789429336.244079:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429336.244169:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648353536:0@lo:400:kworker.0 00000100:00100000:0.0:1789429336.244248:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429336.244381:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648353536 00000100:00100000:1.0:1789429336.244392:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648353536 00000100:00100000:1.0:1789429336.244487:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1789429336.244498:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648353536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429336.244802:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648353536:12345-0@lo:400:kworker.0 Request processed in 300us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429336.244817:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00080000:2.0:1789429336.244842:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429336.245252:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648353536:0@lo:400:kworker.0 00000100:00100000:3.0:1789429336.245301:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648353024 00000100:00100000:3.0:1789429336.245313:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648353024 00000100:00100000:3.0:1789429336.245362:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:3.0:1789429336.245371:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648353024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429336.245428:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648353024:12345-0@lo:400:kworker.0 Request processed in 58us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429336.245435:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1789429336.246568:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648353024:0@lo:400:kworker.0 00010000:00010000:2.0:1789429336.296500:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429336.740057:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429336.741761:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648353920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429336.742349:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429336.742435:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648353792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429336.742484:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648353920 00000100:00100000:3.0:1789429336.742496:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648353920 00000100:00100000:3.0:1789429336.742581:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789429336.742594:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f418a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648353920:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429336.743715:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789429336.744190:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1789429336.744289:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f418a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648353920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1695us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429336.744303:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789429336.744795:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648353792 00000100:00100000:3.0:1789429336.744811:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648353792 00000100:00100000:3.0:1789429336.744879:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789429336.744890:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648353792:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429336.744956:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648353920:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429336.745036:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429336.745115:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648353792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 226us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429336.745122:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789429336.746437:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648353792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789429337.317466:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429338.339520:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429339.363384:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429340.387926:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429340.958711:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429340.958779:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429340.958923:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635006464 00000100:00100000:3.0:1789429340.958933:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635006464 00000100:00100000:3.0:1789429340.959010:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 741 00000100:00100000:3.0:1789429340.959020:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635006464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429340.959088:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635006464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429340.959095:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 741 00000100:00100000:2.0:1789429340.959311:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635006592 00000100:00100000:2.0:1789429340.959316:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635006592 00000100:00100000:2.0:1789429340.959354:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5765 00000100:00100000:2.0:1789429340.959362:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2367:x1876351635006592:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:2.0:1789429340.959384:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad726360c4c 00000100:00080000:2.0:1789429340.959393:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946f416a4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789429340.959454:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969595 00000100:00100000:2.0:1789429340.959689:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+2:2367:x1876351635006592:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 326us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429340.959697:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5765 00010000:00010000:3.0:1789429340.960003:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789429340.960101:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429340.960106:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429340.966715:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429340.966775:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429340.966935:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635006720 00000100:00100000:3.0:1789429340.966945:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635006720 00000100:00100000:3.0:1789429340.967022:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 742 00000100:00100000:3.0:1789429340.967031:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635006720:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429340.967103:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635006720:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 72us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429340.967111:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 742 00000100:00080000:0.0:1789429340.967294:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429340.967920:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635006336 00000100:00100000:2.0:1789429340.967926:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635006336 00000100:00100000:2.0:1789429340.967971:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 543 00000100:00100000:2.0:1789429340.967981:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635006336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429340.968038:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635006336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 58us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429340.968046:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 543 00000100:00100000:0.0:1789429341.347513:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648354048:0@lo:400:kworker.0 00000100:00100000:0.0:1789429341.347589:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429341.347949:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648354048 00000100:00100000:2.0:1789429341.347970:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648354048 00000100:00100000:2.0:1789429341.348039:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1789429341.348049:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648354048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429341.350298:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648354176:0@lo:400:kworker.0 00000100:00100000:1.0:1789429341.350358:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429341.350412:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648354176 00000100:00100000:1.0:1789429341.350418:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648354176 00000100:00100000:1.0:1789429341.350462:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1789429341.350470:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648354176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429341.350515:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648354176:12345-0@lo:400:kworker.0 Request processed in 45us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429341.350521:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1789429341.350563:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648354176:0@lo:400:kworker.0 00000100:00100000:2.0:1789429341.352300:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648354048:12345-0@lo:400:kworker.0 Request processed in 4245us (4703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429341.352314:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1789429341.353279:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648354688:0@lo:400:kworker.0 00000100:00100000:3.0:1789429341.353328:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429341.353484:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648354432:0@lo:400:kworker.0 00000100:00100000:3.0:1789429341.353641:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789429341.353740:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648354688 00000100:00100000:1.0:1789429341.353748:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648354688 00000100:00100000:1.0:1789429341.353798:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1789429341.353808:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648354688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429341.353848:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648354688:12345-0@lo:400:kworker.0 Request processed in 43us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429341.353854:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00080000:1.0:1789429341.353873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429341.353951:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648354560:0@lo:400:kworker.0 00000100:00100000:3.0:1789429341.353976:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429341.354112:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648354688:0@lo:400:kworker.0 00000100:00100000:3.0:1789429341.354138:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429341.354165:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789429341.354170:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648354304:0@lo:400:kworker.0 00000100:00100000:3.0:1789429341.354188:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429341.354228:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648354432 00000100:00100000:3.0:1789429341.354231:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648354432 00000100:00100000:3.0:1789429341.354259:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1789429341.354265:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648354432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429341.354298:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648354432:12345-0@lo:400:kworker.0 Request processed in 30us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429341.354304:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1789429341.354320:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648354560 00000100:00100000:3.0:1789429341.354323:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648354560 00000100:00100000:3.0:1789429341.354342:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648354304 00000100:00100000:3.0:1789429341.354343:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648354304 00000100:00100000:3.0:1789429341.354358:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1789429341.354363:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648354560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429341.354391:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648354560:12345-0@lo:400:kworker.0 Request processed in 27us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429341.354396:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1789429341.354405:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:3.0:1789429341.354410:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648354304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429341.354429:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648354304:12345-0@lo:400:kworker.0 Request processed in 19us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429341.354433:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00080000:3.0:1789429341.354450:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429341.354452:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429341.354465:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648354304:0@lo:400:kworker.0 00000100:00100000:3.0:1789429341.354474:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648354432:0@lo:400:kworker.0 00000100:00100000:3.0:1789429341.354493:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648354560:0@lo:400:kworker.0 00000100:00100000:0.0:1789429341.357536:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648354048:0@lo:400:kworker.0 00010000:00010000:2.0:1789429341.413276:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429341.859634:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429341.859658:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648354816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429341.859748:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429341.860561:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648354816 00000100:00100000:1.0:1789429341.860570:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648354816 00000100:00100000:1.0:1789429341.860625:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789429341.860635:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648354816:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429341.860653:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789429341.860663:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648354944:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429341.860676:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1789429341.860699:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429341.860754:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648354944 00000100:00100000:3.0:1789429341.860758:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648354944 00000100:00100000:3.0:1789429341.860779:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1789429341.860786:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648354944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429341.860791:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648354816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429341.860799:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00002000:00000024:3.0:1789429341.860803:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429341.860832:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648354944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429341.860838:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789429341.860855:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648354816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429341.860944:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648354944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789429342.437256:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429343.460084:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429344.483653:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429345.507748:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789429346.008692:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:1.0:1789429346.008704:0:7635:0:(genops.c:885:class_export_put()) final put ffff946f416a7800/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:2.0:1789429346.008811:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff946f416a7800/12e09781-3d24-4c67-9972-bb781900e20d for lustre-OST0001 00000020:00000080:2.0:1789429346.008858:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946f416a4000 for lustre-OST0001 00000100:00100000:1.0:1789429346.074704:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429346.074744:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429346.074778:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429346.074830:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635007104 00000100:00100000:0.0:1789429346.074840:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635007104 00000100:00100000:2.0:1789429346.074850:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635006848 00000100:00100000:2.0:1789429346.074854:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635006848 00000100:00100000:0.0:1789429346.074894:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635006976 00000100:00100000:0.0:1789429346.074897:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635006976 00000100:00100000:2.0:1789429346.074897:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 545 00000100:00100000:2.0:1789429346.074906:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635006848:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429346.074917:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 746 00000100:00100000:0.0:1789429346.074923:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635007104:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429346.074984:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 747 00000100:00100000:3.0:1789429346.074995:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635006976:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429346.075058:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635006848:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 151us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429346.075066:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 545 00000100:00080000:1.0:1789429346.075232:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429346.077735:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635007104:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 2802us (2981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429346.077748:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 746 00000100:00100000:3.0:1789429346.083995:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635006976:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 8990us (9203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429346.084011:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 747 00000100:00100000:0.0:1789429346.467523:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648355072:0@lo:400:kworker.0 00000100:00100000:0.0:1789429346.467629:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429346.467993:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648355200:0@lo:400:kworker.0 00000100:00100000:1.0:1789429346.468082:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429346.468145:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648355200 00000100:00100000:1.0:1789429346.468154:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648355200 00000100:00100000:1.0:1789429346.468226:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1789429346.468235:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648355200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429346.468286:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648355200:12345-0@lo:400:kworker.0 Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429346.468293:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1789429346.468336:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648355200:0@lo:400:kworker.0 00000100:00100000:2.0:1789429346.470250:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648355072 00000100:00100000:2.0:1789429346.470263:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648355072 00000100:00100000:2.0:1789429346.470330:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1789429346.470341:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648355072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429346.470443:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648355072:12345-0@lo:400:kworker.0 Request processed in 100us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429346.470451:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:0.0:1789429346.470477:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648355072:0@lo:400:kworker.0 00000100:00100000:2.0:1789429346.474428:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648355328:0@lo:400:kworker.0 00000100:00100000:2.0:1789429346.474550:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429346.474692:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648355456:0@lo:400:kworker.0 00000100:00100000:0.0:1789429346.474731:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429346.474790:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648355456 00000100:00100000:0.0:1789429346.474799:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648355456 00000100:00100000:0.0:1789429346.474883:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1789429346.474895:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648355456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429346.474955:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648355456:12345-0@lo:400:kworker.0 Request processed in 62us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429346.474963:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00080000:0.0:1789429346.475009:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429346.475049:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648355456:0@lo:400:kworker.0 00000100:00100000:1.0:1789429346.475137:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648355328 00000100:00100000:1.0:1789429346.475143:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648355328 00000100:00100000:1.0:1789429346.475195:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:1.0:1789429346.475230:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648355328:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789429346.475700:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429346.476468:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648355584:0@lo:400:kworker.0 00000100:00100000:0.0:1789429346.476529:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429346.476570:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429346.476585:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648355712:0@lo:400:kworker.0 00000100:00100000:0.0:1789429346.476611:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429346.476660:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648355712 00000100:00100000:0.0:1789429346.476667:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648355712 00000100:00100000:0.0:1789429346.476731:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:0.0:1789429346.476740:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648355712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429346.476786:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648355712:12345-0@lo:400:kworker.0 Request processed in 47us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429346.476793:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00080000:0.0:1789429346.476815:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429346.476846:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648355712:0@lo:400:kworker.0 00000100:00100000:3.0:1789429346.477015:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648355584 00000100:00100000:3.0:1789429346.477021:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648355584 00000100:00100000:3.0:1789429346.477062:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1789429346.477070:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648355584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429346.477110:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648355584:12345-0@lo:400:kworker.0 Request processed in 42us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429346.477116:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00080000:0.0:1789429346.477436:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429346.477461:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648355584:0@lo:400:kworker.0 00000100:00100000:1.0:1789429346.478308:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648355328:12345-0@lo:400:kworker.0 Request processed in 3077us (3754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429346.478319:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:2.0:1789429346.479298:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648355328:0@lo:400:kworker.0 00010000:00010000:3.0:1789429346.531952:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429346.980451:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648355968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429346.980552:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429346.980650:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429346.980657:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648355840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429346.980837:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648355968 00000100:00100000:1.0:1789429346.980847:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648355968 00000100:00100000:1.0:1789429346.980929:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789429346.980941:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648355968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429346.980991:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1789429346.981597:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648355968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 654us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429346.981608:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789429346.982080:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429346.982164:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648355968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429346.982264:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648355840 00000100:00100000:1.0:1789429346.982272:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648355840 00000100:00100000:1.0:1789429346.982317:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789429346.982325:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648355840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429346.982361:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429346.982410:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648355840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429346.982417:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789429346.982633:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648355840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789429347.555625:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429348.581704:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429349.604562:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429350.628596:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429351.189887:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429351.189931:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429351.189966:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429351.190048:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635007488 00000100:00100000:3.0:1789429351.190059:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635007488 00000100:00100000:3.0:1789429351.190125:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635007360 00000100:00100000:3.0:1789429351.190129:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635007360 00000100:00100000:3.0:1789429351.190172:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 751 00000100:00100000:3.0:1789429351.190182:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635007488:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429351.190305:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635007488:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 123us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429351.190314:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 751 00000100:00100000:3.0:1789429351.190335:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 752 00000100:00100000:3.0:1789429351.190342:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635007360:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429351.190370:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635007360:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429351.190377:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 752 00000100:00100000:1.0:1789429351.190500:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635007232 00000100:00100000:1.0:1789429351.190505:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635007232 00000100:00100000:1.0:1789429351.190559:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 547 00000100:00100000:1.0:1789429351.190567:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635007232:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429351.190597:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635007232:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429351.190605:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 547 00000100:00080000:0.0:1789429351.190872:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429351.589827:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648356096:0@lo:400:kworker.0 00000100:00100000:0.0:1789429351.589897:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429351.590006:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648356224:0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.590041:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429351.590119:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648356736:0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.590159:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429351.590245:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648356224 00000100:00100000:1.0:1789429351.590253:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648356224 00000100:00100000:1.0:1789429351.590302:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:1.0:1789429351.590311:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648356224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.590363:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648356224:12345-0@lo:400:kworker.0 Request processed in 53us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429351.590371:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:1.0:1789429351.590393:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648356736 00000100:00100000:1.0:1789429351.590397:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648356736 00000100:00100000:1.0:1789429351.590432:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:1.0:1789429351.590439:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648356736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.590470:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648356736:12345-0@lo:400:kworker.0 Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429351.590476:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00080000:1.0:1789429351.590496:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429351.590527:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648356224:0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.590538:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648356736:0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.590569:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648356480:0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.590594:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429351.590614:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789429351.590621:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648356352:0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.590654:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429351.590679:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648356480 00000100:00100000:1.0:1789429351.590683:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648356480 00000100:00100000:1.0:1789429351.590712:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:1.0:1789429351.590719:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648356480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.590752:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648356480:12345-0@lo:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429351.590757:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00080000:1.0:1789429351.590774:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429351.590790:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648356480:0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.590806:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648356352 00000100:00100000:1.0:1789429351.590810:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648356352 00000100:00100000:1.0:1789429351.590839:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1789429351.590846:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648356352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.590879:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648356352:12345-0@lo:400:kworker.0 Request processed in 34us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429351.590885:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00080000:1.0:1789429351.590902:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429351.590935:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648356352:0@lo:400:kworker.0 00000100:00100000:0.0:1789429351.592102:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648356608:0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.592528:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648356096 00000100:00100000:1.0:1789429351.592536:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648356096 00000100:00100000:1.0:1789429351.592588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1789429351.592597:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648356096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429351.592824:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429351.592872:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648356096:0@lo:400:kworker.0 00000100:00100000:3.0:1789429351.593520:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648356608 00000100:00100000:3.0:1789429351.593525:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648356608 00000100:00100000:3.0:1789429351.593567:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1789429351.593572:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648356608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429351.593612:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648356608:12345-0@lo:400:kworker.0 Request processed in 40us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429351.593616:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00080000:2.0:1789429351.593679:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429351.593812:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648356608:0@lo:400:kworker.0 00000100:00100000:1.0:1789429351.593872:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648356096:12345-0@lo:400:kworker.0 Request processed in 61us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429351.593883:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00010000:00010000:2.0:1789429351.652129:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429352.099479:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648356864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429352.099574:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429352.099652:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648356992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429352.099675:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429352.099725:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648356864 00000100:00100000:0.0:1789429352.099733:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648356864 00000100:00100000:0.0:1789429352.099783:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648356992 00000100:00100000:0.0:1789429352.099787:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648356992 00000100:00100000:2.0:1789429352.099796:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789429352.099805:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789429352.099806:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648356864:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429352.099810:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648356992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429352.099840:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00002000:00000024:2.0:1789429352.099840:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429352.099941:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648356992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429352.099949:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789429352.105182:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648356864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5369us (5599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429352.105197:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789429352.105429:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648356864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429352.105447:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648356992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789429352.675547:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429353.704106:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429354.724592:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429355.748985:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429356.309055:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429356.309196:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429356.309269:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429356.309647:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635007872 00000100:00100000:2.0:1789429356.309658:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635007872 00000100:00100000:2.0:1789429356.309715:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635007744 00000100:00100000:2.0:1789429356.309717:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635007744 00000100:00100000:2.0:1789429356.309744:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 756 00000100:00100000:2.0:1789429356.309753:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635007872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429356.309816:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635007872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 64us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429356.309823:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 756 00000100:00100000:2.0:1789429356.309836:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 757 00000100:00100000:2.0:1789429356.309842:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635007744:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429356.309859:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635007744:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 18us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429356.309865:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 757 00000100:00080000:1.0:1789429356.310637:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429356.312212:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635007616 00000100:00100000:3.0:1789429356.312224:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635007616 00000100:00100000:3.0:1789429356.312287:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 549 00000100:00100000:3.0:1789429356.312298:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635007616:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429356.312372:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635007616:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 77us (3326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429356.312379:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 549 00000100:00100000:3.0:1789429356.707424:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789429356.707541:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789429356.707563:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648357504:0@lo:400:kworker.0 00000100:00100000:2.0:1789429356.707611:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648357248:0@lo:400:kworker.0 00000100:00100000:2.0:1789429356.707657:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429356.707658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429356.707722:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429356.707731:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648357376:0@lo:400:kworker.0 00000100:00100000:2.0:1789429356.707757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429356.707771:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648357504 00000100:00100000:1.0:1789429356.707780:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648357504 00000100:00100000:2.0:1789429356.707798:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648357248 00000100:00100000:2.0:1789429356.707804:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648357248 00000100:00100000:1.0:1789429356.707844:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:1.0:1789429356.707855:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648357504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429356.707856:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648357376 00000100:00100000:1.0:1789429356.707911:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648357504:12345-0@lo:400:kworker.0 Request processed in 58us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429356.707918:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:2.0:1789429356.707929:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648357376 00000100:00080000:1.0:1789429356.707939:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429356.707945:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429356.707967:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1789429356.707976:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648357248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429356.707978:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648357504:0@lo:400:kworker.0 00000100:00100000:2.0:1789429356.708024:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648357248:12345-0@lo:400:kworker.0 Request processed in 49us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429356.708032:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1789429356.708039:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:1.0:1789429356.708050:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648357376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429356.708084:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648357376:12345-0@lo:400:kworker.0 Request processed in 37us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429356.708090:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1789429356.708121:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648357376:0@lo:400:kworker.0 00000100:00100000:2.0:1789429356.708134:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648357248:0@lo:400:kworker.0 00000100:00100000:3.0:1789429356.708406:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648357120:0@lo:400:kworker.0 00000100:00100000:3.0:1789429356.708443:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429356.708708:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648357760:0@lo:400:kworker.0 00000100:00100000:3.0:1789429356.708741:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789429356.708743:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429356.708750:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648357632:0@lo:400:kworker.0 00000100:00100000:3.0:1789429356.708777:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429356.708782:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648357760 00000100:00100000:0.0:1789429356.708786:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648357760 00000100:00100000:3.0:1789429356.708799:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648357632 00000100:00100000:3.0:1789429356.708803:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648357632 00000100:00100000:0.0:1789429356.708820:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:3.0:1789429356.708825:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1789429356.708826:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648357760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429356.708830:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648357632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429356.708861:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648357760:12345-0@lo:400:kworker.0 Request processed in 34us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429356.708861:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648357632:12345-0@lo:400:kworker.0 Request processed in 30us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429356.708867:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1789429356.708894:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648357632:0@lo:400:kworker.0 00000100:00080000:3.0:1789429356.708933:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429356.708937:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429356.708973:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648357120 00000100:00100000:1.0:1789429356.708977:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648357120 00000100:00100000:1.0:1789429356.709047:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1789429356.709055:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648357120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429356.709083:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1789429356.709091:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648357120:12345-0@lo:400:kworker.0 Request processed in 38us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429356.709097:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1789429356.709113:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648357760:0@lo:400:kworker.0 00000100:00100000:3.0:1789429356.709148:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648357120:0@lo:400:kworker.0 00010000:00010000:3.0:1789429356.771599:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429357.221165:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429357.221190:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648357888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429357.221287:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429357.221356:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429357.221366:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648358016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429357.221397:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429357.221428:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648357888 00000100:00100000:0.0:1789429357.221437:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648357888 00000100:00100000:0.0:1789429357.221487:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648358016 00000100:00100000:0.0:1789429357.221491:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648358016 00000100:00100000:0.0:1789429357.221508:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789429357.221522:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648357888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429357.221557:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1789429357.221557:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789429357.221572:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648358016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429357.221597:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429357.221634:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648357888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429357.221642:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789429357.221663:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648358016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429357.221670:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789429357.221693:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648357888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429357.222349:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648358016:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789429357.797240:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429358.819731:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429359.843497:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429360.867359:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429361.430159:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429361.430243:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429361.430283:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429361.430338:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635008000 00000100:00100000:3.0:1789429361.430348:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635008000 00000100:00100000:3.0:1789429361.430411:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 551 00000100:00100000:0.0:1789429361.430421:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635008128 00000100:00100000:3.0:1789429361.430423:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635008000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429361.430428:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635008128 00000100:00100000:0.0:1789429361.430472:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635008256 00000100:00100000:0.0:1789429361.430476:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635008256 00000100:00100000:0.0:1789429361.430497:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 761 00000100:00100000:3.0:1789429361.430505:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635008000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 83us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429361.430507:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635008128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429361.430521:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 551 00000100:00100000:0.0:1789429361.430553:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635008128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 48us (402us total) trans 0 rc 0/0 00000100:00080000:3.0:1789429361.430557:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429361.430562:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 761 00000100:00100000:0.0:1789429361.430595:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 762 00000100:00100000:0.0:1789429361.430603:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635008256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429361.430629:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635008256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429361.430636:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 762 00000100:00100000:0.0:1789429361.827456:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648358144:0@lo:400:kworker.0 00000100:00100000:0.0:1789429361.827537:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429361.827665:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648358144 00000100:00100000:1.0:1789429361.827674:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648358144 00000100:00100000:1.0:1789429361.827727:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1789429361.827737:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648358144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.827876:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648358528:0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.827912:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429361.827950:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648358272:0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.827974:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429361.827992:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429361.827997:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648358400:0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.828017:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429361.828044:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648358528 00000100:00100000:3.0:1789429361.828048:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648358528 00000100:00100000:3.0:1789429361.828095:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:3.0:1789429361.828102:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648358528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.828139:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648358528:12345-0@lo:400:kworker.0 Request processed in 36us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429361.828146:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:3.0:1789429361.828167:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648358272 00000100:00100000:3.0:1789429361.828171:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648358272 00000100:00100000:3.0:1789429361.828195:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648358400 00000100:00100000:3.0:1789429361.828225:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648358400 00000100:00100000:3.0:1789429361.828250:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1789429361.828256:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648358272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.828289:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648358272:12345-0@lo:400:kworker.0 Request processed in 33us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429361.828298:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1789429361.828310:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1789429361.828316:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648358400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.828343:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648358400:12345-0@lo:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429361.828348:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00080000:3.0:1789429361.828372:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429361.828377:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429361.828402:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648358528:0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.828430:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648358400:0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.828438:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648358272:0@lo:400:kworker.0 00000100:00100000:1.0:1789429361.830118:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648358144:12345-0@lo:400:kworker.0 Request processed in 2375us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429361.830132:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1789429361.834623:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648358144:0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.836402:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429361.836423:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648358784:0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.836502:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429361.836556:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789429361.836573:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648358656:0@lo:400:kworker.0 00000100:00100000:3.0:1789429361.836601:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429361.836720:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648358784 00000100:00100000:2.0:1789429361.836728:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648358784 00000100:00100000:2.0:1789429361.836796:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:2.0:1789429361.836807:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648358784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429361.836870:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648358784:12345-0@lo:400:kworker.0 Request processed in 66us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429361.836881:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:2.0:1789429361.836921:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648358784:0@lo:400:kworker.0 00000100:00080000:3.0:1789429361.836987:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429361.837109:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648358656 00000100:00100000:1.0:1789429361.837115:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648358656 00000100:00100000:1.0:1789429361.837170:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:1.0:1789429361.837177:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648358656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429361.837243:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648358656:12345-0@lo:400:kworker.0 Request processed in 67us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429361.837253:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:1.0:1789429361.837287:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648358656:0@lo:400:kworker.0 00000100:00080000:3.0:1789429361.837346:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789429361.891554:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429362.339556:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648358912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429362.339643:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429362.339839:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648358912 00000100:00100000:0.0:1789429362.339847:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648358912 00000100:00100000:0.0:1789429362.339900:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789429362.339910:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648358912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429362.339944:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1789429362.339994:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648358912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429362.340000:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789429362.340047:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648358912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429362.340406:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648359040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429362.340438:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429362.340592:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648359040 00000100:00100000:1.0:1789429362.340597:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648359040 00000100:00100000:1.0:1789429362.340636:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789429362.340644:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648359040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429362.340675:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429362.340721:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648359040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429362.340728:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789429362.340865:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648359040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789429362.915404:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429363.942359:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429364.963399:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429365.987518:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429366.549050:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429366.549105:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429366.549158:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429366.549259:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635008512 00000100:00100000:2.0:1789429366.549272:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635008512 00000100:00100000:2.0:1789429366.549352:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635008640 00000100:00100000:2.0:1789429366.549356:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635008640 00000100:00100000:2.0:1789429366.549393:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 766 00000100:00100000:2.0:1789429366.549405:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635008512:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429366.549499:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635008512:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 95us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429366.549507:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 766 00000100:00100000:2.0:1789429366.549526:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 767 00000100:00100000:2.0:1789429366.549544:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635008640:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429366.549568:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635008640:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429366.549574:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 767 00000100:00100000:1.0:1789429366.550249:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635008384 00000100:00100000:1.0:1789429366.550257:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635008384 00000100:00100000:1.0:1789429366.550311:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 553 00000100:00100000:1.0:1789429366.550320:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635008384:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429366.550370:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635008384:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 52us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429366.550376:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 553 00000100:00080000:0.0:1789429366.550574:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429366.948456:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648359168:0@lo:400:kworker.0 00000100:00100000:2.0:1789429366.948575:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429366.948754:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648359168 00000100:00100000:1.0:1789429366.948765:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648359168 00000100:00100000:1.0:1789429366.948976:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1789429366.948988:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648359168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429366.949263:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648359552:0@lo:400:kworker.0 00000100:00100000:3.0:1789429366.949301:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429366.949348:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648359552 00000100:00100000:3.0:1789429366.949353:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648359552 00000100:00100000:3.0:1789429366.949397:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1789429366.949404:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648359552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429366.949445:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648359552:12345-0@lo:400:kworker.0 Request processed in 41us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429366.949452:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1789429366.949501:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34021880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648359552:0@lo:400:kworker.0 00000100:00100000:3.0:1789429366.949562:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648359424:0@lo:400:kworker.0 00000100:00100000:3.0:1789429366.949593:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429366.949616:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429366.949622:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648359296:0@lo:400:kworker.0 00000100:00100000:3.0:1789429366.949643:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429366.949682:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648359424 00000100:00100000:3.0:1789429366.949685:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648359424 00000100:00100000:3.0:1789429366.949736:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648359296 00000100:00100000:3.0:1789429366.949740:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648359296 00000100:00100000:3.0:1789429366.949759:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1789429366.949765:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648359424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429366.949815:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648359424:12345-0@lo:400:kworker.0 Request processed in 50us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429366.949822:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1789429366.949837:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1789429366.949849:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648359296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429366.949879:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648359296:12345-0@lo:400:kworker.0 Request processed in 37us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429366.949885:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1789429366.949913:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648359296:0@lo:400:kworker.0 00000100:00100000:3.0:1789429366.949923:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648359424:0@lo:400:kworker.0 00000100:00080000:3.0:1789429366.949953:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429366.949964:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429366.952345:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648359168:12345-0@lo:400:kworker.0 Request processed in 3346us (3758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429366.952362:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648359168:0@lo:400:kworker.0 00000100:00100000:1.0:1789429366.952368:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1789429366.954185:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648359680:0@lo:400:kworker.0 00000100:00100000:2.0:1789429366.954305:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429366.954363:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429366.954377:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648359808:0@lo:400:kworker.0 00000100:00100000:0.0:1789429366.954416:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429366.954447:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648359808 00000100:00100000:1.0:1789429366.954458:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648359808 00000100:00080000:0.0:1789429366.954513:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429366.954548:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1789429366.954573:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648359808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429366.954646:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648359808:12345-0@lo:400:kworker.0 Request processed in 87us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429366.954654:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1789429366.955062:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648359680 00000100:00100000:3.0:1789429366.955069:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648359680 00000100:00100000:3.0:1789429366.955150:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1789429366.955159:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648359680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429366.955240:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648359680:12345-0@lo:400:kworker.0 Request processed in 83us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429366.955248:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1789429366.955834:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648359680:0@lo:400:kworker.0 00000100:00080000:1.0:1789429366.956077:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429366.956386:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648359808:0@lo:400:kworker.0 00010000:00010000:3.0:1789429367.011475:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429367.459488:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648360064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429367.459594:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429367.459666:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648360064 00000100:00100000:3.0:1789429367.459677:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648360064 00000100:00100000:3.0:1789429367.459753:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789429367.459762:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648359936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429367.459766:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648360064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429367.459802:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789429367.459816:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429367.459879:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34020a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648360064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429367.459886:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789429367.459902:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648359936 00000100:00100000:3.0:1789429367.459905:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648359936 00000100:00100000:3.0:1789429367.459918:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789429367.459923:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648359936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429367.459944:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1789429367.459983:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648360064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429367.460172:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648359936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429367.460179:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789429367.460266:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34023800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648359936:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789429368.036015:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429369.060094:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429370.083921:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429371.107490:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429371.671472:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429371.671570:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429371.671601:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429371.671677:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635009024 00000100:00100000:3.0:1789429371.671688:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635009024 00000100:00100000:1.0:1789429371.671734:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635008896 00000100:00100000:1.0:1789429371.671750:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635008896 00000100:00100000:3.0:1789429371.671759:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 771 00000100:00100000:3.0:1789429371.671771:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635009024:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429371.671799:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 772 00000100:00100000:1.0:1789429371.671818:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635008896:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429371.671852:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635009024:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429371.671855:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635008896:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 38us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429371.671865:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 771 00000100:00080000:0.0:1789429371.671899:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429371.672766:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635008768 00000100:00100000:2.0:1789429371.672773:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635008768 00000100:00100000:2.0:1789429371.672855:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 555 00000100:00100000:2.0:1789429371.672864:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635008768:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429371.672919:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635008768:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 56us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429371.672925:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 555 00000100:00100000:1.0:1789429371.676100:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 772 00000100:00100000:2.0:1789429372.067599:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648360448:0@lo:400:kworker.0 00000100:00100000:1.0:1789429372.067612:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648360576:0@lo:400:kworker.0 00000100:00100000:0.0:1789429372.067897:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648360192:0@lo:400:kworker.0 00000100:00100000:3.0:1789429372.068127:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648360320:0@lo:400:kworker.0 00000100:00100000:1.0:1789429372.069505:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429372.069595:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648360576 00000100:00100000:1.0:1789429372.069604:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648360576 00000100:00100000:1.0:1789429372.069660:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1789429372.069671:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648360576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429372.069726:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648360576:12345-0@lo:400:kworker.0 Request processed in 58us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429372.069734:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1789429372.069773:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648360576:0@lo:400:kworker.0 00000100:00080000:1.0:1789429372.069804:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429372.070339:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429372.070484:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648360448 00000100:00100000:1.0:1789429372.070500:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648360448 00000100:00100000:1.0:1789429372.070548:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1789429372.070556:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648360448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429372.070596:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648360448:12345-0@lo:400:kworker.0 Request processed in 42us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429372.070603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00080000:2.0:1789429372.071370:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429372.071406:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648360448:0@lo:400:kworker.0 00000100:00100000:0.0:1789429372.071911:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429372.071952:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648360704:0@lo:400:kworker.0 00000100:00100000:0.0:1789429372.071976:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429372.072025:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648360704 00000100:00100000:2.0:1789429372.072031:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648360704 00000100:00100000:3.0:1789429372.072137:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429372.072143:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1789429372.072154:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648360704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429372.072163:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648360832:0@lo:400:kworker.0 00000100:00100000:3.0:1789429372.072214:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789429372.072309:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429372.072331:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648360320 00000100:00100000:0.0:1789429372.072335:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648360320 00000100:00100000:0.0:1789429372.072362:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:0.0:1789429372.072368:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648360320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429372.072503:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648360704:12345-0@lo:400:kworker.0 Request processed in 350us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429372.072511:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:3.0:1789429372.072514:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648360832 00000100:00100000:3.0:1789429372.072519:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648360832 00000100:00080000:2.0:1789429372.072555:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429372.072574:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1789429372.072582:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648360832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429372.072640:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648360832:12345-0@lo:400:kworker.0 Request processed in 59us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429372.072653:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648360832:0@lo:400:kworker.0 00000100:00100000:2.0:1789429372.072657:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:0.0:1789429372.073156:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648360320:12345-0@lo:400:kworker.0 Request processed in 787us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429372.073163:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:0.0:1789429372.073296:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648360704:0@lo:400:kworker.0 00000100:00100000:1.0:1789429372.073339:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648360192 00000100:00100000:1.0:1789429372.073345:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648360192 00000100:00100000:1.0:1789429372.073401:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1789429372.073409:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648360192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429372.075084:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648360320:0@lo:400:kworker.0 00000100:00100000:1.0:1789429372.075110:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648360192:12345-0@lo:400:kworker.0 Request processed in 1699us (3197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429372.075120:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1789429372.075589:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648360192:0@lo:400:kworker.0 00010000:00010000:2.0:1789429372.132291:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429372.581795:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429372.581818:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648360960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429372.581888:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429372.582044:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648360960 00000100:00100000:0.0:1789429372.582053:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648360960 00000100:00100000:0.0:1789429372.582109:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789429372.582118:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648360960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429372.582154:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1789429372.582389:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648361088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429372.582420:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429372.582456:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648361088 00000100:00100000:3.0:1789429372.582470:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648361088 00000100:00100000:3.0:1789429372.582500:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789429372.582507:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648361088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429372.582525:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429372.582560:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648361088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429372.582567:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789429372.582605:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648361088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429372.583101:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648360960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 982us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429372.583108:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789429372.585691:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34022a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648360960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789429373.156870:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429374.179399:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429375.203342:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429376.227751:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429376.789002:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429376.789048:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429376.789083:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429376.789257:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635009152 00000100:00100000:2.0:1789429376.789267:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635009152 00000100:00100000:2.0:1789429376.789320:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 557 00000100:00100000:2.0:1789429376.789330:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635009152:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429376.789397:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635009152:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 68us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429376.789404:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 557 00000100:00100000:3.0:1789429376.791527:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635009408 00000100:00100000:3.0:1789429376.791538:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635009408 00000100:00100000:3.0:1789429376.791609:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635009280 00000100:00080000:2.0:1789429376.791611:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429376.791614:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635009280 00000100:00080000:2.0:1789429376.791638:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429376.791662:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 776 00000100:00100000:2.0:1789429376.791672:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 777 00000100:00100000:3.0:1789429376.791675:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635009408:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429376.791686:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635009280:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429376.791743:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635009408:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 73us (2694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429376.791751:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 776 00000100:00100000:2.0:1789429376.794664:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635009280:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 2972us (5569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429376.794741:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 777 00000100:00100000:0.0:1789429377.189409:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648361216:0@lo:400:kworker.0 00000100:00100000:0.0:1789429377.189494:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429377.189497:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648361600:0@lo:400:kworker.0 00000100:00100000:0.0:1789429377.189542:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648361728:0@lo:400:kworker.0 00000100:00100000:1.0:1789429377.189544:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429377.189578:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429377.189598:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648361216 00000100:00100000:1.0:1789429377.189605:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648361216 00000100:00100000:0.0:1789429377.189619:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648361728 00000100:00100000:0.0:1789429377.189624:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648361728 00000100:00100000:1.0:1789429377.189668:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1789429377.189672:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:1.0:1789429377.189680:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648361216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429377.189686:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648361728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429377.189738:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648361216:12345-0@lo:400:kworker.0 Request processed in 62us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429377.189743:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648361728:12345-0@lo:400:kworker.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429377.189750:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1789429377.189756:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00080000:0.0:1789429377.189781:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429377.189787:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648361600 00000100:00100000:1.0:1789429377.189791:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648361600 00000100:00100000:1.0:1789429377.189828:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1789429377.189834:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648361600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429377.189847:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648361216:0@lo:400:kworker.0 00000100:00100000:0.0:1789429377.189863:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648361728:0@lo:400:kworker.0 00000100:00100000:1.0:1789429377.189871:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648361600:12345-0@lo:400:kworker.0 Request processed in 36us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429377.189878:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00080000:0.0:1789429377.189907:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429377.189928:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648361600:0@lo:400:kworker.0 00000100:00100000:0.0:1789429377.189931:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648361344:0@lo:400:kworker.0 00000100:00100000:1.0:1789429377.189960:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648361472:0@lo:400:kworker.0 00000100:00100000:0.0:1789429377.189964:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429377.189990:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648361856:0@lo:400:kworker.0 00000100:00100000:1.0:1789429377.189994:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429377.190026:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648361344 00000100:00100000:1.0:1789429377.190029:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648361344 00000100:00100000:0.0:1789429377.190043:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429377.190050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648361472 00000100:00100000:1.0:1789429377.190053:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648361472 00000100:00100000:1.0:1789429377.190083:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1789429377.190090:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648361344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429377.190096:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648361856 00000100:00100000:0.0:1789429377.190102:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648361856 00000100:00100000:1.0:1789429377.190126:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648361344:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429377.190132:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1789429377.190141:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:1.0:1789429377.190150:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1789429377.190152:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648361856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429377.190161:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648361472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429377.190225:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648361856:12345-0@lo:400:kworker.0 Request processed in 52us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429377.190233:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648361472:12345-0@lo:400:kworker.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429377.190234:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:1.0:1789429377.190245:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00080000:2.0:1789429377.190285:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429377.190294:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429377.190366:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648361472:0@lo:400:kworker.0 00000100:00100000:2.0:1789429377.190420:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648361344:0@lo:400:kworker.0 00000100:00100000:2.0:1789429377.190437:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648361856:0@lo:400:kworker.0 00010000:00010000:3.0:1789429377.252003:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429377.700641:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429377.700673:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648361984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429377.700741:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429377.700942:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648361984 00000100:00100000:0.0:1789429377.700951:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648361984 00000100:00100000:0.0:1789429377.701006:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789429377.701015:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648361984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429377.701048:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1789429377.701098:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648361984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429377.701108:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1789429377.701164:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648361984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429377.705900:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648362112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429377.705979:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429377.706256:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648362112 00000100:00100000:2.0:1789429377.706265:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648362112 00000100:00100000:2.0:1789429377.706322:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789429377.706331:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648362112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429377.706365:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429377.706422:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648362112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429377.706430:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789429377.706606:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648362112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789429378.276830:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429379.299346:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429380.325674:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429381.153569:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429381.153727:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635009536 00000100:00100000:2.0:1789429381.153738:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635009536 00000100:00100000:2.0:1789429381.153830:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21136 00000100:00100000:2.0:1789429381.153842:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:36060:x1876351635009536:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:2.0:1789429381.153861:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429381.153885:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360c5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3f8 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789429381.154147:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789429381.154280:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360c61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429381.154295:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429381.154312:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429381.154347:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429381.154350:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429381.154369:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429381.154402:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360c5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3f8 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429381.154431:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360c61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3f8 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429381.154440:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef800) 00010000:00010000:2.0:1789429381.154443:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429381.154445:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547400, rc 0) 00000100:00100000:2.0:1789429381.154513:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:36060:x1876351635009536:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 673us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429381.154520:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21136 00000100:00100000:3.0:1789429381.158735:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429381.158964:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635009792 00000100:00100000:0.0:1789429381.158975:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635009792 00000100:00100000:0.0:1789429381.159065:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21137 00000100:00100000:0.0:1789429381.159076:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+7:36060:x1876351635009792:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:0.0:1789429381.159097:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429381.159142:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360c68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c3ff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.159261:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360c6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x76:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.159276:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360c6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.159288:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360c6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429381.159300:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x76:0x0]: returning size 43 00010000:00010000:0.0:1789429381.159478:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360c68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ff expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.159497:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360c6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ff expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.159512:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x76:0x0].0x0 (ffff946f04fb8200) 00010000:00010000:0.0:1789429381.159516:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429381.159519:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac600, rc 0) 00000100:00100000:0.0:1789429381.159580:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+9:36060:x1876351635009792:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 506us (853us total) trans 4294977126 rc 0/0 00000100:00100000:0.0:1789429381.159586:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21137 00000100:00100000:2.0:1789429381.166272:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429381.166390:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429381.166470:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635010048 00000100:00100000:3.0:1789429381.166578:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635010048 00000100:00100000:3.0:1789429381.166627:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5766 00000100:00100000:3.0:1789429381.166635:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2367:x1876351635010048:12345-192.168.203.39@tcp:8:multiop.0 00000100:00100000:0.0:1789429381.166698:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635009920 00000100:00100000:0.0:1789429381.166704:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635009920 00000100:00100000:0.0:1789429381.166762:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 269 00000100:00100000:0.0:1789429381.166771:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351635009920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429381.166785:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429381.166809:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726360c6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ff expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.166839:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x76:0x0].0x0 (ffff946f04fb8200) 00010000:00010000:0.0:1789429381.166845:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00080000:3.0:1789429381.166897:0:6681:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t0 exp 0000000000000000 cur 1079 last 0 00000100:00100000:0.0:1789429381.166905:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+8:2368:x1876351635009920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 134us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429381.166913:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 269 00000020:00000080:3.0:1789429381.166931:0:6681:0:(genops.c:1384:class_connect()) connect: client 12e09781-3d24-4c67-9972-bb781900e20d, cookie 0xb4c3dad726360c7d 00002000:00100000:3.0:1789429381.166942:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 12e09781-3d24-4c67-9972-bb781900e20d/ffff946e02aaa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789429381.166964:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789429381.168226:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789429381.168258:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946e02aaa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789429381.168630:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2367:x1876351635010048:12345-192.168.203.39@tcp:8:multiop.0 Request processed in 1991us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429381.168640:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5766 00000100:00100000:2.0:1789429381.176794:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429381.177178:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635010176 00000100:00100000:3.0:1789429381.177188:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635010176 00000100:00100000:3.0:1789429381.177303:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5767 00000100:00100000:3.0:1789429381.177315:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:36060:x1876351635010176:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:3.0:1789429381.177333:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429381.177355:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360c84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c406 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429381.177383:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 43, mtime: 0x6aa88648, atime: 0x0, ctime: 0x6aa88648, blocks: 0xb 00010000:00010000:3.0:1789429381.177415:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=1079s v=(0 0) 00010000:00010000:3.0:1789429381.177428:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429381.177438:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360c84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c406 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.177457:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360c84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c406 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.177471:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:3.0:1789429381.177534:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:36060:x1876351635010176:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 220us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429381.177542:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5767 00000100:00080000:0.0:1789429381.177791:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429381.181636:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429381.181739:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635010304 00000100:00100000:1.0:1789429381.181750:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635010304 00002000:00100000:1.0:1789429381.181802:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2f:0x0] (0->4095) req@ffff946f119c6300 x1876351635010304/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:117/0 lens 488/0 e 0 to 0 dl 1789429392 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429381.181814:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c6300 with x1876351635010304 ext(0->4095) 00002000:00010000:1.0:1789429381.181820:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c6300 00000100:00100000:1.0:1789429381.181853:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11510 00000100:00100000:1.0:1789429381.181863:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635010304:12345-192.168.203.39@tcp:3:multiop.0 00000100:00100000:1.0:1789429381.182103:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635010304:12345-192.168.203.39@tcp:3:multiop.0 Request processed in 240us (473us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429381.182110:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11510 00002000:00100000:1.0:1789429381.182116:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x2f:0x0] (0->4095) req@ffff946f119c6300 x1876351635010304/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:117/0 lens 488/4536 e 0 to 0 dl 1789429392 ref 1 fl Complete:/600/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429381.182124:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c6300 with x1876351635010304 ext(0->4095) 00002000:00010000:1.0:1789429381.182127:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f119c6300 00000100:00100000:2.0:1789429381.210747:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429381.210857:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635010560 00000100:00100000:0.0:1789429381.210868:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635010560 00000100:00100000:0.0:1789429381.210927:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 251 00000100:00100000:0.0:1789429381.210938:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+8:36060:x1876351635010560:12345-192.168.203.39@tcp:35:multiop.0 00000100:00100000:0.0:1789429381.211288:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:36060:x1876351635010560:12345-192.168.203.39@tcp:35:multiop.0 Request processed in 351us (551us total) trans 4294977127 rc 0/0 00000100:00100000:0.0:1789429381.211297:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 251 00000100:00100000:0.0:1789429381.222336:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429381.222445:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635010688 00000100:00100000:1.0:1789429381.222455:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635010688 00000100:00100000:1.0:1789429381.222521:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 270 00000100:00100000:1.0:1789429381.222531:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:14501:x1876351635010688:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429381.222547:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789429381.222571:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360c3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3ea expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.222591:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x76:0x0].0x0 (ffff946f04fb8200) 00010000:00010000:1.0:1789429381.222609:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360c61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c3f8 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.222618:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef800) 00010000:00010000:1.0:1789429381.222624:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429381.222681:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:14501:x1876351635010688:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 151us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429381.222688:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 270 00000100:00100000:1.0:1789429381.271669:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429381.271748:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635010816 00000100:00100000:0.0:1789429381.271759:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635010816 00000100:00100000:0.0:1789429381.271819:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21138 00000100:00100000:0.0:1789429381.271829:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:36067:x1876351635010816:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:0.0:1789429381.271851:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429381.271874:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360c8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c40d expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.271938:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360c92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.271952:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.271963:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429381.271999:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429381.272003:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429381.272022:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.272047:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726360c8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c40d expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.272065:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c40d expref: 8 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.272120:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:0.0:1789429381.272123:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429381.272126:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac200, rc 0) 00000100:00100000:0.0:1789429381.272193:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:36067:x1876351635010816:12345-192.168.203.39@tcp:101:stat.0 Request processed in 366us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429381.272258:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21138 00000100:00100000:2.0:1789429381.275344:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429381.275895:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635010944 00000100:00100000:1.0:1789429381.275906:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635010944 00000100:00100000:1.0:1789429381.276042:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21139 00000100:00100000:1.0:1789429381.276053:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+8:36067:x1876351635010944:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:1.0:1789429381.276073:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429381.276095:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360c99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c414 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.276172:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360ca0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.276531:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.276551:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.276569:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ca7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.276577:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.276584:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277453:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360cae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x76:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277465:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x76:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277475:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x76:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429381.277513:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x76:0x0]: returning size 43 00000004:00200000:1.0:1789429381.277517:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429381.277538:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x76:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277548:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360cae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277556:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277567:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360ca0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277574:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277579:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429381.277583:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277589:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360ca0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277620:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:1.0:1789429381.277624:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429381.277629:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360ca0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277635:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360ca0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277884:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277893:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277899:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277904:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429381.277908:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277924:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277933:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa05e6683 (ffff946f2076a900) 00010000:00010000:1.0:1789429381.277936:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429381.277939:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ca7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277945:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ca7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277984:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360c99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c414 expref: 10 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.277998:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360cae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c414 expref: 9 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.278006:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x76:0x0].0x0 (ffff946f2076a500) 00010000:00010000:1.0:1789429381.278008:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429381.278011:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7e00, rc 0) 00000100:00100000:1.0:1789429381.278195:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+9:36067:x1876351635010944:12345-192.168.203.39@tcp:101:stat.0 Request processed in 2141us (2858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429381.278233:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21139 00000100:00100000:2.0:1789429381.291590:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429381.291957:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635011200 00000100:00100000:3.0:1789429381.291970:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635011200 00000100:00100000:3.0:1789429381.292029:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21140 00000100:00100000:3.0:1789429381.292040:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:36068:x1876351635011200:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:3.0:1789429381.292090:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789429381.292116:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360cae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x76:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c414 expref: 9 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.292137:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x76:0x0].0x0 (ffff946f2076a500) 00010000:00010000:3.0:1789429381.292154:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726360c92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c40d expref: 8 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.292163:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:3.0:1789429381.292170:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429381.292193:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360cb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.292255:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360cb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.292266:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360cb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.292280:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360cbc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.292288:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360cbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.292296:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360cbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.292743:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cc3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x76:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.292753:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x76:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.292760:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x76:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789429381.293588:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].27, 64 off9920 00000004:00080000:3.0:1789429381.293599:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1079273398388ns, next at 1080273396068ns, rc = 0 00010000:00010000:3.0:1789429381.293657:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360cca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x76:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293669:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360cca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x76:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293677:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360cca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x76:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293686:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360cca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x76:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293692:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360cca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x76:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293698:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360cca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x76:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293726:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789429381.293745:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cc3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293752:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cc3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293759:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cc3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293765:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429381.293769:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cc3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293776:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cc3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293786:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x76:0x0].0x0 (ffff946f04fb8300) 00010000:00010000:3.0:1789429381.293788:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789429381.293793:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cc3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293798:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cc3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x76:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293813:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360cb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293818:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360cb5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293823:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360cb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293828:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429381.293831:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360cb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293836:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360cb5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293842:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8d00) 00010000:00010000:3.0:1789429381.293843:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429381.293845:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360cb5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429381.293850:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360cb5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429381.293862:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e32876f9 reply state 00000000fece7bd3 transno 4294977128 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360cbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429381.293869:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429381.294374:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789429381.294381:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360cca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x76:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.294391:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1600 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:1.0:1789429381.294395:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360cca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x76:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.294402:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360cca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x76:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.294411:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x76:0x0].0x0 (ffff946f04fb8300) 00010000:00010000:1.0:1789429381.294413:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789429381.294417:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360cca lrc: 1/0,0 mode: --/PW res: [0x200000401:0x76:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.294431:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360cca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x76:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429381.294446:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429381.294447:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429381.294449:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429381.296554:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:36068:x1876351635011200:12345-192.168.203.39@tcp:36:rm.0 Request processed in 4504us (4963us total) trans 4294977128 rc 0/0 00000100:00100000:3.0:1789429381.296568:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21140 00010000:00010000:0.0:1789429381.302094:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360cbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.302112:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360cbc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.302119:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360cbc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.302125:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429381.302130:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360cbc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.302138:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360cbc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.302157:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa05e6683 (ffff946f04fb8100) 00010000:00010000:0.0:1789429381.302160:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429381.302165:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360cbc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429381.302171:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360cbc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa05e6683 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429381.347845:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789429381.863990:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000100:00100000:3.0:1789429381.909007:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429381.909079:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635011456 00000100:00100000:0.0:1789429381.909090:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635011456 00000100:00100000:3.0:1789429381.909097:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429381.909178:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 781 00000100:00100000:0.0:1789429381.909187:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635011456:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429381.909290:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635011456:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 103us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429381.909293:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635011328 00000100:00100000:0.0:1789429381.909300:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 781 00000100:00100000:1.0:1789429381.909302:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635011328 00000100:00080000:0.0:1789429381.909327:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429381.909343:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 559 00000100:00100000:1.0:1789429381.909351:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635011328:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429381.909379:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635011328:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429381.909384:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 559 00000100:00100000:3.0:1789429382.308121:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648362624:0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.308218:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429382.308270:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789429382.308276:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648362240:0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.308306:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429382.308333:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648362752:0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.308357:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429382.308381:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648362368:0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.310278:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429382.310321:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648362880:0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.310362:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429382.310386:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429382.310393:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648362496:0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.310436:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429382.310475:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648362624 00000100:00100000:3.0:1789429382.310482:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648362624 00000100:00100000:3.0:1789429382.310548:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648362880 00000100:00100000:3.0:1789429382.310551:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648362880 00000100:00100000:3.0:1789429382.310575:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1789429382.310583:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648362624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.310644:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648362624:12345-0@lo:400:kworker.0 Request processed in 62us (2444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429382.310651:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1789429382.310667:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1789429382.310673:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648362880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.310703:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648362880:12345-0@lo:400:kworker.0 Request processed in 30us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429382.310708:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1789429382.310729:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648362240 00000100:00100000:3.0:1789429382.310733:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648362240 00000100:00100000:3.0:1789429382.310757:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1789429382.310763:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648362240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.310796:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648362240:12345-0@lo:400:kworker.0 Request processed in 33us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429382.310802:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1789429382.310827:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648362752 00000100:00100000:3.0:1789429382.310830:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648362752 00000100:00100000:3.0:1789429382.310866:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648362368 00000100:00100000:3.0:1789429382.310869:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648362368 00000100:00100000:3.0:1789429382.310885:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648362496 00000100:00100000:3.0:1789429382.310887:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648362496 00000100:00100000:3.0:1789429382.310905:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1789429382.310911:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648362752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.310941:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648362752:12345-0@lo:400:kworker.0 Request processed in 30us (2582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429382.310947:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1789429382.310958:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:3.0:1789429382.310962:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648362368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.310986:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648362368:12345-0@lo:400:kworker.0 Request processed in 23us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429382.310991:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:3.0:1789429382.311002:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1789429382.311008:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648362496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.311031:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648362496:12345-0@lo:400:kworker.0 Request processed in 24us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429382.311037:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00080000:3.0:1789429382.311063:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429382.311068:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429382.311070:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429382.311102:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648362240:0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.311116:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648362752:0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.311126:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648362624:0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.311187:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648362496:0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.311225:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648362368:0@lo:400:kworker.0 00000100:00100000:3.0:1789429382.311238:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648362880:0@lo:400:kworker.0 00010000:00010000:3.0:1789429382.371482:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429382.824731:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648363008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429382.824801:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789429382.824865:0:8083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1080804663461ns, next at 1081804661343ns, rc = 0 00000100:00100000:0.0:1789429382.824873:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429382.824886:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648363136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429382.824919:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429382.824974:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648363008 00000100:00100000:0.0:1789429382.824982:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648363008 00000100:00100000:0.0:1789429382.825022:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648363136 00000100:00100000:0.0:1789429382.825025:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648363136 00000100:00100000:0.0:1789429382.825041:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789429382.825048:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648363008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429382.825078:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1789429382.825179:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789429382.825189:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648363136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429382.825217:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429382.825329:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648363136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429382.825336:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789429382.825500:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648363136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429382.825673:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648363008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 623us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429382.825680:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1789429382.825742:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648363008:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789429383.373553:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977127 is committed 00000004:00080000:1.0:1789429383.373574:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 41 committed 00000001:00080000:1.0:1789429383.373600:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977128 is committed 00000004:00080000:1.0:1789429383.373603:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 40 committed 00000100:00100000:1.0:1789429383.373848:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789429383.373869:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648363264:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789429383.373952:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429383.374106:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648363264 00000100:00100000:3.0:1789429383.374115:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648363264 00000100:00100000:3.0:1789429383.374169:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5768 00000100:00100000:3.0:1789429383.374177:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648363264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789429383.374225:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:47 count 1 00010000:00010000:3.0:1789429383.374261:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429383.374282:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360c84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c406 expref: 5 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429383.374291:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789429383.374295:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429383.374300:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429383.374332:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360c84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c406 expref: 5 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429383.374347:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360c84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c406 expref: 5 pid: 6680 timeout: 1181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429383.374358:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08229180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648363392:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429383.374429:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f06f9e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429383.379270:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08229180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648363392:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429383.379300:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429383.379428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429383.379812:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635011584 00000100:00100000:2.0:1789429383.379820:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635011584 00010000:00010000:2.0:1789429383.379903:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360c84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c406 expref: 6 pid: 6680 timeout: 1181 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429383.379948:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6179 00000100:00100000:2.0:1789429383.379956:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635011584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429383.379971:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429383.379977:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360c84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c406 expref: 6 pid: 6680 timeout: 1181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429383.379988:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360c84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c406 expref: 6 pid: 6680 timeout: 1181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429383.380014:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea6cbde/0xb4c3dad726360c84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c406 expref: 6 pid: 6680 timeout: 1181 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429383.380029:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429383.380034:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429383.380039:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429383.380049:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429383.380079:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429383.380132:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635011584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 176us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429383.380140:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6179 00010000:00010000:1.0:1789429383.380722:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429383.380733:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429383.380743:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429383.380757:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429383.380779:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789429383.381747:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648363264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7567us (7791us total) trans 4294969596 rc 0/0 00000100:00100000:1.0:1789429383.381759:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5768 00000004:00080000:0.0:1789429383.381883:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f0822b800/2, rc 0, transno 4294969596 00000100:00100000:0.0:1789429383.381891:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648363264:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789429383.382019:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789429383.382028:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429383.382038:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0800 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429383.382042:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429383.382054:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429383.382073:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429383.382080:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3303a0d/0xb4c3dad726360cd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429383.382102:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429383.382104:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429383.382106:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789429383.382376:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789429383.395481:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429384.423788:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429385.443924:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429386.468895:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429386.974562:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969596 is committed 00000100:00100000:3.0:1789429387.030674:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.030716:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.030744:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635011840 00000100:00100000:3.0:1789429387.030753:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635011840 00000100:00100000:3.0:1789429387.030811:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 785 00000100:00100000:3.0:1789429387.030823:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635011840:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429387.030895:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635011840:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429387.030902:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 785 00000100:00080000:3.0:1789429387.030921:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429387.031133:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635011712 00000100:00100000:1.0:1789429387.031138:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635011712 00000100:00100000:1.0:1789429387.031168:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 561 00000100:00100000:1.0:1789429387.031175:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635011712:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429387.031231:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635011712:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 55us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.031237:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 561 00000100:00100000:0.0:1789429387.038749:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429387.038786:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.039004:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635012096 00000100:00100000:3.0:1789429387.039014:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635012096 00000100:00100000:3.0:1789429387.039078:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 786 00000100:00100000:3.0:1789429387.039089:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635012096:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429387.039158:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635012096:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429387.039165:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 786 00000100:00080000:0.0:1789429387.039331:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429387.041775:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635011968 00000100:00100000:1.0:1789429387.041789:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635011968 00000100:00080000:0.0:1789429387.041895:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429387.043104:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 809 00000100:00100000:1.0:1789429387.043117:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635011968:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429387.043291:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635011968:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 177us (4548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.043298:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 809 00000001:02000400:3.0:1789429387.127747:0:22511:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 19:43:06 (1789429386) 00000100:00100000:0.0:1789429387.179671:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.184665:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635012224 00000100:00100000:3.0:1789429387.184678:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635012224 00000100:00100000:3.0:1789429387.184734:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21141 00000100:00100000:3.0:1789429387.184744:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+5:36627:x1876351635012224:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:3.0:1789429387.184763:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429387.184789:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360cd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c41b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.184853:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.184874:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.184889:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429387.184924:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429387.184928:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429387.184946:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.184969:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360cd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c41b expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.184990:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c41b expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.184998:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8300) 00010000:00010000:3.0:1789429387.185001:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429387.185004:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1e00, rc 0) 00000100:00100000:3.0:1789429387.185067:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:36627:x1876351635012224:12345-192.168.203.39@tcp:101:touch.0 Request processed in 325us (5405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429387.185074:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21141 00000100:00100000:3.0:1789429387.188349:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.188399:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635012480 00000100:00100000:3.0:1789429387.188409:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635012480 00000100:00100000:3.0:1789429387.188462:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21142 00000100:00100000:3.0:1789429387.188473:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:36627:x1876351635012480:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:3.0:1789429387.188495:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429387.188499:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789429387.188533:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360cdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c41b expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.188548:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8300) 00010000:00010000:3.0:1789429387.188558:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429387.196544:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360ce6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c422 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.196822:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360ced lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.196837:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360ced lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.196851:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360ced lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.196903:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726360cf4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.196912:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726360cf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.196919:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726360cf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789429387.197609:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x31:0x0], index 0: 0 00010000:00010000:2.0:1789429387.197838:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360cfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x77:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.197849:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.197858:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.197892:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360ced lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.197904:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360ced lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.197911:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360ced lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.197917:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429387.197922:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360ced lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.197930:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360ced lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.197941:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef200) 00010000:00010000:2.0:1789429387.197944:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429387.197949:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360ced lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.197956:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726360ced lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789429387.197968:0:6704:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006bb7a6ce reply state 00000000d12e56fd transno 4294977129 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726360cf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429387.197978:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789429387.198008:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726360ce6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c422 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.198028:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360cfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c422 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429387.198041:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x77:0x0].0x0 (ffff946f051efe00) 00010000:00010000:2.0:1789429387.198044:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789429387.198047:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546e00, rc 0) 00000100:00100000:2.0:1789429387.198133:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:36627:x1876351635012480:12345-192.168.203.39@tcp:101:touch.0 Request processed in 9660us (9790us total) trans 4294977129 rc 0/0 00000100:00100000:2.0:1789429387.198142:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21142 00000100:00100000:0.0:1789429387.203475:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1789429387.207251:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726360cf4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.207269:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726360cf4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429387.207282:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635012736 00010000:00010000:3.0:1789429387.207283:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726360cf4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.207292:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547e00 already unused, calling callback (ffffffffc21f74f0) 00000100:00100000:0.0:1789429387.207294:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635012736 00010000:00010000:3.0:1789429387.207297:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726360cf4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.207306:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726360cf4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.207323:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce408299 (ffff946f051efd00) 00010000:00010000:3.0:1789429387.207326:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429387.207331:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726360cf4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.207338:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726360cf4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429387.207350:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21143 00000100:00100000:0.0:1789429387.207364:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+8:36627:x1876351635012736:12345-192.168.203.39@tcp:36:touch.0 00010000:00010000:0.0:1789429387.207430:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429387.207448:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726360cfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c422 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429387.207462:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x77:0x0].0x0 (ffff946f051efe00) 00010000:00010000:0.0:1789429387.207469:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429387.207509:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360d09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x77:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429387.207523:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429387.207534:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429387.207661:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000020d30bf5 reply state 00000000e426fe83 transno 4294977130 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429387.207670:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429387.207767:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+8:36627:x1876351635012736:12345-192.168.203.39@tcp:36:touch.0 Request processed in 405us (4300us total) trans 4294977130 rc 0/0 00000100:00100000:0.0:1789429387.207779:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21143 00010000:00010000:1.0:1789429387.209861:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.209877:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360d09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.209886:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360d09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.209892:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429387.209897:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360d09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.209905:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360d09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.209933:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x77:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:1.0:1789429387.209937:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429387.209941:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360d09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.209949:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360d09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x77:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429387.210759:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429387.210939:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635012864 00000100:00100000:1.0:1789429387.210949:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635012864 00000100:00100000:1.0:1789429387.211010:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21144 00000100:00100000:1.0:1789429387.211022:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:36627:x1876351635012864:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:1.0:1789429387.211046:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429387.211066:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360d10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x77:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c429 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.211122:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360d10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c429 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.211143:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360d10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x77:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c429 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.211164:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x77:0x0].0x0 (ffff946f2076a300) 00010000:00010000:1.0:1789429387.211167:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789429387.211171:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7200, rc 0) 00000100:00100000:1.0:1789429387.211256:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+8:36627:x1876351635012864:12345-192.168.203.39@tcp:101:touch.0 Request processed in 234us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.211264:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21144 00000100:00100000:3.0:1789429387.214064:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429387.214145:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635012992 00000100:00100000:1.0:1789429387.214154:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635012992 00000100:00100000:1.0:1789429387.214225:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5769 00000100:00100000:1.0:1789429387.214233:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2367:x1876351635012992:12345-192.168.203.39@tcp:8:touch.0 00010000:00080000:1.0:1789429387.214266:0:13238:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t0 exp 0000000000000000 cur 1085 last 0 00000020:00000080:1.0:1789429387.214309:0:13238:0:(genops.c:1384:class_connect()) connect: client 12e09781-3d24-4c67-9972-bb781900e20d, cookie 0xb4c3dad726360d17 00002000:00100000:1.0:1789429387.214321:0:13238:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 12e09781-3d24-4c67-9972-bb781900e20d/ffff946f06fb7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 155058176 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789429387.214344:0:13238:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789429387.214571:0:13238:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789429387.214601:0:13238:0:(import.c:65:import_set_state_nolock()) ffff946f06fb4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789429387.214673:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2367:x1876351635012992:12345-192.168.203.39@tcp:8:touch.0 Request processed in 438us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.214681:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5769 00000100:00100000:1.0:1789429387.222486:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429387.222522:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635013120 00000100:00100000:1.0:1789429387.222531:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635013120 00000100:00100000:1.0:1789429387.222586:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5770 00000100:00100000:1.0:1789429387.222595:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:0:x1876351635013120:12345-192.168.203.39@tcp:2:touch.0 00000100:00080000:1.0:1789429387.222833:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789429387.270786:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969263 is committed 00000001:00100000:0.0:1789429387.270798:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000100:00100000:1.0:1789429387.271589:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:0:x1876351635013120:12345-192.168.203.39@tcp:2:touch.0 Request processed in 48989us (49103us total) trans 4294969263 rc 0/0 00000100:00100000:1.0:1789429387.271601:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5770 00000100:00100000:0.0:1789429387.278612:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429387.281445:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635013376 00000100:00100000:2.0:1789429387.281457:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635013376 00000100:00100000:2.0:1789429387.281614:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 252 00000100:00100000:2.0:1789429387.281625:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05b63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+8:36627:x1876351635013376:12345-192.168.203.39@tcp:35:touch.0 00000100:00100000:2.0:1789429387.281969:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05b63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+9:36627:x1876351635013376:12345-192.168.203.39@tcp:35:touch.0 Request processed in 346us (3362us total) trans 4294977131 rc 0/0 00000100:00100000:2.0:1789429387.281977:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 252 00000100:00100000:0.0:1789429387.298186:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.298265:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635013504 00000100:00100000:3.0:1789429387.298283:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635013504 00000100:00100000:3.0:1789429387.298342:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21145 00000100:00100000:3.0:1789429387.298354:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+9:36637:x1876351635013504:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429387.298384:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429387.298407:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1200/0xb4c3dad726360d1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c430 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.298466:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360d25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.298479:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.298491:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429387.298696:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429387.298700:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429387.298722:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360d25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.298748:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1200/0xb4c3dad726360d1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c430 expref: 11 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.298765:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360d25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c430 expref: 10 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.298774:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:3.0:1789429387.298777:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429387.298790:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1e00, rc 0) 00000100:00100000:3.0:1789429387.298949:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+10:36637:x1876351635013504:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 597us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429387.298956:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21145 00000100:00100000:1.0:1789429387.304175:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429387.304361:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635013632 00000100:00100000:2.0:1789429387.304371:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635013632 00000100:00100000:2.0:1789429387.304426:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21146 00000100:00100000:2.0:1789429387.304436:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+10:36637:x1876351635013632:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:2.0:1789429387.304478:0:5841:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1789429387.304579:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+10:36637:x1876351635013632:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 143us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429387.304587:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21146 00000100:00100000:0.0:1789429387.315028:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.315510:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635013760 00000100:00100000:3.0:1789429387.315651:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635013760 00000100:00100000:3.0:1789429387.315705:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 364 00000100:00100000:3.0:1789429387.315715:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12e09781-3d24-4c67-9972-bb781900e20d+5:36637:x1876351635013760:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:3.0:1789429387.316731:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1789429387.317229:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12e09781-3d24-4c67-9972-bb781900e20d+5:36637:x1876351635013760:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 1511us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429387.317240:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 364 00000100:00100000:0.0:1789429387.336459:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429387.336686:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635013888 00000100:00100000:2.0:1789429387.336698:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635013888 00000100:00100000:2.0:1789429387.336758:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 365 00000100:00100000:2.0:1789429387.336768:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12e09781-3d24-4c67-9972-bb781900e20d+5:36637:x1876351635013888:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:2.0:1789429387.336803:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429387.336896:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12e09781-3d24-4c67-9972-bb781900e20d+5:36637:x1876351635013888:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 129us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429387.336904:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 365 00000100:00100000:0.0:1789429387.345536:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.348643:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635014016 00000100:00100000:3.0:1789429387.348657:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635014016 00000100:00100000:3.0:1789429387.348719:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21147 00000100:00100000:3.0:1789429387.348729:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:36637:x1876351635014016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429387.348749:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429387.348769:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1200/0xb4c3dad726360d2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c437 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.348829:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.348843:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.348856:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429387.348891:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429387.348894:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429387.348912:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.348937:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1200/0xb4c3dad726360d2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c437 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.348952:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c437 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.348967:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:3.0:1789429387.348970:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429387.348974:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1800, rc 0) 00000100:00100000:3.0:1789429387.349165:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:36637:x1876351635014016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 436us (3634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429387.349172:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21147 00000100:00100000:1.0:1789429387.357513:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429387.357561:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635014144 00000100:00100000:1.0:1789429387.357721:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635014144 00000100:00100000:1.0:1789429387.357859:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21148 00000100:00100000:1.0:1789429387.357872:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:36637:x1876351635014144:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:1.0:1789429387.357967:0:6704:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789429387.358031:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:36637:x1876351635014144:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 163us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.358039:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21148 00000100:00100000:1.0:1789429387.361121:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.361187:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635014272 00000100:00100000:3.0:1789429387.361218:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635014272 00000100:00100000:3.0:1789429387.361259:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5771 00000100:00100000:3.0:1789429387.361267:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2367:x1876351635014272:12345-192.168.203.39@tcp:8:lfs.0 00010000:00080000:3.0:1789429387.361297:0:6681:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1085 last 0 00000020:00000080:3.0:1789429387.361329:0:6681:0:(genops.c:1384:class_connect()) connect: client 217af837-ec0e-4ad4-94fa-9fc2e0e9f711, cookie 0xb4c3dad726360d3a 00002000:00100000:3.0:1789429387.361340:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 217af837-ec0e-4ad4-94fa-9fc2e0e9f711/ffff946e05c1a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 155058176 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789429387.361351:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789429387.361499:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789429387.361527:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946e05c1e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789429387.361586:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2367:x1876351635014272:12345-192.168.203.39@tcp:8:lfs.0 Request processed in 318us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429387.361593:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5771 00000100:00100000:0.0:1789429387.367835:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429387.367869:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635014400 00000100:00100000:0.0:1789429387.367878:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635014400 00000100:00100000:0.0:1789429387.367943:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 366 00000100:00100000:0.0:1789429387.367953:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:36637:x1876351635014400:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:0.0:1789429387.367979:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1789429387.368041:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:36637:x1876351635014400:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 89us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429387.368048:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 366 00000100:00080000:0.0:1789429387.368073:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429387.373403:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.374331:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635014528 00000100:00100000:3.0:1789429387.374342:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635014528 00000100:00100000:3.0:1789429387.374392:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5772 00000100:00100000:3.0:1789429387.374399:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2367:x1876351635014528:12345-192.168.203.39@tcp:8:lfs.0 00010000:00080000:3.0:1789429387.374432:0:20745:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1085 last 0 00000020:00000080:3.0:1789429387.374467:0:20745:0:(genops.c:1384:class_connect()) connect: client 217af837-ec0e-4ad4-94fa-9fc2e0e9f711, cookie 0xb4c3dad726360d41 00002000:00100000:3.0:1789429387.374480:0:20745:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 217af837-ec0e-4ad4-94fa-9fc2e0e9f711/ffff946e05c1e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 260702208 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789429387.374535:0:20745:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789429387.374681:0:20745:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789429387.374712:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946e05c1d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789429387.374777:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2367:x1876351635014528:12345-192.168.203.39@tcp:8:lfs.0 Request processed in 375us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429387.375949:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5772 00000100:00100000:1.0:1789429387.382389:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429387.382429:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635014656 00000100:00100000:1.0:1789429387.382439:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635014656 00000100:00100000:1.0:1789429387.382501:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 367 00000100:00100000:1.0:1789429387.382510:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:36637:x1876351635014656:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:1.0:1789429387.382533:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429387.382598:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:36637:x1876351635014656:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.382606:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 367 00000100:00080000:1.0:1789429387.382628:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429387.429054:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648363648:0@lo:400:kworker.0 00000100:00100000:1.0:1789429387.429139:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429387.429193:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648363776:0@lo:400:kworker.0 00000100:00100000:2.0:1789429387.429255:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648363904:0@lo:400:kworker.0 00000100:00100000:3.0:1789429387.429290:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429387.429296:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648364160:0@lo:400:kworker.0 00000100:00100000:2.0:1789429387.429308:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429387.429358:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648363520:0@lo:400:kworker.0 00000100:00100000:0.0:1789429387.430168:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648363648 00000100:00100000:0.0:1789429387.430183:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648363648 00000100:00100000:0.0:1789429387.430324:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648363776 00000100:00100000:0.0:1789429387.430329:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648363776 00000100:00100000:0.0:1789429387.430443:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1789429387.430505:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648363648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429387.431587:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429387.431686:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1789429387.431702:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648363776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429387.431775:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648363776:12345-0@lo:400:kworker.0 Request processed in 80us (2486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.432280:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00080000:1.0:1789429387.432308:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429387.432321:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648363904 00000100:00100000:1.0:1789429387.432328:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648363904 00000100:00100000:1.0:1789429387.432365:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648364160 00000100:00100000:1.0:1789429387.432367:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648364160 00000100:00100000:1.0:1789429387.432402:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:1.0:1789429387.432408:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648363904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429387.432449:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648363904:12345-0@lo:400:kworker.0 Request processed in 41us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.432454:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:1.0:1789429387.432469:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:1.0:1789429387.432475:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648364160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429387.432504:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648364160:12345-0@lo:400:kworker.0 Request processed in 29us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.432512:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:1.0:1789429387.432550:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648363776:0@lo:400:kworker.0 00000100:00080000:1.0:1789429387.432570:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429387.432573:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429387.432620:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969596 gen 2 00000004:00080000:1.0:1789429387.432625:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f0822b800, transno 4294969596 00000100:00100000:1.0:1789429387.432635:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648364160:0@lo:400:kworker.0 00000100:00100000:2.0:1789429387.435513:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648363904:0@lo:400:kworker.0 00000100:00100000:0.0:1789429387.436346:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648363648:12345-0@lo:400:kworker.0 Request processed in 5884us (7199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429387.436365:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1789429387.436466:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648363648:0@lo:400:kworker.0 00000100:00100000:3.0:1789429387.436989:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429387.437056:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648364032:0@lo:400:kworker.0 00000100:00100000:3.0:1789429387.437105:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429387.437337:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648363520 00000100:00100000:0.0:1789429387.437346:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648363520 00000100:00100000:0.0:1789429387.437414:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1789429387.437425:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648363520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429387.437489:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648363520:12345-0@lo:400:kworker.0 Request processed in 65us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429387.437497:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:0.0:1789429387.437539:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648363520:0@lo:400:kworker.0 00000100:00100000:2.0:1789429387.442527:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648364032 00000100:00100000:2.0:1789429387.442547:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648364032 00000100:00100000:2.0:1789429387.442678:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:2.0:1789429387.442691:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648364032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429387.442834:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648364032:12345-0@lo:400:kworker.0 Request processed in 146us (5726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429387.442842:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00080000:1.0:1789429387.442965:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429387.443010:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648364032:0@lo:400:kworker.0 00010000:00010000:3.0:1789429387.491505:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429387.497362:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429387.497527:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635014784 00000100:00100000:1.0:1789429387.497541:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635014784 00000100:00100000:1.0:1789429387.497621:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21149 00000100:00100000:1.0:1789429387.497634:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+10:36641:x1876351635014784:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429387.497661:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429387.497688:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360d48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c43e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.497773:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.497791:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.497805:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.497824:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.497838:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.497845:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.497960:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360d5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x77:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.497970:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.497977:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429387.498019:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x77:0x0]: returning size 0 00000004:00200000:1.0:1789429387.498025:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429387.498048:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498061:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498070:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498077:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498084:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498094:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429387.498100:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498108:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498122:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:1.0:1789429387.498125:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429387.498131:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498138:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498152:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498159:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498165:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498170:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429387.498172:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498178:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498188:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce408299 (ffff946f2076aa00) 00010000:00010000:1.0:1789429387.498191:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429387.498193:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498459:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498496:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360d48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c43e expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498511:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360d5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c43e expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.498518:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x77:0x0].0x0 (ffff946f2076a300) 00010000:00010000:1.0:1789429387.498521:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429387.498523:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7a00, rc 0) 00000100:00100000:1.0:1789429387.498606:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+11:36641:x1876351635014784:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 974us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.498614:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21149 00000100:00100000:1.0:1789429387.504656:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.504893:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635014912 00000100:00100000:3.0:1789429387.504906:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635014912 00000100:00100000:3.0:1789429387.504980:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5773 00000100:00100000:3.0:1789429387.504992:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635014912:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429387.505016:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429387.505045:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb6c3010/0xb4c3dad726360d64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c445 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429387.505079:0:8085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x6aa8868b, atime: 0x6aa8868b, ctime: 0x6aa8868b, blocks: 0x1 00010000:00010000:3.0:1789429387.505106:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=1085s v=(0 0) 00010000:00010000:3.0:1789429387.505111:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429387.505122:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6c3010/0xb4c3dad726360d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c445 expref: 6 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.505145:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb6c3010/0xb4c3dad726360d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c445 expref: 6 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.505160:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1200, rc 0) 00000100:00100000:3.0:1789429387.505479:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635014912:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 488us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429387.505488:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5773 00000100:00100000:2.0:1789429387.546028:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429387.546369:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635015040 00000100:00100000:1.0:1789429387.546392:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635015040 00000100:00100000:1.0:1789429387.546468:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21150 00000100:00100000:1.0:1789429387.546484:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:36642:x1876351635015040:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429387.546510:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429387.546538:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360d6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c44c expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546619:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546633:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546645:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546658:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546662:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546667:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546755:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360d80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x77:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546760:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360d80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546764:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360d80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429387.546798:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x77:0x0]: returning size 0 00000004:00200000:1.0:1789429387.546802:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429387.546818:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360d80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546831:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360d80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546838:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546842:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546847:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546852:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429387.546856:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546862:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546871:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:1.0:1789429387.546873:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429387.546877:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546881:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546891:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546895:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546900:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546903:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429387.546904:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546908:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546911:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce408299 (ffff946f2076aa00) 00010000:00010000:1.0:1789429387.546912:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429387.546914:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546917:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xce408299 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546940:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360d6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c44c expref: 8 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546949:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360d80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c44c expref: 7 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429387.546954:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x77:0x0].0x0 (ffff946f2076a300) 00010000:00010000:1.0:1789429387.546955:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429387.546957:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7c00, rc 0) 00000100:00100000:1.0:1789429387.547028:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:36642:x1876351635015040:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 546us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.547040:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21150 00000100:00100000:0.0:1789429387.571551:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429387.571655:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635015168 00000100:00100000:3.0:1789429387.571668:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635015168 00000100:00100000:3.0:1789429387.571795:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5774 00000100:00100000:3.0:1789429387.571808:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635015168:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429387.571830:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429387.571853:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086639b0c/0xb4c3dad726360d87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c453 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.571888:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429387.571892:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429387.571902:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086639b0c/0xb4c3dad726360d87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c453 expref: 7 pid: 20745 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.571922:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000086639b0c/0xb4c3dad726360d87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c453 expref: 7 pid: 20745 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429387.571938:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1000, rc 0) 00000100:00100000:3.0:1789429387.572014:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635015168:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 207us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429387.572021:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5774 00000100:00100000:1.0:1789429387.939824:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648364288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429387.939923:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429387.940076:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648364288 00000100:00100000:3.0:1789429387.940088:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648364288 00000100:00100000:3.0:1789429387.940159:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789429387.940170:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648364288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429387.940220:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1789429387.940296:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648364288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429387.940303:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789429387.940365:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648364288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429387.944126:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648364416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429387.944256:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429387.945845:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648364416 00000100:00100000:1.0:1789429387.945866:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648364416 00000100:00100000:1.0:1789429387.945938:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789429387.945950:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648364416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429387.945985:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429387.946091:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648364416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429387.946099:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789429387.946312:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648364416:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429388.515631:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789429388.519881:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977130 is committed 00000001:00080000:3.0:1789429388.519904:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977131 is committed 00010000:00010000:3.0:1789429389.540863:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429390.565490:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429391.598747:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789429392.097426:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000100:00100000:2.0:1789429392.151745:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429392.151786:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429392.151814:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429392.151834:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429392.151854:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429392.151874:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429392.151899:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429392.151933:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635015808 00000100:00100000:2.0:1789429392.151943:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635015808 00000100:00100000:2.0:1789429392.151994:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635015424 00000100:00100000:2.0:1789429392.151998:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635015424 00000100:00100000:2.0:1789429392.152020:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 790 00000100:00100000:2.0:1789429392.152029:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635015808:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429392.152099:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635015808:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429392.152107:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 790 00000100:00100000:2.0:1789429392.152123:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 791 00000100:00100000:2.0:1789429392.152130:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2369:x1876351635015424:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429392.152155:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2369:x1876351635015424:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429392.152161:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 791 00000100:00100000:2.0:1789429392.152179:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635015552 00000100:00100000:2.0:1789429392.152183:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635015552 00000100:00100000:2.0:1789429392.152223:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635016064 00000100:00100000:2.0:1789429392.152226:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635016064 00000100:00100000:2.0:1789429392.152242:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635015680 00000100:00100000:2.0:1789429392.152245:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635015680 00000100:00100000:2.0:1789429392.152259:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635015936 00000100:00100000:2.0:1789429392.152261:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635015936 00000100:00100000:2.0:1789429392.152274:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 812 00000100:00100000:2.0:1789429392.152279:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635015552:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429392.152305:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635015552:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429392.152311:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 812 00000100:00100000:2.0:1789429392.152322:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 813 00000100:00100000:2.0:1789429392.152328:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635016064:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429392.152364:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635016064:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 35us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429392.152369:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 813 00000100:00100000:2.0:1789429392.152380:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 814 00000100:00100000:2.0:1789429392.152386:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635015680:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429392.152410:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635015680:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429392.152416:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 814 00000100:00100000:2.0:1789429392.152427:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 815 00000100:00100000:2.0:1789429392.152432:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635015936:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429392.152453:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635015936:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429392.152459:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 815 00000100:00100000:0.0:1789429392.152831:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635015296 00000100:00100000:0.0:1789429392.152837:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635015296 00000100:00100000:0.0:1789429392.152876:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 563 00000100:00100000:0.0:1789429392.152884:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635015296:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429392.152911:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635015296:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429392.152917:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 563 00000100:00080000:0.0:1789429392.154293:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429392.154301:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429392.154305:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429392.551265:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648364928:0@lo:400:kworker.0 00000100:00100000:1.0:1789429392.551345:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429392.551407:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789429392.551413:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648364800:0@lo:400:kworker.0 00000100:00100000:1.0:1789429392.551437:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429392.551466:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648364800 00000100:00100000:1.0:1789429392.551473:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648364800 00000100:00100000:1.0:1789429392.551541:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1789429392.551550:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648364800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429392.551599:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648364800:12345-0@lo:400:kworker.0 Request processed in 49us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429392.551606:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00080000:1.0:1789429392.551626:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429392.551656:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648364800:0@lo:400:kworker.0 00000100:00100000:1.0:1789429392.552189:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648364672:0@lo:400:kworker.0 00000100:00100000:1.0:1789429392.552261:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429392.552282:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648365184:0@lo:400:kworker.0 00000100:00100000:1.0:1789429392.552305:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429392.552333:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789429392.552351:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648364544:0@lo:400:kworker.0 00000100:00100000:1.0:1789429392.552377:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429392.552399:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648365056:0@lo:400:kworker.0 00000100:00100000:1.0:1789429392.552419:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429392.552446:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648364928 00000100:00100000:1.0:1789429392.552452:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648364928 00000100:00100000:1.0:1789429392.552486:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648365184 00000100:00100000:1.0:1789429392.552489:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648365184 00000100:00100000:2.0:1789429392.553402:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:2.0:1789429392.553417:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648364928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429392.553489:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648364928:12345-0@lo:400:kworker.0 Request processed in 77us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429392.553495:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:2.0:1789429392.553533:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648364672 00000100:00100000:2.0:1789429392.553537:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648364672 00000100:00100000:2.0:1789429392.553566:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648365056 00000100:00100000:2.0:1789429392.553569:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648365056 00000100:00100000:2.0:1789429392.553593:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1789429392.553599:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648364672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429392.553634:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648364672:12345-0@lo:400:kworker.0 Request processed in 35us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429392.553640:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1789429392.553652:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1789429392.553658:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648365056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429392.553695:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648365056:12345-0@lo:400:kworker.0 Request processed in 37us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429392.553701:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1789429392.553742:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648365056:0@lo:400:kworker.0 00000100:00100000:2.0:1789429392.553753:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648364672:0@lo:400:kworker.0 00000100:00100000:1.0:1789429392.554085:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1789429392.554094:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648365184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429392.554129:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648365184:12345-0@lo:400:kworker.0 Request processed in 37us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429392.554135:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1789429392.554153:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648364544 00000100:00100000:1.0:1789429392.554156:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648364544 00000100:00100000:1.0:1789429392.554180:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1789429392.554186:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648364544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429392.554228:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648364544:12345-0@lo:400:kworker.0 Request processed in 42us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429392.554234:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00080000:1.0:1789429392.554270:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429392.554275:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429392.554277:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429392.554311:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648364928:0@lo:400:kworker.0 00000100:00100000:2.0:1789429392.554627:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648364544:0@lo:400:kworker.0 00000100:00100000:2.0:1789429392.554637:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648365184:0@lo:400:kworker.0 00000001:00100000:0.0:1789429392.611047:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00010000:00010000:2.0:1789429392.611661:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429393.063663:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429393.063689:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648365312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429393.063769:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429393.064243:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648365312 00000100:00100000:0.0:1789429393.064253:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648365312 00000100:00100000:0.0:1789429393.064320:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789429393.064330:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648365312:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429393.064371:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00000024:0.0:1789429393.064379:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1789429393.064385:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648365440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429393.064428:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429393.064450:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648365312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429393.064458:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789429393.064476:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648365440 00000100:00100000:0.0:1789429393.064480:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648365440 00000100:00100000:0.0:1789429393.064494:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789429393.064500:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648365440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429393.064532:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429393.064578:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648365440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429393.064585:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789429393.064643:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648365312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429393.064688:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648365440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789429393.644156:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789429394.319593:0:22713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 24b: lfs df should show both filesystems ========================================================================= 19:43:13 (1789429393) 00000100:00100000:0.0:1789429394.598864:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429394.599117:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635016320 00000100:00100000:1.0:1789429394.599133:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635016320 00000100:00080000:2.0:1789429394.599249:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429394.599288:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21151 00000100:00100000:1.0:1789429394.599303:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:37209:x1876351635016320:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:1.0:1789429394.599349:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429394.599353:0:15669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789429394.599391:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726360d25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c430 expref: 8 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.599414:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:1.0:1789429394.599420:0:15669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429394.599439:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360d8e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c45a expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.599815:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.599832:0:15669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c437 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.599845:0:15669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.599886:0:15669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c437 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.599902:0:15669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c437 expref: 6 pid: 5839 timeout: 1192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429394.599919:0:15669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648365568:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429394.600057:0:15669:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f199dd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429394.606174:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429394.606443:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635016448 00000100:00100000:0.0:1789429394.606467:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635016448 00010000:00010000:0.0:1789429394.606545:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c437 expref: 7 pid: 5839 timeout: 1192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429394.606594:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6180 00000100:00100000:0.0:1789429394.606606:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635016448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429394.606627:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429394.606635:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c437 expref: 7 pid: 5839 timeout: 1192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.606655:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c437 expref: 7 pid: 5839 timeout: 1192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.606682:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:0.0:1789429394.606689:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.606701:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.606710:0:11354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.606734:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429394.606807:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635016448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 202us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429394.606815:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6180 00010000:00010000:1.0:1789429394.607346:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726360d33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c437 expref: 6 pid: 5839 timeout: 1192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429394.607368:0:15669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648365568:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429394.607395:0:15669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.607405:0:15669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.607412:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789429394.609355:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789429394.609652:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d9c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.609677:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.609690:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429394.612740:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x30:0x0], index 1: 0 00010000:00010000:1.0:1789429394.613024:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360da3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x78:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.613041:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.613052:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360da3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.613088:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.613096:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.613103:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.613108:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429394.613112:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.613120:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.613442:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8100) 00010000:00010000:1.0:1789429394.613446:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429394.613453:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.613526:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360d95 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429394.613542:0:15669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003bcf140f reply state 0000000081665ca2 transno 4294977132 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429394.613550:0:15669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429394.613587:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360d8e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c45a expref: 10 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.613608:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360da3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c45a expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.613615:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x78:0x0].0x0 (ffff946f2076ad00) 00010000:00010000:1.0:1789429394.613618:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429394.613620:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7800, rc 0) 00000100:00100000:1.0:1789429394.613751:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+10:37209:x1876351635016320:12345-192.168.203.39@tcp:101:touch.0 Request processed in 14450us (14901us total) trans 4294977132 rc 0/0 00000100:00100000:1.0:1789429394.613759:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21151 00010000:00010000:2.0:1789429394.618194:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429394.618233:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d9c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429394.618242:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d9c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429394.618249:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429394.618254:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d9c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429394.618263:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d9c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429394.618278:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49c85232 (ffff946f2076ac00) 00010000:00010000:2.0:1789429394.618281:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429394.618286:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d9c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429394.618293:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360d9c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x49c85232 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429394.621353:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429394.621427:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635016704 00000100:00100000:2.0:1789429394.621443:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635016704 00000100:00100000:2.0:1789429394.621509:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21152 00000100:00100000:2.0:1789429394.621518:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+9:37209:x1876351635016704:12345-192.168.203.39@tcp:36:touch.0 00010000:00010000:2.0:1789429394.621578:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429394.621606:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360da3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x78:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c45a expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429394.621625:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x78:0x0].0x0 (ffff946f2076ad00) 00010000:00010000:2.0:1789429394.621637:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429394.621683:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360db1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x78:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429394.621695:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x78:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429394.621704:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x78:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789429394.621839:0:6704:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007486fe07 reply state 00000000caf33273 transno 4294977133 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x78:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429394.621849:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789429394.621947:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+10:37209:x1876351635016704:12345-192.168.203.39@tcp:36:touch.0 Request processed in 429us (610us total) trans 4294977133 rc 0/0 00000100:00100000:2.0:1789429394.621954:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21152 00000100:00100000:3.0:1789429394.634036:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1789429394.634176:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x78:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429394.634272:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635016832 00000100:00100000:2.0:1789429394.634289:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635016832 00000100:00100000:2.0:1789429394.634368:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21153 00000100:00100000:2.0:1789429394.634379:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+10:37209:x1876351635016832:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:2.0:1789429394.634404:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429394.634426:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360db8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x78:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c461 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.634602:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360db1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.634613:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360db1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429394.640475:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x78:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c461 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429394.640507:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x78:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c461 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.641504:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429394.641520:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360db1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.641539:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360db1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.641562:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x78:0x0].0x0 (ffff946f051efb00) 00010000:00010000:1.0:1789429394.641566:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429394.641572:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360db1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429394.641580:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360db1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x78:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429394.647719:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x78:0x0].0x0 (ffff946f051efb00) 00010000:00010000:3.0:1789429394.647740:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789429394.647746:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547600, rc 0) 00000100:00100000:3.0:1789429394.647831:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+10:37209:x1876351635016832:12345-192.168.203.39@tcp:101:touch.0 Request processed in 13448us (13806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429394.647841:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21153 00010000:00010000:0.0:1789429394.659580:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429394.660699:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429394.660931:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635016960 00000100:00100000:1.0:1789429394.660942:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635016960 00000100:00100000:1.0:1789429394.661013:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5775 00000100:00100000:1.0:1789429394.661036:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635016960:12345-192.168.203.39@tcp:2:touch.0 00000100:00100000:1.0:1789429394.661419:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635016960:12345-192.168.203.39@tcp:2:touch.0 Request processed in 384us (727us total) trans 4294969597 rc 0/0 00000100:00100000:1.0:1789429394.661429:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5775 00000100:00080000:0.0:1789429394.661671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429394.664665:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429394.664769:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635017216 00000100:00100000:3.0:1789429394.664784:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635017216 00000100:00100000:3.0:1789429394.664915:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 253 00000100:00100000:3.0:1789429394.664928:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+10:37209:x1876351635017216:12345-192.168.203.39@tcp:35:touch.0 00000100:00100000:3.0:1789429394.665443:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:37209:x1876351635017216:12345-192.168.203.39@tcp:35:touch.0 Request processed in 516us (790us total) trans 4294977134 rc 0/0 00000100:00100000:3.0:1789429394.665452:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 253 00000100:00100000:2.0:1789429394.705134:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429394.705353:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635017344 00000100:00100000:0.0:1789429394.705368:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635017344 00000100:00100000:0.0:1789429394.705451:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21154 00000100:00100000:0.0:1789429394.705474:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+11:37218:x1876351635017344:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429394.705505:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429394.705535:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360dbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c468 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.705624:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726360dc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.705641:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726360dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.705655:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726360dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429394.705702:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429394.705706:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429394.705729:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726360dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.705759:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726360dbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c468 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.705784:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726360dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c468 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.705794:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdc00) 00010000:00010000:0.0:1789429394.705798:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429394.705802:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429394.705890:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+12:37218:x1876351635017344:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 418us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429394.705898:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21154 00000100:00100000:1.0:1789429394.713112:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429394.713505:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635017472 00000100:00100000:3.0:1789429394.713518:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635017472 00000100:00100000:3.0:1789429394.713588:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21155 00000100:00100000:3.0:1789429394.713598:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:37218:x1876351635017472:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:3.0:1789429394.713657:0:5839:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1789429394.713752:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:37218:x1876351635017472:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 154us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429394.713760:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21155 00000100:00100000:0.0:1789429394.716488:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429394.716727:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635017600 00000100:00100000:1.0:1789429394.716744:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635017600 00000100:00100000:1.0:1789429394.716847:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 372 00000100:00100000:1.0:1789429394.716863:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12e09781-3d24-4c67-9972-bb781900e20d+6:37218:x1876351635017600:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:1.0:1789429394.716911:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1789429394.717053:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12e09781-3d24-4c67-9972-bb781900e20d+6:37218:x1876351635017600:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 192us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429394.717069:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 372 00000100:00080000:0.0:1789429394.717789:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429394.719532:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429394.719670:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635017728 00000100:00100000:3.0:1789429394.719682:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635017728 00000100:00100000:3.0:1789429394.719749:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 373 00000100:00100000:3.0:1789429394.719760:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12e09781-3d24-4c67-9972-bb781900e20d+6:37218:x1876351635017728:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:3.0:1789429394.719789:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429394.719874:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:12e09781-3d24-4c67-9972-bb781900e20d+6:37218:x1876351635017728:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 116us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429394.719882:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 373 00000100:00100000:3.0:1789429394.735946:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429394.736281:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635017856 00000100:00100000:0.0:1789429394.736296:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635017856 00000100:00100000:0.0:1789429394.736395:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21156 00000100:00100000:0.0:1789429394.736409:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:37218:x1876351635017856:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429394.736439:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429394.736675:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360dcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c46f expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.736765:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.736783:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.736797:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429394.736845:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429394.736849:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429394.736873:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.736904:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360dcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c46f expref: 8 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.736929:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c46f expref: 7 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429394.736939:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdc00) 00010000:00010000:0.0:1789429394.736944:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429394.736948:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad000, rc 0) 00000100:00100000:0.0:1789429394.737288:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:37218:x1876351635017856:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 880us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429394.737297:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21156 00000100:00100000:0.0:1789429394.755679:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429394.755806:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635017984 00000100:00100000:1.0:1789429394.755822:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635017984 00000100:00100000:1.0:1789429394.755901:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21157 00000100:00100000:1.0:1789429394.755912:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:37218:x1876351635017984:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:1.0:1789429394.755958:0:5840:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789429394.756052:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:37218:x1876351635017984:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 140us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429394.756060:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21157 00000100:00100000:2.0:1789429394.760187:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429394.763761:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635018112 00000100:00100000:0.0:1789429394.763789:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635018112 00000100:00080000:3.0:1789429394.763922:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429394.764030:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 374 00000100:00100000:0.0:1789429394.764044:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:37218:x1876351635018112:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:0.0:1789429394.764079:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1789429394.764187:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:37218:x1876351635018112:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 145us (4015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429394.764195:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 374 00000100:00100000:3.0:1789429394.766865:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429394.767130:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635018240 00000100:00100000:1.0:1789429394.767144:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635018240 00000100:00080000:3.0:1789429394.767236:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429394.767281:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 375 00000100:00100000:1.0:1789429394.767294:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:37218:x1876351635018240:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:1.0:1789429394.767342:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429394.767445:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:37218:x1876351635018240:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 153us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429394.767594:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 375 00010000:00010000:3.0:1789429395.684844:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429396.707448:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429397.242245:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969597 is committed 00000100:00100000:2.0:1789429397.279346:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429397.279388:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429397.279407:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429397.279427:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429397.279442:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429397.279460:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429397.279469:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635018880 00000100:00100000:3.0:1789429397.279480:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635018880 00000100:00100000:2.0:1789429397.279504:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429397.279523:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635018624 00000100:00100000:2.0:1789429397.279527:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635018624 00000100:00100000:3.0:1789429397.279532:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 795 00000100:00100000:3.0:1789429397.279541:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635018880:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429397.279610:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635018880:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429397.279618:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 795 00000100:00100000:3.0:1789429397.279634:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635018496 00000100:00100000:3.0:1789429397.279637:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635018496 00000100:00100000:3.0:1789429397.279660:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 796 00000100:00100000:3.0:1789429397.279666:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:2369:x1876351635018496:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429397.279681:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635019136 00000100:00100000:2.0:1789429397.279685:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635019136 00000100:00100000:3.0:1789429397.279692:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:2369:x1876351635018496:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429397.279698:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 796 00000100:00100000:2.0:1789429397.279704:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635018752 00000100:00100000:2.0:1789429397.279706:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635018752 00000100:00080000:3.0:1789429397.279714:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429397.279718:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429397.279720:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635019008 00000100:00080000:3.0:1789429397.279720:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429397.279722:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635019008 00000100:00100000:2.0:1789429397.279741:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 818 00000100:00100000:2.0:1789429397.279748:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635018624:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429397.279774:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635018624:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429397.279780:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 818 00000100:00100000:2.0:1789429397.279792:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 819 00000100:00100000:2.0:1789429397.279798:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635019136:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429397.279827:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635019136:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429397.279833:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 819 00000100:00100000:2.0:1789429397.279845:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 820 00000100:00100000:2.0:1789429397.279850:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635018752:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429397.279853:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635018368 00000100:00100000:0.0:1789429397.279857:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635018368 00000100:00100000:0.0:1789429397.279881:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 565 00000100:00100000:0.0:1789429397.279888:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635018368:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429397.280021:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 821 00000100:00100000:1.0:1789429397.280033:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635019008:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429397.283281:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635018752:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 3340us (3729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429397.283298:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 820 00000100:00080000:3.0:1789429397.283460:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429397.283912:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635018368:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 4022us (4574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429397.283922:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 565 00000100:00100000:1.0:1789429397.284655:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635019008:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 4620us (5146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429397.284668:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 821 00000100:00100000:3.0:1789429397.667503:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648365824:0@lo:400:kworker.0 00000100:00100000:3.0:1789429397.667572:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429397.667642:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648366336:0@lo:400:kworker.0 00000100:00100000:3.0:1789429397.667665:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429397.667692:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789429397.667697:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648365696:0@lo:400:kworker.0 00000100:00100000:3.0:1789429397.667720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429397.667736:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648366208:0@lo:400:kworker.0 00000100:00100000:3.0:1789429397.667753:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429397.667983:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648365824 00000100:00100000:1.0:1789429397.667992:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648365824 00000100:00100000:1.0:1789429397.668049:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648366208 00000100:00100000:1.0:1789429397.668053:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648366208 00000100:00100000:1.0:1789429397.668091:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:1.0:1789429397.668099:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648365824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429397.668156:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648365824:12345-0@lo:400:kworker.0 Request processed in 57us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429397.668163:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:1.0:1789429397.668180:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1789429397.668186:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648366208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429397.668237:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648366208:12345-0@lo:400:kworker.0 Request processed in 51us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429397.668243:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:0.0:1789429397.668257:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648365952:0@lo:400:kworker.0 00000100:00100000:1.0:1789429397.668260:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648365696 00000100:00100000:1.0:1789429397.668263:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648365696 00000100:00100000:1.0:1789429397.668287:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1789429397.668289:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429397.668294:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648365696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429397.668321:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789429397.668327:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648366080:0@lo:400:kworker.0 00000100:00100000:1.0:1789429397.668338:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648365696:12345-0@lo:400:kworker.0 Request processed in 45us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429397.668345:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1789429397.668346:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789429397.668368:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429397.668382:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648365952 00000100:00100000:0.0:1789429397.668385:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648365952 00000100:00100000:1.0:1789429397.668401:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648365696:0@lo:400:kworker.0 00000100:00100000:1.0:1789429397.668412:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648366208:0@lo:400:kworker.0 00000100:00100000:0.0:1789429397.668415:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1789429397.668420:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648365952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429397.668422:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648365824:0@lo:400:kworker.0 00000100:00080000:1.0:1789429397.668443:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429397.668453:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648365952:12345-0@lo:400:kworker.0 Request processed in 33us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429397.668459:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1789429397.668489:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648365952:0@lo:400:kworker.0 00000100:00100000:2.0:1789429397.668953:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648366336 00000100:00100000:2.0:1789429397.668959:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648366336 00000100:00100000:2.0:1789429397.669015:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648366080 00000100:00100000:2.0:1789429397.669019:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648366080 00000100:00100000:2.0:1789429397.669052:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:2.0:1789429397.669059:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648366336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429397.669108:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648366336:12345-0@lo:400:kworker.0 Request processed in 49us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429397.669114:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:2.0:1789429397.669126:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1789429397.669132:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648366080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429397.669161:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648366080:12345-0@lo:400:kworker.0 Request processed in 29us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429397.669166:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1789429397.669222:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648366080:0@lo:400:kworker.0 00000100:00100000:2.0:1789429397.669244:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648366336:0@lo:400:kworker.0 00000100:00080000:1.0:1789429397.669803:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429397.669808:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789429397.734751:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429398.180950:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429398.180972:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648366464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429398.181036:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429398.181089:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648366464 00000100:00100000:0.0:1789429398.181096:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648366464 00000100:00100000:0.0:1789429398.181134:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789429398.181141:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648366464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429398.181172:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1789429398.181232:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648366464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429398.181239:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789429398.181282:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648366464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429398.181908:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648366592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429398.181937:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429398.182061:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648366592 00000100:00100000:3.0:1789429398.182067:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648366592 00000100:00100000:3.0:1789429398.182106:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789429398.182115:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648366592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429398.182147:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429398.182185:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648366592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429398.182191:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789429398.182326:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648366592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789429398.761434:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789429398.766403:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977132 is committed 00000001:00080000:3.0:1789429398.766418:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977133 is committed 00000001:00080000:3.0:1789429398.766425:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977134 is committed 00010000:00010000:3.0:1789429399.779545:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429400.804415:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789429400.846003:0:22909:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 19:43:19 (1789429399) 00000100:00100000:0.0:1789429400.965044:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429400.965383:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635019392 00000100:00100000:1.0:1789429400.965394:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635019392 00000100:00100000:1.0:1789429400.965451:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21158 00000100:00100000:1.0:1789429400.965472:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+9:37789:x1876351635019392:12345-192.168.203.39@tcp:36:mkdir.0 00010000:00010000:1.0:1789429400.965525:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429400.965552:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726360dc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c468 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.965569:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdc00) 00010000:00010000:1.0:1789429400.965575:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429400.965762:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.967381:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c46f expref: 6 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.967390:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.967429:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c46f expref: 6 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.967442:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c46f expref: 6 pid: 15700 timeout: 1198 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429400.967462:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648366720:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429400.967560:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f199dd180 going to sleep for 11 seconds 00000100:00080000:1.0:1789429400.967576:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429400.976365:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429400.976403:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635019520 00000100:00100000:3.0:1789429400.976413:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635019520 00010000:00010000:3.0:1789429400.976465:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c46f expref: 7 pid: 15700 timeout: 1198 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429400.976497:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6181 00000100:00100000:3.0:1789429400.976506:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635019520:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429400.976521:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429400.976529:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c46f expref: 7 pid: 15700 timeout: 1198 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429400.976542:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c46f expref: 7 pid: 15700 timeout: 1198 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429400.976563:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdc00) 00010000:00010000:3.0:1789429400.976569:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429400.976580:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429400.976586:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429400.976605:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429400.976652:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635019520:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 147us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429400.976660:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6181 00000100:00080000:3.0:1789429400.976684:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789429400.977300:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726360dd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c46f expref: 6 pid: 15700 timeout: 1198 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429400.977319:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648366720:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429400.977337:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.977345:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.977351:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.977415:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360de2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.977425:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360de2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.977434:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360de2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429400.979378:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00010000:00010000:1.0:1789429400.979397:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.979413:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.979422:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.979428:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429400.979432:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.979440:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.979456:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdc00) 00010000:00010000:1.0:1789429400.979460:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429400.979466:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429400.979472:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360ddb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429400.979491:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000084ea180c reply state 00000000166a863c transno 4294977135 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360de2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429400.979499:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429400.979592:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+10:37789:x1876351635019392:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 14119us (14553us total) trans 4294977135 rc 0/0 00000100:00100000:1.0:1789429400.979601:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21158 00010000:00010000:3.0:1789429400.982752:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360de2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429400.982769:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360de2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429400.982777:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360de2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429400.982783:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429400.982789:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360de2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429400.982796:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360de2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429400.982811:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f2076a100) 00010000:00010000:3.0:1789429400.982814:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429400.982819:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360de2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429400.982825:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360de2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429400.993606:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429400.995446:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635019648 00000100:00100000:0.0:1789429400.995458:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635019648 00000100:00100000:1.0:1789429401.000575:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21159 00000100:00100000:1.0:1789429401.000590:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:37792:x1876351635019648:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:1.0:1789429401.000615:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429401.000637:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360de9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c476 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.000699:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360df0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.000712:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360df0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.000723:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360df0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429401.000754:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429401.000758:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429401.000775:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360df0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.000798:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360de9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c476 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.000815:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360df0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c476 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.000823:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:1.0:1789429401.000826:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429401.000829:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6000, rc 0) 00000100:00100000:1.0:1789429401.000893:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+10:37792:x1876351635019648:12345-192.168.203.39@tcp:101:touch.0 Request processed in 307us (7296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429401.000904:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21159 00000100:00100000:3.0:1789429401.011421:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.011606:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635019776 00000100:00100000:2.0:1789429401.011617:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635019776 00000100:00100000:2.0:1789429401.011670:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21160 00000100:00100000:2.0:1789429401.011680:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+10:37792:x1876351635019776:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:2.0:1789429401.011699:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429401.011719:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726360df7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c47d expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.011778:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360dfe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.011792:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360dfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.011802:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360dfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.011816:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.011822:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.011828:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.011919:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.011927:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.011939:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429401.011975:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:2.0:1789429401.011979:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429401.011996:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012008:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360dfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012015:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360dfe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012020:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360dfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012026:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.012030:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360dfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012036:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360dfe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012046:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:2.0:1789429401.012049:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.012053:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360dfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012059:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360dfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012075:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012080:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012085:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012089:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.012092:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012305:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012317:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f051ef600) 00010000:00010000:2.0:1789429401.012319:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.012322:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012328:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012359:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726360df7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c47d expref: 12 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012373:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c47d expref: 11 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.012385:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef000) 00010000:00010000:2.0:1789429401.012387:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789429401.012389:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429401.013133:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+11:37792:x1876351635019776:12345-192.168.203.39@tcp:101:touch.0 Request processed in 1450us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.013142:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21160 00000100:00100000:1.0:1789429401.025294:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429401.025333:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635020032 00000100:00100000:1.0:1789429401.025343:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635020032 00000100:00100000:1.0:1789429401.025394:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21161 00000100:00100000:1.0:1789429401.025403:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+11:37792:x1876351635020032:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:1.0:1789429401.025422:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429401.025445:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360e13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c484 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.025562:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.025577:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.025589:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.025647:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360e21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.025655:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360e21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.025661:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360e21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429401.026236:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x32:0x0], index 0: 0 00010000:00010000:1.0:1789429401.026409:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360e28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.026419:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360e28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.026427:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360e28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.026459:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.026467:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.026474:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.026480:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429401.026484:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.026490:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.026500:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef000) 00010000:00010000:1.0:1789429401.026503:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429401.026507:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.026513:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429401.026524:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000997a9297 reply state 00000000fce070a7 transno 4294977136 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360e21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.026533:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429401.026561:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360e13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c484 expref: 14 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.026573:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360e28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c484 expref: 13 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.026579:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f2076a200) 00010000:00010000:1.0:1789429401.026581:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429401.026583:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6e00, rc 0) 00000100:00100000:1.0:1789429401.026643:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+14:37792:x1876351635020032:12345-192.168.203.39@tcp:101:touch.0 Request processed in 1241us (1357us total) trans 4294977136 rc 0/0 00000100:00100000:1.0:1789429401.026651:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21161 00000100:00100000:1.0:1789429401.026719:0:6898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6898:1876351648366848:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789429401.026774:0:6898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429401.026823:0:6898:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c2720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429401.026842:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648366848 00000100:00100000:1.0:1789429401.026847:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648366848 00000100:00100000:1.0:1789429401.026886:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5776 00000100:00100000:1.0:1789429401.026894:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6898:x1876351648366848:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789429401.026928:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00080000:3.0:1789429401.029041:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789429401.030609:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360e21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.030624:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360e21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.030632:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360e21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.030638:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429401.030643:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360e21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.030652:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360e21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.030672:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x1cda55a (ffff946f2076a600) 00010000:00010000:3.0:1789429401.030676:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429401.030680:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360e21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.030686:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726360e21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.035296:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.035346:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635020288 00000100:00100000:3.0:1789429401.035355:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635020288 00000100:00100000:3.0:1789429401.035406:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21162 00000100:00100000:3.0:1789429401.035416:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:37792:x1876351635020288:12345-192.168.203.39@tcp:36:touch.0 00010000:00010000:3.0:1789429401.035472:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429401.035499:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726360e28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c484 expref: 13 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.035561:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f2076a200) 00010000:00010000:3.0:1789429401.035572:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429401.035615:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.035629:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.035639:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429401.035758:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008c63ead0 reply state 0000000099fe6c3a transno 4294977137 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.035768:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789429401.035852:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:37792:x1876351635020288:12345-192.168.203.39@tcp:36:touch.0 Request processed in 437us (562us total) trans 4294977137 rc 0/0 00000100:00100000:3.0:1789429401.035858:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21162 00010000:00010000:3.0:1789429401.039322:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.039338:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.039345:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.039351:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429401.039355:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.039362:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.039377:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f08640a00) 00010000:00010000:3.0:1789429401.039380:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429401.039384:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.039389:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.056602:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.056641:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635020416 00000100:00100000:3.0:1789429401.057219:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635020416 00000100:00100000:3.0:1789429401.057289:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21163 00000100:00100000:3.0:1789429401.057300:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+13:37792:x1876351635020416:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:3.0:1789429401.057325:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429401.057351:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360e3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c48b expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.057416:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360e3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c48b expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.057432:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360e3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c48b expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.057451:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f08640f00) 00010000:00010000:3.0:1789429401.057454:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789429401.057458:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1600, rc 0) 00000100:00100000:3.0:1789429401.057514:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+14:37792:x1876351635020416:12345-192.168.203.39@tcp:101:touch.0 Request processed in 216us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429401.057520:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21163 00000100:00100000:1.0:1789429401.065301:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6898:x1876351648366848:12345-0@lo:5:osp-pre-0-0.0 Request processed in 38402us (38521us total) trans 4294969264 rc 0/0 00000100:00100000:1.0:1789429401.065315:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5776 00000100:00100000:2.0:1789429401.065452:0:6898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6898:1876351648366848:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789429401.065466:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x32:0x0]-[0x240000400:0x61:0x0] 00000100:00100000:2.0:1789429401.070417:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.070554:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635020544 00000100:00100000:3.0:1789429401.070565:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635020544 00000100:00100000:3.0:1789429401.070638:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5777 00000100:00100000:3.0:1789429401.070648:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635020544:12345-192.168.203.39@tcp:2:touch.0 00000100:00080000:2.0:1789429401.070690:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429401.070936:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635020544:12345-192.168.203.39@tcp:2:touch.0 Request processed in 289us (527us total) trans 4294969265 rc 0/0 00000100:00100000:3.0:1789429401.070944:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5777 00000100:00100000:3.0:1789429401.095537:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.095638:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635020800 00000100:00100000:2.0:1789429401.095648:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635020800 00000100:00100000:2.0:1789429401.095706:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 254 00000100:00100000:2.0:1789429401.095717:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:37792:x1876351635020800:12345-192.168.203.39@tcp:35:touch.0 00000100:00100000:2.0:1789429401.096053:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+15:37792:x1876351635020800:12345-192.168.203.39@tcp:35:touch.0 Request processed in 337us (525us total) trans 4294977138 rc 0/0 00000100:00100000:2.0:1789429401.096061:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 254 00000100:00100000:3.0:1789429401.115676:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429401.115809:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635020928 00000100:00100000:1.0:1789429401.115819:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635020928 00000100:00100000:1.0:1789429401.115899:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21164 00000100:00100000:1.0:1789429401.115908:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+15:37798:x1876351635020928:12345-192.168.203.39@tcp:101:chmod.0 00010000:00010000:1.0:1789429401.115930:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429401.115949:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360e44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c492 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116004:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116016:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116025:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116036:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116042:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116047:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116131:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360e59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116138:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360e59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116144:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360e59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429401.116177:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7a:0x0]: returning size 0 00000004:00200000:1.0:1789429401.116181:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429401.116237:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360e59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116249:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360e59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116258:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116263:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116270:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116285:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429401.116289:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116296:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116306:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef000) 00010000:00010000:1.0:1789429401.116309:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429401.116314:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116320:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116335:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116350:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116357:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116362:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429401.116365:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116371:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116377:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x1cda55a (ffff946f2076ab00) 00010000:00010000:1.0:1789429401.116379:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429401.116382:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116387:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116414:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360e44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c492 expref: 17 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116427:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360e59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c492 expref: 16 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.116439:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f08640f00) 00010000:00010000:1.0:1789429401.116441:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429401.116444:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7800, rc 0) 00000100:00100000:1.0:1789429401.116504:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+16:37798:x1876351635020928:12345-192.168.203.39@tcp:101:chmod.0 Request processed in 597us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429401.116511:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21164 00000100:00100000:2.0:1789429401.123146:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429401.123232:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635021056 00000100:00100000:0.0:1789429401.123243:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635021056 00000100:00100000:0.0:1789429401.123314:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5778 00000100:00100000:0.0:1789429401.123324:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635021056:12345-192.168.203.39@tcp:101:chmod.0 00010000:00010000:0.0:1789429401.123343:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429401.123374:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f53d4231/0xb4c3dad726360e60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c499 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429401.123402:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x6aa88699, atime: 0x6aa88699, ctime: 0x6aa88699, blocks: 0x1 00010000:00010000:0.0:1789429401.123422:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=1099s v=(0 0) 00010000:00010000:0.0:1789429401.123427:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429401.123436:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f53d4231/0xb4c3dad726360e60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c499 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.123454:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f53d4231/0xb4c3dad726360e60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c499 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.123475:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00000100:00100000:0.0:1789429401.123537:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635021056:12345-192.168.203.39@tcp:101:chmod.0 Request processed in 214us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429401.123545:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5778 00000100:00100000:0.0:1789429401.127142:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.127338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635021312 00000100:00100000:3.0:1789429401.127348:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635021312 00000100:00100000:2.0:1789429401.127597:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21165 00000100:00100000:2.0:1789429401.127606:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+16:37798:x1876351635021312:12345-192.168.203.39@tcp:36:chmod.0 00010000:00010000:2.0:1789429401.127651:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429401.127673:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726360e59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c492 expref: 16 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.127691:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f08640f00) 00010000:00010000:2.0:1789429401.127695:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429401.127715:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.127725:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.127732:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789429401.127888:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000600ae6c2 reply state 000000007bd48b06 transno 4294977139 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.127894:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789429401.127978:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+17:37798:x1876351635021312:12345-192.168.203.39@tcp:36:chmod.0 Request processed in 372us (844us total) trans 4294977139 rc 0/0 00000100:00100000:2.0:1789429401.127985:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21165 00010000:00010000:3.0:1789429401.129769:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.129783:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.129790:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.129797:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429401.129801:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.129809:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.129824:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f08640f00) 00010000:00010000:3.0:1789429401.129827:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789429401.129832:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.129837:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360e67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429401.130750:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.130824:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635021440 00000100:00100000:2.0:1789429401.130832:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635021440 00000100:00100000:2.0:1789429401.130890:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5779 00000100:00100000:2.0:1789429401.130900:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635021440:12345-192.168.203.39@tcp:2:chmod.0 00002000:00010000:2.0:1789429401.131087:0:20745:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x32:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789429401.131089:0:20745:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x32:0x0] updating lvb mtime from disk: 1789429401 -> 1789429401 00002000:00010000:2.0:1789429401.131091:0:20745:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x32:0x0] updating lvb atime from disk: 1789429401 -> 1789429401 00002000:00010000:2.0:1789429401.131093:0:20745:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x32:0x0] updating lvb ctime from disk: 1789429401 -> 1789429401 00002000:00010000:2.0:1789429401.131094:0:20745:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x32:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789429401.131140:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c08f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351635021440:12345-192.168.203.39@tcp:2:chmod.0 Request processed in 241us (394us total) trans 4294969266 rc 0/0 00000100:00100000:2.0:1789429401.131147:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5779 00000100:00100000:2.0:1789429401.197658:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.197820:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635021568 00000100:00100000:3.0:1789429401.197831:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635021568 00000100:00100000:3.0:1789429401.197893:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21166 00000100:00100000:3.0:1789429401.197903:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:37799:x1876351635021568:12345-192.168.203.39@tcp:101:checkstat.500 00010000:00010000:3.0:1789429401.197924:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429401.197945:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360e6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4a0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.198192:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.198617:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.198631:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429401.198932:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429401.198936:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429401.199082:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.199112:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726360e6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a0 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.199128:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a0 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.199136:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:2.0:1789429401.199139:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429401.199143:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:2.0:1789429401.199297:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:37799:x1876351635021568:12345-192.168.203.39@tcp:101:checkstat.500 Request processed in 1394us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.199306:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21166 00000100:00100000:3.0:1789429401.206901:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429401.207112:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635021696 00000100:00100000:1.0:1789429401.207124:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635021696 00000100:00100000:1.0:1789429401.207185:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21167 00000100:00100000:1.0:1789429401.207196:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:37799:x1876351635021696:12345-192.168.203.39@tcp:101:checkstat.500 00010000:00010000:1.0:1789429401.207255:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429401.207288:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360e7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4a7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207357:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207372:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207383:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207397:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207413:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207422:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207537:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207546:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207554:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429401.207574:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:1.0:1789429401.207578:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429401.207600:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207612:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207618:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207624:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207630:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429401.207634:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207642:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207654:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:1.0:1789429401.207657:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429401.207661:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207669:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726360e83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207681:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207687:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207693:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207709:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429401.207713:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207719:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207727:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f2076ab00) 00010000:00010000:1.0:1789429401.207729:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429401.207732:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207738:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726360e8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207772:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726360e7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a7 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207786:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a7 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.207792:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef000) 00010000:00010000:1.0:1789429401.207794:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789429401.207797:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7600, rc 0) 00000100:00100000:1.0:1789429401.207861:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:37799:x1876351635021696:12345-192.168.203.39@tcp:101:checkstat.500 Request processed in 667us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429401.207869:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21167 00000100:00100000:0.0:1789429401.210945:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429401.211125:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635021824 00000100:00100000:1.0:1789429401.211136:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635021824 00000100:00100000:1.0:1789429401.211264:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21168 00000100:00100000:1.0:1789429401.211285:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:37799:x1876351635021824:12345-192.168.203.39@tcp:101:checkstat.500 00010000:00010000:1.0:1789429401.211307:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429401.211330:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360e98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4ae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211396:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360e9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211425:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360e9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211438:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360e9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211454:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ea6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211461:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211468:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211575:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211583:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211591:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429401.211618:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7a:0x0]: returning size 0 00000004:00200000:1.0:1789429401.211622:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429401.211640:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211651:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211659:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360e9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211665:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360e9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211678:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360e9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211683:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429401.211687:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360e9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211694:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360e9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211715:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef000) 00010000:00010000:1.0:1789429401.211718:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429401.211723:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360e9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211729:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad726360e9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211742:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211748:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ea6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211753:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211757:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429401.211760:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211770:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ea6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211776:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x1cda55a (ffff946f2076af00) 00010000:00010000:1.0:1789429401.211778:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429401.211781:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ea6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211786:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726360ea6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211814:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360e98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ae expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211826:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ae expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.211833:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f08640f00) 00010000:00010000:1.0:1789429401.211835:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429401.211837:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6800, rc 0) 00000100:00100000:1.0:1789429401.211902:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:37799:x1876351635021824:12345-192.168.203.39@tcp:101:checkstat.500 Request processed in 628us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429401.211909:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21168 00000100:00100000:3.0:1789429401.222595:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429401.222670:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635021952 00000100:00100000:1.0:1789429401.222683:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635021952 00000100:00100000:1.0:1789429401.222764:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5780 00000100:00100000:1.0:1789429401.222775:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635021952:12345-192.168.203.39@tcp:101:checkstat.500 00010000:00010000:1.0:1789429401.222795:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429401.222813:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2609b53/0xb4c3dad726360eb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4b5 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.222838:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429401.222843:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429401.222852:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2609b53/0xb4c3dad726360eb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4b5 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.222869:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2609b53/0xb4c3dad726360eb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4b5 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.222882:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7000, rc 0) 00000100:00100000:1.0:1789429401.222943:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635021952:12345-192.168.203.39@tcp:101:checkstat.500 Request processed in 170us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429401.222950:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5780 00000100:00080000:2.0:1789429401.223504:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429401.270089:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.270285:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635022080 00000100:00100000:2.0:1789429401.270296:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635022080 00000100:00100000:2.0:1789429401.270359:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21169 00000100:00100000:2.0:1789429401.270370:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:37800:x1876351635022080:12345-192.168.203.39@tcp:101:setfacl.0 00010000:00010000:2.0:1789429401.270394:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429401.270428:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360ebb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4bc expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.270495:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.270509:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.270520:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429401.270555:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:2.0:1789429401.270560:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429401.270600:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.270628:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726360ebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4bc expref: 18 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.270646:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4bc expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.270654:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef000) 00010000:00010000:2.0:1789429401.270657:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429401.270661:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546a00, rc 0) 00000100:00100000:2.0:1789429401.270963:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+17:37800:x1876351635022080:12345-192.168.203.39@tcp:101:setfacl.0 Request processed in 593us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.270981:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21169 00000100:00100000:0.0:1789429401.292381:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429401.292474:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635022336 00000100:00100000:1.0:1789429401.292488:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635022336 00000100:00100000:1.0:1789429401.292547:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21170 00000100:00100000:1.0:1789429401.292556:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:37800:x1876351635022336:12345-192.168.203.39@tcp:36:setfacl.0 00010000:00010000:1.0:1789429401.292636:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.292653:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c47d expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.292669:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a7 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.292676:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4bc expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.292683:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 6/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.292732:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4bc expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.292744:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4bc expref: 17 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.292758:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648366976:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429401.292902:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a7 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.292912:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a7 expref: 8 pid: 5841 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.292922:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648367104:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429401.292954:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c47d expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.292969:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c47d expref: 17 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.292978:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648367232:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429401.292999:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c272c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789429401.301550:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429401.301596:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429401.301673:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.301810:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635022464 00000100:00100000:2.0:1789429401.301821:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635022464 00010000:00010000:2.0:1789429401.301862:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4bc expref: 18 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.301899:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635022592 00000100:00100000:2.0:1789429401.301902:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635022592 00010000:00010000:2.0:1789429401.301918:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a7 expref: 9 pid: 5841 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.301930:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635022720 00000100:00100000:2.0:1789429401.301932:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635022720 00010000:00010000:2.0:1789429401.301943:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c47d expref: 19 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.301957:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6182 00000100:00100000:2.0:1789429401.301966:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351635022464:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429401.301992:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429401.301999:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4bc expref: 19 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302012:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4bc expref: 19 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302033:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef000) 00010000:00010000:2.0:1789429401.302038:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302045:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302054:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429401.302101:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351635022464:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 136us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.302108:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6182 00000100:00100000:2.0:1789429401.302125:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6183 00000100:00100000:2.0:1789429401.302131:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2371:x1876351635022592:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429401.302139:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429401.302144:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a7 expref: 9 pid: 5841 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302152:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a7 expref: 9 pid: 5841 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302162:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef000) 00010000:00010000:2.0:1789429401.302165:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302172:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302177:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429401.302194:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2371:x1876351635022592:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 64us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.302228:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6183 00000100:00100000:2.0:1789429401.302242:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6184 00000100:00100000:2.0:1789429401.302249:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635022720:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429401.302257:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429401.302262:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c47d expref: 18 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302281:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c47d expref: 18 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302293:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef000) 00010000:00010000:2.0:1789429401.302297:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302304:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302312:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.302331:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429401.302350:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635022720:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 102us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.302356:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6184 00010000:00010000:1.0:1789429401.302448:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360ec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4bc expref: 17 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.302465:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648366976:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429401.302477:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726360e91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a7 expref: 8 pid: 5841 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.302486:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648367104:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429401.302495:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360e0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c47d expref: 16 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.302503:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648367232:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429401.302526:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.302535:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.302540:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789429401.358529:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977140 is committed 00000004:00010000:3.0:1789429401.358762:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002cf8bb8e reply state 00000000a4b2eda2 transno 4294977140 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.358777:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1789429401.358895:0:5841:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789429401.358919:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+11:37800:x1876351635022336:12345-192.168.203.39@tcp:36:setfacl.0 Request processed in 66359us (66543us total) trans 4294977140 rc 0/0 00000100:00100000:3.0:1789429401.358928:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21170 00010000:00010000:0.0:1789429401.359060:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.359070:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.359078:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.359084:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429401.359089:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.359108:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.359123:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef000) 00010000:00010000:0.0:1789429401.359126:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789429401.359131:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.359137:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726360ec9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429401.394308:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.394566:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635022848 00000100:00100000:2.0:1789429401.394576:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635022848 00000100:00100000:2.0:1789429401.394627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21171 00000100:00100000:2.0:1789429401.394636:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:37801:x1876351635022848:12345-192.168.203.39@tcp:101:checkstat.500 00010000:00010000:2.0:1789429401.394656:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429401.394678:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360ed0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4c3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.394745:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360ed7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.394759:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360ed7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.394769:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360ed7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.394783:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360ede lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.394789:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.394796:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395632:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395644:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395652:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429401.395676:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:2.0:1789429401.395679:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429401.395702:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395719:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360ed7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395726:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360ed7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395733:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360ed7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395738:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.395742:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360ed7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395750:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360ed7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395763:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:2.0:1789429401.395767:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.395773:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360ed7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395780:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360ed7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395794:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360ede lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395801:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360ede lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395806:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360ede lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395811:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.395813:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360ede lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395819:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360ede lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395825:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f051eff00) 00010000:00010000:2.0:1789429401.395827:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.395829:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360ede lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395835:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360ede lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395864:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360ed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4c3 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395877:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4c3 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.395885:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef600) 00010000:00010000:2.0:1789429401.395888:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789429401.395890:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547000, rc 0) 00000100:00100000:2.0:1789429401.398894:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:37801:x1876351635022848:12345-192.168.203.39@tcp:101:checkstat.500 Request processed in 4247us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.398905:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21171 00000100:00100000:1.0:1789429401.423917:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.424411:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635022976 00000100:00100000:3.0:1789429401.424422:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635022976 00000100:00100000:3.0:1789429401.424487:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21172 00000100:00100000:3.0:1789429401.424498:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+10:37802:x1876351635022976:12345-192.168.203.39@tcp:101:setfacl.0 00010000:00010000:3.0:1789429401.424523:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429401.424657:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360eec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4ca expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.424730:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360ef3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.424746:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.424757:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.424773:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360efa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.424781:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360efa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.424787:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360efa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425718:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425733:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425743:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429401.425778:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:3.0:1789429401.425782:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429401.425805:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425820:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360ef3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425827:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360ef3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425834:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360ef3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425839:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429401.425843:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360ef3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425850:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360ef3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425862:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:3.0:1789429401.425865:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429401.425869:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360ef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425874:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360ef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425887:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360efa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425893:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360efa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425899:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360efa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425904:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429401.425907:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360efa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425913:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360efa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425920:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f08640a00) 00010000:00010000:3.0:1789429401.425922:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429401.425925:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360efa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425930:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360efa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425962:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360eec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ca expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425975:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ca expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.425982:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef600) 00010000:00010000:3.0:1789429401.425985:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429401.425988:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1a00, rc 0) 00000100:00100000:3.0:1789429401.426173:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+11:37802:x1876351635022976:12345-192.168.203.39@tcp:101:setfacl.0 Request processed in 1676us (2264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429401.426181:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21172 00000100:00100000:0.0:1789429401.438247:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.438588:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635023232 00000100:00100000:2.0:1789429401.438601:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635023232 00000100:00100000:2.0:1789429401.438664:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21173 00000100:00100000:2.0:1789429401.438676:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+11:37802:x1876351635023232:12345-192.168.203.39@tcp:36:setfacl.0 00010000:00010000:2.0:1789429401.438760:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.438778:0:15700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4c3 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.438788:0:15700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ca expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.438797:0:15700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.438831:0:15700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ca expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.438845:0:15700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ca expref: 11 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.438860:0:15700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34071c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648367360:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429401.439099:0:15700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4c3 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.439110:0:15700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4c3 expref: 8 pid: 5839 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.439124:0:15700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34071880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648367488:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429401.439293:0:15700:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f29ee4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429401.442326:0:15700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34071c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648367360:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429401.445397:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.445653:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635023360 00000100:00100000:2.0:1789429401.445665:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635023360 00010000:00010000:2.0:1789429401.445709:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ca expref: 12 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.445746:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6185 00000100:00100000:2.0:1789429401.445756:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351635023360:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429401.445770:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429401.445777:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ca expref: 12 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.445790:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ca expref: 12 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.445811:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad726360f01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ca expref: 12 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.445826:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef600) 00010000:00010000:2.0:1789429401.445831:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.445840:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.445847:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429401.445902:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351635023360:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 148us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.445909:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6185 00000100:00100000:2.0:1789429401.450813:0:15700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34071880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648367488:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429401.450847:0:15700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429401.451303:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.451449:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635023488 00000100:00100000:3.0:1789429401.451466:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635023488 00010000:00010000:3.0:1789429401.451522:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4c3 expref: 9 pid: 5839 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.451572:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6186 00000100:00100000:3.0:1789429401.451584:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2370:x1876351635023488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429401.451604:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429401.451613:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4c3 expref: 9 pid: 5839 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.451627:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4c3 expref: 9 pid: 5839 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.451654:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360ee5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4c3 expref: 9 pid: 5839 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.451678:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef600) 00010000:00010000:3.0:1789429401.451684:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.451697:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.451707:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.451739:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429401.451809:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351635023488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 226us (507us total) trans 0 rc 0/0 00010000:00010000:2.0:1789429401.451816:0:15700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.451830:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6186 00010000:00010000:2.0:1789429401.451840:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789429401.485530:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977141 is committed 00000004:00010000:2.0:1789429401.485654:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000045cc27d reply state 000000004985ce77 transno 4294977141 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.485669:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1789429401.485757:0:15700:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789429401.485775:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+11:37802:x1876351635023232:12345-192.168.203.39@tcp:36:setfacl.0 Request processed in 47097us (47578us total) trans 4294977141 rc 0/0 00000100:00100000:2.0:1789429401.485785:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21173 00010000:00010000:2.0:1789429401.485817:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.485826:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.485833:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.485839:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.485844:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.485852:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.485867:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051ef600) 00010000:00010000:2.0:1789429401.485870:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789429401.485875:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.485881:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f08 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.502368:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.502477:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635023616 00000100:00100000:2.0:1789429401.502487:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635023616 00000100:00100000:2.0:1789429401.502547:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21174 00000100:00100000:2.0:1789429401.502558:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:37803:x1876351635023616:12345-192.168.203.39@tcp:101:checkstat.500 00010000:00010000:2.0:1789429401.502579:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429401.502598:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4d1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.502661:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.502676:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.502686:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.502700:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.502707:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.502712:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.502997:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503005:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503012:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429401.503030:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:2.0:1789429401.503034:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429401.503054:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503066:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503072:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503079:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503089:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.503093:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503099:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503110:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:2.0:1789429401.503113:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.503117:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503123:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503134:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503139:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503144:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503149:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.503151:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503156:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503166:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f051ef600) 00010000:00010000:2.0:1789429401.503169:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.503171:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503176:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503253:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d1 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503279:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d1 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.503287:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051eff00) 00010000:00010000:2.0:1789429401.503289:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789429401.503291:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546400, rc 0) 00000100:00100000:2.0:1789429401.503349:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:37803:x1876351635023616:12345-192.168.203.39@tcp:101:checkstat.500 Request processed in 793us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.503357:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21174 00000100:00100000:2.0:1789429401.527959:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.528039:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635023744 00000100:00100000:3.0:1789429401.528058:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635023744 00000100:00100000:3.0:1789429401.528150:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21175 00000100:00100000:3.0:1789429401.528165:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+10:37804:x1876351635023744:12345-192.168.203.39@tcp:101:setfacl.0 00010000:00010000:3.0:1789429401.528253:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429401.528294:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360f2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4d8 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.528513:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.528534:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.528548:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.528565:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.528572:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.528579:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.528863:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.528873:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.528953:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429401.528990:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:2.0:1789429401.528993:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429401.529015:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529027:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f32 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529033:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f32 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529051:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529062:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.529067:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f32 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529075:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f32 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529086:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:2.0:1789429401.529089:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.529094:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529099:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529112:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529118:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f39 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529124:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529129:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.529131:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529138:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f39 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529149:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f051ef600) 00010000:00010000:2.0:1789429401.529151:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.529154:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f39 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529160:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529191:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726360f2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d8 expref: 12 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529260:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d8 expref: 11 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.529268:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051eff00) 00010000:00010000:2.0:1789429401.529282:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429401.529285:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429401.529353:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+11:37804:x1876351635023744:12345-192.168.203.39@tcp:101:setfacl.0 Request processed in 1193us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.529362:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21175 00000100:00100000:3.0:1789429401.536123:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429401.536370:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635024000 00000100:00100000:1.0:1789429401.536385:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635024000 00000100:00100000:1.0:1789429401.536454:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21176 00000100:00100000:1.0:1789429401.536464:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+11:37804:x1876351635024000:12345-192.168.203.39@tcp:36:setfacl.0 00010000:00010000:1.0:1789429401.536544:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.536562:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d1 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.536571:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d8 expref: 11 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.536579:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.536613:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d8 expref: 11 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.536627:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d8 expref: 11 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.536640:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648367616:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429401.536746:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d1 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.536756:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d1 expref: 8 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.536765:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648367744:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429401.536786:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e158659c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429401.539668:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648367616:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429401.539686:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648367744:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429401.539714:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.544061:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.544167:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635024256 00000100:00100000:2.0:1789429401.544183:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635024256 00000100:00100000:3.0:1789429401.544279:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:2.0:1789429401.544282:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d1 expref: 9 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.544339:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635024128 00000100:00100000:2.0:1789429401.544343:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635024128 00010000:00010000:2.0:1789429401.544360:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d8 expref: 12 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.544388:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6187 00000100:00100000:2.0:1789429401.544397:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2370:x1876351635024256:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429401.544412:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429401.544419:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d1 expref: 9 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.544431:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d1 expref: 9 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.544452:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d1 expref: 9 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.544609:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6188 00000100:00100000:1.0:1789429401.544621:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351635024128:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429401.544630:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429401.544636:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d8 expref: 12 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.544646:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d8 expref: 12 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.544659:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4d8 expref: 12 pid: 15669 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.544675:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051eff00) 00010000:00010000:1.0:1789429401.544681:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.544691:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.544698:0:11354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.544724:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429401.544782:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351635024128:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 164us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429401.544789:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6188 00010000:00010000:1.0:1789429401.544913:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.544921:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.546031:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051eff00) 00010000:00010000:2.0:1789429401.546036:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429401.546095:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351635024256:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1697us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.546103:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6187 00000001:00080000:3.0:1789429401.607424:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977142 is committed 00000004:00010000:2.0:1789429401.613929:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002a3a72e5 reply state 00000000ece4a828 transno 4294977142 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.613949:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1789429401.614136:0:5841:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789429401.614158:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+11:37804:x1876351635024000:12345-192.168.203.39@tcp:36:setfacl.0 Request processed in 77691us (78045us total) trans 4294977142 rc 0/0 00000100:00100000:3.0:1789429401.614166:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21176 00010000:00010000:2.0:1789429401.614499:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.614517:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.614538:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.614545:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.614550:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.614557:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.614572:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f051eff00) 00010000:00010000:2.0:1789429401.614575:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789429401.614580:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.614586:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726360f47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.625736:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.626192:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635024384 00000100:00100000:2.0:1789429401.626365:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635024384 00000100:00100000:3.0:1789429401.627787:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21177 00000100:00100000:3.0:1789429401.627802:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:37805:x1876351635024384:12345-192.168.203.39@tcp:101:checkstat.500 00010000:00010000:3.0:1789429401.627824:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429401.627845:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360f4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4df expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.627909:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360f55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.627929:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.627940:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.627955:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360f5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.627962:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.627969:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629738:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629755:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629766:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429401.629798:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:3.0:1789429401.629801:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429401.629829:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629840:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629850:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360f55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629856:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360f55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629862:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429401.629866:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360f55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629872:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360f55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629884:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:3.0:1789429401.629887:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429401.629892:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360f55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629897:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726360f55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629909:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629914:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360f5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629920:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360f5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629925:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429401.629928:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360f5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629932:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360f5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629939:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f08640a00) 00010000:00010000:3.0:1789429401.629942:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429401.629944:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360f5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629948:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726360f5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629983:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360f4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4df expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.629995:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4df expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.630002:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f08640600) 00010000:00010000:3.0:1789429401.630004:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789429401.630006:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:3.0:1789429401.630082:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:37805:x1876351635024384:12345-192.168.203.39@tcp:101:checkstat.500 Request processed in 2283us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429401.630090:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21177 00000100:00100000:3.0:1789429401.647301:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.647485:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635024512 00000100:00100000:2.0:1789429401.647495:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635024512 00000100:00100000:2.0:1789429401.647558:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21178 00000100:00100000:2.0:1789429401.647568:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+10:37806:x1876351635024512:12345-192.168.203.39@tcp:101:setfacl.0 00010000:00010000:2.0:1789429401.647591:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429401.647613:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4e6 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.647674:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.647687:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.647697:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.647711:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.647718:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.647724:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648006:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648015:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648023:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429401.648053:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:2.0:1789429401.648057:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429401.648078:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648090:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648283:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648289:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648296:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.648300:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648308:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648319:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:2.0:1789429401.648321:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.648325:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648331:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360f71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648342:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648348:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648354:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648359:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.648363:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648368:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648375:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f051eff00) 00010000:00010000:2.0:1789429401.648377:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.648380:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648386:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360f78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648417:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360f6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4e6 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648430:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4e6 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.648437:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f08640600) 00010000:00010000:2.0:1789429401.648440:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429401.648442:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429401.648496:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+11:37806:x1876351635024512:12345-192.168.203.39@tcp:101:setfacl.0 Request processed in 930us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.648504:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21178 00000100:00100000:1.0:1789429401.653445:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.653525:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635024768 00000100:00100000:2.0:1789429401.653536:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635024768 00000100:00100000:2.0:1789429401.653594:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21179 00000100:00100000:2.0:1789429401.653605:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+11:37806:x1876351635024768:12345-192.168.203.39@tcp:36:setfacl.0 00010000:00010000:2.0:1789429401.653683:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.653701:0:15700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4df expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.653710:0:15700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4e6 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.653719:0:15700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 5/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.653752:0:15700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4e6 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.653767:0:15700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4e6 expref: 11 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.653780:0:15700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34071c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648367872:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429401.653892:0:15700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4df expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.653903:0:15700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4df expref: 8 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.653913:0:15700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34073480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648368000:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429401.653937:0:15700:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2f573600 going to sleep for 11 seconds 00000100:00100000:2.0:1789429401.656637:0:15700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34071c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648367872:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429401.656654:0:15700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34073480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648368000:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429401.656682:0:15700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.658122:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429401.658165:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.658242:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635024896 00000100:00100000:3.0:1789429401.658252:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635024896 00010000:00010000:3.0:1789429401.658306:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4e6 expref: 12 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.658350:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635025024 00000100:00100000:3.0:1789429401.658353:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635025024 00010000:00010000:3.0:1789429401.658367:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4df expref: 9 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.658394:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6189 00000100:00100000:3.0:1789429401.658404:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351635024896:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429401.658418:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429401.658425:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4e6 expref: 12 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658438:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4e6 expref: 12 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658460:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726360f7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4e6 expref: 12 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658477:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f08640600) 00010000:00010000:3.0:1789429401.658482:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658491:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658498:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429401.658551:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351635024896:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 148us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429401.658561:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6189 00000100:00100000:3.0:1789429401.658579:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6190 00000100:00100000:3.0:1789429401.658586:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2371:x1876351635025024:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429401.658593:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429401.658598:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4df expref: 9 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658607:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4df expref: 9 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658620:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360f63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4df expref: 9 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658630:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f08640600) 00010000:00010000:3.0:1789429401.658634:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658642:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658649:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658673:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429401.658695:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635025024:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 110us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429401.658701:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6190 00010000:00010000:3.0:1789429401.658800:0:15700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.658809:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789429401.705690:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977143 is committed 00000001:00080000:3.0:1789429401.706465:0:15700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977143 00000004:00010000:3.0:1789429401.706641:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008a6441ea reply state 00000000b6a58a97 transno 4294977144 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.706659:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789429401.706784:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+12:37806:x1876351635024768:12345-192.168.203.39@tcp:36:setfacl.0 Request processed in 53178us (53345us total) trans 4294977144 rc 0/0 00000100:00100000:3.0:1789429401.706792:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21179 00000020:00080000:3.0:1789429401.706796:0:15700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789429401.726279:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.726298:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.726307:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.726317:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.726323:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.726331:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.726350:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f08640600) 00010000:00010000:2.0:1789429401.726354:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789429401.726359:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.726365:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360f86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.741480:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429401.741849:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635025152 00000100:00100000:0.0:1789429401.741860:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635025152 00000100:00100000:0.0:1789429401.741922:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21180 00000100:00100000:0.0:1789429401.741932:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:37807:x1876351635025152:12345-192.168.203.39@tcp:101:checkstat.500 00010000:00010000:0.0:1789429401.741951:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429401.741974:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad726360f8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4ed expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742038:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360f94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742052:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360f94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742062:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360f94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742076:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360f9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742081:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360f9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742087:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360f9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742603:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742613:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742626:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429401.742652:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:0.0:1789429401.742656:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429401.742682:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742694:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360f94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742701:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360f94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742708:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360f94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742714:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429401.742718:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360f94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742725:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360f94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742737:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:0.0:1789429401.742740:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429401.742745:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360f94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742751:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726360f94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742767:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360f9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742773:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360f9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742779:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360f9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742784:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ada00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429401.742787:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360f9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742794:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360f9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742802:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f120fd400) 00010000:00010000:0.0:1789429401.742804:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429401.742807:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360f9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742813:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726360f9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742844:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad726360f8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ed expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742857:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ed expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.742869:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f120fd500) 00010000:00010000:0.0:1789429401.742871:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789429401.742874:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:0.0:1789429401.742982:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:37807:x1876351635025152:12345-192.168.203.39@tcp:101:checkstat.500 Request processed in 1051us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429401.742990:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21180 00000100:00100000:1.0:1789429401.759523:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.759737:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635025280 00000100:00100000:2.0:1789429401.759747:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635025280 00000100:00100000:2.0:1789429401.759809:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21181 00000100:00100000:2.0:1789429401.759818:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+11:37808:x1876351635025280:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:2.0:1789429401.759843:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429401.759863:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360fa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4f4 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.759927:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360fb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.759942:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.759953:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.759967:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360fb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.759974:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.759981:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.760413:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360fbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.760423:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.760431:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429401.760948:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:3.0:1789429401.760953:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429401.760975:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360fbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.760989:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.760995:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360fb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761002:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761008:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429401.761012:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761020:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360fb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761033:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:3.0:1789429401.761037:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429401.761041:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360fb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761048:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726360fb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761062:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761068:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360fb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761074:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761079:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429401.761082:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761088:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360fb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761161:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f051eff00) 00010000:00010000:3.0:1789429401.761163:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429401.761167:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360fb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761177:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726360fb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761424:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726360fa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4f4 expref: 13 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761440:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360fbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4f4 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.761448:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f120fd500) 00010000:00010000:3.0:1789429401.761450:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429401.761453:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547a00, rc 0) 00000100:00100000:3.0:1789429401.761536:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:37808:x1876351635025280:12345-192.168.203.39@tcp:101:rm.0 Request processed in 1718us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429401.761544:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21181 00000100:00100000:0.0:1789429401.766804:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.766895:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635025536 00000100:00100000:3.0:1789429401.766906:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635025536 00000100:00100000:3.0:1789429401.766962:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21182 00000100:00100000:3.0:1789429401.766972:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+12:37808:x1876351635025536:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:3.0:1789429401.766992:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429401.767012:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360fc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c4fb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429401.767097:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00010000:00010000:3.0:1789429401.767536:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360fc5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4fb expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.767557:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:3.0:1789429401.767560:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789429401.767565:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4fb expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.767577:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:3.0:1789429401.767665:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:37808:x1876351635025536:12345-192.168.203.39@tcp:101:rm.0 Request processed in 694us (866us total) trans 4294977145 rc 301/301 00000100:00100000:3.0:1789429401.767672:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21182 00000100:00100000:1.0:1789429401.773840:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.773918:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635025664 00000100:00100000:2.0:1789429401.773928:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635025664 00000100:00100000:2.0:1789429401.774019:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 255 00000100:00100000:2.0:1789429401.774030:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:37808:x1876351635025664:12345-192.168.203.39@tcp:37:rm.0 00000100:00100000:2.0:1789429401.780016:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:37808:x1876351635025664:12345-192.168.203.39@tcp:37:rm.0 Request processed in 5979us (6177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.780029:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 255 00000100:00100000:0.0:1789429401.784666:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.784762:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635025920 00000100:00100000:2.0:1789429401.784772:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635025920 00000100:00100000:2.0:1789429401.784859:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 256 00000100:00100000:2.0:1789429401.784871:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+13:37808:x1876351635025920:12345-192.168.203.39@tcp:35:rm.0 00000100:00100000:2.0:1789429401.785108:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:37808:x1876351635025920:12345-192.168.203.39@tcp:35:rm.0 Request processed in 238us (451us total) trans 4294977146 rc 0/0 00000100:00100000:2.0:1789429401.785117:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 256 00000100:00100000:1.0:1789429401.788074:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.788253:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635026176 00000100:00100000:3.0:1789429401.788281:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635026176 00000100:00100000:3.0:1789429401.788479:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21183 00000100:00100000:3.0:1789429401.788491:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:37808:x1876351635026176:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:3.0:1789429401.788516:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429401.788537:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360fd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c502 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.788632:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360fda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.788647:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.788659:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429401.788671:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00010000:00010000:3.0:1789429401.788790:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726360fd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c502 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.788807:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360fda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c502 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.788816:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f120fd500) 00010000:00010000:3.0:1789429401.788819:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789429401.788823:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:3.0:1789429401.788886:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:37808:x1876351635026176:12345-192.168.203.39@tcp:101:rm.0 Request processed in 397us (820us total) trans 4294977147 rc 0/0 00000100:00100000:3.0:1789429401.788893:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21183 00000100:00100000:1.0:1789429401.792061:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429401.792184:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635026304 00000100:00100000:0.0:1789429401.792194:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635026304 00000100:00100000:0.0:1789429401.792287:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21184 00000100:00100000:0.0:1789429401.792297:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:37808:x1876351635026304:12345-192.168.203.39@tcp:41:rm.0 00000004:00000024:0.0:1789429401.792354:0:15669:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7685013504 avail 7680819200 00000100:00100000:0.0:1789429401.792423:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:37808:x1876351635026304:12345-192.168.203.39@tcp:41:rm.0 Request processed in 128us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429401.792431:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21184 00000100:00100000:1.0:1789429401.795286:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429401.795858:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635026432 00000100:00100000:2.0:1789429401.795870:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635026432 00000100:00100000:2.0:1789429401.795962:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21185 00000100:00100000:2.0:1789429401.795973:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+16:37808:x1876351635026432:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:2.0:1789429401.795994:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429401.796015:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360fe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c509 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796079:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360fef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796164:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796177:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796192:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360ff6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796330:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796340:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796616:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726360ffd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796626:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726360ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796633:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726360ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429401.796667:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7a:0x0]: returning size 0 00000004:00200000:2.0:1789429401.796672:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429401.796691:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726360ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796702:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726360ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796715:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360fef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796720:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360fef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796727:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360fef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796733:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.796737:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360fef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796744:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360fef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796755:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f120fd500) 00010000:00010000:2.0:1789429401.796758:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.796764:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360fef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796770:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad726360fef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796781:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360ff6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796788:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360ff6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796793:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796799:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.796802:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360ff6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796808:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360ff6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796816:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x1cda55a (ffff946f051ef600) 00010000:00010000:2.0:1789429401.796818:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.796821:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360ff6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796827:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726360ff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796858:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726360fe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c509 expref: 18 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796872:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726360ffd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c509 expref: 17 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.796879:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f08640f00) 00010000:00010000:2.0:1789429401.796882:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789429401.796885:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546600, rc 0) 00000100:00100000:2.0:1789429401.797008:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+17:37808:x1876351635026432:12345-192.168.203.39@tcp:101:rm.0 Request processed in 1037us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429401.797015:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21185 00000100:00100000:0.0:1789429401.800610:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.800676:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635026688 00000100:00100000:3.0:1789429401.800687:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635026688 00000100:00100000:3.0:1789429401.800742:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21186 00000100:00100000:3.0:1789429401.800752:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:37808:x1876351635026688:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:3.0:1789429401.800802:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789429401.800828:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726360ffd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c509 expref: 17 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.800849:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad726360e3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c48b expref: 16 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.800860:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f08640f00) 00010000:00010000:3.0:1789429401.800870:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726360fbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4f4 expref: 15 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.800884:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f120fd500) 00010000:00010000:3.0:1789429401.800888:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429401.800907:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361004 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.800920:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361004 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.800929:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361004 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.800944:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636100b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.800951:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636100b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.800957:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636100b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.801350:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.801362:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ae expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.801370:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.801404:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ae expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.801419:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ae expref: 8 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.801433:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648368128:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429401.801519:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c2720c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429401.804688:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429401.804761:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635026816 00000100:00100000:1.0:1789429401.804772:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635026816 00010000:00010000:1.0:1789429401.804812:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ae expref: 9 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.804858:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6191 00000100:00100000:1.0:1789429401.804869:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2370:x1876351635026816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429401.804885:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429401.804891:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ae expref: 9 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.804905:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ae expref: 9 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.804927:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f08640f00) 00010000:00010000:1.0:1789429401.804932:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.804942:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.804949:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.804967:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429401.805018:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2370:x1876351635026816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 151us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429401.805025:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6191 00010000:00010000:3.0:1789429401.806536:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726360ead lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ae expref: 8 pid: 5840 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.806557:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648368128:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429401.806579:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.806672:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.806680:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789429401.807897:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].24, 64 off9728 00000004:00080000:0.0:1789429401.807911:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1099787709692ns, next at 1100787706540ns, rc = 0 00010000:00010000:0.0:1789429401.807978:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361019 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.807996:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808008:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361019 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808017:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361019 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808023:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361019 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808031:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361019 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808164:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789429401.808190:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808707:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808718:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808724:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429401.808728:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808737:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808750:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f08640f00) 00010000:00010000:0.0:1789429401.808753:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789429401.808758:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808765:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361012 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808785:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361004 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808791:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361004 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808797:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361004 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808803:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429401.808806:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361004 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808811:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361004 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808818:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f120fd500) 00010000:00010000:0.0:1789429401.808820:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429401.808824:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361004 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429401.808830:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361004 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x79:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429401.808842:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d2b90935 reply state 000000009a0d22a3 transno 4294977148 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636100b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429401.808850:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429401.808978:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:37808:x1876351635026688:12345-192.168.203.39@tcp:36:rm.0 Request processed in 8224us (8373us total) trans 4294977148 rc 0/0 00000100:00100000:0.0:1789429401.808989:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21186 00010000:00010000:3.0:1789429401.809061:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789429401.809068:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361019 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.809074:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2adc00 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:3.0:1789429401.809078:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361019 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.809084:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361019 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.809106:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7a:0x0].0x0 (ffff946f08640f00) 00010000:00010000:3.0:1789429401.809109:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789429401.809112:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361019 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.809122:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361019 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.809137:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429401.809139:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429401.809141:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429401.813785:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429401.813856:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635026944 00000100:00100000:1.0:1789429401.813866:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635026944 00000100:00100000:1.0:1789429401.813924:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21187 00000100:00100000:1.0:1789429401.813934:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:37808:x1876351635026944:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:1.0:1789429401.813958:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429401.813977:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726361020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c510 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814038:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361027 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814052:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361027 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814063:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361027 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814076:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636102e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814083:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636102e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814090:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636102e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814523:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361035 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814534:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814542:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429401.814572:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00000004:00200000:1.0:1789429401.814576:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429401.814596:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361035 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814606:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361027 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814613:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361027 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814620:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361027 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814626:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429401.814630:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361027 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814638:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361027 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814649:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:1.0:1789429401.814653:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429401.814657:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361027 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814663:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361027 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814674:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636102e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814681:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636102e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814692:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636102e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814697:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429401.814700:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636102e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814706:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636102e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814712:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f2076af00) 00010000:00010000:1.0:1789429401.814714:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429401.814717:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636102e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814724:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636102e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814753:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726361020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c510 expref: 18 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814766:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361035 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c510 expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.814773:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f120fd500) 00010000:00010000:1.0:1789429401.814775:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429401.814778:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7e00, rc 0) 00000100:00100000:1.0:1789429401.814835:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+17:37808:x1876351635026944:12345-192.168.203.39@tcp:101:rm.0 Request processed in 902us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429401.814846:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21187 00010000:00010000:2.0:1789429401.817262:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636100b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.817288:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636100b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.817296:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636100b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.817302:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.817307:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636100b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.817314:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636100b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.817330:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x1cda55a (ffff946f08640a00) 00010000:00010000:2.0:1789429401.817333:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.817338:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636100b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.817344:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad72636100b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x79:0x0].0x1cda55a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429401.818551:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.818621:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635027200 00000100:00100000:3.0:1789429401.818631:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635027200 00000100:00100000:3.0:1789429401.818686:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 257 00000100:00100000:3.0:1789429401.818696:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+16:37808:x1876351635027200:12345-192.168.203.39@tcp:35:rm.0 00000100:00100000:3.0:1789429401.818921:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:37808:x1876351635027200:12345-192.168.203.39@tcp:35:rm.0 Request processed in 225us (374us total) trans 4294977149 rc 0/0 00000100:00100000:3.0:1789429401.818928:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 257 00000100:00100000:0.0:1789429401.821975:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.822052:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635027456 00000100:00100000:3.0:1789429401.822063:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635027456 00000100:00100000:3.0:1789429401.822124:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21188 00000100:00100000:3.0:1789429401.822132:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:37808:x1876351635027456:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:3.0:1789429401.822186:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789429401.822247:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361035 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c510 expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.822290:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726360fda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x79:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c502 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.822300:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f120fd500) 00010000:00010000:3.0:1789429401.822311:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726360df0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c476 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.822320:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:3.0:1789429401.822324:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429401.822345:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.822358:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a0 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.822367:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.822399:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a0 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.822413:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a0 expref: 7 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.822427:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648368256:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429401.822510:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c2720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429401.826057:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429401.826131:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635027584 00000100:00100000:1.0:1789429401.826141:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635027584 00010000:00010000:1.0:1789429401.826178:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a0 expref: 8 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.826245:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6192 00000100:00100000:1.0:1789429401.826255:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635027584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429401.826286:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429401.826293:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a0 expref: 8 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.826306:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a0 expref: 8 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.826327:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:1.0:1789429401.826333:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.826342:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.826350:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.826369:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429401.826424:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635027584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 170us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429401.826435:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6192 00010000:00010000:3.0:1789429401.826854:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726360e75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4a0 expref: 7 pid: 6704 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.826872:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648368256:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429401.826894:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.826903:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.826909:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.826932:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361043 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.826942:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361043 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.826950:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361043 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.827189:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.827226:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ed expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.827234:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.827283:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ed expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.827297:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ed expref: 6 pid: 5839 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.827309:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648368384:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429401.827421:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c2720c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789429401.828472:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429401.831700:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429401.831785:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648368384:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429401.831814:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.831881:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635027712 00000100:00100000:1.0:1789429401.831889:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635027712 00010000:00010000:1.0:1789429401.831927:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ed expref: 7 pid: 5839 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429401.831964:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6193 00000100:00100000:1.0:1789429401.831973:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635027712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429401.831988:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429401.831995:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ed expref: 7 pid: 5839 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.832006:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ed expref: 7 pid: 5839 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.832026:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad726360fa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x79:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4ed expref: 7 pid: 5839 timeout: 1199 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.832041:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f120fd500) 00010000:00010000:1.0:1789429401.832046:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.832055:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.832062:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429401.832096:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429401.832151:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635027712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 179us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429401.832158:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6193 00010000:00010000:3.0:1789429401.832291:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.832299:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429401.833000:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x79:0x0]: returning size 16384 00010000:00010000:3.0:1789429401.833017:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833025:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833032:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833038:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429401.833042:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833049:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833059:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x79:0x0].0x0 (ffff946f120fd500) 00010000:00010000:3.0:1789429401.833062:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789429401.833066:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833076:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636104a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x79:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833099:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833105:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833110:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833115:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429401.833117:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833122:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833129:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a800) 00010000:00010000:3.0:1789429401.833132:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429401.833135:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429401.833140:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad72636103c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429401.833151:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002c5abb67 reply state 00000000e25a7044 transno 4294977150 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361043 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429401.833159:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789429401.833246:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+16:37808:x1876351635027456:12345-192.168.203.39@tcp:36:rm.0 Request processed in 11114us (11278us total) trans 4294977150 rc 0/0 00000100:00100000:3.0:1789429401.833254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21188 00010000:00010000:2.0:1789429401.836901:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361043 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.836921:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361043 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.836934:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361043 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.836941:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429401.836946:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361043 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.836954:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361043 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.836971:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdcf231c7 (ffff946f08640f00) 00010000:00010000:2.0:1789429401.836974:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429401.836979:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361043 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429401.836986:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361043 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdcf231c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429402.390126:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429402.390167:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429402.390197:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429402.390229:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635027840 00000100:00100000:1.0:1789429402.390240:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635027840 00000100:00100000:2.0:1789429402.390245:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429402.390260:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429402.390289:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429402.390302:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 567 00000100:00100000:1.0:1789429402.390310:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635027840:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429402.390311:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429402.390331:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635028096 00000100:00100000:2.0:1789429402.390334:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635028096 00000100:00100000:2.0:1789429402.390361:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635028608 00000100:00100000:2.0:1789429402.390363:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635028608 00000100:00100000:1.0:1789429402.390377:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635027840:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 67us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429402.390385:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 567 00000100:00100000:2.0:1789429402.390386:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635028224 00000100:00100000:2.0:1789429402.390388:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635028224 00000100:00100000:2.0:1789429402.390403:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635028480 00000100:00100000:2.0:1789429402.390405:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635028480 00000100:00100000:2.0:1789429402.390418:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 824 00000100:00100000:1.0:1789429402.390422:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 825 00000100:00100000:2.0:1789429402.390423:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351635028096:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429402.390428:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635028608:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429402.390450:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635028608:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429402.390451:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351635028096:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429402.390456:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 825 00000100:00100000:2.0:1789429402.390459:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 824 00000100:00100000:1.0:1789429402.390469:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 826 00000100:00100000:1.0:1789429402.390474:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635028224:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429402.390496:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635028224:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429402.392353:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 827 00000100:00100000:2.0:1789429402.392374:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635028480:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429402.392435:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635028480:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (2121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429402.392443:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 827 00000100:00080000:2.0:1789429402.392480:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429402.392986:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635028352 00000100:00100000:2.0:1789429402.392995:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635028352 00000100:00100000:2.0:1789429402.393043:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635027968 00000100:00100000:2.0:1789429402.393046:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635027968 00000100:00100000:2.0:1789429402.393071:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 800 00000100:00100000:2.0:1789429402.393077:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635028352:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429402.393118:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635028352:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 40us (2920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429402.393125:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 800 00000100:00100000:2.0:1789429402.393139:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 801 00000100:00100000:2.0:1789429402.393147:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+15:2370:x1876351635027968:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429402.393177:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+15:2370:x1876351635027968:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429402.393183:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 801 00000100:00080000:2.0:1789429402.393933:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429402.395437:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 826 00000100:00100000:2.0:1789429402.787526:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648368768:0@lo:400:kworker.0 00000100:00100000:2.0:1789429402.787596:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429402.787662:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789429402.787670:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648368896:0@lo:400:kworker.0 00000100:00100000:2.0:1789429402.787697:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429402.787733:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648368768 00000100:00100000:2.0:1789429402.787740:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648368768 00000100:00100000:2.0:1789429402.787809:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1789429402.787818:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648368768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429402.787866:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648368768:12345-0@lo:400:kworker.0 Request processed in 49us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429402.787873:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1789429402.787895:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648368896 00000100:00100000:2.0:1789429402.787899:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648368896 00000100:00100000:2.0:1789429402.787923:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:2.0:1789429402.787929:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648368896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429402.787958:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648368896:12345-0@lo:400:kworker.0 Request processed in 30us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429402.787964:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00080000:2.0:1789429402.787979:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429402.788014:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648368896:0@lo:400:kworker.0 00000100:00100000:2.0:1789429402.788024:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648368768:0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788218:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648368640:0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788259:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429402.788291:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648369152:0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788314:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429402.788349:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789429402.788355:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648368512:0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788385:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429402.788405:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648369024:0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788423:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429402.788449:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648369152 00000100:00100000:1.0:1789429402.788452:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648369152 00000100:00100000:1.0:1789429402.788487:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:1.0:1789429402.788493:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648369152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788526:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648369152:12345-0@lo:400:kworker.0 Request processed in 33us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429402.788532:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:1.0:1789429402.788551:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648368512 00000100:00100000:1.0:1789429402.788554:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648368512 00000100:00100000:1.0:1789429402.788578:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1789429402.788584:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648368512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788612:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648368512:12345-0@lo:400:kworker.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429402.788618:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1789429402.788641:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648368640 00000100:00100000:1.0:1789429402.788645:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648368640 00000100:00100000:1.0:1789429402.788666:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648369024 00000100:00100000:1.0:1789429402.788669:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648369024 00000100:00100000:1.0:1789429402.788689:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1789429402.788694:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648368640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788725:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648368640:12345-0@lo:400:kworker.0 Request processed in 30us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429402.788729:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1789429402.788739:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:1.0:1789429402.788744:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648369024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788766:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648369024:12345-0@lo:400:kworker.0 Request processed in 22us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429402.788784:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00080000:1.0:1789429402.788816:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429402.788821:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429402.788838:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34071c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648368512:0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788848:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648369024:0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788855:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648368640:0@lo:400:kworker.0 00000100:00100000:1.0:1789429402.788863:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648369152:0@lo:400:kworker.0 00010000:00010000:3.0:1789429402.856272:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429402.898934:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969264 is committed 00000001:00080000:0.0:1789429402.898951:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969266 is committed 00000004:00080000:2.0:1789429403.299846:0:6898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1101279643693ns, next at 1102279641605ns, rc = 0 00000100:00100000:2.0:1789429403.299876:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648369408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429403.299937:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429403.299992:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429403.299998:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648369280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429403.300027:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429403.300073:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648369408 00000100:00100000:2.0:1789429403.300080:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648369408 00000100:00100000:2.0:1789429403.300129:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648369280 00000100:00100000:2.0:1789429403.300132:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648369280 00000100:00100000:2.0:1789429403.300146:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789429403.300154:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648369408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429403.300184:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47382528 pending 0 free 3856662528 avail 3854565376 00000100:00080000:2.0:1789429403.300250:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429403.300274:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789429403.300281:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648369280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429403.300299:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429403.300334:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648369280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429403.300341:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789429403.300382:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648369408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 229us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429403.300387:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789429403.300418:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648369280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429403.300426:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969264 gen 2 00000100:00100000:2.0:1789429403.300441:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648369408:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789429403.876589:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429404.899498:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429405.933862:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429406.947920:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977148 is committed 00000004:00080000:2.0:1789429406.947935:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 33 committed 00000004:00080000:2.0:1789429406.947989:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 34 committed 00000100:00100000:3.0:1789429406.948260:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648369536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789429406.948331:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1789429406.948697:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977150 is committed 00000100:00100000:1.0:1789429406.948840:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648369536 00000100:00100000:1.0:1789429406.948849:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648369536 00000100:00100000:1.0:1789429406.948920:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5781 00000100:00100000:1.0:1789429406.948930:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648369536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789429406.948957:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:50 count 1 00010000:00010000:1.0:1789429406.948985:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429406.949008:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f53d4231/0xb4c3dad726360e60 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c499 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429406.949024:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2609b53/0xb4c3dad726360eb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4b5 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429406.949032:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1789429406.949037:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429406.949041:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789429406.949137:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789429406.949712:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2609b53/0xb4c3dad726360eb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4b5 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429406.949733:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2609b53/0xb4c3dad726360eb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4b5 expref: 6 pid: 6680 timeout: 1204 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429406.949747:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876351648369664:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429406.949877:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f53d4231/0xb4c3dad726360e60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c499 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429406.949887:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f53d4231/0xb4c3dad726360e60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c499 expref: 6 pid: 6681 timeout: 1204 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429406.949897:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876351648369792:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429406.949920:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f140dca80 going to sleep for 11 seconds 00010000:00010000:3.0:1789429406.953717:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429406.962998:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429406.963080:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429406.963313:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635028736 00000100:00100000:3.0:1789429406.963322:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635028736 00010000:00010000:3.0:1789429406.963388:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2609b53/0xb4c3dad726360eb4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4b5 expref: 7 pid: 6680 timeout: 1204 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429406.963422:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635028864 00000100:00100000:3.0:1789429406.963425:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635028864 00010000:00010000:3.0:1789429406.963439:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f53d4231/0xb4c3dad726360e60 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c499 expref: 7 pid: 6681 timeout: 1204 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429406.963460:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6194 00000100:00100000:3.0:1789429406.963468:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635028736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429406.963484:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429406.963490:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2609b53/0xb4c3dad726360eb4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4b5 expref: 7 pid: 6680 timeout: 1204 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429406.963503:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2609b53/0xb4c3dad726360eb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4b5 expref: 7 pid: 6680 timeout: 1204 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429406.963534:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429406.963589:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635028736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 121us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429406.963597:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6194 00000100:00100000:3.0:1789429406.963617:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6195 00000100:00100000:3.0:1789429406.963623:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2368:x1876351635028864:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429406.963632:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429406.963635:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f53d4231/0xb4c3dad726360e60 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c499 expref: 7 pid: 6681 timeout: 1204 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429406.963645:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f53d4231/0xb4c3dad726360e60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x32:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c499 expref: 7 pid: 6681 timeout: 1204 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429406.963659:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429406.963664:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429406.963670:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429406.963680:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429406.963703:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429406.963724:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2368:x1876351635028864:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 101us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429406.963733:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6195 00000100:00080000:2.0:1789429406.964262:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789429406.964394:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2609b53/0xb4c3dad726360eb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c4b5 expref: 6 pid: 6680 timeout: 1204 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429406.964411:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876351648369664:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429406.964423:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f53d4231/0xb4c3dad726360e60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c499 expref: 6 pid: 6681 timeout: 1204 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429406.964432:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876351648369792:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429406.964456:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429406.964466:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429406.964473:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429406.964482:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429406.964490:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429406.964514:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789429406.964976:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648369536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16047us (16644us total) trans 4294969267 rc 0/0 00000100:00100000:1.0:1789429406.964989:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5781 00010000:00010000:0.0:1789429406.965166:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789429406.965173:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429406.965182:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6a00 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:0.0:1789429406.965187:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429406.965248:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429406.965267:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429406.965275:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a3f41c1/0xb4c3dad726361051 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429406.965293:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429406.965295:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429406.965297:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789429406.965455:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f119d6d80/2, rc 0, transno 4294969267 00000100:00100000:3.0:1789429406.965462:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648369536:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789429407.512744:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429407.512780:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429407.512803:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429407.512830:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429407.512847:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429407.512861:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429407.512879:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429407.512900:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635029248 00000100:00100000:3.0:1789429407.512998:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635029504 00000100:00100000:3.0:1789429407.513003:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635029504 00000100:00100000:1.0:1789429407.513060:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635028992 00000100:00100000:3.0:1789429407.513061:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635029120 00000100:00100000:1.0:1789429407.513064:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635028992 00000100:00100000:3.0:1789429407.513064:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635029120 00000100:00100000:1.0:1789429407.513088:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 569 00000100:00100000:3.0:1789429407.513088:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 805 00000100:00100000:1.0:1789429407.513098:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635028992:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429407.513098:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635029504:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429407.513178:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635029760 00000100:00100000:0.0:1789429407.513182:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635029760 00000100:00100000:0.0:1789429407.513243:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635029376 00000100:00100000:0.0:1789429407.513246:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635029376 00000100:00100000:0.0:1789429407.513263:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635029632 00000100:00100000:0.0:1789429407.513265:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635029632 00000100:00100000:0.0:1789429407.513282:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 830 00000100:00100000:0.0:1789429407.513289:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635029760:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429407.513360:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635029504:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 263us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429407.513367:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 805 00000100:00100000:3.0:1789429407.513385:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 806 00000100:00100000:3.0:1789429407.513392:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635029120:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429407.513454:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635029248 00000100:00100000:2.0:1789429407.513477:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 831 00000100:00100000:2.0:1789429407.513483:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351635029376:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429407.514648:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635028992:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1545us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429407.514659:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 569 00000100:00100000:1.0:1789429407.514710:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 832 00000100:00100000:1.0:1789429407.514719:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635029632:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429407.514750:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635029632:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 34us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429407.514757:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 832 00000100:00100000:1.0:1789429407.514772:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 833 00000100:00100000:1.0:1789429407.514779:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635029248:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429407.514804:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635029248:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429407.514809:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 833 00000100:00080000:1.0:1789429407.514961:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429407.514967:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429407.515138:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635029760:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1848us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429407.515146:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 830 00000100:00100000:3.0:1789429407.515626:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635029120:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 2232us (2775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429407.515635:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 806 00000100:00100000:2.0:1789429407.515891:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351635029376:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 2405us (3026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429407.515900:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 831 00000100:00100000:2.0:1789429407.909487:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648370304:0@lo:400:kworker.0 00000100:00100000:3.0:1789429407.909504:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648370048:0@lo:400:kworker.0 00000100:00100000:1.0:1789429407.910487:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648369920:0@lo:400:kworker.0 00000100:00100000:2.0:1789429407.911957:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429407.912111:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648370176:0@lo:400:kworker.0 00000100:00100000:2.0:1789429407.912422:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429407.914468:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429407.914542:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648370432:0@lo:400:kworker.0 00000100:00100000:1.0:1789429407.914595:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429407.914682:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648370176 00000100:00100000:1.0:1789429407.914692:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648370176 00000100:00100000:1.0:1789429407.914753:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648370432 00000100:00100000:1.0:1789429407.914757:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648370432 00000100:00100000:1.0:1789429407.914782:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:1.0:1789429407.914791:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648370176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429407.914857:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648370176:12345-0@lo:400:kworker.0 Request processed in 66us (2434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429407.914865:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:1.0:1789429407.914884:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:1.0:1789429407.914890:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648370432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429407.914925:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648370432:12345-0@lo:400:kworker.0 Request processed in 35us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429407.914931:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:1.0:1789429407.914951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648369920 00000100:00100000:1.0:1789429407.914955:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648369920 00000100:00100000:1.0:1789429407.914982:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1789429407.914990:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648369920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429407.915025:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648369920:12345-0@lo:400:kworker.0 Request processed in 36us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429407.915032:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00080000:1.0:1789429407.915094:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429407.915161:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648370176:0@lo:400:kworker.0 00000100:00100000:3.0:1789429407.916274:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429407.916347:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648370560:0@lo:400:kworker.0 00000100:00100000:3.0:1789429407.916413:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429407.916428:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648370304 00000100:00100000:0.0:1789429407.916438:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648370304 00000100:00100000:3.0:1789429407.916489:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648370048 00000100:00100000:0.0:1789429407.916494:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648370560 00000100:00100000:3.0:1789429407.916499:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648370048 00000100:00100000:0.0:1789429407.916501:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648370560 00000100:00100000:0.0:1789429407.916580:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1789429407.916586:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1789429407.916594:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648370304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429407.916602:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648370048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429407.916692:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648370048:12345-0@lo:400:kworker.0 Request processed in 94us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429407.916701:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1789429407.916707:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648370304:12345-0@lo:400:kworker.0 Request processed in 115us (4755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429407.916716:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:0.0:1789429407.916736:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1789429407.916744:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648370560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429407.916783:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648370560:12345-0@lo:400:kworker.0 Request processed in 41us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429407.916790:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1789429407.917009:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648370048:0@lo:400:kworker.0 00000100:00100000:3.0:1789429407.917027:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648370560:0@lo:400:kworker.0 00000100:00100000:3.0:1789429407.917392:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648370304:0@lo:400:kworker.0 00000100:00100000:0.0:1789429407.919349:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648369920:0@lo:400:kworker.0 00000100:00100000:0.0:1789429407.919376:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648370432:0@lo:400:kworker.0 00000100:00080000:1.0:1789429407.920681:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1789429407.938738:0:23107:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 19:43:26 (1789429406) 00010000:00010000:3.0:1789429407.975419:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429407.991549:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969267 is committed 00000100:00100000:0.0:1789429408.420171:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648370816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429408.420728:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f65c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648370688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429408.420821:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429408.421023:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429408.427110:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648370688 00000100:00100000:3.0:1789429408.427110:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648370816 00000100:00100000:2.0:1789429408.427134:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648370688 00000100:00100000:3.0:1789429408.427134:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648370816 00000100:00100000:2.0:1789429408.427277:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789429408.427292:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648370688:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429408.427300:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789429408.427312:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648370816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429408.427351:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47382528 pending 0 free 3856662528 avail 3854565376 00002000:00000024:3.0:1789429408.427351:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429408.427543:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648370816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 233us (6518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429408.427552:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:1.0:1789429408.427583:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429408.428476:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648370816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429408.429776:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648370688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2480us (8946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429408.429791:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789429408.431053:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969267 gen 2 00000004:00080000:1.0:1789429408.431076:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f119d6d80, transno 4294969267 00000100:00100000:1.0:1789429408.431128:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f65c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648370688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789429409.009474:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789429409.448277:0:23157:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_25b needs >= 2 MDTs 00010000:00010000:3.0:1789429410.019482:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429411.043715:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789429411.104521:0:23205:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 26a: allow mtime to get older ============ 19:43:30 (1789429410) 00000100:00100000:2.0:1789429411.229470:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429411.236190:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635029888 00000100:00100000:1.0:1789429411.236231:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635029888 00000100:00080000:2.0:1789429411.236311:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429411.236331:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21189 00000100:00100000:1.0:1789429411.236345:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:38657:x1876351635029888:12345-192.168.203.39@tcp:101:utime.0 00010000:00010000:1.0:1789429411.236373:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429411.236404:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c517 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.236683:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636105f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.236702:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636105f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.236721:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636105f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429411.236766:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429411.236770:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429411.236822:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636105f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.236858:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c517 expref: 10 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.236878:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636105f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c517 expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.236887:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a600) 00010000:00010000:1.0:1789429411.236891:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429411.236895:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7e00, rc 0) 00000100:00100000:1.0:1789429411.236990:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+9:38657:x1876351635029888:12345-192.168.203.39@tcp:101:utime.0 Request processed in 649us (7531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429411.236998:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21189 00000100:00100000:2.0:1789429411.240964:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429411.243268:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635030144 00000100:00100000:1.0:1789429411.243293:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635030144 00000100:00100000:1.0:1789429411.243410:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21190 00000100:00100000:1.0:1789429411.243424:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+9:38657:x1876351635030144:12345-192.168.203.39@tcp:36:utime.0 00010000:00010000:1.0:1789429411.243506:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429411.243544:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636105f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c517 expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.243569:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a600) 00010000:00010000:1.0:1789429411.243583:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429411.243863:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361066 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.243880:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.243893:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.243905:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636106d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.243912:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636106d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.243918:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636106d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.244891:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361066 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.244904:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361066 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.244911:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361066 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.244917:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429411.244922:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361066 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.244930:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361066 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.244947:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a200) 00010000:00010000:1.0:1789429411.244951:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429411.244956:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361066 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.244964:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361066 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429411.244988:0:6704:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000065ed3748 reply state 00000000502e8ff3 transno 4294977151 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636106d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429411.244998:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429411.245135:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+10:38657:x1876351635030144:12345-192.168.203.39@tcp:36:utime.0 Request processed in 1708us (4182us total) trans 4294977151 rc 0/0 00000100:00100000:1.0:1789429411.245146:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21190 00000100:00100000:2.0:1789429411.254523:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1789429411.254608:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636106d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429411.254625:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636106d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429411.254634:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636106d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429411.254642:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429411.254648:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636106d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429411.254658:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636106d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429411.254695:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb7bb56a (ffff946f2076a100) 00010000:00010000:0.0:1789429411.254699:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429411.254706:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636106d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429411.254713:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636106d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429411.255481:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635030272 00000100:00100000:1.0:1789429411.255496:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635030272 00000100:00100000:1.0:1789429411.255585:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21191 00000100:00100000:1.0:1789429411.255599:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:38657:x1876351635030272:12345-192.168.203.39@tcp:101:utime.0 00010000:00010000:1.0:1789429411.255635:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429411.255665:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c51e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.255756:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad72636107b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.255770:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad72636107b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.255784:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad72636107b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429411.255832:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429411.255836:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429411.255864:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad72636107b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.255893:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c51e expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.255913:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad72636107b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c51e expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.255922:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a700) 00010000:00010000:1.0:1789429411.255925:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429411.255928:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6e00, rc 0) 00000100:00100000:1.0:1789429411.256017:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+10:38657:x1876351635030272:12345-192.168.203.39@tcp:101:utime.0 Request processed in 420us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429411.256025:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21191 00000100:00100000:2.0:1789429411.260833:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429411.261184:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635030400 00000100:00100000:1.0:1789429411.261252:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635030400 00000100:00100000:1.0:1789429411.261328:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21192 00000100:00100000:1.0:1789429411.261341:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+10:38657:x1876351635030400:12345-192.168.203.39@tcp:101:utime.0 00010000:00010000:1.0:1789429411.261369:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429411.261396:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c525 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261488:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361089 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261504:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261522:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261538:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726361090 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261545:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726361090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261553:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726361090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261664:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726361097 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261672:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726361097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261679:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726361097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429411.261716:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7b:0x0]: returning size 0 00000004:00200000:1.0:1789429411.261719:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429411.261742:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726361097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261755:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726361097 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261765:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361089 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261783:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361089 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261790:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261797:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429411.261802:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361089 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261811:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361089 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261825:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a700) 00010000:00010000:1.0:1789429411.261828:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429411.261834:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261840:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad726361089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261854:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726361090 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261860:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726361090 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261865:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726361090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261871:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429411.261875:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726361090 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261880:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726361090 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261886:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb7bb56a (ffff946f2076a200) 00010000:00010000:1.0:1789429411.261889:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429411.261891:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726361090 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261896:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad726361090 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261929:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c525 expref: 12 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261944:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726361097 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c525 expref: 11 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429411.261952:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7b:0x0].0x0 (ffff946f2076a600) 00010000:00010000:1.0:1789429411.261954:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429411.261957:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6200, rc 0) 00000100:00100000:1.0:1789429411.262040:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+11:38657:x1876351635030400:12345-192.168.203.39@tcp:101:utime.0 Request processed in 701us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429411.262048:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21192 00010000:00010000:3.0:1789429412.067490:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789429412.089879:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977151 is committed 00000100:00100000:2.0:1789429412.271130:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429412.271262:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635030528 00000100:00100000:1.0:1789429412.271276:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635030528 00000100:00100000:1.0:1789429412.271381:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21193 00000100:00100000:1.0:1789429412.271397:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:38657:x1876351635030528:12345-192.168.203.39@tcp:101:utime.0 00010000:00010000:1.0:1789429412.271424:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429412.271452:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad72636109e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c52c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.271542:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.271559:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.271575:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429412.271619:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429412.271623:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429412.271648:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.271676:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad72636109e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c52c expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.271696:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c52c expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.271705:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a700) 00010000:00010000:1.0:1789429412.271709:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429412.271712:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7e00, rc 0) 00000100:00100000:1.0:1789429412.271788:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:38657:x1876351635030528:12345-192.168.203.39@tcp:101:utime.0 Request processed in 395us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429412.271800:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21193 00000100:00080000:2.0:1789429412.272008:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429412.281509:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429412.282622:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635030656 00000100:00100000:3.0:1789429412.282638:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635030656 00000100:00100000:3.0:1789429412.282720:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21194 00000100:00100000:3.0:1789429412.282731:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:38657:x1876351635030656:12345-192.168.203.39@tcp:101:utime.0 00010000:00010000:3.0:1789429412.282751:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429412.282774:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad7263610ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c533 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.282844:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad7263610b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.282858:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad7263610b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.282869:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad7263610b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.282885:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263610ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.282891:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263610ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.282897:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263610ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286076:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286168:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286181:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429412.286254:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7b:0x0]: returning size 0 00000004:00200000:0.0:1789429412.286258:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429412.286284:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286296:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286306:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad7263610b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286312:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad7263610b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286318:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad7263610b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286323:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429412.286328:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad7263610b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286334:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad7263610b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286347:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a700) 00010000:00010000:0.0:1789429412.286350:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429412.286354:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad7263610b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286361:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad7263610b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286378:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263610ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286385:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263610ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286391:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263610ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286396:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429412.286399:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263610ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286404:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263610ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286412:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb7bb56a (ffff946f08640200) 00010000:00010000:0.0:1789429412.286415:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429412.286418:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263610ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286425:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263610ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286464:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1600/0xb4c3dad7263610ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c533 expref: 9 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286479:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c533 expref: 8 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429412.286486:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7b:0x0].0x0 (ffff946f2076a600) 00010000:00010000:0.0:1789429412.286489:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429412.286491:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:0.0:1789429412.286639:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:38657:x1876351635030656:12345-192.168.203.39@tcp:101:utime.0 Request processed in 3908us (5145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429412.286649:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21194 00000100:00100000:0.0:1789429412.300354:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429412.303301:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635030912 00000100:00100000:2.0:1789429412.303317:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635030912 00000100:00100000:2.0:1789429412.303443:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21195 00000100:00100000:2.0:1789429412.303455:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+10:38657:x1876351635030912:12345-192.168.203.39@tcp:36:utime.0 00010000:00010000:2.0:1789429412.303510:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429412.303537:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6200/0xb4c3dad726361097 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c525 expref: 10 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429412.303558:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7b:0x0].0x0 (ffff946f2076a600) 00010000:00010000:2.0:1789429412.303564:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429412.303609:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429412.303629:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c533 expref: 7 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429412.303638:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429412.303675:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c533 expref: 7 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429412.303690:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c533 expref: 7 pid: 15700 timeout: 1210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429412.303706:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648370944:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429412.303813:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789429412.306654:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648370944:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429412.306685:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429412.307467:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429412.307547:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635031040 00000100:00100000:3.0:1789429412.307555:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635031040 00010000:00010000:3.0:1789429412.307592:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c533 expref: 8 pid: 15700 timeout: 1210 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429412.307634:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6196 00000100:00100000:3.0:1789429412.307644:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351635031040:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429412.307659:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429412.307665:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c533 expref: 8 pid: 15700 timeout: 1210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.307684:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c533 expref: 8 pid: 15700 timeout: 1210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.307705:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263610c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c533 expref: 8 pid: 15700 timeout: 1210 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.307722:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7b:0x0].0x0 (ffff946f2076a600) 00010000:00010000:3.0:1789429412.307728:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.307737:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.307744:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.307773:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429412.307870:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635031040:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 226us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429412.307877:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6196 00010000:00010000:2.0:1789429412.307930:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429412.307939:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789429412.308157:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004ce6e199 reply state 0000000049d78a86 transno 4294977152 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429412.308166:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789429412.308290:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:38657:x1876351635030912:12345-192.168.203.39@tcp:36:utime.0 Request processed in 4837us (7944us total) trans 4294977152 rc 0/0 00000100:00100000:2.0:1789429412.308298:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21195 00000100:00100000:2.0:1789429412.319659:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429412.320759:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635031168 00010000:00010000:3.0:1789429412.320759:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429412.320772:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635031168 00010000:00010000:3.0:1789429412.320774:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.320784:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.320796:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429412.320801:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.320809:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.320825:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7b:0x0].0x0 (ffff946f2076a600) 00010000:00010000:3.0:1789429412.320828:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429412.320834:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429412.320840:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad7263610c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429412.320849:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21196 00000100:00100000:1.0:1789429412.320866:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+10:38657:x1876351635031168:12345-192.168.203.39@tcp:101:utime.0 00010000:00010000:1.0:1789429412.320887:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429412.320908:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad7263610cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c53a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.320968:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad7263610cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c53a expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.320981:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad7263610cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c53a expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.320989:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7b:0x0].0x0 (ffff946f2076ad00) 00010000:00010000:1.0:1789429412.320992:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789429412.320994:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6400, rc 0) 00000100:00100000:1.0:1789429412.321056:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+11:38657:x1876351635031168:12345-192.168.203.39@tcp:101:utime.0 Request processed in 193us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429412.321062:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21196 00000100:00100000:0.0:1789429412.325587:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429412.325655:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635031296 00000100:00100000:3.0:1789429412.325664:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635031296 00000100:00100000:3.0:1789429412.325722:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 258 00000100:00100000:3.0:1789429412.325732:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05b62c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+11:38657:x1876351635031296:12345-192.168.203.39@tcp:49:utime.0 00000100:00100000:3.0:1789429412.325878:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05b62c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+11:38657:x1876351635031296:12345-192.168.203.39@tcp:49:utime.0 Request processed in 148us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429412.325887:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 258 00000100:00100000:3.0:1789429412.335676:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429412.336112:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635031424 00000100:00100000:1.0:1789429412.336123:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635031424 00000100:00100000:1.0:1789429412.336183:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21197 00000100:00100000:1.0:1789429412.336337:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+11:38657:x1876351635031424:12345-192.168.203.39@tcp:101:utime.0 00010000:00010000:1.0:1789429412.336358:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429412.336389:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263610d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c541 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336559:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263610dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336574:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263610dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336586:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263610dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336601:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336608:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336615:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336885:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad7263610eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336894:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad7263610eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336901:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad7263610eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429412.336930:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7b:0x0]: returning size 0 00000004:00200000:1.0:1789429412.336934:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429412.336953:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad7263610eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336963:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad7263610eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336970:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263610dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336976:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263610dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336982:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263610dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.336988:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429412.336993:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263610dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.337000:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263610dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.337011:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a700) 00010000:00010000:1.0:1789429412.338509:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429412.338519:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263610dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.338530:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263610dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.338554:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.338560:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.338565:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.338570:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429412.338573:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.338578:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.338589:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb7bb56a (ffff946f2076a200) 00010000:00010000:1.0:1789429412.338591:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429412.338594:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.338598:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.338641:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263610d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c541 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.338653:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad7263610eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c541 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.338665:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7b:0x0].0x0 (ffff946f2076ad00) 00010000:00010000:1.0:1789429412.338667:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429412.338669:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6a00, rc 0) 00000100:00100000:1.0:1789429412.338790:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+12:38657:x1876351635031424:12345-192.168.203.39@tcp:101:utime.0 Request processed in 2597us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429412.338798:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21197 00000100:00100000:2.0:1789429412.345731:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429412.347003:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635031552 00000100:00100000:1.0:1789429412.347014:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635031552 00000100:00100000:1.0:1789429412.347073:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21198 00000100:00100000:1.0:1789429412.347767:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:38657:x1876351635031552:12345-192.168.203.39@tcp:101:utime.0 00010000:00010000:1.0:1789429412.347791:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429412.347814:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263610f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c548 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.347876:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.347890:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.347900:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.347914:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361100 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.347921:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.347928:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348239:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726361107 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348250:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726361107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348258:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726361107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429412.348290:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7b:0x0]: returning size 0 00000004:00200000:1.0:1789429412.348294:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429412.348314:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726361107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348334:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726361107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348341:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348347:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348352:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348358:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429412.348361:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348378:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348389:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a700) 00010000:00010000:1.0:1789429412.348392:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429412.348396:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348402:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad7263610f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348414:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348420:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361100 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348426:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348431:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429412.348434:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348448:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361100 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348455:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfb7bb56a (ffff946f2076a200) 00010000:00010000:1.0:1789429412.348458:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429412.348461:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361100 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348471:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361100 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfb7bb56a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348503:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263610f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c548 expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348516:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726361107 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c548 expref: 8 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429412.348524:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7b:0x0].0x0 (ffff946f2076ad00) 00010000:00010000:1.0:1789429412.348526:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429412.348528:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7000, rc 0) 00000100:00100000:1.0:1789429412.348588:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:38657:x1876351635031552:12345-192.168.203.39@tcp:101:utime.0 Request processed in 1507us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429412.348597:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21198 00000100:00100000:0.0:1789429412.633609:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429412.633652:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429412.633686:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429412.633716:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429412.633737:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429412.633769:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635031936 00000100:00100000:0.0:1789429412.633778:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635031936 00000100:00100000:0.0:1789429412.633832:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635032192 00000100:00100000:0.0:1789429412.633836:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635032192 00000100:00100000:0.0:1789429412.633856:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635031808 00000100:00100000:0.0:1789429412.633859:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635031808 00000100:00100000:0.0:1789429412.633879:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635032064 00000100:00100000:0.0:1789429412.633882:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635032064 00000100:00100000:0.0:1789429412.633898:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 836 00000100:00100000:0.0:1789429412.633907:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351635031936:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429412.633970:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2371:x1876351635031936:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 64us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429412.633977:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 836 00000100:00100000:0.0:1789429412.633993:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 837 00000100:00100000:0.0:1789429412.633999:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635032192:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429412.634025:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635032192:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429412.634031:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 837 00000100:00100000:0.0:1789429412.634043:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 838 00000100:00100000:0.0:1789429412.634049:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635031808:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429412.634071:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635031808:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429412.634077:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 838 00000100:00100000:0.0:1789429412.634088:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 839 00000100:00100000:0.0:1789429412.634094:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635032064:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429412.634116:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635032064:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429412.634121:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 839 00000100:00080000:2.0:1789429412.634471:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429412.634477:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429412.634855:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635031680 00000100:00100000:1.0:1789429412.634869:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635031680 00000100:00100000:1.0:1789429412.634951:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 571 00000100:00100000:1.0:1789429412.634962:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635031680:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429412.635069:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635031680:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 109us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429412.635076:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 571 00000100:00100000:3.0:1789429413.027811:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648371200:0@lo:400:kworker.0 00000100:00100000:1.0:1789429413.027851:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648371328:0@lo:400:kworker.0 00000100:00100000:2.0:1789429413.027928:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648371072:0@lo:400:kworker.0 00000100:00100000:0.0:1789429413.027935:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648371456:0@lo:400:kworker.0 00000100:00100000:3.0:1789429413.030411:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429413.030505:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648371712:0@lo:400:kworker.0 00000100:00100000:1.0:1789429413.030796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429413.030881:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429413.030882:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648371200 00000100:00100000:1.0:1789429413.030893:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648371200 00000100:00100000:2.0:1789429413.030918:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648371584:0@lo:400:kworker.0 00000100:00100000:2.0:1789429413.030944:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429413.030993:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648371072 00000100:00100000:2.0:1789429413.030998:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648371072 00000100:00100000:2.0:1789429413.031050:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1789429413.031060:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648371072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429413.031122:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648371072:12345-0@lo:400:kworker.0 Request processed in 63us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429413.031129:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1789429413.031167:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648371328 00000100:00100000:2.0:1789429413.031171:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648371328 00000100:00100000:2.0:1789429413.031232:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648371584 00000100:00100000:2.0:1789429413.031235:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648371584 00000100:00100000:2.0:1789429413.031258:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1789429413.031264:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648371328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429413.031305:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648371328:12345-0@lo:400:kworker.0 Request processed in 40us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429413.031311:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1789429413.031323:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:2.0:1789429413.031328:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648371584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429413.031357:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648371584:12345-0@lo:400:kworker.0 Request processed in 29us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429413.031367:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00080000:2.0:1789429413.031383:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429413.031410:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1789429413.031418:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648371200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429413.031423:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648371328:0@lo:400:kworker.0 00000100:00100000:1.0:1789429413.031452:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648371200:12345-0@lo:400:kworker.0 Request processed in 35us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429413.031458:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:2.0:1789429413.031458:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648371072:0@lo:400:kworker.0 00000100:00100000:2.0:1789429413.031467:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648371584:0@lo:400:kworker.0 00000100:00100000:3.0:1789429413.031542:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429413.031580:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648371200:0@lo:400:kworker.0 00000100:00100000:3.0:1789429413.031601:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648371712 00000100:00100000:3.0:1789429413.031604:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648371712 00000100:00100000:3.0:1789429413.031639:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1789429413.031645:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648371712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429413.031680:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648371712:12345-0@lo:400:kworker.0 Request processed in 35us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429413.031686:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00080000:3.0:1789429413.031703:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429413.031720:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648371712:0@lo:400:kworker.0 00000100:00100000:0.0:1789429413.036670:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429413.036858:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648371456 00000100:00100000:2.0:1789429413.036872:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648371456 00000100:00100000:2.0:1789429413.036949:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:2.0:1789429413.036961:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648371456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429413.037056:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648371456:12345-0@lo:400:kworker.0 Request processed in 98us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429413.037064:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1789429413.039752:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648371456:0@lo:400:kworker.0 00000100:00080000:0.0:1789429413.039851:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789429413.093488:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429413.542531:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789429413.542568:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648371840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429413.542673:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429413.543551:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648371840 00000100:00100000:1.0:1789429413.543567:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648371840 00000100:00100000:1.0:1789429413.543650:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789429413.543662:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648371840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429413.543700:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47382528 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1789429413.543793:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648371840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429413.543800:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789429413.544062:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648371840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429413.548909:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789429413.548941:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648371968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429413.549065:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429413.549147:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648371968 00000100:00100000:2.0:1789429413.549157:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648371968 00000100:00100000:2.0:1789429413.549244:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789429413.549254:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648371968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429413.549299:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429413.549359:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648371968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429413.549367:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789429413.549426:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648371968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429414.118768:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429415.140774:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429416.163581:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789429417.177545:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977152 is committed 00010000:00010000:0.0:1789429417.187802:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429417.777592:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429417.777720:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635032320 00000100:00100000:1.0:1789429417.777734:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635032320 00000100:00100000:1.0:1789429417.777803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 573 00000100:00100000:1.0:1789429417.777814:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635032320:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429417.777925:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635032320:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 113us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429417.777934:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 573 00000100:00100000:0.0:1789429417.778471:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429417.778519:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429417.779370:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635032576 00000100:00100000:3.0:1789429417.779385:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635032576 00000100:00100000:3.0:1789429417.779534:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 842 00000100:00100000:3.0:1789429417.779546:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635032576:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429417.779624:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635032576:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 81us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429417.779631:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 842 00000100:00080000:3.0:1789429417.779653:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429417.779746:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429417.779817:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429417.779837:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429417.779858:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429417.779876:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635032448 00000100:00100000:3.0:1789429417.779882:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635032448 00000100:00100000:3.0:1789429417.779917:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635032832 00000100:00100000:3.0:1789429417.779920:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635032832 00000100:00100000:3.0:1789429417.779941:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 813 00000100:00100000:3.0:1789429417.779948:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+11:2368:x1876351635032448:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429417.779994:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+11:2368:x1876351635032448:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 45us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429417.780000:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 813 00000100:00100000:3.0:1789429417.780013:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 814 00000100:00100000:3.0:1789429417.780019:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2369:x1876351635032832:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429417.780046:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2369:x1876351635032832:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429417.780052:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 814 00000100:00100000:3.0:1789429417.780070:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635032960 00000100:00100000:3.0:1789429417.780074:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635032960 00000100:00100000:3.0:1789429417.780097:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635032704 00000100:00100000:3.0:1789429417.780100:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635032704 00000100:00100000:3.0:1789429417.780120:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635033088 00000100:00100000:3.0:1789429417.780124:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635033088 00000100:00100000:3.0:1789429417.780168:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 843 00000100:00100000:3.0:1789429417.780176:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635032960:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429417.780279:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635032960:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 102us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429417.781475:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5782 00000100:00100000:2.0:1789429417.781506:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+5:2367:x1876351635032704:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:2.0:1789429417.781549:0:20986:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad726360c7d 00000100:00080000:2.0:1789429417.781564:0:20986:0:(import.c:65:import_set_state_nolock()) ffff946e02aaa000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789429417.781633:0:20986:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969597 00000100:00100000:2.0:1789429417.782007:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+2:2367:x1876351635032704:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 514us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429417.782500:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 843 00000100:00100000:3.0:1789429417.782540:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5783 00000100:00100000:3.0:1789429417.782555:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2367:x1876351635033088:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:3.0:1789429417.782585:0:8085:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad726360d41 00000100:00080000:3.0:1789429417.782595:0:8085:0:(import.c:65:import_set_state_nolock()) ffff946e05c1d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789429417.782645:0:8085:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969597 00000100:00100000:3.0:1789429417.782822:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+2:2367:x1876351635033088:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 273us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429417.782830:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5783 00010000:00010000:3.0:1789429417.782855:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429417.782896:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789429417.782906:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429417.782910:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429417.782913:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429417.783420:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5782 00000100:00100000:2.0:1789429418.148765:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648372224:0@lo:400:kworker.0 00000100:00100000:2.0:1789429418.148865:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429418.148942:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648372736:0@lo:400:kworker.0 00000100:00100000:2.0:1789429418.148973:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429418.149009:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789429418.149016:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648372352:0@lo:400:kworker.0 00000100:00100000:2.0:1789429418.149041:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429418.149076:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648372224 00000100:00100000:2.0:1789429418.149085:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648372224 00000100:00100000:2.0:1789429418.149134:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648372352 00000100:00100000:2.0:1789429418.149137:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648372352 00000100:00100000:2.0:1789429418.149185:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:2.0:1789429418.149195:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648372224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429418.149282:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648372224:12345-0@lo:400:kworker.0 Request processed in 88us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429418.149290:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1789429418.149418:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648372480:0@lo:400:kworker.0 00000100:00100000:1.0:1789429418.149455:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429418.149476:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789429418.149482:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648372096:0@lo:400:kworker.0 00000100:00100000:1.0:1789429418.149512:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429418.149538:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648372608:0@lo:400:kworker.0 00000100:00100000:1.0:1789429418.149562:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429418.149594:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648372608 00000100:00100000:1.0:1789429418.149598:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648372608 00000100:00100000:1.0:1789429418.149632:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:1.0:1789429418.149639:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648372352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429418.149673:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648372352:12345-0@lo:400:kworker.0 Request processed in 34us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429418.149680:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:1.0:1789429418.149695:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1789429418.149701:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648372608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429418.149734:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648372608:12345-0@lo:400:kworker.0 Request processed in 34us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429418.149741:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1789429418.149761:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648372096 00000100:00100000:1.0:1789429418.149764:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648372096 00000100:00100000:1.0:1789429418.149791:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1789429418.149797:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648372096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429418.149829:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648372096:12345-0@lo:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429418.149835:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1789429418.149893:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648372096:0@lo:400:kworker.0 00000100:00100000:1.0:1789429418.149907:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648372608:0@lo:400:kworker.0 00000100:00100000:1.0:1789429418.149986:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648372352:0@lo:400:kworker.0 00000100:00100000:1.0:1789429418.149997:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648372224:0@lo:400:kworker.0 00000100:00100000:3.0:1789429418.150439:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648372736 00000100:00100000:3.0:1789429418.150445:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648372736 00000100:00100000:3.0:1789429418.150492:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648372480 00000100:00100000:3.0:1789429418.150496:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648372480 00000100:00100000:3.0:1789429418.150523:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:3.0:1789429418.150531:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648372736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429418.150594:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648372736:12345-0@lo:400:kworker.0 Request processed in 64us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429418.150601:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:3.0:1789429418.150615:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:3.0:1789429418.150621:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648372480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429418.150658:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648372480:12345-0@lo:400:kworker.0 Request processed in 37us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429418.150664:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00080000:3.0:1789429418.150682:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429418.150688:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429418.150691:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429418.150724:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648372480:0@lo:400:kworker.0 00000100:00100000:3.0:1789429418.150753:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648372736:0@lo:400:kworker.0 00010000:00010000:3.0:1789429418.211901:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429418.659430:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789429418.659453:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648372864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429418.659456:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648372992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429418.663764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429418.664069:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429418.672122:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648372992 00000100:00100000:0.0:1789429418.672218:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648372992 00000100:00100000:1.0:1789429418.673099:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648372864 00000100:00100000:1.0:1789429418.673108:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648372864 00000100:00100000:3.0:1789429418.673434:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789429418.673447:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648372992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429418.673485:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429418.673566:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648372992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (9807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429418.673572:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789429418.673590:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789429418.673596:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648372864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429418.673613:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47382528 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1789429418.673651:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648372864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (9582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429418.673657:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789429418.673709:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648372864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429418.673817:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648372992:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789429419.236311:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789429419.244096:0:23403:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 26b: sync mtime between ost and mds ====== 19:43:38 (1789429418) 00000100:00100000:1.0:1789429419.383130:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429419.383431:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635033344 00000100:00100000:3.0:1789429419.383442:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635033344 00000100:00100000:3.0:1789429419.383515:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21199 00000100:00100000:3.0:1789429419.383527:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+11:39226:x1876351635033344:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:3.0:1789429419.383547:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429419.383551:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789429419.383580:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad72636107b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c51e expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429419.383598:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a700) 00010000:00010000:3.0:1789429419.383603:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429419.383618:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad72636110e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c54f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429419.383858:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429419.383873:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c52c expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429419.383882:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429419.383914:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c52c expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429419.383928:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c52c expref: 7 pid: 5840 timeout: 1217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429419.383941:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648373120:192.168.203.39@tcp:104: 00000100:00080000:1.0:1789429419.384042:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429419.384163:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e02408600 going to sleep for 11 seconds 00000100:00100000:3.0:1789429419.389303:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429419.389822:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648373120:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429419.389848:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429419.392316:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635033472 00000100:00100000:0.0:1789429419.392327:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635033472 00010000:00010000:0.0:1789429419.392383:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c52c expref: 8 pid: 5840 timeout: 1217 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429419.392418:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6197 00000100:00100000:0.0:1789429419.392427:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2369:x1876351635033472:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429419.392441:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429419.392448:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c52c expref: 8 pid: 5840 timeout: 1217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.392461:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c52c expref: 8 pid: 5840 timeout: 1217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.392488:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263610a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c52c expref: 8 pid: 5840 timeout: 1217 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.392500:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a700) 00010000:00010000:0.0:1789429419.392506:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.392515:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.392522:0:11354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.392549:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429419.392711:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635033472:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 283us (3417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429419.392719:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6197 00010000:00010000:0.0:1789429419.392750:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.392758:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.392812:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad72636111c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.392822:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad72636111c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.392831:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad72636111c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789429419.393761:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x31:0x0], index 1: 0 00010000:00010000:0.0:1789429419.394016:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726361123 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.394028:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726361123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.394036:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726361123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.394069:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.394077:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.394084:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.394090:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429419.394094:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.394102:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.394113:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a700) 00010000:00010000:0.0:1789429419.394116:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429419.394121:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.394132:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361115 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429419.394157:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000883c0ed reply state 00000000310514cb transno 4294977153 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad72636111c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429419.394166:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789429419.394197:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad72636110e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c54f expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.394341:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726361123 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c54f expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.394348:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f120fd800) 00010000:00010000:0.0:1789429419.394350:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429419.394353:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac600, rc 0) 00000100:00100000:0.0:1789429419.394401:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+13:39226:x1876351635033344:12345-192.168.203.39@tcp:101:touch.0 Request processed in 10877us (11280us total) trans 4294977153 rc 0/0 00000100:00100000:0.0:1789429419.394408:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21199 00000100:00080000:1.0:1789429419.397372:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789429419.404537:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad72636111c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429419.404555:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad72636111c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429419.404564:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad72636111c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429419.404571:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429419.404576:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad72636111c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429419.404584:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad72636111c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429419.404599:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x38be3934 (ffff946f120fd400) 00010000:00010000:1.0:1789429419.404602:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429419.404607:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad72636111c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429419.404612:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad72636111c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429419.406172:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429419.406220:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635033728 00000100:00100000:1.0:1789429419.406230:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635033728 00000100:00100000:1.0:1789429419.406277:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21200 00000100:00100000:1.0:1789429419.406287:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:39226:x1876351635033728:12345-192.168.203.39@tcp:36:touch.0 00010000:00010000:1.0:1789429419.406696:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429419.406722:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad726361123 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c54f expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429419.406737:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f120fd800) 00010000:00010000:1.0:1789429419.406749:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429419.406796:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726361131 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429419.406808:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726361131 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429419.406818:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726361131 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429419.406941:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cb3bf55a reply state 00000000e6cdbe51 transno 4294977154 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726361131 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429419.406950:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429419.407059:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+13:39226:x1876351635033728:12345-192.168.203.39@tcp:36:touch.0 Request processed in 773us (895us total) trans 4294977154 rc 0/0 00000100:00100000:1.0:1789429419.407066:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21200 00000100:00100000:0.0:1789429419.416308:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429419.416347:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635033856 00000100:00100000:0.0:1789429419.416357:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635033856 00000100:00100000:0.0:1789429419.416409:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21201 00000100:00100000:0.0:1789429419.416418:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+13:39226:x1876351635033856:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:0.0:1789429419.416441:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429419.416461:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726361138 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c556 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.416541:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726361138 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c556 expref: 14 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.416557:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726361138 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c556 expref: 14 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429419.416586:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:0.0:1789429419.416590:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789429419.416594:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac200, rc 0) 00000100:00100000:0.0:1789429419.416647:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+14:39226:x1876351635033856:12345-192.168.203.39@tcp:101:touch.0 Request processed in 230us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429419.416654:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21201 00010000:00010000:2.0:1789429419.417833:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726361131 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429419.417846:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726361131 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429419.417855:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726361131 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429419.417861:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429419.417867:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726361131 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429419.417875:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726361131 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429419.417891:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:2.0:1789429419.417894:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429419.417900:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726361131 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429419.417906:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad726361131 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429419.423620:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429419.424264:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635033984 00000100:00100000:0.0:1789429419.424276:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635033984 00000100:00100000:0.0:1789429419.424331:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5784 00000100:00100000:0.0:1789429419.424339:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2367:x1876351635033984:12345-192.168.203.39@tcp:8:touch.0 00010000:00080000:0.0:1789429419.424374:0:6680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t0 exp 0000000000000000 cur 1117 last 0 00000020:00000080:0.0:1789429419.424408:0:6680:0:(genops.c:1384:class_connect()) connect: client 12e09781-3d24-4c67-9972-bb781900e20d, cookie 0xb4c3dad72636113f 00002000:00100000:0.0:1789429419.424421:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 12e09781-3d24-4c67-9972-bb781900e20d/ffff946e02cdd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789429419.424432:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789429419.424551:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789429419.424634:0:6680:0:(import.c:65:import_set_state_nolock()) ffff946e02cdf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789429419.424714:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2367:x1876351635033984:12345-192.168.203.39@tcp:8:touch.0 Request processed in 373us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429419.424723:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5784 00000100:00100000:2.0:1789429419.436328:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429419.436369:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635034112 00000100:00100000:3.0:1789429419.436380:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635034112 00000100:00080000:1.0:1789429419.436434:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429419.436458:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5785 00000100:00100000:3.0:1789429419.436470:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:0:x1876351635034112:12345-192.168.203.39@tcp:2:touch.0 00000001:00100000:0.0:1789429419.496424:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000001:00100000:0.0:1789429419.496443:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:0.0:1789429419.496447:0:7635:0:(genops.c:885:class_export_put()) final put ffff946e02aaa800/12e09781-3d24-4c67-9972-bb781900e20d 00000001:00080000:0.0:1789429419.496466:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969598 is committed 00000001:00100000:0.0:1789429419.496471:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:0.0:1789429419.496473:0:7635:0:(genops.c:885:class_export_put()) final put ffff946e05c1e000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:1.0:1789429419.496525:0:17042:0:(genops.c:844:class_export_destroy()) destroying export ffff946e02aaa800/12e09781-3d24-4c67-9972-bb781900e20d for lustre-OST0001 00000020:00000080:1.0:1789429419.496574:0:17042:0:(genops.c:844:class_export_destroy()) destroying export ffff946e05c1e000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 for lustre-OST0001 00000020:00000080:1.0:1789429419.496590:0:17042:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946e02aaa000 for lustre-OST0001 00000020:00000080:1.0:1789429419.496595:0:17042:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946e05c1d800 for lustre-OST0001 00000100:00100000:1.0:1789429419.496691:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+5:0:x1876351635034112:12345-192.168.203.39@tcp:2:touch.0 Request processed in 60218us (60366us total) trans 4294969598 rc 0/0 00000100:00100000:1.0:1789429419.496702:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5785 00000100:00100000:2.0:1789429419.501609:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429419.501780:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635034368 00000100:00100000:3.0:1789429419.501791:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635034368 00000100:00100000:3.0:1789429419.501849:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 259 00000100:00100000:3.0:1789429419.501859:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:39226:x1876351635034368:12345-192.168.203.39@tcp:35:touch.0 00000100:00100000:3.0:1789429419.503527:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:39226:x1876351635034368:12345-192.168.203.39@tcp:35:touch.0 Request processed in 1662us (1920us total) trans 4294977155 rc 0/0 00000100:00100000:3.0:1789429419.503538:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 259 00010000:00010000:3.0:1789429420.259390:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429420.521856:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429420.523364:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635034496 00000100:00100000:3.0:1789429420.523383:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635034496 00000100:00100000:3.0:1789429420.523620:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21202 00000100:00100000:3.0:1789429420.523635:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:39094:x1876351635034496:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1789429420.523672:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429420.523706:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361146 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c55d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429420.523790:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636114d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429420.523807:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636114d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429420.523828:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636114d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429420.523874:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429420.523878:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429420.523903:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636114d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429420.523933:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c55d expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429420.523957:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636114d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c55d expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429420.523966:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640000) 00010000:00010000:3.0:1789429420.523969:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429420.523973:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:3.0:1789429420.524060:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:39094:x1876351635034496:12345-192.168.203.39@tcp:101:bash.0 Request processed in 429us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429420.524069:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21202 00000100:00100000:2.0:1789429420.531621:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429420.534269:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635034752 00000100:00100000:1.0:1789429420.534285:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635034752 00000100:00100000:1.0:1789429420.534362:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21203 00000100:00100000:1.0:1789429420.534376:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+15:39094:x1876351635034752:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1789429420.534398:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429420.534401:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789429420.534431:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636114d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c55d expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.534828:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640000) 00010000:00010000:1.0:1789429420.534843:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429420.534860:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361154 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c564 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535023:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636115b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535036:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636115b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535049:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636115b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535061:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361162 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535067:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535074:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535158:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361169 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535168:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535176:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429420.535186:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7c:0x0]: returning size 0 00010000:00010000:1.0:1789429420.535592:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636115b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535601:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636115b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535607:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636115b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535613:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429420.535618:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636115b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535624:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636115b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535635:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076aa00) 00010000:00010000:1.0:1789429420.535638:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429420.535643:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636115b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535650:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636115b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535661:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535667:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361162 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535672:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535677:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429420.535680:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535687:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361162 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535694:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x38be3934 (ffff946f2076a900) 00010000:00010000:1.0:1789429420.535697:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429420.535700:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361162 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535705:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361162 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535821:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361154 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c564 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535837:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361169 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c564 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429420.535845:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:1.0:1789429420.535848:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429420.535850:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7400, rc 0) 00000100:00100000:1.0:1789429420.535925:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+16:39094:x1876351635034752:12345-192.168.203.39@tcp:101:bash.0 Request processed in 1551us (4312us total) trans 4294977156 rc 0/0 00000100:00100000:1.0:1789429420.535933:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21203 00000100:00100000:2.0:1789429420.539662:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429420.539995:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635034880 00000100:00100000:3.0:1789429420.540011:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635034880 00000100:00100000:3.0:1789429420.540091:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5786 00000100:00100000:3.0:1789429420.540108:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:39094:x1876351635034880:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1789429420.540140:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429420.540169:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad726361177 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c56b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429420.540484:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x6aa886ab, atime: 0x6aa886ab, ctime: 0x6aa886ab, blocks: 0x1 00010000:00010000:2.0:1789429420.540518:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=1118s v=(0 0) 00010000:00010000:2.0:1789429420.540523:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429420.540534:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad726361177 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c56b expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429420.540557:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad726361177 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c56b expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429420.540572:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1600, rc 0) 00000100:00100000:2.0:1789429420.540746:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:39094:x1876351635034880:12345-192.168.203.39@tcp:101:bash.0 Request processed in 644us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429420.540755:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5786 00000100:00100000:2.0:1789429420.561047:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429420.561179:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635035136 00000100:00100000:0.0:1789429420.561193:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635035136 00000100:00100000:0.0:1789429420.561321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 260 00000100:00100000:0.0:1789429420.561334:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:39094:x1876351635035136:12345-192.168.203.39@tcp:35:bash.0 00000001:00080000:0.0:1789429420.562033:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977157 00000100:00100000:0.0:1789429420.562256:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:39094:x1876351635035136:12345-192.168.203.39@tcp:35:bash.0 Request processed in 922us (1220us total) trans 4294977158 rc 0/0 00000100:00100000:0.0:1789429420.562267:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 260 00000020:00080000:0.0:1789429420.562273:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789429421.283463:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429421.589156:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429421.590137:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635035264 00000100:00100000:0.0:1789429421.590154:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635035264 00000100:00100000:0.0:1789429421.590519:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21204 00000100:00100000:0.0:1789429421.590537:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:39240:x1876351635035264:12345-192.168.203.39@tcp:101:chmod.0 00010000:00010000:0.0:1789429421.590569:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429421.590601:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636117e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c572 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789429421.590866:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789429421.591108:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429421.591134:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429421.591147:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429421.591196:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429421.592337:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429421.592518:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429421.592570:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad72636117e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c572 expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429421.592599:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c572 expref: 8 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429421.592619:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429421.592622:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429421.592627:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad200, rc 0) 00000100:00100000:0.0:1789429421.593089:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:39240:x1876351635035264:12345-192.168.203.39@tcp:101:chmod.0 Request processed in 2557us (3947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429421.593099:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21204 00000100:00100000:3.0:1789429421.613084:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429421.613964:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635035392 00000100:00100000:1.0:1789429421.613976:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635035392 00000100:00100000:1.0:1789429421.614038:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21205 00000100:00100000:1.0:1789429421.614048:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:39240:x1876351635035392:12345-192.168.203.39@tcp:101:chmod.0 00010000:00010000:1.0:1789429421.614069:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429421.614089:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636118c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c579 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614161:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361193 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614392:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614405:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614422:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636119a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614430:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636119a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614436:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636119a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614526:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614534:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614541:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429421.614575:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7c:0x0]: returning size 4 00000004:00200000:1.0:1789429421.614581:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429421.614601:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614612:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614624:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361193 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614630:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361193 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614636:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361193 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614642:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429421.614645:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361193 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614651:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361193 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614663:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:1.0:1789429421.614666:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429421.614670:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614676:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614689:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636119a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614695:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636119a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614700:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636119a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614705:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429421.614708:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636119a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614713:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636119a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614719:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x38be3934 (ffff946f2076aa00) 00010000:00010000:1.0:1789429421.614721:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429421.614723:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636119a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614728:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636119a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614759:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636118c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c579 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614772:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c579 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.614780:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:1.0:1789429421.614782:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429421.614784:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6600, rc 0) 00000100:00100000:1.0:1789429421.615129:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:39240:x1876351635035392:12345-192.168.203.39@tcp:101:chmod.0 Request processed in 1072us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429421.615137:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21205 00000100:00100000:2.0:1789429421.626765:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429421.626981:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635035520 00000100:00100000:0.0:1789429421.626995:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635035520 00000100:00100000:0.0:1789429421.627055:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5787 00000100:00100000:0.0:1789429421.627065:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2367:x1876351635035520:12345-192.168.203.39@tcp:8:chmod.0 00010000:00080000:0.0:1789429421.627113:0:13238:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1119 last 0 00000020:00000080:0.0:1789429421.627165:0:13238:0:(genops.c:1384:class_connect()) connect: client 217af837-ec0e-4ad4-94fa-9fc2e0e9f711, cookie 0xb4c3dad7263611a8 00002000:00100000:0.0:1789429421.627180:0:13238:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 217af837-ec0e-4ad4-94fa-9fc2e0e9f711/ffff946e02cd8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789429421.627839:0:13238:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789429421.628108:0:13238:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789429421.628164:0:13238:0:(import.c:65:import_set_state_nolock()) ffff946f3f330800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789429421.628346:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2367:x1876351635035520:12345-192.168.203.39@tcp:8:chmod.0 Request processed in 1272us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429421.628357:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5787 00000100:00100000:3.0:1789429421.641792:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429421.641945:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635035648 00000100:00100000:2.0:1789429421.641959:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635035648 00000100:00100000:2.0:1789429421.642117:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5788 00000100:00100000:2.0:1789429421.642140:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:0:x1876351635035648:12345-192.168.203.39@tcp:101:chmod.0 00010000:00010000:2.0:1789429421.642165:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429421.642188:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263611af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c580 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429421.642585:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3462d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648373248:192.168.203.39@tcp:106: 00000100:00100000:3.0:1789429421.642719:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865540 going to sleep for 11 seconds 00000100:00080000:1.0:1789429421.643912:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1789429421.649647:0:6680:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x31:0x0] updating lvb size: 0 -> 4 00002000:00010000:0.0:1789429421.649658:0:6680:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x31:0x0] updating lvb mtime: 1789429419 -> 1789429420 00002000:00010000:0.0:1789429421.649662:0:6680:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x31:0x0] updating lvb ctime: 1789429419 -> 1789429420 00000100:00100000:0.0:1789429421.649693:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3462d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1876351648373248:192.168.203.39@tcp:106: 00010000:00010000:0.0:1789429421.649740:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263611af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c580 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429421.649768:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000008093fd/0xb4c3dad7263611af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c580 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429421.649785:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546c00, rc 0) 00000100:00100000:0.0:1789429421.649859:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:0:x1876351635035648:12345-192.168.203.39@tcp:101:chmod.0 Request processed in 7722us (8079us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429421.649869:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5788 00000100:00100000:2.0:1789429421.660963:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429421.661104:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635035904 00000100:00100000:1.0:1789429421.661132:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635035904 00000100:00100000:1.0:1789429421.661253:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21206 00000100:00100000:1.0:1789429421.661266:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:39240:x1876351635035904:12345-192.168.203.39@tcp:36:chmod.0 00010000:00010000:1.0:1789429421.661341:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429421.661378:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c579 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.661405:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:1.0:1789429421.661411:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429421.661458:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.661475:0:15700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361169 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c564 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.661486:0:15700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.661529:0:15700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361169 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c564 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.661546:0:15700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361169 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c564 expref: 17 pid: 5839 timeout: 1219 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429421.661570:0:15700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648373376:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429421.661679:0:15700:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f341a2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429421.666875:0:15700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d57100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648373376:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429421.666922:0:15700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429421.674344:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429421.674482:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635036032 00000100:00100000:1.0:1789429421.674566:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635036032 00010000:00010000:1.0:1789429421.674648:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361169 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c564 expref: 18 pid: 5839 timeout: 1219 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429421.674696:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6198 00000100:00100000:1.0:1789429421.674708:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635036032:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429421.674727:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429421.674735:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361169 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c564 expref: 18 pid: 5839 timeout: 1219 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.674751:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361169 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c564 expref: 18 pid: 5839 timeout: 1219 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.674777:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361169 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c564 expref: 18 pid: 5839 timeout: 1219 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.674797:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:1.0:1789429421.674803:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.674815:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.674825:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789429421.675097:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789429421.675312:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429421.675393:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351635036032:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 685us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429421.675403:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6198 00010000:00010000:0.0:1789429421.676630:0:15700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429421.676645:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429421.678740:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005856ced8 reply state 000000001fb27e4f transno 4294977159 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429421.678762:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429421.679429:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:39240:x1876351635035904:12345-192.168.203.39@tcp:36:chmod.0 Request processed in 18158us (18482us total) trans 4294977159 rc 0/0 00000100:00100000:0.0:1789429421.679441:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21206 00000100:00100000:3.0:1789429421.684285:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429421.684362:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635036160 00000100:00100000:0.0:1789429421.684376:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635036160 00000100:00100000:0.0:1789429421.684444:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21207 00000100:00100000:0.0:1789429421.684456:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:39240:x1876351635036160:12345-192.168.203.39@tcp:101:chmod.0 00010000:00010000:0.0:1789429421.684486:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429421.684514:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263611bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c587 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429421.684595:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263611bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c587 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429421.684613:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263611bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c587 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429421.684636:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:0.0:1789429421.684640:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789429421.684645:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2aca00, rc 0) 00010000:00010000:1.0:1789429421.684773:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.684785:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.684794:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.684801:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429421.684807:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.684816:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.684831:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:1.0:1789429421.684834:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789429421.684838:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.684850:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263611b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429421.685731:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:39240:x1876351635036160:12345-192.168.203.39@tcp:101:chmod.0 Request processed in 1268us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429421.685743:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21207 00000100:00100000:3.0:1789429421.690662:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429421.690778:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635036288 00000100:00100000:1.0:1789429421.690791:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635036288 00000100:00100000:1.0:1789429421.690864:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5789 00000100:00100000:1.0:1789429421.690876:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635036288:12345-192.168.203.39@tcp:2:chmod.0 00000001:00080000:0.0:1789429421.755698:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969599 is committed 00000001:00100000:0.0:1789429421.755714:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00002000:00010000:2.0:1789429421.758827:0:20986:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x31:0x0] updating lvb size from disk: 4 -> 0 00002000:00010000:2.0:1789429421.758836:0:20986:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x31:0x0] updating lvb mtime from disk: 1789429420 -> 1789429419 00002000:00010000:2.0:1789429421.758839:0:20986:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x31:0x0] updating lvb atime from disk: 1789429419 -> 1789429419 00002000:00010000:2.0:1789429421.758841:0:20986:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x31:0x0] updating lvb ctime from disk: 1789429420 -> 1789429422 00002000:00010000:2.0:1789429421.758843:0:20986:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x31:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789429421.758970:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635036288:12345-192.168.203.39@tcp:2:chmod.0 Request processed in 68091us (68318us total) trans 4294969599 rc 0/0 00000100:00100000:2.0:1789429421.758981:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5789 00000100:00100000:1.0:1789429421.787285:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429421.792893:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635036416 00000100:00100000:3.0:1789429421.792909:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635036416 00000100:00100000:2.0:1789429421.798127:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21208 00000100:00100000:2.0:1789429421.798142:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:39241:x1876351635036416:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:2.0:1789429421.798170:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429421.798192:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263611c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c58e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.798270:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263611cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.798284:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263611cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.798296:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263611cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429421.798331:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429421.798334:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429421.798357:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263611cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.798383:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263611c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c58e expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.798402:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263611cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c58e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.798409:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:2.0:1789429421.798413:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429421.798417:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546c00, rc 0) 00000100:00100000:2.0:1789429421.798483:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:39241:x1876351635036416:12345-192.168.203.39@tcp:101:stat.0 Request processed in 343us (11208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429421.798490:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21208 00000100:00100000:1.0:1789429421.810511:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429421.810600:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635036544 00000100:00100000:2.0:1789429421.810610:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635036544 00000100:00100000:2.0:1789429421.810668:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21209 00000100:00100000:2.0:1789429421.810677:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:39241:x1876351635036544:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:2.0:1789429421.810696:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429421.810717:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263611d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c595 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.810777:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263611d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.810790:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263611d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.810801:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263611d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.810815:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263611e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.810822:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263611e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.810829:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263611e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.810911:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad7263611e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.810920:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad7263611e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.810927:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad7263611e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429421.810971:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7c:0x0]: returning size 4 00000004:00200000:2.0:1789429421.810983:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429421.811010:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad7263611e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811027:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad7263611e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811037:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263611d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811043:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263611d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811054:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263611d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811060:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429421.811064:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263611d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811071:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263611d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811083:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:2.0:1789429421.811085:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429421.811090:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263611d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811096:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263611d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811108:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263611e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811114:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263611e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811128:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263611e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811133:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429421.811136:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263611e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811146:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263611e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811156:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x38be3934 (ffff946f051ef400) 00010000:00010000:2.0:1789429421.811159:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429421.811161:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263611e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811166:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263611e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811192:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263611d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c595 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811247:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad7263611e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c595 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.811254:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:2.0:1789429421.811256:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789429421.811259:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546a00, rc 0) 00000100:00100000:2.0:1789429421.811315:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:39241:x1876351635036544:12345-192.168.203.39@tcp:101:stat.0 Request processed in 640us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429421.811322:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21209 00000100:00100000:3.0:1789429421.850893:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429421.851096:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635036672 00000100:00100000:1.0:1789429421.851106:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635036672 00000100:00100000:1.0:1789429421.851171:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21210 00000100:00100000:1.0:1789429421.851180:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:39242:x1876351635036672:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:1.0:1789429421.851224:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429421.851246:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad7263611ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c59c expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851398:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851411:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851421:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851435:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263611fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851446:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263611fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851452:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263611fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851531:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361203 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851539:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851546:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429421.851676:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7c:0x0]: returning size 4 00000004:00200000:1.0:1789429421.851681:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429421.851697:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851709:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851717:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851724:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851731:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851741:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429421.851745:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851752:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851763:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:1.0:1789429421.851765:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429421.851769:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851775:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263611f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851786:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263611fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851792:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263611fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851798:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263611fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851802:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429421.851805:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263611fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851810:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263611fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851821:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x38be3934 (ffff946f2076aa00) 00010000:00010000:1.0:1789429421.851823:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429421.851826:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263611fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851831:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad7263611fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x38be3934 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851855:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad7263611ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c59c expref: 12 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851867:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361203 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c59c expref: 11 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429421.851873:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:1.0:1789429421.851875:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429421.851878:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7600, rc 0) 00000100:00100000:1.0:1789429421.852069:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:39242:x1876351635036672:12345-192.168.203.39@tcp:101:stat.0 Request processed in 889us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429421.852076:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21210 00000100:00100000:3.0:1789429421.872509:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429421.878070:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635036800 00000100:00100000:2.0:1789429421.878086:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635036800 00000100:00100000:2.0:1789429421.878231:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5790 00000100:00100000:2.0:1789429421.878242:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635036800:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:2.0:1789429421.882391:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429421.882420:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636120a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5a3 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429421.882488:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648373504:192.168.203.39@tcp:106: 00000100:00100000:2.0:1789429421.882603:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f29ee4b40 going to sleep for 11 seconds 00002000:00010000:2.0:1789429421.891679:0:6681:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x31:0x0] updating lvb size: 0 -> 4 00002000:00010000:2.0:1789429421.891687:0:6681:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x31:0x0] updating lvb mtime: 1789429419 -> 1789429420 00000100:00100000:2.0:1789429421.891714:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1876351648373504:192.168.203.39@tcp:106: 00010000:00010000:2.0:1789429421.891751:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636120a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5a3 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.891775:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d72859c/0xb4c3dad72636120a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5a3 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429421.891788:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546e00, rc 0) 00000100:00100000:2.0:1789429421.891850:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635036800:12345-192.168.203.39@tcp:101:stat.0 Request processed in 13609us (19349us total) trans 0 rc 301/301 00000100:00100000:2.0:1789429421.891859:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5790 00010000:00010000:3.0:1789429422.308322:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789429422.356939:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977159 is committed 00000001:00080000:1.0:1789429422.356957:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977158 is committed 00000100:00100000:3.0:1789429422.878386:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429422.878428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429422.878454:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429422.878455:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635037184 00000100:00100000:1.0:1789429422.878467:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635037184 00000100:00100000:3.0:1789429422.878491:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429422.878518:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429422.878527:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635037696 00000100:00100000:1.0:1789429422.878531:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635037696 00000100:00100000:3.0:1789429422.878544:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429422.878592:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635036928 00000100:00100000:2.0:1789429422.878598:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635036928 00000100:00100000:0.0:1789429422.878607:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635037440 00000100:00100000:2.0:1789429422.878648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 575 00000100:00100000:2.0:1789429422.878658:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635036928:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429422.878702:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635037440 00000100:00100000:2.0:1789429422.878736:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635036928:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 78us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429422.878739:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635037056 00000100:00100000:0.0:1789429422.878744:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635037056 00000100:00100000:2.0:1789429422.878752:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 575 00000100:00100000:0.0:1789429422.878771:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 818 00000100:00100000:0.0:1789429422.878782:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351635037440:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:2.0:1789429422.878786:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429422.878819:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351635037440:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 39us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429422.878827:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 818 00000100:00100000:0.0:1789429422.878843:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 819 00000100:00100000:0.0:1789429422.878849:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351635037056:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429422.878875:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351635037056:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429422.878881:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 819 00000100:00100000:1.0:1789429422.885937:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635037312 00000100:00100000:1.0:1789429422.885953:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635037312 00000100:00100000:1.0:1789429422.886048:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 846 00000100:00100000:1.0:1789429422.886060:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635037184:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429422.886468:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635037184:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 409us (8039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429422.886478:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 846 00000100:00100000:1.0:1789429422.886500:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 847 00000100:00100000:1.0:1789429422.886508:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635037696:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429422.886526:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429422.886542:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635037696:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 33us (8050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429422.886549:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 847 00000100:00100000:1.0:1789429422.886564:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635037568 00000100:00100000:1.0:1789429422.886568:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635037568 00000100:00100000:1.0:1789429422.886589:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 848 00000100:00100000:1.0:1789429422.886596:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635037312:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429422.886621:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635037312:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (8077us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429422.886628:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 848 00000100:00100000:1.0:1789429422.886644:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 849 00000100:00100000:1.0:1789429422.886652:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635037568:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429422.886691:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635037568:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 40us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429422.886699:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 849 00000100:00080000:1.0:1789429422.886755:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429422.886759:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429423.274985:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648373632:0@lo:400:kworker.0 00000100:00100000:1.0:1789429423.275228:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429423.275275:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648374144:0@lo:400:kworker.0 00000100:00100000:2.0:1789429423.275288:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648373632 00000100:00100000:2.0:1789429423.275296:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648373632 00000100:00100000:1.0:1789429423.275301:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429423.275323:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789429423.275328:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648374016:0@lo:400:kworker.0 00000100:00100000:2.0:1789429423.275348:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1789429423.275360:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429423.275361:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648373632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429423.275393:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648373760:0@lo:400:kworker.0 00000100:00100000:2.0:1789429423.275409:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648373632:12345-0@lo:400:kworker.0 Request processed in 50us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429423.275415:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429423.275417:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:1.0:1789429423.275429:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648374272:0@lo:400:kworker.0 00000100:00100000:1.0:1789429423.275445:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429423.275449:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648374144 00000100:00100000:2.0:1789429423.275452:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648374144 00000100:00100000:1.0:1789429423.275462:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789429423.275471:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648373888:0@lo:400:kworker.0 00000100:00100000:1.0:1789429423.275495:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429423.275495:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648373760 00000100:00100000:2.0:1789429423.275498:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648373760 00000100:00100000:2.0:1789429423.275513:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648373888 00000100:00100000:2.0:1789429423.275516:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648373888 00000100:00100000:2.0:1789429423.275535:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1789429423.275540:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648374144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429423.275569:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648374144:12345-0@lo:400:kworker.0 Request processed in 30us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429423.275575:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1789429423.275586:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:2.0:1789429423.275591:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648373760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429423.275619:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648373760:12345-0@lo:400:kworker.0 Request processed in 28us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429423.275624:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:2.0:1789429423.275634:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:2.0:1789429423.275639:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648373888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429423.275663:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648373888:12345-0@lo:400:kworker.0 Request processed in 24us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429423.275668:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00080000:2.0:1789429423.275684:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429423.275717:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648373888:0@lo:400:kworker.0 00000100:00100000:2.0:1789429423.275727:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648373760:0@lo:400:kworker.0 00000100:00100000:2.0:1789429423.275753:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648373632:0@lo:400:kworker.0 00000100:00100000:2.0:1789429423.275761:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648374144:0@lo:400:kworker.0 00000100:00100000:1.0:1789429423.277028:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648374016 00000100:00100000:1.0:1789429423.277037:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648374016 00000100:00100000:1.0:1789429423.277278:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648374272 00000100:00100000:1.0:1789429423.277282:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648374272 00000100:00100000:1.0:1789429423.277309:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1789429423.277320:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648374016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429423.277388:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648374016:12345-0@lo:400:kworker.0 Request processed in 72us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429423.277395:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1789429423.277412:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:1.0:1789429423.277418:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648374272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429423.277451:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648374272:12345-0@lo:400:kworker.0 Request processed in 34us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429423.277459:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00080000:2.0:1789429423.280785:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429423.280794:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429423.280842:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648374272:0@lo:400:kworker.0 00000100:00100000:2.0:1789429423.280885:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648374016:0@lo:400:kworker.0 00010000:00010000:3.0:1789429423.331337:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429423.382256:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429423.382298:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429423.382379:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635037952 00000100:00100000:1.0:1789429423.382391:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635037952 00000100:00100000:1.0:1789429423.382467:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5791 00000100:00100000:1.0:1789429423.382478:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635037952:12345-192.168.203.39@tcp:16:kworker.0 00000100:00100000:1.0:1789429423.382592:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635037952:12345-192.168.203.39@tcp:16:kworker.0 Request processed in 116us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429423.382600:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5791 00000100:00100000:3.0:1789429423.385046:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635037824 00000100:00100000:3.0:1789429423.385060:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635037824 00002000:00100000:3.0:1789429423.385120:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x31:0x0] (0->3) req@ffff946e15187800 x1876351635037824/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:159/0 lens 496/0 e 0 to 0 dl 1789429434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429423.385132:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15187800 with x1876351635037824 ext(0->3) 00002000:00010000:3.0:1789429423.385137:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15187800 00000100:00100000:3.0:1789429423.385175:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11511 00000100:00100000:3.0:1789429423.385184:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635037824:12345-192.168.203.39@tcp:4:bash.0 00000100:00100000:3.0:1789429423.385961:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+8:2368:x1876351635037824:12345-192.168.203.39@tcp:4:bash.0 Request processed in 775us (3712us total) trans 4294969600 rc 0/0 00000100:00100000:3.0:1789429423.385970:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11511 00002000:00100000:3.0:1789429423.385979:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x31:0x0] (0->3) req@ffff946e15187800 x1876351635037824/t4294969600(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:159/0 lens 496/448 e 0 to 0 dl 1789429434 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429423.385986:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15187800 with x1876351635037824 ext(0->3) 00002000:00010000:3.0:1789429423.385990:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e15187800 00000100:00100000:3.0:1789429423.779520:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789429423.779545:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648374400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429423.779614:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429423.779907:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648374400 00000100:00100000:0.0:1789429423.779916:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648374400 00000100:00100000:0.0:1789429423.779962:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1789429423.779971:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648374400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429423.780006:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47382528 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1789429423.780103:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648374400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429423.780121:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789429423.780246:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429423.780256:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648374528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429423.780285:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429423.780317:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648374528 00000100:00100000:3.0:1789429423.780321:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648374528 00000100:00100000:3.0:1789429423.780345:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789429423.780351:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648374528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429423.780364:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50921472 pending 1703936 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429423.780396:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648374528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429423.780401:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789429423.780436:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648374528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429423.781010:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648374400:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789429424.356251:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429425.384564:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429426.403339:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789429426.905572:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969600 is committed 00010000:00010000:3.0:1789429427.427315:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429427.991916:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429427.992017:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429427.992049:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429427.992086:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429427.992112:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429427.992130:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429427.992153:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429427.992160:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635038336 00000100:00100000:0.0:1789429427.992170:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635038336 00000100:00080000:3.0:1789429427.992221:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429427.992246:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635038848 00000100:00100000:0.0:1789429427.992250:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635038848 00000100:00100000:3.0:1789429427.992253:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635038464 00000100:00100000:3.0:1789429427.992256:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635038464 00000100:00100000:0.0:1789429427.992273:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635038720 00000100:00100000:0.0:1789429427.992275:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635038720 00000100:00100000:3.0:1789429427.992281:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 852 00000100:00100000:3.0:1789429427.992289:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635038336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429427.992300:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 853 00000100:00100000:0.0:1789429427.992306:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635038848:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429427.992356:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635038336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 66us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429427.992363:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 852 00000100:00100000:2.0:1789429427.992370:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635038592 00000100:00100000:2.0:1789429427.992373:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635038592 00000100:00100000:3.0:1789429427.992378:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 854 00000100:00100000:3.0:1789429427.992384:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635038464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429427.992402:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635038208 00000100:00100000:2.0:1789429427.992404:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635038208 00000100:00100000:2.0:1789429427.992426:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 823 00000100:00100000:2.0:1789429427.992433:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351635038592:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429427.992507:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635038080 00000100:00100000:1.0:1789429427.992511:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635038080 00000100:00100000:1.0:1789429427.992542:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 577 00000100:00100000:1.0:1789429427.992550:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635038080:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429427.995782:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635038848:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 3463us (3683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429427.995801:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 853 00000100:00100000:0.0:1789429427.995841:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 855 00000100:00100000:0.0:1789429427.995857:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635038720:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429427.995899:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635038720:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 50us (3745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429427.995905:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 855 00000100:00080000:0.0:1789429427.996051:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429427.996414:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429427.996420:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429427.996743:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635038464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 4353us (4606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429427.996753:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 854 00000100:00100000:3.0:1789429427.996863:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 824 00000100:00100000:3.0:1789429427.996873:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+13:2368:x1876351635038208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429427.996927:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+13:2368:x1876351635038208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 56us (4814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429427.996933:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 824 00000100:00100000:2.0:1789429427.997633:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351635038592:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 5196us (5578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429427.997644:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 823 00000100:00100000:1.0:1789429427.997655:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635038080:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 5105us (5754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429427.997664:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 577 00000100:00100000:2.0:1789429428.387763:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648375040:0@lo:400:kworker.0 00000100:00100000:2.0:1789429428.387834:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429428.387906:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789429428.387912:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648374656:0@lo:400:kworker.0 00000100:00100000:2.0:1789429428.388010:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429428.388038:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648375168:0@lo:400:kworker.0 00000100:00100000:2.0:1789429428.388064:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429428.388101:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648374784:0@lo:400:kworker.0 00000100:00100000:3.0:1789429428.388548:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648374912:0@lo:400:kworker.0 00000100:00100000:3.0:1789429428.388583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429428.389093:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429428.389297:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648375296:0@lo:400:kworker.0 00000100:00100000:2.0:1789429428.389323:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429428.389358:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648374656 00000100:00100000:2.0:1789429428.389365:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648374656 00000100:00100000:2.0:1789429428.389410:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1789429428.389418:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648374656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429428.389471:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648374656:12345-0@lo:400:kworker.0 Request processed in 53us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429428.389479:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1789429428.389528:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648375168 00000100:00100000:1.0:1789429428.389532:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648375168 00000100:00100000:1.0:1789429428.389568:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648374912 00000100:00100000:1.0:1789429428.389571:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648374912 00000100:00100000:1.0:1789429428.389587:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648374784 00000100:00100000:1.0:1789429428.389590:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648374784 00000100:00100000:1.0:1789429428.389606:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1789429428.389613:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648375168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429428.389648:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648375168:12345-0@lo:400:kworker.0 Request processed in 36us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429428.389658:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1789429428.389671:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1789429428.389687:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648374912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429428.389719:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648374912:12345-0@lo:400:kworker.0 Request processed in 43us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429428.389724:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1789429428.389734:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:1.0:1789429428.389738:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648374784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429428.389776:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648374784:12345-0@lo:400:kworker.0 Request processed in 37us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429428.389781:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00080000:1.0:1789429428.389800:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429428.389831:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648374912:0@lo:400:kworker.0 00000100:00100000:0.0:1789429428.390010:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648375040 00000100:00100000:0.0:1789429428.390015:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648375040 00000100:00100000:0.0:1789429428.390049:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648375296 00000100:00100000:0.0:1789429428.390052:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648375296 00000100:00100000:0.0:1789429428.390082:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1789429428.390089:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648375040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429428.391255:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648375040:12345-0@lo:400:kworker.0 Request processed in 1161us (3415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429428.391265:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1789429428.391288:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1789429428.391298:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648375296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429428.391335:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648375296:12345-0@lo:400:kworker.0 Request processed in 40us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429428.391341:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00080000:0.0:1789429428.391367:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429428.391371:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429428.392255:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648374656:0@lo:400:kworker.0 00000100:00100000:2.0:1789429428.392277:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648375168:0@lo:400:kworker.0 00000100:00100000:2.0:1789429428.392288:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648375040:0@lo:400:kworker.0 00000100:00100000:2.0:1789429428.392329:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648374784:0@lo:400:kworker.0 00000100:00100000:2.0:1789429428.392340:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648375296:0@lo:400:kworker.0 00010000:00010000:3.0:1789429428.451599:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789429428.527149:0:23602:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 19:43:47 (1789429427) 00000100:00100000:3.0:1789429428.760489:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429428.760627:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635039104 00000100:00100000:1.0:1789429428.760639:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635039104 00000100:00100000:1.0:1789429428.760707:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21211 00000100:00100000:1.0:1789429428.760716:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+13:39808:x1876351635039104:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:1.0:1789429428.760753:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429428.760756:0:15669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789429428.760783:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263611cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c58e expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.760800:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:1.0:1789429428.760813:0:15669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429428.760826:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361211 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5aa expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.761083:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.761098:0:15669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c572 expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.761107:0:15669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.761140:0:15669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c572 expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.761153:0:15669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c572 expref: 9 pid: 15669 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429428.761166:0:15669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648375424:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429428.761629:0:15669:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f32232840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429428.766774:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429428.766869:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635039232 00000100:00100000:0.0:1789429428.766879:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635039232 00010000:00010000:0.0:1789429428.766928:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c572 expref: 10 pid: 15669 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429428.766975:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6199 00000100:00100000:0.0:1789429428.766986:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351635039232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429428.767000:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429428.767007:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c572 expref: 10 pid: 15669 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429428.767022:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c572 expref: 10 pid: 15669 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429428.767044:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429428.767050:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429428.767076:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429428.767084:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429428.767106:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429428.767170:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351635039232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 186us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429428.767177:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6199 00010000:00010000:1.0:1789429428.767877:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361185 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c572 expref: 9 pid: 15669 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429428.767904:0:15669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648375424:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429428.767925:0:15669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.767934:0:15669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.767943:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.767964:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636121f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.767973:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636121f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.767982:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636121f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429428.773785:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x33:0x0], index 0: 0 00010000:00010000:1.0:1789429428.778426:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361226 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.778450:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.778463:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.778518:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.778524:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.778531:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.778537:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429428.778542:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.778550:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.778562:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd300) 00010000:00010000:1.0:1789429428.778565:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429428.778570:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.778576:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361218 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429428.778592:0:15669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004680323a reply state 00000000813c7830 transno 4294977160 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636121f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429428.778601:0:15669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429428.778643:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361211 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5aa expref: 15 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.778666:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5aa expref: 14 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.778674:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7e:0x0].0x0 (ffff946f2076a400) 00010000:00010000:1.0:1789429428.778677:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429428.778679:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6000, rc 0) 00000100:00100000:1.0:1789429428.778928:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+15:39808:x1876351635039104:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 18211us (18447us total) trans 4294977160 rc 0/0 00000100:00100000:1.0:1789429428.778937:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21211 00010000:00010000:2.0:1789429428.788174:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636121f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429428.788190:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636121f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429428.788227:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636121f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429428.788234:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429428.788240:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636121f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429428.788248:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636121f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429428.788264:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xacf77ab6 (ffff946f2076a500) 00010000:00010000:2.0:1789429428.788267:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429428.788272:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636121f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429428.788278:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad72636121f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429428.814927:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429428.817630:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635039360 00000100:00100000:1.0:1789429428.817645:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635039360 00000100:00100000:1.0:1789429428.817719:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21212 00000100:00100000:1.0:1789429428.817730:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:39815:x1876351635039360:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:1.0:1789429428.817752:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429428.817778:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361234 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5b1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.817844:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636123b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.817859:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636123b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.817870:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636123b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429428.818038:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429428.818043:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429428.818134:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636123b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.818159:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad726361234 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5b1 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.818178:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636123b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5b1 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.818185:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a000) 00010000:00010000:1.0:1789429428.818188:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429428.818192:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6600, rc 0) 00000100:00100000:1.0:1789429428.819005:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:39815:x1876351635039360:12345-192.168.203.39@tcp:101:touch.0 Request processed in 1272us (4083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429428.819015:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21212 00000100:00100000:3.0:1789429428.830184:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429428.836631:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635039616 00000100:00100000:2.0:1789429428.836646:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635039616 00000100:00100000:3.0:1789429428.837591:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21213 00000100:00100000:3.0:1789429428.837604:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:39815:x1876351635039616:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:3.0:1789429428.837624:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429428.837628:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789429428.837655:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636123b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5b1 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.837674:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076a000) 00010000:00010000:3.0:1789429428.837690:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429428.837716:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad726361242 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5b8 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838100:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361249 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838115:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838125:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838143:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361250 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838149:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838155:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838307:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838315:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838322:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838416:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361249 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838424:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361249 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838429:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361249 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838435:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429428.838439:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361249 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838449:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361249 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838458:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640500) 00010000:00010000:3.0:1789429428.838461:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429428.838464:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361249 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838469:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361249 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838478:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838483:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361250 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838489:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361250 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838494:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429428.838496:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361250 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838501:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361250 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838507:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xacf77ab6 (ffff946f08640e00) 00010000:00010000:3.0:1789429428.838510:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429428.838512:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361250 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838520:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361250 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838556:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad726361242 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5b8 expref: 12 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838570:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5b8 expref: 11 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.838576:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7e:0x0].0x0 (ffff946f2076a400) 00010000:00010000:3.0:1789429428.838578:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429428.838581:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:3.0:1789429428.838651:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:39815:x1876351635039616:12345-192.168.203.39@tcp:101:touch.0 Request processed in 1050us (8476us total) trans 4294977161 rc 0/0 00000100:00100000:3.0:1789429428.838659:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21213 00000100:00100000:0.0:1789429428.841781:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429428.841911:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635039872 00000100:00100000:2.0:1789429428.841921:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635039872 00000100:00100000:2.0:1789429428.841980:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21214 00000100:00100000:2.0:1789429428.841990:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:39815:x1876351635039872:12345-192.168.203.39@tcp:36:touch.0 00010000:00010000:2.0:1789429428.842046:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429428.842138:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5b8 expref: 11 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429428.842158:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7e:0x0].0x0 (ffff946f2076a400) 00010000:00010000:2.0:1789429428.842163:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429428.842238:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429428.842251:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361226 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5aa expref: 13 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429428.842261:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429428.842292:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5aa expref: 13 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429428.842317:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361226 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5aa expref: 13 pid: 15669 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429428.842330:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648375552:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429428.842414:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e02408d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429428.844662:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648375552:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429428.844697:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429428.845101:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429428.845165:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635040000 00000100:00100000:3.0:1789429428.845172:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635040000 00010000:00010000:3.0:1789429428.845235:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361226 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5aa expref: 14 pid: 15669 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429428.845265:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6200 00000100:00100000:3.0:1789429428.845274:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+14:2370:x1876351635040000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429428.845288:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429428.845303:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361226 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5aa expref: 14 pid: 15669 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.845321:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5aa expref: 14 pid: 15669 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.845339:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361226 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5aa expref: 14 pid: 15669 timeout: 1226 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.845354:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7e:0x0].0x0 (ffff946f2076a400) 00010000:00010000:3.0:1789429428.845359:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.845368:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.845375:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.845405:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429428.845447:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+13:2370:x1876351635040000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 174us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429428.845454:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6200 00010000:00010000:1.0:1789429428.845539:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.845546:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429428.845697:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ae1eb092 reply state 000000000988ac93 transno 4294977162 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429428.845706:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429428.845776:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:39815:x1876351635039872:12345-192.168.203.39@tcp:36:touch.0 Request processed in 3787us (4003us total) trans 4294977162 rc 0/0 00000100:00100000:1.0:1789429428.845783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21214 00000100:00100000:1.0:1789429428.852102:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1789429428.852321:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429428.852334:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429428.852343:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429428.852348:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429428.852353:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429428.852360:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429428.852377:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7e:0x0].0x0 (ffff946f2076a400) 00010000:00010000:0.0:1789429428.852379:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429428.852384:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429428.852390:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361265 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429428.852581:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635040128 00000100:00100000:3.0:1789429428.852592:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635040128 00000100:00100000:3.0:1789429428.852645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21215 00000100:00100000:3.0:1789429428.852656:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:39815:x1876351635040128:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:3.0:1789429428.852687:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429428.852705:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636126c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5bf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.852770:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636126c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5bf expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.852783:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636126c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5bf expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429428.852801:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7e:0x0].0x0 (ffff946f08640500) 00010000:00010000:3.0:1789429428.852804:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789429428.852807:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0400, rc 0) 00000100:00100000:3.0:1789429428.852858:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:39815:x1876351635040128:12345-192.168.203.39@tcp:101:touch.0 Request processed in 204us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429428.852866:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21215 00000100:00100000:0.0:1789429428.858773:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429428.858984:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635040256 00000100:00100000:1.0:1789429428.858995:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635040256 00000100:00100000:1.0:1789429428.859055:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5792 00000100:00100000:1.0:1789429428.859077:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:39815:x1876351635040256:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:1.0:1789429428.859096:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429428.859119:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726361273 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5c6 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429428.859149:0:20745:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789429428.859170:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=1126s v=(0 0) 00010000:00010000:1.0:1789429428.859176:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429428.859185:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726361273 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5c6 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.859232:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726361273 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5c6 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429428.859245:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6200, rc 0) 00000100:00100000:1.0:1789429428.859316:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:39815:x1876351635040256:12345-192.168.203.39@tcp:101:touch.0 Request processed in 252us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429428.859323:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5792 00000100:00100000:0.0:1789429428.861515:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429428.861583:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635040384 00000100:00100000:3.0:1789429428.861591:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635040384 00000100:00100000:3.0:1789429428.861642:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5793 00000100:00100000:3.0:1789429428.861651:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635040384:12345-192.168.203.39@tcp:2:touch.0 00002000:00010000:3.0:1789429428.861941:0:13238:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x33:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789429428.861945:0:13238:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x33:0x0] updating lvb mtime from disk: 0 -> 978261179 00002000:00010000:3.0:1789429428.861948:0:13238:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x33:0x0] updating lvb atime from disk: 0 -> 978261179 00002000:00010000:3.0:1789429428.861950:0:13238:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x33:0x0] updating lvb ctime from disk: 0 -> 1789429429 00002000:00010000:3.0:1789429428.861952:0:13238:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x33:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789429428.862010:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635040384:12345-192.168.203.39@tcp:2:touch.0 Request processed in 360us (503us total) trans 4294969268 rc 0/0 00000100:00100000:3.0:1789429428.862017:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5793 00000100:00100000:2.0:1789429428.866464:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429428.866759:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635040640 00000100:00100000:3.0:1789429428.866770:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635040640 00000100:00100000:3.0:1789429428.866890:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 261 00000100:00100000:3.0:1789429428.866907:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:39815:x1876351635040640:12345-192.168.203.39@tcp:35:touch.0 00000100:00100000:3.0:1789429428.867286:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:39815:x1876351635040640:12345-192.168.203.39@tcp:35:touch.0 Request processed in 380us (831us total) trans 4294977163 rc 0/0 00000100:00100000:3.0:1789429428.867295:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 261 00000100:00100000:1.0:1789429428.871521:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429428.871670:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635040896 00000100:00100000:3.0:1789429428.871681:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635040896 00000100:00100000:3.0:1789429428.871781:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 262 00000100:00100000:3.0:1789429428.871792:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:39808:x1876351635040896:12345-192.168.203.39@tcp:35:multiop.0 00000100:00100000:3.0:1789429428.872040:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:39808:x1876351635040896:12345-192.168.203.39@tcp:35:multiop.0 Request processed in 249us (528us total) trans 4294977164 rc 0/0 00000100:00100000:3.0:1789429428.872047:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 262 00000100:00100000:3.0:1789429428.899550:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789429428.899575:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648375680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429428.899642:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429428.899730:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648375680 00000100:00100000:0.0:1789429428.899738:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648375680 00000100:00100000:0.0:1789429428.899795:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789429428.899809:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648375808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429428.899814:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648375680:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429428.899845:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789429428.899850:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47382528 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1789429428.899891:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648375808 00000100:00100000:2.0:1789429428.899897:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648375808 00000100:00100000:0.0:1789429428.899916:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648375680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429428.899922:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1789429428.899934:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789429428.899935:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648375808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429428.899959:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429428.899986:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648375680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429428.900000:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648375808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429428.900017:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789429428.900055:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648375808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789429429.475327:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429429.914374:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429429.914461:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635041024 00000100:00100000:2.0:1789429429.914472:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635041024 00000100:00100000:2.0:1789429429.914557:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21216 00000100:00100000:2.0:1789429429.914568:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+14:39818:x1876351635041024:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:2.0:1789429429.914591:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429429.914612:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad72636127a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5cd expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429429.914673:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361281 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429429.914687:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429429.914698:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429429.914747:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429429.914752:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429429.914772:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361281 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429429.915089:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad72636127a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5cd expref: 16 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429429.915181:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361281 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5cd expref: 15 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429429.915191:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef400) 00010000:00010000:2.0:1789429429.915194:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429429.915250:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547400, rc 0) 00000100:00100000:2.0:1789429429.915313:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+15:39818:x1876351635041024:12345-192.168.203.39@tcp:101:stat.0 Request processed in 747us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429429.915320:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21216 00000100:00080000:0.0:1789429429.920438:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429429.927343:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429429.927445:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635041152 00000100:00100000:1.0:1789429429.927456:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635041152 00000100:00100000:1.0:1789429429.927517:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21217 00000100:00100000:1.0:1789429429.927527:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+15:39818:x1876351635041152:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:1.0:1789429429.927549:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429429.927570:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726361288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5d4 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927635:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636128f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927650:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636128f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927662:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636128f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927681:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361296 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927687:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927693:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927789:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636129d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927797:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636129d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927805:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636129d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429429.927838:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7e:0x0]: returning size 0 00000004:00200000:1.0:1789429429.927842:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429429.927861:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636129d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927873:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636129d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927892:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636128f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927899:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636128f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927910:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636128f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927915:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429429.927919:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636128f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927926:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636128f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927937:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef400) 00010000:00010000:1.0:1789429429.927940:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429429.927945:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636128f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927952:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad72636128f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927965:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927971:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361296 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927977:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927982:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429429.927984:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.927994:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361296 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.928000:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xacf77ab6 (ffff946f2076a900) 00010000:00010000:1.0:1789429429.928002:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429429.928005:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361296 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.928010:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361296 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.928251:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad726361288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5d4 expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.928268:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636129d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5d4 expref: 16 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429429.928276:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7e:0x0].0x0 (ffff946f08640500) 00010000:00010000:1.0:1789429429.928278:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429429.928281:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7800, rc 0) 00000100:00100000:1.0:1789429429.928343:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:39818:x1876351635041152:12345-192.168.203.39@tcp:101:stat.0 Request processed in 818us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429429.928350:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21217 00000100:00100000:1.0:1789429429.935554:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429429.935652:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635041280 00000100:00100000:0.0:1789429429.935663:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635041280 00000100:00100000:0.0:1789429429.935745:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5794 00000100:00100000:0.0:1789429429.935756:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635041280:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:0.0:1789429429.935774:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429429.935801:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000050ec1c3/0xb4c3dad7263612a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5db expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429429.935862:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e15184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8085:1876351648375936:192.168.203.39@tcp:106: 00000100:00100000:0.0:1789429429.935964:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03223540 going to sleep for 11 seconds 00000100:00080000:1.0:1789429429.936172:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429429.939938:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e15184380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8085:1876351648375936:192.168.203.39@tcp:106: 00010000:00010000:2.0:1789429429.939980:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000050ec1c3/0xb4c3dad7263612a4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5db expref: 7 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429429.940004:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000050ec1c3/0xb4c3dad7263612a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5db expref: 7 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429429.940017:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad000, rc 0) 00000100:00100000:2.0:1789429429.940105:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635041280:12345-192.168.203.39@tcp:101:stat.0 Request processed in 4350us (4559us total) trans 0 rc 301/301 00000100:00100000:2.0:1789429429.940115:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5794 00000100:00100000:3.0:1789429429.980607:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429429.980698:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635041408 00000100:00100000:2.0:1789429429.980709:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635041408 00000100:00100000:2.0:1789429429.980769:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5795 00000100:00100000:2.0:1789429429.980789:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635041408:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:2.0:1789429429.980810:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429429.980830:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad7263612ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5e2 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429429.980891:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876351648376064:192.168.203.39@tcp:106: 00000100:00100000:2.0:1789429429.980981:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e02408d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429429.988158:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1876351648376064:192.168.203.39@tcp:106: 00010000:00010000:2.0:1789429429.988234:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad7263612ab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5e2 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429429.988257:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad7263612ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5e2 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429429.988270:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546400, rc 0) 00000100:00100000:2.0:1789429429.988333:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635041408:12345-192.168.203.39@tcp:101:stat.0 Request processed in 7554us (7735us total) trans 0 rc 301/301 00000100:00100000:2.0:1789429429.988342:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5795 00000100:00100000:0.0:1789429430.033126:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429430.033230:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635041536 00000100:00100000:3.0:1789429430.033240:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635041536 00000100:00100000:3.0:1789429430.033310:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21218 00000100:00100000:3.0:1789429430.033319:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:39820:x1876351635041536:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:3.0:1789429430.033343:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429430.033364:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263612b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5e9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429430.033430:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429430.033444:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429430.033458:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429430.033493:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429430.033497:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429430.033517:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429430.033541:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263612b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5e9 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429430.033559:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5e9 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429430.033568:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef400) 00010000:00010000:3.0:1789429430.033571:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429430.033575:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00080000:1.0:1789429430.033742:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429430.033805:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:39820:x1876351635041536:12345-192.168.203.39@tcp:101:stat.0 Request processed in 487us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429430.033813:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21218 00000100:00100000:3.0:1789429430.040965:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429430.041193:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635041664 00000100:00100000:0.0:1789429430.041220:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635041664 00000100:00100000:0.0:1789429430.041276:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21219 00000100:00100000:0.0:1789429430.041284:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:39820:x1876351635041664:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:0.0:1789429430.041305:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429430.041324:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad7263612c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5f0 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041382:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041395:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041407:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041421:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263612ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041428:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263612ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041435:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263612ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041513:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad7263612d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041521:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad7263612d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041528:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad7263612d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429430.041557:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7e:0x0]: returning size 0 00000004:00200000:0.0:1789429430.041560:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429430.041575:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad7263612d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041585:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad7263612d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041593:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041603:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041609:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041615:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429430.041619:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041627:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041638:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef400) 00010000:00010000:0.0:1789429430.041641:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429430.041647:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041653:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041671:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263612ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041678:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263612ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041684:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263612ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041689:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429430.041692:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263612ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041699:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263612ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041705:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xacf77ab6 (ffff946f120fd900) 00010000:00010000:0.0:1789429430.041707:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429430.041710:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263612ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041716:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263612ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xacf77ab6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041742:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad7263612c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5f0 expref: 16 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041754:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad7263612d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5f0 expref: 15 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429430.041761:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7e:0x0].0x0 (ffff946f08640500) 00010000:00010000:0.0:1789429430.041764:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429430.041766:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac000, rc 0) 00000100:00100000:0.0:1789429430.041832:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:39820:x1876351635041664:12345-192.168.203.39@tcp:101:stat.0 Request processed in 548us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429430.041839:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21219 00010000:00010000:3.0:1789429430.499447:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429431.524462:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789429432.547141:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977162 is committed 00000001:00080000:1.0:1789429432.547157:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977160 is committed 00000001:00080000:1.0:1789429432.547168:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977164 is committed 00000001:00080000:1.0:1789429432.547176:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977163 is committed 00010000:00010000:3.0:1789429432.547335:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429433.114545:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429433.114595:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429433.114627:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429433.114652:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429433.114670:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429433.114686:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429433.114709:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429433.114735:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635042304 00000100:00100000:3.0:1789429433.114744:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635042304 00000100:00100000:3.0:1789429433.114800:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635041920 00000100:00100000:3.0:1789429433.114804:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635041920 00000100:00100000:3.0:1789429433.114827:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 828 00000100:00100000:3.0:1789429433.114836:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2368:x1876351635042304:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429433.114908:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2368:x1876351635042304:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 72us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429433.114915:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 828 00000100:00100000:3.0:1789429433.114936:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 829 00000100:00100000:3.0:1789429433.114942:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+14:2368:x1876351635041920:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429433.114968:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+14:2368:x1876351635041920:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429433.114974:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 829 00000100:00100000:3.0:1789429433.114993:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635042048 00000100:00100000:3.0:1789429433.114997:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635042048 00000100:00100000:3.0:1789429433.115020:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635042560 00000100:00100000:3.0:1789429433.115023:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635042560 00000100:00100000:3.0:1789429433.115050:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635042176 00000100:00100000:3.0:1789429433.115054:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635042176 00000100:00100000:3.0:1789429433.115070:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635042432 00000100:00100000:3.0:1789429433.115072:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635042432 00000100:00100000:3.0:1789429433.115091:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 858 00000100:00100000:3.0:1789429433.115096:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635042048:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429433.115129:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635042048:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429433.115136:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 858 00000100:00100000:3.0:1789429433.115151:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 859 00000100:00100000:3.0:1789429433.115158:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635042560:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429433.115185:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635042560:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (532us total) trans 0 rc 0/0 00000100:00080000:1.0:1789429433.115188:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429433.115193:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 859 00000100:00080000:1.0:1789429433.115194:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429433.115222:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429433.115242:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 860 00000100:00100000:3.0:1789429433.115249:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635042176:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429433.115272:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635042176:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429433.115278:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 860 00000100:00100000:3.0:1789429433.115289:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 861 00000100:00100000:3.0:1789429433.115295:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351635042432:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429433.115317:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351635042432:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429433.115323:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 861 00000100:00100000:2.0:1789429433.116446:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635041792 00000100:00100000:2.0:1789429433.116454:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635041792 00000100:00100000:2.0:1789429433.116556:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 579 00000100:00100000:2.0:1789429433.116569:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635041792:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429433.116616:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635041792:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 52us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429433.116624:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 579 00000100:00100000:2.0:1789429433.508191:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648376192:0@lo:400:kworker.0 00000100:00100000:2.0:1789429433.508287:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429433.510850:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648376192 00000100:00100000:1.0:1789429433.510863:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648376192 00000100:00100000:1.0:1789429433.510909:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1789429433.510916:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648376192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.511413:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648376320:0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.511456:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429433.511502:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648376320 00000100:00100000:3.0:1789429433.511506:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648376320 00000100:00100000:3.0:1789429433.511552:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:3.0:1789429433.511560:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648376320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.511598:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648376320:12345-0@lo:400:kworker.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429433.511605:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:3.0:1789429433.511660:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b320e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648376320:0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.511696:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648376448:0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.511720:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429433.511748:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648376448 00000100:00100000:3.0:1789429433.511752:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648376448 00000100:00100000:3.0:1789429433.511783:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1789429433.511789:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648376448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.511823:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1876351648376448:12345-0@lo:400:kworker.0 Request processed in 34us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429433.511829:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1789429433.511853:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3299:1876351648376448:0@lo:400:kworker.0 00000100:00080000:3.0:1789429433.511870:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429433.516216:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648376192:12345-0@lo:400:kworker.0 Request processed in 5278us (7907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429433.516241:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:3.0:1789429433.518083:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648376576:0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.518145:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429433.518193:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648376576 00000100:00100000:3.0:1789429433.518219:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648376576 00000100:00100000:3.0:1789429433.518287:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1789429433.518295:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648376576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.518348:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648376576:12345-0@lo:400:kworker.0 Request processed in 54us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429433.518355:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1789429433.518393:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648376576:0@lo:400:kworker.0 00000100:00080000:3.0:1789429433.518417:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429433.518448:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429433.518455:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648376704:0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.518483:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429433.518509:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648376704 00000100:00100000:3.0:1789429433.518512:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648376704 00000100:00100000:3.0:1789429433.518556:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1789429433.518562:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648376704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.518598:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648376704:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429433.518604:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1789429433.518641:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01275500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648376704:0@lo:400:kworker.0 00000100:00080000:3.0:1789429433.518660:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429433.518687:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e1030bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648376832:0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.518711:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429433.518745:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648376832 00000100:00100000:3.0:1789429433.518749:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648376832 00000100:00100000:3.0:1789429433.518780:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:3.0:1789429433.518786:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648376832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429433.518821:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648376832:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429433.518827:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:3.0:1789429433.518854:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e1030bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648376832:0@lo:400:kworker.0 00000100:00080000:3.0:1789429433.518866:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429433.523614:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648376192:0@lo:400:kworker.0 00010000:00010000:0.0:1789429433.572361:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789429433.610637:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969268 is committed 00000100:00100000:3.0:1789429434.021532:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e1030bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648376960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429434.021632:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429434.021725:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648376960 00000100:00100000:3.0:1789429434.021736:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648376960 00000100:00100000:3.0:1789429434.021796:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789429434.021805:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648376960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429434.021868:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47382528 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1789429434.021921:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648376960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429434.021929:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789429434.021991:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e1030bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648376960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429434.023578:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429434.023601:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e1030bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648377088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429434.023669:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429434.023786:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648377088 00000100:00100000:3.0:1789429434.023796:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648377088 00000100:00100000:3.0:1789429434.023849:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789429434.023957:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648377088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429434.023996:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429434.024071:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648377088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429434.024133:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e1030bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648377088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429434.031302:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00010000:00010000:3.0:1789429434.595344:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429435.622705:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789429436.015604:0:23799:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_27 skipping excluded test 27 00010000:00010000:3.0:1789429436.645761:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789429437.337559:0:23847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 30: recreate file race =================== 19:43:56 (1789429436) 00010000:00010000:0.0:1789429437.667897:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429437.778184:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429437.778522:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635042816 00000100:00100000:0.0:1789429437.778534:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635042816 00000100:00080000:3.0:1789429437.778721:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429437.778757:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21220 00000100:00100000:0.0:1789429437.778771:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+14:40527:x1876351635042816:12345-192.168.203.39@tcp:36:mkdir.0 00010000:00010000:0.0:1789429437.778827:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429437.778854:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361281 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5cd expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.778875:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef400) 00010000:00010000:0.0:1789429437.778880:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429437.779090:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.779168:0:15700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5e9 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.779178:0:15700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.779409:0:15700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5e9 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.779424:0:15700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5e9 expref: 11 pid: 5839 timeout: 1235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429437.779438:0:15700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648377216:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429437.779529:0:15700:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f030a3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429437.789806:0:15700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648377216:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429437.789846:0:15700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429437.791237:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429437.791324:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635042944 00000100:00100000:1.0:1789429437.791334:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635042944 00010000:00010000:1.0:1789429437.791397:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5e9 expref: 12 pid: 5839 timeout: 1235 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429437.791439:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6201 00000100:00100000:1.0:1789429437.791449:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351635042944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429437.791464:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429437.791472:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5e9 expref: 12 pid: 5839 timeout: 1235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.791485:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5e9 expref: 12 pid: 5839 timeout: 1235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.791506:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad7263612b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5e9 expref: 12 pid: 5839 timeout: 1235 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.791528:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef400) 00010000:00010000:1.0:1789429437.791533:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.791543:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.791550:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.791580:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429437.791640:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2370:x1876351635042944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 192us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429437.791647:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6201 00000100:00080000:3.0:1789429437.791687:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789429437.792024:0:15700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.792034:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.792103:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263612e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x88709611 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.792114:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263612e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.792123:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263612e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429437.793433:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7f:0x0]: returning size 16384 00010000:00010000:0.0:1789429437.793447:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.793455:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.793463:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.793469:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ade00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429437.793473:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.793482:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.793495:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef400) 00010000:00010000:0.0:1789429437.793498:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429437.793503:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.793509:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612dc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429437.793526:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b25e5061 reply state 00000000561efdf6 transno 4294977165 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263612e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429437.793535:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429437.793620:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+15:40527:x1876351635042816:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 14851us (15445us total) trans 4294977165 rc 0/0 00000100:00100000:0.0:1789429437.793628:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21220 00010000:00010000:2.0:1789429437.799404:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263612e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.799422:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263612e3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.799431:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263612e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.799437:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ace00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429437.799441:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263612e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.799449:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263612e3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.799464:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x88709611 (ffff946f120fd900) 00010000:00010000:2.0:1789429437.799468:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429437.799473:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263612e3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.799480:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263612e3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429437.812506:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429437.812910:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635043072 00000100:00100000:3.0:1789429437.812920:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635043072 00000100:00100000:3.0:1789429437.812979:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21221 00000100:00100000:3.0:1789429437.812990:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+14:40530:x1876351635043072:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:3.0:1789429437.813034:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429437.813059:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263612ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5f7 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.813121:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263612f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.813132:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263612f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.813143:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263612f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429437.813176:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429437.813180:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429437.813235:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263612f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.813270:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263612ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5f7 expref: 16 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.813289:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263612f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5f7 expref: 15 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.813302:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640700) 00010000:00010000:3.0:1789429437.813305:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429437.813309:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:3.0:1789429437.813369:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+15:40530:x1876351635043072:12345-192.168.203.39@tcp:101:cp.0 Request processed in 381us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429437.813376:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21221 00000100:00100000:3.0:1789429437.818617:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429437.818702:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635043200 00000100:00100000:0.0:1789429437.818712:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635043200 00000100:00100000:0.0:1789429437.818771:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21222 00000100:00100000:0.0:1789429437.818781:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:40530:x1876351635043200:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:0.0:1789429437.818801:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429437.818822:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c5fe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.818909:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.818927:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.818938:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.818955:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361306 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.818962:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.818969:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.819184:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad72636130d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.819193:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad72636130d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.819359:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad72636130d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429437.824404:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7f:0x0]: returning size 16384 00000004:00200000:1.0:1789429437.824414:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429437.824451:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad72636130d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824471:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824478:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824485:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824491:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429437.824496:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824503:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824518:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640700) 00010000:00010000:1.0:1789429437.824521:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429437.824525:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824532:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263612ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824549:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824555:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361306 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824560:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361306 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824565:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429437.824567:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361306 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824573:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361306 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824580:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x88709611 (ffff946f120fd800) 00010000:00010000:1.0:1789429437.824582:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429437.824585:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361306 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824591:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361306 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824632:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263612f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5fe expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824649:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad72636130d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5fe expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.824656:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:1.0:1789429437.824659:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789429437.824661:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac600, rc 0) 00000100:00100000:1.0:1789429437.824805:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+16:40530:x1876351635043200:12345-192.168.203.39@tcp:101:cp.0 Request processed in 6025us (6196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429437.824815:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21222 00000100:00100000:2.0:1789429437.840890:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429437.840991:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635043328 00000100:00100000:3.0:1789429437.841011:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635043328 00000100:00100000:3.0:1789429437.841074:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21223 00000100:00100000:3.0:1789429437.841085:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+16:40530:x1876351635043328:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:3.0:1789429437.841106:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429437.841125:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361314 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c605 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841197:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636131b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841251:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636131b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841479:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636131b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841497:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361322 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841504:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841512:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841565:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636131b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841573:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636131b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841580:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636131b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841586:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429437.841589:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636131b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841596:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636131b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841606:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:3.0:1789429437.841609:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429437.841614:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636131b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841621:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636131b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841633:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841639:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361322 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841646:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841651:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429437.841653:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841659:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361322 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841666:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0xb7a3866f (ffff946f08640100) 00010000:00010000:3.0:1789429437.841668:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429437.841671:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361322 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841676:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361322 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841712:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361314 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c605 expref: 17 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841721:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:3.0:1789429437.841724:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429437.841727:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361314 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c605 expref: 17 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.841736:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:3.0:1789429437.841794:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+16:40530:x1876351635043328:12345-192.168.203.39@tcp:101:cp.0 Request processed in 711us (913us total) trans 0 rc 301/301 00000100:00100000:3.0:1789429437.841806:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21223 00000100:00100000:3.0:1789429437.856109:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429437.856226:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635043456 00000100:00100000:0.0:1789429437.856237:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635043456 00000100:00100000:0.0:1789429437.856313:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21224 00000100:00100000:0.0:1789429437.856323:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:40530:x1876351635043456:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:0.0:1789429437.856343:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429437.856365:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361329 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c60c expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856430:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726361330 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856443:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726361330 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856455:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726361330 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856470:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361337 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856477:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856484:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856537:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726361330 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856545:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726361330 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856552:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726361330 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856558:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429437.856563:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726361330 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856575:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726361330 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856587:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:0.0:1789429437.856590:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429437.856595:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726361330 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856601:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad726361330 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856613:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856620:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361337 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856627:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856632:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429437.856635:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856640:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361337 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856647:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0xb7a3866f (ffff946f120fd500) 00010000:00010000:0.0:1789429437.856649:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429437.856651:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361337 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856658:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361337 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856687:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361329 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c60c expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856697:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:0.0:1789429437.856699:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429437.856703:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361329 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c60c expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.856712:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429437.856777:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:40530:x1876351635043456:12345-192.168.203.39@tcp:101:cp.0 Request processed in 455us (678us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429437.856784:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21224 00000100:00100000:0.0:1789429437.885577:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429437.885720:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635043712 00000100:00100000:3.0:1789429437.885731:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635043712 00000100:00100000:3.0:1789429437.885792:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21225 00000100:00100000:3.0:1789429437.885801:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:40530:x1876351635043712:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:3.0:1789429437.885821:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429437.885843:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636133e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c613 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.885949:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361345 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.885964:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.885976:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.885992:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636134c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.886010:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636134c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.886017:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636134c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789429437.886678:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x32:0x0], index 1: 0 00010000:00010000:3.0:1789429437.886834:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361353 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x80:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.886846:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.886854:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.886887:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361345 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.886895:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361345 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.886901:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.886907:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429437.886912:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361345 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.886919:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361345 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.886930:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:3.0:1789429437.886933:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429437.886938:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361345 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.886944:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361345 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429437.886955:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000036ea66b0 reply state 0000000015511805 transno 4294977166 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636134c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429437.886964:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789429437.886994:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636133e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c613 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.887022:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c613 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429437.887030:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x80:0x0].0x0 (ffff946f08640b00) 00010000:00010000:3.0:1789429437.887032:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429437.887035:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0800, rc 0) 00000100:00100000:3.0:1789429437.887100:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:40530:x1876351635043712:12345-192.168.203.39@tcp:101:cp.0 Request processed in 1299us (1532us total) trans 4294977166 rc 0/0 00000100:00100000:3.0:1789429437.887108:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21225 00000100:00100000:2.0:1789429437.894323:0:8083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8083:1876351648377344:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789429437.894394:0:8083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429437.894461:0:8083:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789429437.896666:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648377344 00000100:00100000:3.0:1789429437.896679:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648377344 00000100:00100000:3.0:1789429437.896750:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5796 00000100:00100000:3.0:1789429437.896760:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:8083:x1876351648377344:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789429437.896810:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00080000:0.0:1789429437.896907:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429437.898736:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1789429437.898831:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636134c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.898854:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636134c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.898863:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636134c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.898869:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429437.898874:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636134c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.898882:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636134c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.898897:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0xb7a3866f (ffff946f08640100) 00010000:00010000:0.0:1789429437.898900:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429437.898905:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636134c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429437.898911:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636134c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429437.906524:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635043840 00000100:00100000:1.0:1789429437.906541:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635043840 00000100:00100000:1.0:1789429437.906623:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5797 00000100:00100000:1.0:1789429437.906633:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635043840:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:1.0:1789429437.906651:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429437.906671:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095a0deb0/0xb4c3dad726361361 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c61a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429437.906698:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789429437.906718:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=1135s v=(0 0) 00010000:00010000:1.0:1789429437.906724:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429437.906733:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095a0deb0/0xb4c3dad726361361 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c61a expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.906750:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000095a0deb0/0xb4c3dad726361361 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c61a expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429437.906763:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6600, rc 0) 00000100:00100000:1.0:1789429437.906830:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635043840:12345-192.168.203.39@tcp:101:cp.0 Request processed in 197us (8099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429437.906838:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5797 00000100:00080000:0.0:1789429437.906992:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429437.927420:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429437.930972:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635043968 00000100:00100000:2.0:1789429437.930984:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635043968 00000100:00100000:2.0:1789429437.931050:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5798 00000100:00100000:2.0:1789429437.931061:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+7:40530:x1876351635043968:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:2.0:1789429437.931079:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429437.931097:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c621 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.931130:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095a0deb0/0xb4c3dad726361361 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c61a expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.931139:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429437.931143:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429437.931149:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->1150975] (req 0->1150975) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.931413:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095a0deb0/0xb4c3dad726361361 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c61a expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.931431:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095a0deb0/0xb4c3dad726361361 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c61a expref: 8 pid: 6682 timeout: 1235 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429437.931445:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648377472:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429437.931539:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e038650c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429437.933737:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c08c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:8083:x1876351648377344:12345-0@lo:5:osp-pre-1-0.0 Request processed in 36973us (39337us total) trans 4294969601 rc 0/0 00000100:00100000:3.0:1789429437.933749:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5796 00000100:00100000:2.0:1789429437.934167:0:8083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8083:1876351648377344:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789429437.934192:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x32:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1789429437.935933:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648377472:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429437.935964:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->1150975] (req 0->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.935984:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546800, rc 0) 00000100:00100000:2.0:1789429437.936044:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+8:40530:x1876351635043968:12345-192.168.203.39@tcp:101:cp.0 Request processed in 4985us (8630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429437.936054:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5798 00000100:00100000:0.0:1789429437.936760:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429437.936829:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635044096 00000100:00100000:2.0:1789429437.936841:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635044096 00010000:00010000:2.0:1789429437.936871:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095a0deb0/0xb4c3dad726361361 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c61a expref: 8 pid: 6682 timeout: 1235 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429437.936907:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6202 00000100:00100000:2.0:1789429437.936916:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635044096:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429437.936932:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429437.936953:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095a0deb0/0xb4c3dad726361361 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c61a expref: 8 pid: 6682 timeout: 1235 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.936966:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095a0deb0/0xb4c3dad726361361 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c61a expref: 8 pid: 6682 timeout: 1235 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.936988:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095a0deb0/0xb4c3dad726361361 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c61a expref: 8 pid: 6682 timeout: 1235 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.937009:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429437.937015:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429437.937023:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.937033:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429437.937064:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429437.937078:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648377600:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429437.937144:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e038650c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429437.948608:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11354:1876351648377600:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429437.948635:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429437.948685:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635044096:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11769us (11926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429437.948697:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6202 00000100:00100000:1.0:1789429437.990965:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429437.991019:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429437.991105:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635044224 00000100:00100000:2.0:1789429437.991115:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635044224 00002000:00100000:2.0:1789429437.991164:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x32:0x0] (0->1048575) req@ffff946f3f8d8700 x1876351635044224/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:173/0 lens 488/0 e 0 to 0 dl 1789429448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429437.991187:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8700 with x1876351635044224 ext(0->1048575) 00002000:00010000:2.0:1789429437.991194:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f8d8700 00000100:00100000:2.0:1789429437.991249:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11512 00000100:00100000:2.0:1789429437.991259:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635044224:12345-192.168.203.39@tcp:4:cp.0 00000100:00100000:0.0:1789429437.992352:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635044480 00000100:00100000:0.0:1789429437.992359:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635044480 00000100:00100000:0.0:1789429437.992403:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 263 00000100:00100000:0.0:1789429437.992413:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:40530:x1876351635044480:12345-192.168.203.39@tcp:35:cp.0 00000100:00100000:0.0:1789429437.992710:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:40530:x1876351635044480:12345-192.168.203.39@tcp:35:cp.0 Request processed in 298us (1763us total) trans 4294977167 rc 0/0 00000100:00100000:0.0:1789429437.992719:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 263 00000100:00100000:0.0:1789429438.042584:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429438.042682:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635044736 00000100:00100000:3.0:1789429438.042693:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635044736 00000100:00100000:3.0:1789429438.042759:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21226 00000100:00100000:3.0:1789429438.042769:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+19:40536:x1876351635044736:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1789429438.042794:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429438.042814:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636136f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c628 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429438.043025:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361376 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x80:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429438.043038:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361376 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x80:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429438.043051:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361376 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x80:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429438.043062:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x80:0x0]: returning size 1150584 00010000:00010000:3.0:1789429438.043178:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad72636136f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c628 expref: 22 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429438.043197:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361376 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x80:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c628 expref: 21 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429438.044981:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x80:0x0].0x0 (ffff946f08640b00) 00010000:00010000:3.0:1789429438.044985:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789429438.044988:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:2.0:1789429438.045478:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351635044224:12345-192.168.203.39@tcp:4:cp.0 Request processed in 54216us (54454us total) trans 4294969602 rc 0/0 00000100:00100000:2.0:1789429438.045491:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11512 00002000:00100000:2.0:1789429438.045502:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x32:0x0] (0->1048575) req@ffff946f3f8d8700 x1876351635044224/t4294969602(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:173/0 lens 488/448 e 0 to 0 dl 1789429448 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429438.045512:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8700 with x1876351635044224 ext(0->1048575) 00002000:00010000:2.0:1789429438.045517:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f3f8d8700 00000100:00100000:3.0:1789429438.052858:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+21:40536:x1876351635044736:12345-192.168.203.39@tcp:101:bash.0 Request processed in 10078us (10272us total) trans 4294977168 rc 0/0 00000100:00100000:3.0:1789429438.052873:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21226 00000100:00100000:0.0:1789429438.069768:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429438.069879:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635044864 00000100:00100000:3.0:1789429438.069893:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635044864 00000100:00100000:3.0:1789429438.069967:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21227 00000100:00100000:3.0:1789429438.069992:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+21:40536:x1876351635044864:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1789429438.070034:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429438.070061:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361384 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x80:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c62f expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429438.070105:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad72636138b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x80:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429438.070121:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad72636138b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429438.070135:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad72636138b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429438.070306:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361384 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x80:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c62f expref: 23 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429438.070329:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad72636138b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c62f expref: 22 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429438.070338:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x80:0x0].0x0 (ffff946f08640b00) 00010000:00010000:3.0:1789429438.070341:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789429438.070346:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1a00, rc 0) 00000100:00100000:3.0:1789429438.070414:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+22:40536:x1876351635044864:12345-192.168.203.39@tcp:101:bash.0 Request processed in 437us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429438.070421:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21227 00000100:00100000:1.0:1789429438.230664:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429438.231482:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635044992 00000100:00100000:2.0:1789429438.231498:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635044992 00000100:00100000:2.0:1789429438.231586:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 581 00000100:00100000:2.0:1789429438.231598:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635044992:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429438.231699:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635044992:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 104us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429438.231708:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 581 00000100:00100000:3.0:1789429438.231881:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429438.232280:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429438.232306:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635045376 00000100:00100000:3.0:1789429438.232310:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635045376 00000100:00100000:3.0:1789429438.232353:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 864 00000100:00100000:3.0:1789429438.232361:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351635045376:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429438.232406:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351635045376:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 46us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429438.232413:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 864 00000100:00100000:2.0:1789429438.232797:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635045120 00000100:00100000:2.0:1789429438.232802:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635045120 00000100:00100000:2.0:1789429438.232850:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 833 00000100:00100000:2.0:1789429438.232857:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+22:2370:x1876351635045120:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429438.232895:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+22:2370:x1876351635045120:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 39us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429438.232902:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 833 00000100:00100000:3.0:1789429438.235930:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429438.235978:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429438.236014:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429438.236070:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429438.236183:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635045248 00000100:00100000:2.0:1789429438.236195:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635045248 00000100:00100000:2.0:1789429438.236298:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635045760 00000100:00100000:2.0:1789429438.236302:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635045760 00000100:00100000:2.0:1789429438.236327:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635045632 00000100:00100000:2.0:1789429438.236330:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635045632 00000100:00100000:2.0:1789429438.236356:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 865 00000100:00100000:2.0:1789429438.236368:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635045248:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429438.236453:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635045248:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 86us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429438.236461:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 865 00000100:00100000:2.0:1789429438.236479:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 866 00000100:00100000:2.0:1789429438.236487:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635045760:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429438.236515:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635045760:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429438.236522:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 866 00000100:00100000:2.0:1789429438.236534:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 867 00000100:00100000:2.0:1789429438.236541:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635045632:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429438.236566:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635045632:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429438.236573:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 867 00000100:00100000:0.0:1789429438.238152:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635045504 00000100:00100000:0.0:1789429438.238168:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635045504 00000100:00100000:0.0:1789429438.238259:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 834 00000100:00100000:0.0:1789429438.238269:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2370:x1876351635045504:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429438.238347:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2370:x1876351635045504:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 78us (2367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429438.238354:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 834 00000100:00080000:3.0:1789429438.238461:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429438.238468:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429438.627690:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648377856:0@lo:400:kworker.0 00000100:00100000:1.0:1789429438.627783:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429438.627853:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648378368:0@lo:400:kworker.0 00000100:00100000:1.0:1789429438.627879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429438.627913:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789429438.627919:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648377984:0@lo:400:kworker.0 00000100:00100000:1.0:1789429438.627941:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429438.627978:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648377856 00000100:00100000:1.0:1789429438.627987:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648377856 00000100:00100000:1.0:1789429438.628051:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648377984 00000100:00100000:1.0:1789429438.628054:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648377984 00000100:00100000:1.0:1789429438.628088:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:1.0:1789429438.628099:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648377856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429438.628161:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648377856:12345-0@lo:400:kworker.0 Request processed in 65us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429438.628169:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:1.0:1789429438.628235:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:1.0:1789429438.628242:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648377984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429438.628271:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648377984:12345-0@lo:400:kworker.0 Request processed in 29us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429438.628276:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:1.0:1789429438.628297:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648378368 00000100:00100000:1.0:1789429438.628301:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648378368 00000100:00100000:1.0:1789429438.628325:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1789429438.628332:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648378368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429438.628364:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648378368:12345-0@lo:400:kworker.0 Request processed in 32us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429438.628370:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00080000:1.0:1789429438.628388:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429438.628425:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648377984:0@lo:400:kworker.0 00000100:00100000:1.0:1789429438.628435:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648377856:0@lo:400:kworker.0 00000100:00100000:1.0:1789429438.628443:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648378368:0@lo:400:kworker.0 00000100:00100000:0.0:1789429438.628548:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648377728:0@lo:400:kworker.0 00000100:00100000:0.0:1789429438.628589:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429438.628621:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648378240:0@lo:400:kworker.0 00000100:00100000:0.0:1789429438.628646:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429438.628666:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429438.628673:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648378112:0@lo:400:kworker.0 00000100:00100000:0.0:1789429438.628696:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429438.628724:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648378112 00000100:00100000:0.0:1789429438.628728:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648378112 00000100:00100000:0.0:1789429438.628763:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1789429438.628769:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648378112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429438.628802:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648378112:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429438.628808:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00080000:0.0:1789429438.628824:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429438.628842:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648378112:0@lo:400:kworker.0 00000100:00100000:0.0:1789429438.628862:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648378240 00000100:00100000:0.0:1789429438.628865:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648378240 00000100:00100000:0.0:1789429438.628893:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:0.0:1789429438.628899:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648378240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429438.628934:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876351648378240:12345-0@lo:400:kworker.0 Request processed in 36us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429438.628942:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00080000:0.0:1789429438.628955:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429438.628971:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3301:1876351648378240:0@lo:400:kworker.0 00000100:00100000:1.0:1789429438.629325:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648377728 00000100:00100000:1.0:1789429438.629330:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648377728 00000100:00100000:1.0:1789429438.629411:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1789429438.629420:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648377728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429438.629513:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3301:x1876351648377728:12345-0@lo:400:kworker.0 Request processed in 95us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429438.629524:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1789429438.635507:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3301:1876351648377728:0@lo:400:kworker.0 00010000:00010000:3.0:1789429438.691516:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429439.094838:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429439.094932:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635045888 00000100:00100000:1.0:1789429439.094944:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635045888 00000100:00100000:1.0:1789429439.095041:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21228 00000100:00100000:1.0:1789429439.095053:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:40539:x1876351635045888:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:1.0:1789429439.095071:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429439.095094:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361392 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c636 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.095176:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.095191:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.095243:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429439.095278:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429439.095281:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429439.095299:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.095330:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad726361392 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c636 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.095348:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c636 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.095361:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640700) 00010000:00010000:1.0:1789429439.095364:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429439.095368:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6c00, rc 0) 00000100:00100000:1.0:1789429439.095424:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:40539:x1876351635045888:12345-192.168.203.39@tcp:101:rm.0 Request processed in 374us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429439.095430:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21228 00000100:00080000:0.0:1789429439.095762:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429439.101545:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429439.103909:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635046016 00000100:00100000:1.0:1789429439.103923:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635046016 00000100:00100000:1.0:1789429439.104101:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21229 00000100:00100000:1.0:1789429439.104112:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:40539:x1876351635046016:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:1.0:1789429439.104133:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429439.104165:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c63d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104244:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263613a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104259:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263613a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104280:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263613a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104296:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104304:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104316:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104404:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad7263613b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104413:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad7263613b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104420:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad7263613b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429439.104445:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7f:0x0]: returning size 16384 00000004:00200000:1.0:1789429439.104449:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429439.104477:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad7263613b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104489:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263613a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104496:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263613a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104504:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263613a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104511:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429439.104515:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263613a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104523:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263613a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104535:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640700) 00010000:00010000:1.0:1789429439.104538:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429439.104543:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263613a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104548:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad7263613a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104559:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104566:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104572:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104578:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429439.104581:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104587:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104595:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x88709611 (ffff946f2076a600) 00010000:00010000:1.0:1789429439.104597:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429439.104600:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104606:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x88709611 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104811:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c63d expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104834:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad7263613b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c63d expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.104842:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:1.0:1789429439.104845:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789429439.104848:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6e00, rc 0) 00000100:00100000:1.0:1789429439.104913:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:40539:x1876351635046016:12345-192.168.203.39@tcp:101:rm.0 Request processed in 803us (3377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429439.104920:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21229 00000100:00100000:2.0:1789429439.109358:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429439.109452:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635046144 00000100:00100000:0.0:1789429439.109462:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635046144 00000100:00100000:0.0:1789429439.109550:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21230 00000100:00100000:0.0:1789429439.109561:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:40539:x1876351635046144:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:0.0:1789429439.109582:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429439.109605:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263613bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c644 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.109680:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263613c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.109694:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263613c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.109705:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263613c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.109721:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263613ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.109738:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263613ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.109751:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263613ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.109950:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263613d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x80:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.109961:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263613d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.109969:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263613d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429439.110018:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x80:0x0]: returning size 1150584 00000004:00200000:0.0:1789429439.110022:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429439.110041:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263613d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110052:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263613d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110060:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263613c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110066:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263613c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110073:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263613c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110079:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2acc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429439.110083:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263613c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110092:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263613c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110102:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:0.0:1789429439.110106:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429439.110110:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263613c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110117:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263613c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110130:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263613ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110136:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263613ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110154:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263613ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110160:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429439.110163:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263613ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110169:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263613ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110177:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0xb7a3866f (ffff946f120fd500) 00010000:00010000:0.0:1789429439.110180:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429439.110183:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263613ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110194:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263613ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110257:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263613bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c644 expref: 15 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110280:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263613d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c644 expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.110289:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x80:0x0].0x0 (ffff946f08640b00) 00010000:00010000:0.0:1789429439.110291:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429439.110294:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:0.0:1789429439.110354:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:40539:x1876351635046144:12345-192.168.203.39@tcp:101:rm.0 Request processed in 795us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429439.110362:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21230 00000100:00100000:1.0:1789429439.114844:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429439.114878:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635046272 00000100:00100000:1.0:1789429439.114887:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635046272 00000100:00100000:1.0:1789429439.114945:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5799 00000100:00100000:1.0:1789429439.114954:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635046272:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:1.0:1789429439.114973:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429439.115010:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008601d168/0xb4c3dad7263613d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c64b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429439.115073:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648378496:192.168.203.39@tcp:106: 00000100:00100000:1.0:1789429439.115165:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0fb4d0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1789429439.118317:0:6682:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0x32:0x0] updating lvb size: 0 -> 1150584 00002000:00010000:1.0:1789429439.118326:0:6682:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x32:0x0] updating lvb mtime: 0 -> 1789429438 00002000:00010000:1.0:1789429439.118328:0:6682:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x32:0x0] updating lvb atime: 0 -> 1789429438 00002000:00010000:1.0:1789429439.118331:0:6682:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0x32:0x0] updating lvb ctime: 0 -> 1789429438 00000100:00100000:1.0:1789429439.118354:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1876351648378496:192.168.203.39@tcp:106: 00010000:00010000:1.0:1789429439.118391:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008601d168/0xb4c3dad7263613d8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c64b expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.118414:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008601d168/0xb4c3dad7263613d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c64b expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.118427:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6800, rc 0) 00000100:00100000:1.0:1789429439.118479:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635046272:12345-192.168.203.39@tcp:101:rm.0 Request processed in 3525us (3646us total) trans 0 rc 301/301 00000100:00100000:1.0:1789429439.118488:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5799 00000100:00100000:3.0:1789429439.125134:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429439.125297:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635046528 00000100:00100000:1.0:1789429439.125307:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635046528 00000100:00100000:1.0:1789429439.125365:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21231 00000100:00100000:1.0:1789429439.125376:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:40539:x1876351635046528:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:1.0:1789429439.125426:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429439.125453:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263613d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c644 expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125484:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x80:0x0].0x0 (ffff946f08640b00) 00010000:00010000:1.0:1789429439.125489:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429439.125513:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125527:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125542:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125557:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125564:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125572:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125896:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x80:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125908:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361353 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c613 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125917:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361376 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x80:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c628 expref: 21 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125924:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 5/0,1 mode: --/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125957:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361376 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x80:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c628 expref: 21 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.125971:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361376 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x80:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c628 expref: 21 pid: 15700 timeout: 1237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429439.126001:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648378624:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429439.126129:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c613 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.126225:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361353 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c613 expref: 21 pid: 5840 timeout: 1237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429439.126239:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648378752:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429439.126263:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0fb4d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429439.131803:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648378624:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429439.131824:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648378752:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429439.131852:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429439.134954:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429439.135043:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635046656 00000100:00100000:1.0:1789429439.135053:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635046656 00010000:00010000:1.0:1789429439.135111:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361353 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c613 expref: 22 pid: 5840 timeout: 1237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429439.135158:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6203 00000100:00100000:1.0:1789429439.135167:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351635046656:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429439.135182:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429439.135188:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361353 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c613 expref: 22 pid: 5840 timeout: 1237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.135242:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c613 expref: 22 pid: 5840 timeout: 1237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.135265:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361353 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x80:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c613 expref: 22 pid: 5840 timeout: 1237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.135291:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x80:0x0].0x0 (ffff946f08640b00) 00010000:00010000:1.0:1789429439.135297:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.135306:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.135314:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429439.135361:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+21:2369:x1876351635046656:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 195us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429439.135369:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6203 00000100:00080000:0.0:1789429439.135539:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429439.139542:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789429439.139565:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648378880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429439.139642:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429439.139690:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648378880 00000100:00100000:3.0:1789429439.139697:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648378880 00000100:00100000:3.0:1789429439.139748:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789429439.139757:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648378880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429439.139790:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52494336 pending 1703936 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429439.139839:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648378880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429439.139846:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00080000:3.0:1789429439.139866:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429439.139897:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648378880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429439.140150:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429439.140161:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648379008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429439.140192:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429439.140370:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648379008 00000100:00100000:2.0:1789429439.140375:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648379008 00000100:00100000:2.0:1789429439.140409:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789429439.140416:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648379008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429439.140435:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47382528 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1789429439.140471:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648379008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429439.140477:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1789429439.140545:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648379008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429439.145542:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429439.145668:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635046784 00000100:00100000:0.0:1789429439.145678:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635046784 00010000:00010000:0.0:1789429439.145717:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361376 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x80:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c628 expref: 21 pid: 15700 timeout: 1237 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429439.145757:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6204 00000100:00100000:0.0:1789429439.145767:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351635046784:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429439.145782:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429439.145789:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361376 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x80:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c628 expref: 21 pid: 15700 timeout: 1237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.145802:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361376 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x80:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c628 expref: 21 pid: 15700 timeout: 1237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.145833:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361376 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x80:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c628 expref: 21 pid: 15700 timeout: 1237 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.145848:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x80:0x0].0x0 (ffff946f08640b00) 00010000:00010000:0.0:1789429439.145854:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.145864:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.145873:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.145900:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429439.145949:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351635046784:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 183us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429439.145957:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6204 00010000:00010000:1.0:1789429439.146110:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146120:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429439.146699:0:5839:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x80:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1789429439.146790:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146799:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146807:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146826:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c7e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429439.146831:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146840:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146851:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x80:0x0].0x0 (ffff946f08640b00) 00010000:00010000:1.0:1789429439.146854:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789429439.146858:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146865:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x80:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146879:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146886:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146892:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146897:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429439.146901:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146911:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146918:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:1.0:1789429439.146921:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429439.146923:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.146929:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429439.146939:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006517b2ae reply state 00000000c7ff8c6e transno 4294977169 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429439.146948:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429439.147006:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:40539:x1876351635046528:12345-192.168.203.39@tcp:36:rm.0 Request processed in 21631us (21878us total) trans 4294977169 rc 0/0 00000100:00100000:1.0:1789429439.147014:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21231 00010000:00010000:2.0:1789429439.155312:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.155330:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.155338:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.155345:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429439.155350:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.155359:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.155376:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0xb7a3866f (ffff946f2076a600) 00010000:00010000:2.0:1789429439.155379:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429439.155385:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.155392:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad7263613e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429439.177773:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429439.178092:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635046912 00000100:00100000:1.0:1789429439.178103:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635046912 00000100:00100000:1.0:1789429439.178167:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21232 00000100:00100000:1.0:1789429439.178177:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:40540:x1876351635046912:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:1.0:1789429439.178234:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429439.178256:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c652 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.178326:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.178345:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.178356:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429439.178389:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7f:0x0]: returning size 16384 00000004:00200000:1.0:1789429439.178392:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429439.178410:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.178433:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad7263613f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c652 expref: 16 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.178451:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c652 expref: 15 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.178471:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:1.0:1789429439.178475:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429439.178478:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7e00, rc 0) 00000100:00100000:1.0:1789429439.178537:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:40540:x1876351635046912:12345-192.168.203.39@tcp:101:cp.0 Request processed in 362us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429439.178545:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21232 00000100:00100000:1.0:1789429439.182564:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429439.182767:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635047040 00000100:00100000:2.0:1789429439.182776:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635047040 00000100:00100000:2.0:1789429439.182837:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21233 00000100:00100000:2.0:1789429439.182847:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:40540:x1876351635047040:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:2.0:1789429439.182867:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429439.182886:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361402 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c659 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.182944:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361409 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.182957:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361409 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.182969:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361409 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.182984:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183002:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183010:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183064:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361409 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183071:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361409 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183077:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361409 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183083:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429439.183086:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361409 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183094:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361409 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183105:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:2.0:1789429439.183107:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429439.183112:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361409 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183118:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361409 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183129:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183135:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361410 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183150:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183156:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429439.183159:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183165:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361410 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183173:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0xb7a3866f (ffff946f051ef600) 00010000:00010000:2.0:1789429439.183175:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429439.183178:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361410 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183183:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361410 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183415:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361402 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c659 expref: 16 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183427:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:2.0:1789429439.183429:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429439.183434:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361402 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c659 expref: 16 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.183445:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429439.183504:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:40540:x1876351635047040:12345-192.168.203.39@tcp:101:cp.0 Request processed in 657us (947us total) trans 0 rc 301/301 00000100:00100000:2.0:1789429439.183511:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21233 00000100:00100000:2.0:1789429439.189247:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429439.189426:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635047296 00000100:00100000:1.0:1789429439.189436:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635047296 00000100:00100000:1.0:1789429439.189505:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21234 00000100:00100000:1.0:1789429439.189516:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:40540:x1876351635047296:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:1.0:1789429439.189535:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429439.189538:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789429439.189564:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263613fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c652 expref: 15 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.189581:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:1.0:1789429439.189585:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429439.189597:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361417 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c660 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.189894:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636141e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.189908:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636141e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.189920:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636141e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.189935:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361425 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.189943:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361425 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.189951:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361425 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429439.192246:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x34:0x0], index 0: 0 00010000:00010000:1.0:1789429439.195402:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636142c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.195425:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636142c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.195438:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636142c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.195497:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636141e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.195506:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636141e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.195513:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636141e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.195521:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429439.195525:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636141e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.195534:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636141e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.195545:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:1.0:1789429439.195548:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429439.195553:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636141e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.195560:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6600/0xb4c3dad72636141e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429439.195574:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c8ff7583 reply state 00000000802ea81f transno 4294977170 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361425 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429439.195584:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429439.195705:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361417 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c660 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.195723:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636142c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c660 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.195732:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x26:0x0].0x0 (ffff946f2076ae00) 00010000:00010000:1.0:1789429439.195734:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429439.195737:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7400, rc 0) 00000100:00100000:1.0:1789429439.195812:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:40540:x1876351635047296:12345-192.168.203.39@tcp:101:cp.0 Request processed in 6297us (6573us total) trans 4294977170 rc 0/0 00000100:00100000:1.0:1789429439.195828:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21234 00010000:00010000:0.0:1789429439.197920:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361425 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.197936:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361425 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.197949:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361425 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.197956:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429439.197961:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361425 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.197969:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361425 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.197999:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0xb7a3866f (ffff946f2076a100) 00010000:00010000:0.0:1789429439.198003:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429439.198007:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361425 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.198014:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad726361425 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7f:0x0].0xb7a3866f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429439.200246:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429439.200874:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635047424 00000100:00100000:3.0:1789429439.200885:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635047424 00000100:00100000:3.0:1789429439.201100:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5800 00000100:00100000:3.0:1789429439.201112:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635047424:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:3.0:1789429439.201130:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429439.201161:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad72636143a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c667 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429439.201190:0:20986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789429439.201245:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=1137s v=(0 0) 00010000:00010000:3.0:1789429439.201251:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429439.201260:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad72636143a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c667 expref: 8 pid: 20986 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429439.201288:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad72636143a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c667 expref: 8 pid: 20986 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429439.201303:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1800, rc 0) 00000100:00100000:3.0:1789429439.201362:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635047424:12345-192.168.203.39@tcp:101:cp.0 Request processed in 252us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429439.201370:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5800 00000100:00100000:3.0:1789429439.205974:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429439.206247:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635047552 00000100:00100000:0.0:1789429439.206258:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635047552 00000100:00100000:0.0:1789429439.206315:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5801 00000100:00100000:0.0:1789429439.206325:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:40540:x1876351635047552:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:0.0:1789429439.206341:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429439.206358:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca262c9c/0xb4c3dad726361441 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c66e expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.206388:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad72636143a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c667 expref: 9 pid: 20986 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.206402:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429439.206407:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429439.206412:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca262c9c/0xb4c3dad726361441 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->1150975] (req 0->1150975) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c66e expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.206441:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad72636143a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c667 expref: 9 pid: 20986 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429439.206454:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad72636143a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c667 expref: 9 pid: 20986 timeout: 1237 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429439.206468:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648379136:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429439.206550:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f030a3300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429439.210094:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648379136:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429439.210131:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca262c9c/0xb4c3dad726361441 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->1150975] (req 0->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c66e expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429439.210161:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac800, rc 0) 00000100:00100000:2.0:1789429439.210244:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:40540:x1876351635047552:12345-192.168.203.39@tcp:101:cp.0 Request processed in 3920us (4278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429439.210253:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5801 00000100:00100000:3.0:1789429439.211585:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429439.211670:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635047680 00000100:00100000:1.0:1789429439.211678:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635047680 00010000:00010000:1.0:1789429439.211711:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad72636143a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c667 expref: 9 pid: 20986 timeout: 1237 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429439.211740:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6205 00000100:00100000:1.0:1789429439.211747:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2370:x1876351635047680:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429439.211759:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429439.211779:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad72636143a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c667 expref: 9 pid: 20986 timeout: 1237 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.211792:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad72636143a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c667 expref: 9 pid: 20986 timeout: 1237 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.211812:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad72636143a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c667 expref: 9 pid: 20986 timeout: 1237 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.211837:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429439.211841:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429439.211848:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca262c9c/0xb4c3dad726361441 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c66e expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.211857:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca262c9c/0xb4c3dad726361441 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c66e expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429439.211889:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ca262c9c/0xb4c3dad726361441 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c66e expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429439.211903:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648379264:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429439.211966:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0fb4d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429439.217609:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648379264:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429439.217653:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429439.217712:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351635047680:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5964us (6130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429439.217724:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6205 00000100:00100000:0.0:1789429439.238433:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429439.238677:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429439.238918:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635048064 00000100:00100000:3.0:1789429439.238930:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635048064 00000100:00100000:3.0:1789429439.239000:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 264 00000100:00100000:3.0:1789429439.239010:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05b60450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:40540:x1876351635048064:12345-192.168.203.39@tcp:35:cp.0 00000100:00100000:3.0:1789429439.239610:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05b60450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:40540:x1876351635048064:12345-192.168.203.39@tcp:35:cp.0 Request processed in 599us (930us total) trans 4294977171 rc 0/0 00000100:00100000:3.0:1789429439.239619:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 264 00000100:00100000:2.0:1789429439.239720:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635047808 00000100:00100000:2.0:1789429439.239725:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635047808 00002000:00100000:2.0:1789429439.239756:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34:0x0] (0->1048575) req@ffff946f054db100 x1876351635047808/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:175/0 lens 488/0 e 0 to 0 dl 1789429450 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429439.239767:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054db100 with x1876351635047808 ext(0->1048575) 00002000:00010000:2.0:1789429439.239772:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054db100 00000100:00100000:2.0:1789429439.239799:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11513 00000100:00100000:2.0:1789429439.239806:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635047808:12345-192.168.203.39@tcp:4:cp.0 00000100:00100000:2.0:1789429439.273951:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351635047808:12345-192.168.203.39@tcp:4:cp.0 Request processed in 34134us (35516us total) trans 4294969269 rc 0/0 00000100:00100000:2.0:1789429439.273966:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11513 00002000:00100000:2.0:1789429439.273980:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x34:0x0] (0->1048575) req@ffff946f054db100 x1876351635047808/t4294969269(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:175/0 lens 488/448 e 0 to 0 dl 1789429450 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429439.274000:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054db100 with x1876351635047808 ext(0->1048575) 00002000:00010000:2.0:1789429439.274006:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054db100 00010000:00010000:0.0:1789429439.715570:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429440.123541:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429440.124443:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635048320 00000100:00100000:0.0:1789429440.124456:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635048320 00000100:00100000:0.0:1789429440.124542:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 265 00000100:00100000:0.0:1789429440.124553:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+20:40536:x1876351635048320:12345-192.168.203.39@tcp:35:bash.0 00000004:00080000:0.0:1789429440.124909:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x80:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789429440.125037:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].28, 64 off9984 00000004:00080000:0.0:1789429440.125049:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1138104848055ns, next at 1139104845762ns, rc = 0 00010000:00010000:0.0:1789429440.125113:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361448 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x80:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429440.125138:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429440.125151:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429440.125160:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361448 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429440.125171:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361448 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429440.125178:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361448 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429440.125237:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789429440.125351:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+21:40536:x1876351635048320:12345-192.168.203.39@tcp:35:bash.0 Request processed in 800us (1819us total) trans 4294977172 rc 0/0 00000100:00100000:0.0:1789429440.125359:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 265 00010000:00010000:3.0:1789429440.125438:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789429440.125445:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361448 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429440.125452:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2adc00 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:3.0:1789429440.125455:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361448 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429440.125463:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361448 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429440.125476:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x80:0x0].0x0 (ffff946f08640b00) 00010000:00010000:3.0:1789429440.125479:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789429440.125484:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361448 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429440.125501:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361448 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x80:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429440.125512:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429440.125513:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429440.125515:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429440.740578:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429441.763430:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429442.273805:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969602 is committed 00000001:00080000:0.0:1789429442.273825:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969601 is committed 00010000:00010000:1.0:1789429442.793784:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789429442.848753:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977172 is committed 00000004:00080000:1.0:1789429442.848764:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 42 committed 00000100:00100000:2.0:1789429442.850442:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000001:00080000:1.0:1789429442.851641:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977170 is committed 00000001:00080000:1.0:1789429442.851653:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977171 is committed 00000100:00100000:2.0:1789429442.851870:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648379392:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789429442.851939:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429442.852153:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648379392 00000100:00100000:0.0:1789429442.852161:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648379392 00000100:00100000:0.0:1789429442.852273:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5802 00000100:00100000:0.0:1789429442.852284:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648379392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789429442.852310:0:13238:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:50 count 1 00010000:00010000:0.0:1789429442.852334:0:13238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429442.852361:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 6 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429442.852371:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x32:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1789429442.852375:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789429442.852380:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429442.852411:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 6 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429442.852425:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 6 pid: 20745 timeout: 1240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429442.852437:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648379520:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429442.852512:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edc00 going to sleep for 11 seconds 00000100:00080000:3.0:1789429442.859039:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429442.859794:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429442.859921:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635048448 00000100:00100000:1.0:1789429442.859931:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635048448 00010000:00010000:1.0:1789429442.859988:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 7 pid: 20745 timeout: 1240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429442.860032:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6206 00000100:00100000:1.0:1789429442.860043:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635048448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429442.860058:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429442.860063:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 7 pid: 20745 timeout: 1240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429442.860076:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 7 pid: 20745 timeout: 1240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429442.860099:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789429442.860104:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789429442.860109:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429442.860118:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429442.860137:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429442.860187:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635048448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 146us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429442.860194:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6206 00000100:00080000:0.0:1789429442.860466:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789429442.863779:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7b86653/0xb4c3dad726361368 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c621 expref: 6 pid: 20745 timeout: 1240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429442.863871:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13238:1876351648379520:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429442.863904:0:13238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429442.863917:0:13238:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429442.863925:0:13238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429442.863936:0:13238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429442.863944:0:13238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429442.864878:0:13238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789429442.865418:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648379392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13134us (13476us total) trans 4294969603 rc 0/0 00000100:00100000:2.0:1789429442.865429:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5802 00000100:00100000:2.0:1789429442.865483:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969601 gen 2 00000100:00100000:2.0:1789429442.865500:0:3300:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff946f3221c000 x1876351648379392/t4294969603(4294969603) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789429458 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789429442.865510:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f3221c000/2, rc 0, transno 4294969603 00000100:00100000:2.0:1789429442.865515:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648379392:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789429442.866595:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789429442.866608:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429442.866628:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad600 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:1.0:1789429442.866632:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429442.866643:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429442.866666:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429442.866673:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad72636144f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429442.866696:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429442.866698:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429442.866699:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429443.350746:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429443.350796:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429443.350942:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635048576 00000100:00100000:1.0:1789429443.350952:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635048576 00000100:00100000:1.0:1789429443.351082:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 583 00000100:00100000:1.0:1789429443.351093:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635048576:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429443.351171:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635048576:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 79us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429443.351178:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 583 00000100:00100000:1.0:1789429443.351419:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635048832 00000100:00100000:1.0:1789429443.351423:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635048832 00000100:00100000:1.0:1789429443.351468:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 870 00000100:00100000:1.0:1789429443.351476:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635048832:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429443.351512:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635048832:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 36us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429443.351518:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 870 00000100:00080000:3.0:1789429443.351530:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429443.352999:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429443.353121:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429443.353145:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429443.353164:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429443.353187:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429443.353230:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635049344 00000100:00100000:2.0:1789429443.353237:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635049344 00000100:00100000:2.0:1789429443.353278:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635048960 00000100:00100000:2.0:1789429443.353281:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635048960 00000100:00100000:2.0:1789429443.353297:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635049216 00000100:00100000:2.0:1789429443.353299:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635049216 00000100:00100000:2.0:1789429443.353317:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 871 00000100:00100000:2.0:1789429443.353324:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635049344:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429443.353376:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635049344:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 52us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429443.353383:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 871 00000100:00100000:2.0:1789429443.353401:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 872 00000100:00100000:2.0:1789429443.353407:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635048960:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429443.353432:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635048960:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429443.353438:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 872 00000100:00100000:2.0:1789429443.353449:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 873 00000100:00100000:2.0:1789429443.353455:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351635049216:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429443.353479:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351635049216:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429443.353485:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 873 00000100:00100000:1.0:1789429443.353694:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635049088 00000100:00100000:1.0:1789429443.353699:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635049088 00000100:00100000:1.0:1789429443.353743:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635048704 00000100:00100000:1.0:1789429443.353746:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635048704 00000100:00100000:1.0:1789429443.353781:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 838 00000100:00100000:1.0:1789429443.353789:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2368:x1876351635049088:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429443.353827:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2368:x1876351635049088:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 39us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429443.353895:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 838 00000100:00100000:1.0:1789429443.353910:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 839 00000100:00100000:1.0:1789429443.353917:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:2368:x1876351635048704:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429443.353947:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:2368:x1876351635048704:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429443.353953:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 839 00000100:00080000:3.0:1789429443.355493:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429443.355500:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429443.355503:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429443.747671:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648379904:0@lo:400:kworker.0 00000100:00100000:0.0:1789429443.747749:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429443.747765:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648379776:0@lo:400:kworker.0 00000100:00100000:1.0:1789429443.747812:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429443.747823:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429443.747833:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648380032:0@lo:400:kworker.0 00000100:00100000:1.0:1789429443.747840:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648380288:0@lo:400:kworker.0 00000100:00100000:1.0:1789429443.747875:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429443.747898:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648379904 00000100:00100000:0.0:1789429443.747906:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648379904 00000100:00100000:1.0:1789429443.747912:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789429443.747921:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648379648:0@lo:400:kworker.0 00000100:00100000:0.0:1789429443.747975:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648379776 00000100:00100000:0.0:1789429443.747981:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648379776 00000100:00100000:1.0:1789429443.747981:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429443.748016:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1789429443.748024:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648380160:0@lo:400:kworker.0 00000100:00100000:0.0:1789429443.748029:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648379904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429443.748054:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429443.748089:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648380160 00000100:00100000:0.0:1789429443.748090:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648379904:12345-0@lo:400:kworker.0 Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429443.748095:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648380160 00000100:00100000:0.0:1789429443.748102:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:0.0:1789429443.748140:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1789429443.748149:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648379776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429443.748185:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648379776:12345-0@lo:400:kworker.0 Request processed in 38us (373us total) trans 0 rc 0/0 00000100:00080000:3.0:1789429443.748240:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429443.748318:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1789429443.748328:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648380160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429443.748362:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648380160:12345-0@lo:400:kworker.0 Request processed in 36us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429443.748373:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1789429443.748397:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648380288 00000100:00100000:1.0:1789429443.748401:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648380288 00000100:00100000:1.0:1789429443.748429:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:1.0:1789429443.748435:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648380288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429443.748467:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648380288:12345-0@lo:400:kworker.0 Request processed in 33us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429443.748474:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:1.0:1789429443.748492:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648379648 00000100:00100000:1.0:1789429443.748495:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648379648 00000100:00100000:1.0:1789429443.748522:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1789429443.748528:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648379648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429443.748558:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648379648:12345-0@lo:400:kworker.0 Request processed in 30us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429443.748564:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1789429443.748616:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429443.748649:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648379904:0@lo:400:kworker.0 00000100:00100000:1.0:1789429443.748693:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648379648:0@lo:400:kworker.0 00000100:00100000:1.0:1789429443.748703:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648380160:0@lo:400:kworker.0 00000100:00100000:1.0:1789429443.748711:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648379776:0@lo:400:kworker.0 00000100:00100000:1.0:1789429443.748721:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648380288:0@lo:400:kworker.0 00000100:00100000:2.0:1789429443.748928:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648380032 00000100:00100000:2.0:1789429443.748934:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648380032 00000100:00100000:2.0:1789429443.748987:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:2.0:1789429443.748995:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648380032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429443.749038:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648380032:12345-0@lo:400:kworker.0 Request processed in 44us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429443.749045:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:2.0:1789429443.749444:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648380032:0@lo:400:kworker.0 00000100:00080000:1.0:1789429443.749651:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429443.754491:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00010000:00010000:3.0:1789429443.811483:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429443.811593:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969269 is committed 00000100:00100000:0.0:1789429444.259613:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429444.259635:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648380416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429444.259700:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429444.260122:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429444.260140:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648380544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429444.260172:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429444.260315:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648380416 00000100:00100000:2.0:1789429444.260323:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648380416 00000100:00100000:2.0:1789429444.260381:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648380544 00000100:00100000:2.0:1789429444.260384:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648380544 00000100:00100000:2.0:1789429444.260404:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1789429444.260413:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648380416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429444.260449:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3827302400 avail 3825205248 00000100:00100000:2.0:1789429444.260494:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648380416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429444.260500:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1789429444.260519:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789429444.260525:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648380544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429444.260543:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429444.260592:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648380544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429444.260597:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789429444.260641:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648380544:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789429444.261086:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429444.261161:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648380416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789429444.838882:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429445.859346:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429446.883570:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429447.036445:0:24050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 19:44:06 (1789429446) 00000100:00100000:0.0:1789429447.134693:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429447.135221:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635049600 00000100:00100000:2.0:1789429447.135233:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635049600 00000100:00100000:2.0:1789429447.135300:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21235 00000100:00100000:2.0:1789429447.135310:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:41109:x1876351635049600:12345-192.168.203.39@tcp:36:mkdir.0 00010000:00010000:2.0:1789429447.135360:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429447.135387:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad7263612f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5f7 expref: 16 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.135404:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640700) 00010000:00010000:2.0:1789429447.135409:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429447.135592:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.135612:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c636 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.135622:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.135652:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c636 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.135897:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c636 expref: 13 pid: 5839 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429447.135986:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b320000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648380672:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429447.136072:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e15865f00 going to sleep for 11 seconds 00000100:00080000:1.0:1789429447.136253:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429447.152749:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429447.152781:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635049728 00000100:00100000:3.0:1789429447.152790:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635049728 00010000:00010000:3.0:1789429447.152848:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c636 expref: 14 pid: 5839 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429447.152881:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6207 00000100:00100000:3.0:1789429447.152891:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2369:x1876351635049728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429447.152905:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429447.152911:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c636 expref: 14 pid: 5839 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.152924:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c636 expref: 14 pid: 5839 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.152955:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640700) 00010000:00010000:3.0:1789429447.152960:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.152970:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.152979:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.152998:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429447.153044:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2369:x1876351635049728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 154us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429447.153052:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6207 00000100:00080000:3.0:1789429447.153106:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789429447.153418:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361399 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c636 expref: 13 pid: 5839 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429447.153432:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b320000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648380672:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429447.153452:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.153461:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.153466:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.153490:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636145d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.153498:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636145d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.153505:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636145d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429447.155515:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x81:0x0]: returning size 16384 00010000:00010000:1.0:1789429447.155543:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.155552:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.155559:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.156156:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429447.156161:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.156170:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.156188:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640700) 00010000:00010000:1.0:1789429447.156191:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429447.156195:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.156525:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547a00/0xb4c3dad726361456 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429447.159000:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006f0f45ca reply state 0000000053077cba transno 4294977173 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636145d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429447.159018:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429447.159131:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+17:41109:x1876351635049600:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 23819us (24442us total) trans 4294977173 rc 0/0 00000100:00100000:1.0:1789429447.159139:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21235 00010000:00010000:2.0:1789429447.165467:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636145d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.165485:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636145d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.165493:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636145d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.165499:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c6000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429447.165504:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636145d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.165512:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636145d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.165528:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeaeb0ef3 (ffff946f2076ab00) 00010000:00010000:2.0:1789429447.165531:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429447.165536:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636145d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.165543:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636145d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429447.248404:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429447.248985:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635049856 00000100:00100000:1.0:1789429447.248995:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635049856 00000100:00100000:1.0:1789429447.249061:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21236 00000100:00100000:1.0:1789429447.249071:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:41115:x1876351635049856:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429447.249092:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429447.249252:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c675 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.249321:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636146b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.249335:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636146b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.249347:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636146b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429447.249596:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429447.249600:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429447.249623:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636146b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.249645:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6c00/0xb4c3dad726361464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c675 expref: 18 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.249662:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636146b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c675 expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.249670:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076af00) 00010000:00010000:1.0:1789429447.249673:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429447.249677:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6000, rc 0) 00000100:00100000:1.0:1789429447.249736:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+17:41115:x1876351635049856:12345-192.168.203.39@tcp:101:dd.0 Request processed in 666us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429447.249743:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21236 00000100:00100000:1.0:1789429447.253540:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429447.253758:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635049984 00000100:00100000:3.0:1789429447.253768:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635049984 00000100:00100000:3.0:1789429447.253836:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21237 00000100:00100000:3.0:1789429447.253846:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:41115:x1876351635049984:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429447.253865:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429447.253926:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726361472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c67c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.253995:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361479 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254009:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254020:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254036:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254044:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254051:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254399:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726361487 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254408:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726361487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x81:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254415:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726361487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x81:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429447.254439:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x81:0x0]: returning size 16384 00000004:00200000:3.0:1789429447.254442:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429447.254462:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726361487 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x81:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254473:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254480:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361479 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254487:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254493:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429447.254497:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254504:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361479 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254657:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076af00) 00010000:00010000:3.0:1789429447.254662:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429447.254668:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254675:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254687:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254693:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361480 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254698:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254703:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429447.254706:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254713:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361480 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254721:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeaeb0ef3 (ffff946f08640900) 00010000:00010000:3.0:1789429447.254723:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429447.254726:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361480 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254732:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254766:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726361472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c67c expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254793:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726361487 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x81:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c67c expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429447.254800:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x81:0x0].0x0 (ffff946f08640000) 00010000:00010000:3.0:1789429447.254803:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789429447.254805:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0200, rc 0) 00000100:00100000:3.0:1789429447.254903:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:41115:x1876351635049984:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1058us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429447.254911:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21237 00000100:00100000:1.0:1789429447.259584:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429447.259752:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635050240 00000100:00100000:2.0:1789429447.259763:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635050240 00000100:00100000:2.0:1789429447.259824:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21238 00000100:00100000:2.0:1789429447.259834:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+18:41115:x1876351635050240:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429447.259855:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429447.259885:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636148e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c683 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.260073:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361495 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x81:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.260088:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361495 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.260099:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361495 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.260113:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636149c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.260121:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636149c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.260129:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636149c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429447.260794:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x33:0x0], index 1: 0 00010000:00010000:1.0:1789429447.260965:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263614a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.260975:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263614a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.260984:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263614a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.261016:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361495 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.261027:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361495 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.261033:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361495 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.261038:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429447.261042:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361495 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.261049:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361495 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.261062:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x81:0x0].0x0 (ffff946f08640000) 00010000:00010000:1.0:1789429447.261065:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429447.261070:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361495 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.261076:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361495 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429447.261087:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009ff965e2 reply state 00000000c09cd48b transno 4294977174 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636149c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429447.261095:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429447.261135:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636148e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c683 expref: 21 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.261150:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263614a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c683 expref: 20 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.261162:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x82:0x0].0x0 (ffff946f2076a800) 00010000:00010000:1.0:1789429447.261164:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429447.261166:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c7e00, rc 0) 00000100:00100000:1.0:1789429447.261269:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+21:41115:x1876351635050240:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1436us (1693us total) trans 4294977174 rc 0/0 00000100:00100000:1.0:1789429447.261277:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21238 00010000:00010000:2.0:1789429447.264952:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636149c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.264970:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636149c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.264977:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636149c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.264983:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429447.264988:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636149c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.264997:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636149c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.265013:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x81:0x0].0xb5cb80f7 (ffff946f051ef600) 00010000:00010000:2.0:1789429447.265016:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429447.265021:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636149c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.265028:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636149c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429447.266711:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429447.266833:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635050368 00000100:00100000:2.0:1789429447.266844:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635050368 00000100:00100000:2.0:1789429447.266939:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5803 00000100:00100000:2.0:1789429447.266950:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:41115:x1876351635050368:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429447.267010:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429447.267031:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c68a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429447.267059:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789429447.267079:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=1145s v=(0 0) 00010000:00010000:2.0:1789429447.267084:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429447.267094:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.267113:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.267126:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546400, rc 0) 00000100:00100000:2.0:1789429447.267182:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+7:41115:x1876351635050368:12345-192.168.203.39@tcp:101:dd.0 Request processed in 234us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429447.267188:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5803 00000100:00080000:3.0:1789429447.267732:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429447.269822:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429447.270014:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635050624 00000100:00100000:3.0:1789429447.270023:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635050624 00000100:00100000:3.0:1789429447.270078:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 266 00000100:00100000:3.0:1789429447.270088:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:41115:x1876351635050624:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:3.0:1789429447.272254:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+21:41115:x1876351635050624:12345-192.168.203.39@tcp:35:dd.0 Request processed in 2157us (2429us total) trans 4294977175 rc 0/0 00000100:00100000:3.0:1789429447.272267:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 266 00000100:00100000:2.0:1789429447.340655:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429447.340804:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635050752 00000100:00100000:0.0:1789429447.340815:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635050752 00000100:00100000:0.0:1789429447.340878:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21239 00000100:00100000:0.0:1789429447.340888:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:41120:x1876351635050752:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429447.340913:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429447.340941:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263614b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c691 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.341003:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.341017:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.341028:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429447.341061:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429447.341065:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429447.341084:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.341108:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263614b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c691 expref: 15 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.341123:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c691 expref: 14 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.341132:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076af00) 00010000:00010000:0.0:1789429447.341135:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429447.341138:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad200, rc 0) 00000100:00100000:0.0:1789429447.341192:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:41120:x1876351635050752:12345-192.168.203.39@tcp:101:dd.0 Request processed in 305us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429447.341220:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21239 00000100:00100000:0.0:1789429447.345134:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429447.348716:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635050880 00000100:00100000:0.0:1789429447.348730:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635050880 00000100:00100000:0.0:1789429447.348810:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21240 00000100:00100000:0.0:1789429447.348820:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:41120:x1876351635050880:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429447.348840:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429447.349039:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263614c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c698 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349106:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263614cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349120:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263614cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349130:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263614cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349144:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263614d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349150:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263614d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349157:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263614d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349258:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263614db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x81:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349267:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263614db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x81:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349274:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263614db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x81:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429447.349300:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x81:0x0]: returning size 16384 00000004:00200000:0.0:1789429447.349303:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429447.349321:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263614db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x81:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349331:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263614cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349337:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263614cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349342:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263614cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349348:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429447.349352:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263614cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349359:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263614cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349370:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076af00) 00010000:00010000:0.0:1789429447.349373:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429447.349377:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263614cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349383:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263614cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349393:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263614d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349402:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263614d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349408:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263614d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349412:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429447.349414:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263614d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349419:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263614d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349425:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xeaeb0ef3 (ffff946f120fdc00) 00010000:00010000:0.0:1789429447.349427:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429447.349430:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263614d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349435:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263614d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xeaeb0ef3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349462:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263614c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c698 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349474:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263614db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x81:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c698 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.349481:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x81:0x0].0x0 (ffff946f08640000) 00010000:00010000:0.0:1789429447.349484:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789429447.349487:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ace00, rc 0) 00000100:00100000:0.0:1789429447.349552:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:41120:x1876351635050880:12345-192.168.203.39@tcp:101:dd.0 Request processed in 734us (4426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429447.349559:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21240 00000100:00100000:2.0:1789429447.360951:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429447.362481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635051136 00000100:00100000:0.0:1789429447.362494:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635051136 00000100:00100000:0.0:1789429447.362565:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21241 00000100:00100000:0.0:1789429447.362575:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:41120:x1876351635051136:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429447.362594:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429447.362615:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263614e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x81:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c69f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362687:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263614e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x81:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362700:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263614e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362712:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263614e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362725:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263614f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362731:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263614f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362737:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263614f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362846:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263614f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362855:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263614f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362862:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263614f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429447.362871:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x82:0x0]: returning size 512 00010000:00010000:0.0:1789429447.362965:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263614e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362973:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263614e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362979:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263614e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362985:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ada00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429447.362989:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263614e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.362997:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263614e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363007:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x81:0x0].0x0 (ffff946f08640000) 00010000:00010000:0.0:1789429447.363011:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429447.363016:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263614e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363023:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263614e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x81:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363037:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263614f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363043:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263614f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363048:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263614f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363053:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429447.363055:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263614f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363060:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263614f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363066:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x81:0x0].0xb5cb80f7 (ffff946f120fd500) 00010000:00010000:0.0:1789429447.363069:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429447.363072:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263614f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363077:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263614f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x81:0x0].0xb5cb80f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363116:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263614e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x81:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c69f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363130:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263614f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c69f expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429447.363137:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x82:0x0].0x0 (ffff946f2076a800) 00010000:00010000:0.0:1789429447.363139:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429447.363142:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad000, rc 0) 00000100:00100000:0.0:1789429447.363229:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:41120:x1876351635051136:12345-192.168.203.39@tcp:101:dd.0 Request processed in 655us (2286us total) trans 4294977176 rc 0/0 00000100:00100000:0.0:1789429447.363237:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21241 00000100:00100000:3.0:1789429447.369039:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429447.369160:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635051264 00000100:00100000:0.0:1789429447.369169:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635051264 00000100:00080000:3.0:1789429447.369513:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429447.369743:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5804 00000100:00100000:1.0:1789429447.369755:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:41120:x1876351635051264:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429447.369771:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429447.369790:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055575d98/0xb4c3dad726361505 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6a6 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.369821:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.369830:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429447.369834:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789429447.369839:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055575d98/0xb4c3dad726361505 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6a6 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.369871:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.369883:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 6 pid: 6681 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429447.369901:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648380800:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429447.369992:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c2e2a80 going to sleep for 11 seconds 00000001:00080000:2.0:1789429447.376097:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969603 is committed 00000100:00100000:3.0:1789429447.388778:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429447.388973:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635051392 00000100:00100000:2.0:1789429447.388983:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635051392 00002000:00100000:2.0:1789429447.389035:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x33:0x0] (0->511) req@ffff946e10309180 x1876351635051392/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:183/0 lens 1000/0 e 0 to 0 dl 1789429458 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429447.389046:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10309180 with x1876351635051392 ext(0->511) 00010000:00010000:2.0:1789429447.389054:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 7 pid: 6681 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.389072:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 7 pid: 6681 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429447.389080:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e10309180 00000100:00100000:2.0:1789429447.389106:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1404 00000100:00100000:2.0:1789429447.389113:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635051392:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429447.389622:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351635051392:12345-192.168.203.39@tcp:4:dd.0 Request processed in 508us (864us total) trans 4294969604 rc 0/0 00000100:00100000:2.0:1789429447.389630:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1404 00002000:00100000:2.0:1789429447.389637:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_014: refresh rw locks for [0x280000400:0x33:0x0] (0->511) req@ffff946e10309180 x1876351635051392/t4294969604(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:183/0 lens 1000/448 e 0 to 0 dl 1789429458 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429447.389646:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10309180 with x1876351635051392 ext(0->511) 00010000:00010000:2.0:1789429447.389651:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 9 pid: 6681 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429447.389663:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 9 pid: 6681 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429447.389669:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946e10309180 00000100:00100000:3.0:1789429447.398426:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429447.399417:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635051520 00000100:00100000:1.0:1789429447.399430:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635051520 00010000:00010000:1.0:1789429447.399476:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 9 pid: 6681 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429447.399521:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6208 00000100:00100000:1.0:1789429447.399530:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:21439:x1876351635051520:12345-192.168.203.39@tcp:103:ldlm_cb00_002.0 00010000:00010000:1.0:1789429447.399545:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429447.399576:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x33:0x0] updating lvb size from disk: 0 -> 512 00002000:00010000:1.0:1789429447.399580:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x33:0x0] updating lvb mtime from disk: 0 -> 1789429447 00002000:00010000:1.0:1789429447.399582:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x33:0x0] updating lvb ctime from disk: 0 -> 1789429447 00010000:00010000:1.0:1789429447.399587:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 9 pid: 6681 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.399600:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 9 pid: 6681 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.399622:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789429447.399627:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789429447.399635:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000055575d98/0xb4c3dad726361505 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6a6 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.399649:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055575d98/0xb4c3dad726361505 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6a6 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.399685:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000055575d98/0xb4c3dad726361505 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6a6 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429447.399699:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648380928:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429447.400322:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c2e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429447.406726:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5826:1876351648380928:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429447.406764:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429447.406823:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:21439:x1876351635051520:12345-192.168.203.39@tcp:103:ldlm_cb00_002.0 Request processed in 7292us (8405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429447.406834:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6208 00010000:00010000:1.0:1789429447.424483:0:20986:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.39@tcp) returned -22 from blocking AST (req@00000000c5952330 x1876351648380800) - normal race ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 8 pid: 6681 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.424523:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ea183cf/0xb4c3dad7263614b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c68a expref: 8 pid: 6681 timeout: 1245 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429447.424535:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648380800:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429447.424613:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000055575d98/0xb4c3dad726361505 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6a6 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429447.424633:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6c00, rc 0) 00000100:00100000:1.0:1789429447.424717:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:41120:x1876351635051264:12345-192.168.203.39@tcp:101:dd.0 Request processed in 54965us (55686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429447.424725:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5804 00010000:00010000:3.0:1789429447.907704:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789429447.911451:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977176 is committed 00000001:00080000:1.0:1789429447.911468:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977174 is committed 00000001:00080000:1.0:1789429447.911477:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977175 is committed 00000100:00100000:3.0:1789429448.478063:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429448.478163:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429448.478196:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429448.478250:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429448.478272:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429448.478286:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429448.478300:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429448.478320:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429448.478342:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635051904 00000100:00100000:3.0:1789429448.478350:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635051904 00000100:00100000:3.0:1789429448.478390:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635052288 00000100:00100000:3.0:1789429448.478393:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635052288 00000100:00100000:3.0:1789429448.478411:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 843 00000100:00100000:3.0:1789429448.478419:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635051904:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429448.478483:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635051904:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 64us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429448.478491:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 843 00000100:00100000:3.0:1789429448.478505:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 844 00000100:00100000:3.0:1789429448.478511:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351635052288:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429448.478534:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351635052288:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429448.478540:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 844 00000100:00100000:2.0:1789429448.478822:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635052160 00000100:00100000:2.0:1789429448.478827:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635052160 00000100:00100000:2.0:1789429448.478863:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635052416 00000100:00100000:2.0:1789429448.478866:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635052416 00000100:00100000:2.0:1789429448.478891:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635052032 00000100:00100000:2.0:1789429448.478894:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635052032 00000100:00100000:2.0:1789429448.478907:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635052544 00000100:00100000:2.0:1789429448.478909:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635052544 00000100:00100000:2.0:1789429448.478933:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 876 00000100:00100000:2.0:1789429448.478941:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635052160:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429448.478977:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635052160:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 37us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429448.478984:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 876 00000100:00100000:2.0:1789429448.478997:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 877 00000100:00100000:2.0:1789429448.479003:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635052416:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429448.479026:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635052416:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429448.479033:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 877 00000100:00100000:2.0:1789429448.479044:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 878 00000100:00100000:2.0:1789429448.479050:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635052032:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429448.479074:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635052032:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429448.479080:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 878 00000100:00100000:2.0:1789429448.479090:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 879 00000100:00100000:2.0:1789429448.479096:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635052544:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429448.479117:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635052544:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429448.479123:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 879 00000100:00080000:2.0:1789429448.479158:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429448.479468:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635051776 00000100:00100000:1.0:1789429448.479473:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635051776 00000100:00100000:1.0:1789429448.479512:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 585 00000100:00100000:1.0:1789429448.479520:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635051776:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429448.479560:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635051776:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 41us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429448.479566:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 585 00000100:00100000:0.0:1789429448.481635:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635051648 00000100:00100000:0.0:1789429448.481646:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635051648 00002000:00100000:0.0:1789429448.481751:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x33:0x0] (0->4095) req@ffff946f34499f80 x1876351635051648/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:184/0 lens 488/0 e 0 to 0 dl 1789429459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429448.481762:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499f80 with x1876351635051648 ext(0->4095) 00002000:00010000:0.0:1789429448.481768:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34499f80 00000100:00100000:0.0:1789429448.481801:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11514 00000100:00100000:0.0:1789429448.481809:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635051648:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429448.482026:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635051648:12345-192.168.203.39@tcp:3:dd.0 Request processed in 217us (3972us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429448.482034:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11514 00002000:00100000:0.0:1789429448.482040:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x33:0x0] (0->4095) req@ffff946f34499f80 x1876351635051648/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:184/0 lens 488/4536 e 0 to 0 dl 1789429459 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429448.482049:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34499f80 with x1876351635051648 ext(0->4095) 00002000:00010000:0.0:1789429448.482052:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f34499f80 00000100:00100000:2.0:1789429448.487993:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429448.488455:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635052800 00000100:00100000:3.0:1789429448.488466:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635052800 00000100:00100000:3.0:1789429448.488526:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 267 00000100:00100000:3.0:1789429448.488535:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:41120:x1876351635052800:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:3.0:1789429448.488824:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:41120:x1876351635052800:12345-192.168.203.39@tcp:35:dd.0 Request processed in 289us (840us total) trans 4294977177 rc 0/0 00000100:00100000:3.0:1789429448.488832:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 267 00000100:00100000:0.0:1789429448.867555:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648381312:0@lo:400:kworker.0 00000100:00100000:0.0:1789429448.867631:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429448.867689:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429448.867699:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648381440:0@lo:400:kworker.0 00000100:00100000:0.0:1789429448.867724:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429448.867800:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648381312 00000100:00100000:2.0:1789429448.867807:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648381312 00000100:00100000:2.0:1789429448.867876:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1789429448.867886:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648381312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429448.867944:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648381312:12345-0@lo:400:kworker.0 Request processed in 60us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429448.867951:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1789429448.867974:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648381440 00000100:00100000:2.0:1789429448.867977:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648381440 00000100:00100000:2.0:1789429448.868002:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1789429448.868008:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648381440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429448.868032:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648381440:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429448.868038:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00080000:0.0:1789429448.868146:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429448.868150:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429448.868176:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648381440:0@lo:400:kworker.0 00000100:00100000:0.0:1789429448.868185:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648381312:0@lo:400:kworker.0 00000100:00100000:1.0:1789429448.868611:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648381184:0@lo:400:kworker.0 00000100:00100000:1.0:1789429448.868641:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429448.868669:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648381696:0@lo:400:kworker.0 00000100:00100000:1.0:1789429448.868687:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429448.868715:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789429448.868720:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648381056:0@lo:400:kworker.0 00000100:00100000:1.0:1789429448.868742:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429448.868758:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648381568:0@lo:400:kworker.0 00000100:00100000:1.0:1789429448.868773:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429448.868796:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648381184 00000100:00100000:1.0:1789429448.868800:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648381184 00000100:00100000:1.0:1789429448.868822:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648381568 00000100:00100000:1.0:1789429448.868824:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648381568 00000100:00100000:1.0:1789429448.868845:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:1.0:1789429448.868851:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648381184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429448.869003:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1789429448.869012:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648381568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429448.869063:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648381696 00000100:00100000:0.0:1789429448.869067:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648381696 00000100:00100000:0.0:1789429448.869090:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1789429448.869097:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648381696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429448.869394:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648381056 00000100:00100000:2.0:1789429448.869398:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648381056 00000100:00100000:2.0:1789429448.869432:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1789429448.869439:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648381056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429448.869731:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648381568:12345-0@lo:400:kworker.0 Request processed in 720us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429448.869738:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1789429448.870121:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648381568:0@lo:400:kworker.0 00000100:00080000:3.0:1789429448.870152:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429448.870156:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429448.870331:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648381696:12345-0@lo:400:kworker.0 Request processed in 1233us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429448.870338:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1789429448.871192:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969603 gen 2 00000004:00080000:3.0:1789429448.871212:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f3221c000, transno 4294969603 00000100:00100000:3.0:1789429448.871223:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648381696:0@lo:400:kworker.0 00000100:00100000:1.0:1789429448.873587:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648381184:12345-0@lo:400:kworker.0 Request processed in 4730us (4938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429448.873603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:3.0:1789429448.873726:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648381184:0@lo:400:kworker.0 00000100:00100000:2.0:1789429448.873957:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648381056:12345-0@lo:400:kworker.0 Request processed in 4517us (5212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429448.873966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1789429448.874045:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648381056:0@lo:400:kworker.0 00010000:00010000:1.0:1789429448.931547:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429449.379344:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648381824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429449.379408:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429449.379500:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648381824 00000100:00100000:1.0:1789429449.379508:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648381824 00000100:00100000:1.0:1789429449.379556:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1789429449.379566:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648381824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429449.379611:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52494336 pending 1703936 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429449.379937:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648381824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 372us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429449.379944:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1789429449.379993:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648381952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429449.380035:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429449.380112:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648381952 00000100:00100000:3.0:1789429449.380118:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648381952 00000100:00100000:3.0:1789429449.380149:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789429449.380156:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648381952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429449.380174:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3855613952 avail 3853516800 00000100:00100000:3.0:1789429449.380224:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648381952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429449.380231:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1789429449.380300:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648381952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429449.380512:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648381824:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789429449.958221:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429450.979893:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429452.004082:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429452.499285:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969604 is committed 00000001:00080000:1.0:1789429453.027194:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977177 is committed 00010000:00010000:1.0:1789429453.028415:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429453.597647:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429453.597693:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429453.597726:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429453.597762:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429453.597779:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429453.597797:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429453.597842:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429453.597859:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635053056 00000100:00100000:2.0:1789429453.597869:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635053056 00000100:00100000:3.0:1789429453.597899:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635053440 00000100:00100000:3.0:1789429453.597905:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635053440 00000100:00100000:0.0:1789429453.597988:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635053312 00000100:00100000:0.0:1789429453.597993:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635053312 00000100:00100000:0.0:1789429453.598039:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635053568 00000100:00100000:0.0:1789429453.598042:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635053568 00000100:00100000:0.0:1789429453.598060:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635053184 00000100:00100000:0.0:1789429453.598062:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635053184 00000100:00100000:0.0:1789429453.598077:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635053696 00000100:00100000:0.0:1789429453.598080:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635053696 00000100:00100000:0.0:1789429453.598095:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 882 00000100:00100000:0.0:1789429453.598104:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635053312:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429453.598149:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 848 00000100:00100000:2.0:1789429453.598161:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:2368:x1876351635053056:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429453.598175:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635053312:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429453.598184:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 882 00000100:00100000:2.0:1789429453.598233:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+18:2368:x1876351635053056:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 43us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429453.598234:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 883 00000100:00100000:2.0:1789429453.598246:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 848 00000100:00100000:0.0:1789429453.598248:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351635053568:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429453.598266:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 849 00000100:00100000:2.0:1789429453.598276:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351635053440:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429453.598278:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351635053568:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429453.598288:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 883 00000100:00100000:0.0:1789429453.598303:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 884 00000100:00100000:0.0:1789429453.598311:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635053184:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429453.598318:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351635053440:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 42us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429453.598326:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 849 00000100:00100000:0.0:1789429453.598344:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635053184:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 33us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429453.598397:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 885 00000100:00100000:1.0:1789429453.598407:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635053696:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429453.598435:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635053696:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429453.598442:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 885 00000100:00080000:1.0:1789429453.598617:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429453.598622:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429453.598624:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429453.598737:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 884 00000100:00100000:0.0:1789429453.598765:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635052928 00000100:00100000:0.0:1789429453.598769:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635052928 00000100:00100000:0.0:1789429453.598794:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 587 00000100:00100000:0.0:1789429453.598800:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635052928:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429453.598831:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635052928:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429453.598838:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 587 00000100:00100000:1.0:1789429453.988447:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648382336:0@lo:400:kworker.0 00000100:00100000:0.0:1789429453.988501:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648382464:0@lo:400:kworker.0 00000100:00100000:1.0:1789429453.988520:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429453.988554:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429453.988643:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648382080:0@lo:400:kworker.0 00000100:00100000:3.0:1789429453.988683:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429453.988720:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648382592:0@lo:400:kworker.0 00000100:00100000:3.0:1789429453.988745:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429453.988805:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648382080 00000100:00100000:3.0:1789429453.988806:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789429453.988814:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648382080 00000100:00100000:3.0:1789429453.988815:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648382208:0@lo:400:kworker.0 00000100:00100000:3.0:1789429453.988843:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429453.988875:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1789429453.988876:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648382720:0@lo:400:kworker.0 00000100:00100000:2.0:1789429453.988895:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648382080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429453.990415:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648382080:12345-0@lo:400:kworker.0 Request processed in 1516us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429453.990438:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1789429453.990467:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429453.990529:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648382080:0@lo:400:kworker.0 00000100:00100000:2.0:1789429453.990550:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648382336 00000100:00100000:2.0:1789429453.990557:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648382336 00000100:00100000:3.0:1789429453.990566:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648382592 00000100:00100000:3.0:1789429453.990572:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648382592 00000100:00100000:1.0:1789429453.992441:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648382208 00000100:00100000:1.0:1789429453.992521:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648382208 00000100:00100000:1.0:1789429453.992710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1789429453.992783:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648382208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429453.995992:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648382208:12345-0@lo:400:kworker.0 Request processed in 3265us (7140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429453.996007:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1789429453.996099:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648382464 00000100:00100000:1.0:1789429453.996107:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648382464 00000100:00100000:2.0:1789429453.997044:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1789429453.997055:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648382336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429453.997133:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648382336:12345-0@lo:400:kworker.0 Request processed in 79us (8614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429453.997140:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1789429453.998489:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:3.0:1789429453.998499:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648382592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429453.998827:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648382592:12345-0@lo:400:kworker.0 Request processed in 329us (10080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429453.998835:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:3.0:1789429453.998895:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648382208:0@lo:400:kworker.0 00000100:00100000:3.0:1789429453.998909:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648382592:0@lo:400:kworker.0 00000100:00100000:1.0:1789429453.999359:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648382720 00000100:00100000:1.0:1789429453.999367:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648382720 00000100:00100000:1.0:1789429453.999401:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1789429453.999409:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648382464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429453.999457:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648382464:12345-0@lo:400:kworker.0 Request processed in 49us (10912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429453.999464:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1789429453.999478:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1789429453.999485:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648382720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429453.999523:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648382720:12345-0@lo:400:kworker.0 Request processed in 39us (9058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429453.999529:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1789429453.999661:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648382336:0@lo:400:kworker.0 00000100:00100000:1.0:1789429453.999707:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648382464:0@lo:400:kworker.0 00000100:00080000:2.0:1789429453.999998:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429454.000002:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429454.000005:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429454.000036:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05471180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648382720:0@lo:400:kworker.0 00010000:00010000:1.0:1789429454.052304:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429454.499417:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648382848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429454.499489:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429454.499667:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648382848 00000100:00100000:0.0:1789429454.499675:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648382848 00000100:00100000:0.0:1789429454.499729:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1789429454.499739:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648382848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429454.499773:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429454.500088:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648382976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429454.500119:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429454.500218:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648382976 00000100:00100000:3.0:1789429454.500223:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648382976 00000100:00100000:3.0:1789429454.500255:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789429454.500263:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648382976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429454.500295:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429454.500398:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648382976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429454.500413:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648382848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 673us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429454.500422:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789429454.500563:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648382976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 299us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429454.500570:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789429454.500677:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648382848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789429455.077287:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429455.673104:0:24252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 19:44:14 (1789429454) 00010000:00010000:1.0:1789429456.100238:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429457.126114:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429458.147385:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429458.710681:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429458.710732:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429458.710760:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429458.710781:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429458.710802:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429458.710822:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429458.710853:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429458.710878:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635054080 00000100:00100000:3.0:1789429458.710888:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635054080 00000100:00100000:3.0:1789429458.710948:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635054592 00000100:00100000:3.0:1789429458.710952:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635054592 00000100:00100000:3.0:1789429458.710972:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635054208 00000100:00100000:3.0:1789429458.710974:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635054208 00000100:00100000:3.0:1789429458.710990:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635054464 00000100:00100000:3.0:1789429458.710992:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635054464 00000100:00100000:3.0:1789429458.711304:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 888 00000100:00100000:3.0:1789429458.711317:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635054080:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429458.711384:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635054080:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429458.711393:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 888 00000100:00100000:3.0:1789429458.711409:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 889 00000100:00100000:3.0:1789429458.711416:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635054592:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429458.711441:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635054592:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429458.711447:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 889 00000100:00100000:3.0:1789429458.711459:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 890 00000100:00100000:3.0:1789429458.711466:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635054208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429458.711487:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635054208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429458.711494:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 890 00000100:00100000:3.0:1789429458.711505:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 891 00000100:00100000:3.0:1789429458.711510:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351635054464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429458.711535:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351635054464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429458.711541:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 891 00000100:00100000:3.0:1789429458.711559:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635054336 00000100:00100000:3.0:1789429458.711563:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635054336 00000100:00100000:3.0:1789429458.711590:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635053952 00000100:00100000:3.0:1789429458.711593:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635053952 00000100:00100000:3.0:1789429458.711618:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 853 00000100:00100000:3.0:1789429458.711625:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351635054336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429458.711655:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351635054336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429458.711663:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 853 00000100:00100000:3.0:1789429458.711679:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 854 00000100:00100000:3.0:1789429458.711686:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351635053952:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429458.711709:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351635053952:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429458.711715:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 854 00000100:00080000:3.0:1789429458.711742:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429458.711747:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429458.711749:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429458.712452:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635053824 00000100:00100000:1.0:1789429458.712459:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635053824 00000100:00100000:1.0:1789429458.712504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 589 00000100:00100000:1.0:1789429458.712512:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635053824:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429458.712549:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635053824:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 39us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429458.712557:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 589 00000100:00100000:0.0:1789429459.107407:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648383104:0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.107475:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429459.107516:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648383616:0@lo:400:kworker.0 00000100:00100000:1.0:1789429459.107603:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648383360:0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.107608:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429459.107629:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429459.107633:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789429459.107639:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648383232:0@lo:400:kworker.0 00000100:00100000:1.0:1789429459.107646:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429459.107651:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648383488:0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.107658:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429459.111424:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648383744:0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.111488:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429459.111779:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648383104 00000100:00100000:0.0:1789429459.111790:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648383104 00000100:00100000:0.0:1789429459.112065:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1789429459.112075:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648383104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.112132:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648383104:12345-0@lo:400:kworker.0 Request processed in 59us (4658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429459.112139:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1789429459.112171:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648383616 00000100:00100000:0.0:1789429459.112175:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648383616 00000100:00100000:0.0:1789429459.112229:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648383360 00000100:00100000:0.0:1789429459.112232:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648383360 00000100:00100000:0.0:1789429459.112253:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648383232 00000100:00100000:0.0:1789429459.112256:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648383232 00000100:00100000:0.0:1789429459.112273:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:0.0:1789429459.112279:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648383616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.112630:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648383616:12345-0@lo:400:kworker.0 Request processed in 351us (5021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429459.112637:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:0.0:1789429459.112649:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1789429459.112654:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648383360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.112682:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648383360:12345-0@lo:400:kworker.0 Request processed in 28us (5052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429459.112688:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1789429459.112699:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1789429459.112706:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648383232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.113068:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648383232:12345-0@lo:400:kworker.0 Request processed in 362us (5407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429459.113074:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00080000:0.0:1789429459.113098:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429459.113140:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05471500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648383232:0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.113151:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05471880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648383104:0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.113161:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05470a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648383616:0@lo:400:kworker.0 00000100:00100000:3.0:1789429459.114284:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648383744 00000100:00100000:3.0:1789429459.114291:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648383744 00000100:00100000:3.0:1789429459.114339:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1789429459.114347:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648383744:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789429459.114372:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429459.114400:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05473480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648383744:12345-0@lo:400:kworker.0 Request processed in 55us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429459.114406:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1789429459.114415:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05473b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648383744:0@lo:400:kworker.0 00000100:00100000:1.0:1789429459.118803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429459.118906:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05470e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648383360:0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.118957:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648383488 00000100:00100000:0.0:1789429459.119067:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648383488 00000100:00100000:0.0:1789429459.119182:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:0.0:1789429459.119194:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648383488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429459.119434:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648383488:12345-0@lo:400:kworker.0 Request processed in 244us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429459.119454:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00080000:1.0:1789429459.120760:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429459.120795:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05472a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648383488:0@lo:400:kworker.0 00010000:00010000:0.0:1789429459.174127:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429459.619476:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429459.619500:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648383872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429459.619580:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429459.619952:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648383872 00000100:00100000:2.0:1789429459.619959:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648383872 00000100:00100000:2.0:1789429459.620011:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789429459.620020:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648383872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429459.620051:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429459.620111:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648383872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429459.620118:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1789429459.620230:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648383872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429459.620704:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648384000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429459.620746:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429459.621616:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648384000 00000100:00100000:0.0:1789429459.621624:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648384000 00000100:00100000:0.0:1789429459.621671:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789429459.621679:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648384000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429459.621706:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3855613952 avail 3853516800 00000100:00100000:0.0:1789429459.621769:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648384000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429459.621775:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789429459.623646:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648384000:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789429460.195529:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429461.219379:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429462.244035:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429463.267425:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429463.830495:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429463.830544:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429463.830648:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429463.830698:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635054848 00000100:00100000:0.0:1789429463.830709:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635054848 00000100:00100000:0.0:1789429463.830786:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 858 00000100:00100000:0.0:1789429463.830798:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635054848:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429463.830883:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635054848:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 87us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429463.830891:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 858 00000100:00080000:2.0:1789429463.833239:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429463.835104:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635055104 00000100:00100000:1.0:1789429463.835116:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635055104 00000100:00100000:1.0:1789429463.835176:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635055360 00000100:00100000:1.0:1789429463.835180:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635055360 00000100:00100000:1.0:1789429463.835227:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 894 00000100:00100000:1.0:1789429463.835238:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635055104:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429463.835250:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:0.0:1789429463.835290:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429463.835297:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429463.835298:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429463.835308:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635055104:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (4762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429463.835316:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 894 00000100:00100000:0.0:1789429463.835329:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635054720 00000100:00100000:1.0:1789429463.835335:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635054976 00000100:00100000:1.0:1789429463.835339:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635054976 00000100:00100000:0.0:1789429463.835347:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635054720 00000100:00100000:1.0:1789429463.835372:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 895 00000100:00100000:1.0:1789429463.835381:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635055360:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429463.835393:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 591 00000100:00100000:0.0:1789429463.835405:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635054720:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429463.835427:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635055360:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 47us (4789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429463.835434:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 895 00000100:00100000:3.0:1789429463.835440:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429463.835448:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635054720:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 45us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429463.835457:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 591 00000100:00100000:3.0:1789429463.835488:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429463.835540:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635055488 00000100:00100000:3.0:1789429463.835544:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635055488 00000100:00100000:3.0:1789429463.835565:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 896 00000100:00100000:3.0:1789429463.835571:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635054976:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429463.835602:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 897 00000100:00100000:1.0:1789429463.835609:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635055488:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429463.835772:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635055488:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 161us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429463.835774:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635054976:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 197us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429463.835787:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 897 00000100:00100000:3.0:1789429463.835795:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 896 00000100:00100000:3.0:1789429463.835840:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635055232 00000100:00100000:3.0:1789429463.835845:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635055232 00000100:00100000:3.0:1789429463.835881:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 859 00000100:00080000:1.0:1789429463.835888:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429463.835890:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351635055232:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:1.0:1789429463.835893:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429463.835897:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429463.835930:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351635055232:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 42us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429463.835938:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 859 00000100:00100000:3.0:1789429464.227866:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648384384:0@lo:400:kworker.0 00000100:00100000:3.0:1789429464.227938:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429464.227999:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429464.228005:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648384512:0@lo:400:kworker.0 00000100:00100000:3.0:1789429464.228029:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429464.228221:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648384128:0@lo:400:kworker.0 00000100:00100000:0.0:1789429464.228257:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429464.228299:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648384640:0@lo:400:kworker.0 00000100:00100000:0.0:1789429464.228323:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429464.228343:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789429464.228349:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f02d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648384256:0@lo:400:kworker.0 00000100:00100000:0.0:1789429464.228482:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429464.228504:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648384768:0@lo:400:kworker.0 00000100:00100000:0.0:1789429464.228527:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429464.228555:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648384384 00000100:00100000:0.0:1789429464.228564:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648384384 00000100:00100000:0.0:1789429464.228609:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648384640 00000100:00100000:0.0:1789429464.228612:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648384640 00000100:00100000:0.0:1789429464.228630:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648384256 00000100:00100000:0.0:1789429464.228633:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648384256 00000100:00100000:0.0:1789429464.228654:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1789429464.228661:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648384384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429464.228724:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648384384:12345-0@lo:400:kworker.0 Request processed in 62us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429464.228730:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1789429464.228745:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1789429464.228751:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648384640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429464.228782:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648384640:12345-0@lo:400:kworker.0 Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429464.228788:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1789429464.228798:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1789429464.228815:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648384256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429464.228843:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648384256:12345-0@lo:400:kworker.0 Request processed in 39us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429464.228850:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1789429464.228888:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648384384:0@lo:400:kworker.0 00000100:00100000:0.0:1789429464.228923:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648384256:0@lo:400:kworker.0 00000100:00100000:0.0:1789429464.228933:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648384640:0@lo:400:kworker.0 00000100:00100000:3.0:1789429464.229093:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648384512 00000100:00100000:3.0:1789429464.229097:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648384512 00000100:00100000:3.0:1789429464.229137:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648384768 00000100:00100000:3.0:1789429464.229141:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648384768 00000100:00100000:3.0:1789429464.229161:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1789429464.229167:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648384512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429464.229228:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648384512:12345-0@lo:400:kworker.0 Request processed in 60us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429464.229234:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1789429464.229246:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1789429464.229252:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648384768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429464.229282:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648384768:12345-0@lo:400:kworker.0 Request processed in 30us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429464.229287:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:2.0:1789429464.229530:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648384128 00000100:00100000:2.0:1789429464.229535:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648384128 00000100:00100000:2.0:1789429464.229571:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1789429464.229578:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648384128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429464.229617:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648384128:12345-0@lo:400:kworker.0 Request processed in 39us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429464.229624:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00080000:1.0:1789429464.229723:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429464.229728:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429464.229731:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429464.230079:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648384512:0@lo:400:kworker.0 00000100:00100000:0.0:1789429464.230109:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648384768:0@lo:400:kworker.0 00000100:00100000:0.0:1789429464.230117:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f02d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648384128:0@lo:400:kworker.0 00010000:00010000:2.0:1789429464.291912:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429464.739544:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648384896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429464.739613:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429464.741587:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429464.741604:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648385024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429464.741659:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429464.741790:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648384896 00000100:00100000:2.0:1789429464.741809:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648384896 00000100:00100000:2.0:1789429464.741870:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648385024 00000100:00100000:2.0:1789429464.741874:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648385024 00000100:00100000:2.0:1789429464.741892:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789429464.741900:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648384896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429464.741935:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429464.741994:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648384896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429464.742002:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789429464.742020:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789429464.742027:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648385024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429464.742046:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429464.742077:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648385024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429464.742082:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789429464.742190:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648385024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429464.742249:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648384896:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429465.319743:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429466.339453:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429467.364373:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429468.389659:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429468.975864:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429468.975909:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429468.975930:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429468.975950:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429468.975978:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429468.975996:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429468.976019:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429468.976078:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635055616 00000100:00100000:3.0:1789429468.976089:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635055616 00000100:00100000:2.0:1789429468.976140:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635055872 00000100:00100000:3.0:1789429468.976141:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 593 00000100:00100000:2.0:1789429468.976144:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635055872 00000100:00100000:3.0:1789429468.976150:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635055616:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429468.976178:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635056384 00000100:00100000:2.0:1789429468.976181:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635056384 00000100:00100000:2.0:1789429468.976194:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635056000 00000100:00100000:2.0:1789429468.976196:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635056000 00000100:00100000:2.0:1789429468.976228:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635056256 00000100:00100000:3.0:1789429468.976229:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635055616:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 80us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429468.976230:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635056256 00000100:00100000:3.0:1789429468.976237:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 593 00000100:00100000:2.0:1789429468.976244:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 900 00000100:00100000:2.0:1789429468.976249:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635055872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429468.976270:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 901 00000100:00100000:3.0:1789429468.976276:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635056384:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429468.976278:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635055872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429468.976284:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 900 00000100:00100000:2.0:1789429468.976297:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 902 00000100:00100000:3.0:1789429468.976298:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635056384:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429468.976303:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635056000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429468.976304:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 901 00000100:00100000:3.0:1789429468.976315:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 903 00000100:00100000:3.0:1789429468.976320:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635056256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429468.976323:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635056000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 20us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429468.976328:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 902 00000100:00100000:3.0:1789429468.976338:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635056256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 18us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429468.976344:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 903 00000100:00080000:1.0:1789429468.976896:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429468.976900:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429468.977020:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635056128 00000100:00100000:0.0:1789429468.977025:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635056128 00000100:00100000:0.0:1789429468.977062:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635055744 00000100:00100000:0.0:1789429468.977065:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635055744 00000100:00100000:0.0:1789429468.977082:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 863 00000100:00100000:0.0:1789429468.977088:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351635056128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429468.977122:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351635056128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 34us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429468.977128:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 863 00000100:00100000:0.0:1789429468.977141:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 864 00000100:00100000:0.0:1789429468.977146:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635055744:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429468.977163:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635055744:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 18us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429468.977169:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 864 00000100:00080000:3.0:1789429468.977249:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429469.347480:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648385280:0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.347553:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429469.347621:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648385792:0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.347648:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429469.347681:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789429469.347687:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648385152:0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.347716:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429469.347739:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648385664:0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.347779:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429469.347805:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648385408:0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.347828:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429469.347846:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429469.347852:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648385536:0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.347873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429469.347905:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648385792 00000100:00100000:1.0:1789429469.347911:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648385792 00000100:00100000:1.0:1789429469.347960:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648385536 00000100:00100000:1.0:1789429469.347964:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648385536 00000100:00100000:1.0:1789429469.347986:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1789429469.347994:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648385792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.348042:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648385792:12345-0@lo:400:kworker.0 Request processed in 49us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429469.348049:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1789429469.348065:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1789429469.348071:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648385536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.348099:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648385536:12345-0@lo:400:kworker.0 Request processed in 29us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429469.348104:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1789429469.348120:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648385152 00000100:00100000:1.0:1789429469.348123:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648385152 00000100:00100000:1.0:1789429469.348143:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1789429469.348149:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648385152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.348174:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648385152:12345-0@lo:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429469.348179:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1789429469.348222:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648385280 00000100:00100000:1.0:1789429469.348225:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648385280 00000100:00100000:1.0:1789429469.348246:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648385664 00000100:00100000:1.0:1789429469.348248:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648385664 00000100:00100000:1.0:1789429469.348261:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648385408 00000100:00100000:1.0:1789429469.348263:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648385408 00000100:00100000:1.0:1789429469.348278:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1789429469.348284:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648385280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.348310:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648385280:12345-0@lo:400:kworker.0 Request processed in 27us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429469.348316:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1789429469.348327:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1789429469.348332:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648385664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.348354:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648385664:12345-0@lo:400:kworker.0 Request processed in 23us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429469.348359:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1789429469.348369:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1789429469.348374:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648385408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.348396:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648385408:12345-0@lo:400:kworker.0 Request processed in 22us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429469.348401:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00080000:1.0:1789429469.348418:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429469.348422:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429469.348424:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429469.348456:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648385536:0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.348465:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648385408:0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.348489:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648385152:0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.348496:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648385664:0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.348504:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648385280:0@lo:400:kworker.0 00000100:00100000:1.0:1789429469.348511:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648385792:0@lo:400:kworker.0 00010000:00010000:0.0:1789429469.423091:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429469.859796:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648385920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429469.859931:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429469.859969:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648385920 00000100:00100000:0.0:1789429469.859977:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648385920 00000100:00100000:1.0:1789429469.859991:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429469.859997:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648386048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429469.860020:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429469.861831:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648386048 00000100:00100000:0.0:1789429469.861841:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648386048 00000100:00100000:0.0:1789429469.861885:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1789429469.861895:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648385920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429469.861930:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3855613952 avail 3853516800 00000100:00100000:0.0:1789429469.862045:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648385920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429469.862051:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1789429469.862071:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1789429469.862077:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648386048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429469.862095:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429469.862122:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648386048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429469.862127:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789429469.864159:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648385920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429469.864193:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648386048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789429470.442903:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429470.457001:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429470.457152:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429470.457473:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635056512 00000100:00100000:2.0:1789429470.457483:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635056512 00000100:00100000:2.0:1789429470.457535:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635056768 00000100:00100000:2.0:1789429470.457538:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635056768 00000100:00100000:2.0:1789429470.457560:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21242 00000100:00100000:2.0:1789429470.457569:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+19:2368:x1876351635056512:12345-192.168.203.39@tcp:41:mkdir.0 00000004:00000024:2.0:1789429470.457610:0:15669:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1789429470.457674:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+19:2368:x1876351635056512:12345-192.168.203.39@tcp:41:mkdir.0 Request processed in 105us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429470.457681:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21242 00000100:00100000:2.0:1789429470.457699:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21243 00000100:00100000:2.0:1789429470.457705:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+18:41981:x1876351635056768:12345-192.168.203.39@tcp:36:mkdir.0 00010000:00010000:2.0:1789429470.457742:0:15669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429470.457778:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6000/0xb4c3dad72636146b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c675 expref: 18 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.458115:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076af00) 00010000:00010000:2.0:1789429470.458122:0:15669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429470.458296:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.458311:0:15669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c691 expref: 15 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.458319:0:15669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789429470.458324:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789429470.458350:0:15669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c691 expref: 15 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.458853:0:15669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c691 expref: 15 pid: 15669 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429470.458871:0:15669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648386176:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429470.459004:0:15669:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c37cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789429470.477440:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429470.478551:0:15669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648386176:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429470.478577:0:15669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429470.479836:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635056896 00000100:00100000:3.0:1789429470.479845:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635056896 00010000:00010000:3.0:1789429470.479895:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c691 expref: 16 pid: 15669 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429470.480099:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6209 00000100:00100000:3.0:1789429470.480110:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351635056896:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429470.480123:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429470.480131:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c691 expref: 16 pid: 15669 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.480155:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c691 expref: 16 pid: 15669 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.480176:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263614bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c691 expref: 16 pid: 15669 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.480190:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076af00) 00010000:00010000:3.0:1789429470.480195:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.480221:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.480227:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.480248:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429470.480298:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2370:x1876351635056896:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 190us (2864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429470.480305:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6209 00000100:00080000:2.0:1789429470.481931:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789429470.481955:0:15669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.481965:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.481990:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361513 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.482001:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.482009:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429470.487534:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x83:0x0]: returning size 16384 00010000:00010000:2.0:1789429470.487552:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.487564:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.487571:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.487578:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429470.488090:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.488101:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.488117:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f2076af00) 00010000:00010000:2.0:1789429470.488121:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429470.488126:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.488131:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636150c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789429470.488667:0:15669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003ab89245 reply state 00000000c637099a transno 4294977178 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429470.488677:0:15669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789429470.488773:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+19:41981:x1876351635056768:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 31055us (31609us total) trans 4294977178 rc 0/0 00000100:00100000:2.0:1789429470.488782:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21243 00010000:00010000:2.0:1789429470.494950:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361513 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.494967:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361513 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.494975:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361513 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.494981:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429470.494986:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361513 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.494994:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361513 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.495010:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf71a3c7c (ffff946f051ef800) 00010000:00010000:2.0:1789429470.495013:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429470.495082:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361513 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.495090:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361513 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429470.518304:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429470.518424:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635057024 00000100:00100000:0.0:1789429470.518435:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635057024 00000100:00100000:0.0:1789429470.518481:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21244 00000100:00100000:0.0:1789429470.518491:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+18:41982:x1876351635057024:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429470.518513:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429470.518535:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad72636151a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6ad expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429470.518603:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726361521 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429470.518617:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726361521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429470.518629:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726361521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429470.518660:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429470.518664:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429470.518682:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726361521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429470.518705:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad72636151a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6ad expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429470.518727:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726361521 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6ad expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429470.518736:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:0.0:1789429470.518739:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429470.518742:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429470.520347:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+19:41982:x1876351635057024:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1853us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429470.520356:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21244 00000100:00100000:3.0:1789429470.525786:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429470.525934:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635057152 00000100:00100000:1.0:1789429470.525944:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635057152 00000100:00100000:1.0:1789429470.525994:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21245 00000100:00100000:1.0:1789429470.526005:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+19:41982:x1876351635057152:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429470.526095:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429470.526116:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030400/0xb4c3dad726361528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6b4 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.526179:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636152f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.526195:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636152f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.526228:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636152f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.526244:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad726361536 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.526253:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad726361536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.526260:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad726361536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.526330:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031600/0xb4c3dad72636153d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x83:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.526338:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031600/0xb4c3dad72636153d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.526344:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031600/0xb4c3dad72636153d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429470.529333:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x83:0x0]: returning size 16384 00000004:00200000:1.0:1789429470.529341:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429470.529541:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031600/0xb4c3dad72636153d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529559:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636152f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529566:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636152f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529574:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636152f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529579:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429470.529584:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636152f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529592:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636152f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529607:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:1.0:1789429470.529610:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429470.529615:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636152f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529621:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636152f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529634:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad726361536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529640:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad726361536 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529645:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad726361536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529650:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00030000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429470.529653:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad726361536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529659:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad726361536 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529666:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf71a3c7c (ffff946f2076a700) 00010000:00010000:1.0:1789429470.529669:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429470.529672:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad726361536 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529682:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad726361536 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529722:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030400/0xb4c3dad726361528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6b4 expref: 21 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529737:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031600/0xb4c3dad72636153d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x83:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6b4 expref: 20 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.529745:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x83:0x0].0x0 (ffff946f2076a600) 00010000:00010000:1.0:1789429470.529747:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789429470.529749:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031600, rc 0) 00000100:00100000:1.0:1789429470.529922:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+20:41982:x1876351635057152:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3918us (4140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429470.529930:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21245 00000100:00100000:0.0:1789429470.544227:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429470.544260:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635057408 00000100:00100000:3.0:1789429470.544270:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635057408 00000100:00100000:3.0:1789429470.553099:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21246 00000100:00100000:3.0:1789429470.553119:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+20:41982:x1876351635057408:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429470.553141:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429470.553162:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726361544 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6bb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.553278:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636154b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x83:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.553292:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636154b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.553304:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636154b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554102:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361552 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x83:0x0].0xf8942489 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554114:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361552 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554126:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361552 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554723:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361559 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x84:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554734:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554741:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429470.554751:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x84:0x0]: returning size 0 00010000:00010000:3.0:1789429470.554785:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636154b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554901:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636154b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554908:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636154b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554914:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429470.554918:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636154b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554926:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636154b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554938:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x83:0x0].0x0 (ffff946f2076a600) 00010000:00010000:3.0:1789429470.554941:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429470.554946:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636154b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.554952:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636154b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429470.554964:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005c79c5c1 reply state 0000000000830113 transno 4294977179 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361552 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429470.554971:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789429470.555003:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726361544 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6bb expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.555031:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6bb expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.555039:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f08640f00) 00010000:00010000:3.0:1789429470.555041:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429470.555044:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1800, rc 0) 00000100:00100000:3.0:1789429470.555113:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:41982:x1876351635057408:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 2000us (10894us total) trans 4294977179 rc 0/0 00000100:00100000:3.0:1789429470.555121:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21246 00010000:00010000:2.0:1789429470.559455:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361552 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.559472:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361552 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.559480:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361552 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.559486:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429470.559492:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361552 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.559500:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361552 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.559515:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x83:0x0].0xf8942489 (ffff946f08640900) 00010000:00010000:2.0:1789429470.559518:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429470.559522:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361552 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.559528:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361552 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429470.563773:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429470.564227:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635057664 00000100:00100000:2.0:1789429470.564237:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635057664 00000100:00100000:2.0:1789429470.564292:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21247 00000100:00100000:2.0:1789429470.564302:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+22:41982:x1876351635057664:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1789429470.564327:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429470.564346:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361567 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6c2 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.564435:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x84:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.564449:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361559 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6bb expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.564457:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.564485:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6bb expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.564496:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361559 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6bb expref: 23 pid: 5840 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429470.564508:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1876351648386304:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429470.564579:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f80d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789429470.577879:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1876351648386304:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429470.577907:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429470.590604:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429470.590661:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635057792 00000100:00100000:1.0:1789429470.590671:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635057792 00010000:00010000:1.0:1789429470.590709:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361559 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6bb expref: 24 pid: 5840 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429470.590742:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6210 00000100:00100000:1.0:1789429470.590751:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+24:2370:x1876351635057792:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429470.590775:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429470.590783:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361559 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6bb expref: 24 pid: 5840 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.594214:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6bb expref: 24 pid: 5840 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.594239:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361559 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6bb expref: 24 pid: 5840 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.594253:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f08640f00) 00010000:00010000:1.0:1789429470.594259:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.594268:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.594275:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.594304:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429470.594316:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.594327:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429470.594349:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x84:0x0]: returning size 0 00000100:00100000:1.0:1789429470.594365:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351635057792:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3614us (3768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429470.594374:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6210 00000004:00080000:2.0:1789429470.594607:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x35:0x0], index 0: 0 00010000:00010000:2.0:1789429470.594823:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.594833:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.594839:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.594845:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429470.594849:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.594858:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.594868:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f08640f00) 00010000:00010000:2.0:1789429470.594871:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789429470.594874:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.594880:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636156e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.595005:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361567 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6c2 expref: 23 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.595020:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x83:0x0].0x0 (ffff946f2076a600) 00010000:00010000:2.0:1789429470.595022:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789429470.595026:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361567 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6c2 expref: 23 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.595036:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429470.595067:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+22:41982:x1876351635057664:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 30767us (31313us total) trans 4294977180 rc 301/301 00000100:00100000:2.0:1789429470.595145:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21247 00000100:00100000:3.0:1789429470.599417:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429470.600785:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635058048 00000100:00100000:3.0:1789429470.600852:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635058048 00000100:00100000:3.0:1789429470.600933:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 268 00000100:00100000:3.0:1789429470.600942:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+22:41982:x1876351635058048:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1789429470.602553:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:41982:x1876351635058048:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1606us (3139us total) trans 4294977181 rc 0/0 00000100:00100000:3.0:1789429470.602568:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 268 00000100:00100000:3.0:1789429470.616062:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429470.617304:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635058176 00000100:00100000:1.0:1789429470.617314:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635058176 00000100:00100000:1.0:1789429470.617365:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21248 00000100:00100000:1.0:1789429470.617375:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+23:41982:x1876351635058176:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429470.617398:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429470.617419:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030400/0xb4c3dad72636157c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x84:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6c9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.617480:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030400/0xb4c3dad72636157c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6c9 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.617495:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030400/0xb4c3dad72636157c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6c9 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.617513:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f2076a900) 00010000:00010000:1.0:1789429470.617516:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789429470.617520:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030400, rc 0) 00000100:00100000:1.0:1789429470.617575:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+24:41982:x1876351635058176:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 200us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429470.617583:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21248 00000100:00100000:3.0:1789429470.623416:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429470.623783:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635058432 00000100:00100000:2.0:1789429470.623793:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635058432 00000100:00100000:2.0:1789429470.623847:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 269 00000100:00100000:2.0:1789429470.623858:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+24:41982:x1876351635058432:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1789429470.624143:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:41982:x1876351635058432:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 286us (735us total) trans 4294977182 rc 0/0 00000100:00100000:2.0:1789429470.624151:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 269 00000100:00100000:0.0:1789429470.662532:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429470.662620:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635058560 00000100:00100000:3.0:1789429470.662629:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635058560 00000100:00100000:3.0:1789429470.662676:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21249 00000100:00100000:3.0:1789429470.662686:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:41983:x1876351635058560:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:3.0:1789429470.662708:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429470.662728:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726361583 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6d0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663523:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636158a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663540:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636158a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663552:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636158a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663565:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361591 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663571:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663576:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663644:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x84:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663652:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663658:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429470.663691:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x84:0x0]: returning size 0 00000004:00200000:3.0:1789429470.663695:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429470.663714:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663725:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663732:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636158a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663739:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636158a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663766:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636158a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663780:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429470.663785:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636158a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663793:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636158a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663803:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x83:0x0].0x0 (ffff946f2076a600) 00010000:00010000:3.0:1789429470.663806:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429470.663811:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636158a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663818:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636158a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663827:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361591 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663832:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361591 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663837:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361591 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663844:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429470.663847:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361591 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663852:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361591 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663859:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x83:0x0].0xf8942489 (ffff946f08640200) 00010000:00010000:3.0:1789429470.663861:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429470.663864:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361591 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663870:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad726361591 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663899:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad726361583 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d0 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663934:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d0 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.663942:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f2076a900) 00010000:00010000:3.0:1789429470.663945:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429470.663947:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0800, rc 0) 00000100:00100000:3.0:1789429470.664003:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:41983:x1876351635058560:12345-192.168.203.39@tcp:101:cp.0 Request processed in 1319us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429470.664011:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21249 00000100:00100000:2.0:1789429470.675670:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429470.680966:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635058688 00000100:00100000:1.0:1789429470.680981:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635058688 00000100:00100000:1.0:1789429470.683351:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5805 00000100:00100000:1.0:1789429470.683368:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635058688:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:1.0:1789429470.683387:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429470.683405:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000445ff87b/0xb4c3dad72636159f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6d7 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429470.683431:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789429470.683449:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=1168s v=(0 0) 00010000:00010000:1.0:1789429470.683453:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429470.683462:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000445ff87b/0xb4c3dad72636159f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d7 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.683483:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000445ff87b/0xb4c3dad72636159f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d7 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.683494:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031800, rc 0) 00000100:00100000:1.0:1789429470.683559:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635058688:12345-192.168.203.39@tcp:101:cp.0 Request processed in 197us (7898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429470.683565:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5805 00000100:00080000:1.0:1789429470.685148:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429470.702531:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429470.702567:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635058944 00000100:00100000:1.0:1789429470.702578:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635058944 00000100:00100000:1.0:1789429470.702640:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21250 00000100:00100000:1.0:1789429470.702650:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+26:41983:x1876351635058944:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:1.0:1789429470.702670:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429470.702691:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263615a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.702798:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.702813:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d0 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.702823:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 4/0,1 mode: --/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.702861:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d0 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.702875:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d0 expref: 27 pid: 5840 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429470.702889:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648386432:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429470.702969:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429470.711819:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429470.711879:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648386432:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429470.712375:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429470.712404:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635059072 00000100:00100000:2.0:1789429470.712411:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635059072 00010000:00010000:2.0:1789429470.712445:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d0 expref: 28 pid: 5840 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429470.712562:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6211 00000100:00100000:2.0:1789429470.712572:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+28:2371:x1876351635059072:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429470.712823:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429470.712832:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d0 expref: 28 pid: 5840 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.712846:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d0 expref: 28 pid: 5840 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.712870:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361598 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d0 expref: 28 pid: 5840 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.712886:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f2076a900) 00010000:00010000:2.0:1789429470.712892:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.713135:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.713147:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.714021:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429470.714330:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.714342:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429470.714362:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x84:0x0]: returning size 0 00000100:00100000:2.0:1789429470.714375:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+27:2371:x1876351635059072:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1801us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429470.714384:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6211 00010000:00010000:3.0:1789429470.714495:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263615a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6de expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.714513:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6de expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.714521:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f2076a900) 00010000:00010000:3.0:1789429470.714524:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789429470.714526:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031000, rc 0) 00000100:00100000:3.0:1789429470.721391:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+27:41983:x1876351635058944:12345-192.168.203.39@tcp:101:cp.0 Request processed in 11905us (12031us total) trans 4294977183 rc 0/0 00000100:00100000:3.0:1789429470.721408:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21250 00000100:00100000:3.0:1789429470.735350:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429470.740337:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635059328 00000100:00100000:1.0:1789429470.740353:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635059328 00000100:00100000:1.0:1789429470.740425:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21251 00000100:00100000:1.0:1789429470.740435:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+27:41983:x1876351635059328:12345-192.168.203.39@tcp:36:cp.0 00010000:00010000:1.0:1789429470.740743:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.740768:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.740780:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789429470.740835:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977184 00000004:00010000:1.0:1789429470.740860:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000676680da reply state 00000000728645e6 transno 4294977185 ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429470.740869:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429470.740969:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:41983:x1876351635059328:12345-192.168.203.39@tcp:36:cp.0 Request processed in 535us (5629us total) trans 4294977185 rc 0/0 00000100:00100000:1.0:1789429470.740979:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21251 00000020:00080000:1.0:1789429470.740984:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789429470.746690:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429470.751354:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635059456 00000100:00100000:0.0:1789429470.751370:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635059456 00000100:00100000:0.0:1789429470.751441:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5806 00000100:00100000:0.0:1789429470.751452:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:41983:x1876351635059456:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:0.0:1789429470.751469:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429470.751487:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6e5 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429470.751516:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000445ff87b/0xb4c3dad72636159f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d7 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429470.751525:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429470.751530:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429470.751535:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429470.751568:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000445ff87b/0xb4c3dad72636159f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d7 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429470.751582:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000445ff87b/0xb4c3dad72636159f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d7 expref: 8 pid: 6682 timeout: 1268 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429470.751595:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05472a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648386560:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429470.751681:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0fb4de40 going to sleep for 11 seconds 00010000:00010000:3.0:1789429470.753304:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.753318:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.753326:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.753332:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429470.753336:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.753344:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.753361:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f2076a900) 00010000:00010000:3.0:1789429470.753364:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429470.753368:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.753375:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429470.759478:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429470.759530:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05472a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648386560:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429470.759590:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.759611:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad200, rc 0) 00000100:00100000:1.0:1789429470.759663:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:41983:x1876351635059456:12345-192.168.203.39@tcp:101:cp.0 Request processed in 8213us (12982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429470.759672:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5806 00000100:00100000:1.0:1789429470.759702:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635059584 00000100:00100000:1.0:1789429470.759709:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635059584 00010000:00010000:1.0:1789429470.759737:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000445ff87b/0xb4c3dad72636159f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d7 expref: 8 pid: 6682 timeout: 1268 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429470.759780:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6212 00000100:00100000:1.0:1789429470.759790:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635059584:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429470.759803:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429470.759808:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000445ff87b/0xb4c3dad72636159f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d7 expref: 8 pid: 6682 timeout: 1268 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.759821:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000445ff87b/0xb4c3dad72636159f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d7 expref: 8 pid: 6682 timeout: 1268 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.759870:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000445ff87b/0xb4c3dad72636159f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6d7 expref: 8 pid: 6682 timeout: 1268 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.759883:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429470.759887:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429470.759893:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.759904:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429470.759967:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429470.759981:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648386688:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429470.760252:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789429470.764560:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648386688:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429470.764584:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429470.764658:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635059584:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4868us (5189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429470.764670:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6212 00000100:00100000:1.0:1789429470.772957:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429470.772986:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635059712 00000100:00100000:1.0:1789429470.772996:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635059712 00002000:00010000:1.0:1789429470.773183:0:18633:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/53 (0->18446744073709551615) 00002000:00100000:1.0:1789429470.773501:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e2a00 with x1876351635059712 ext(0->18446744073709551615) 00002000:00010000:1.0:1789429470.773515:0:18633:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e2a00. 00000100:00100000:1.0:1789429470.773573:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11515 00000100:00100000:1.0:1789429470.773585:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635059712:12345-192.168.203.39@tcp:10:cp.0 00002000:00010000:1.0:1789429470.773879:0:18633:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789429470.773884:0:18633:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb mtime from disk: 0 -> 1789429471 00002000:00010000:1.0:1789429470.773886:0:18633:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789429470.773888:0:18633:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb ctime from disk: 0 -> 1789429471 00002000:00010000:1.0:1789429470.773890:0:18633:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789429470.773951:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635059712:12345-192.168.203.39@tcp:10:cp.0 Request processed in 368us (1002us total) trans 4294969270 rc 0/0 00000100:00100000:1.0:1789429470.773960:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11515 00002000:00010000:1.0:1789429470.773964:0:18633:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/53 (0->18446744073709551615) 00002000:00100000:1.0:1789429470.773966:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e2a00 with x1876351635059712 ext(0->18446744073709551615) 00002000:00010000:1.0:1789429470.773971:0:18633:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e2a00. 00000100:00100000:3.0:1789429470.784825:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429470.784858:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635059840 00000100:00100000:3.0:1789429470.784868:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635059840 00000100:00100000:3.0:1789429470.784926:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21252 00000100:00100000:3.0:1789429470.784936:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:41983:x1876351635059840:12345-192.168.203.39@tcp:101:cp.0 00010000:00010000:3.0:1789429470.784958:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429470.784977:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad7263615c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.785181:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263615d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x84:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.785337:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6de expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.785348:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263615d0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x84:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.785380:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6de expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429470.785394:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6de expref: 30 pid: 5839 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429470.785407:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f094700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648386816:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429470.785520:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429470.803270:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429470.803453:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f094700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5840:1876351648386816:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429470.803546:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263615d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x84:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429470.803725:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635059968 00000100:00100000:2.0:1789429470.803734:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635059968 00010000:00010000:2.0:1789429470.803778:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6de expref: 31 pid: 5839 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429470.803821:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6213 00000100:00100000:2.0:1789429470.803831:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351635059968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429470.803845:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429470.803851:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6de expref: 31 pid: 5839 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.803864:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6de expref: 31 pid: 5839 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.803885:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x84:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6de expref: 31 pid: 5839 timeout: 1268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.803900:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f2076a900) 00010000:00010000:2.0:1789429470.803906:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263615d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x84:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.803915:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263615d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.803923:0:11354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263615d0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.803945:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429470.803992:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351635059968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 161us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429470.804003:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6213 00010000:00010000:2.0:1789429470.804037:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263615d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.804044:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263615d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429470.804150:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x84:0x0]: returning size 0 00000004:00200000:2.0:1789429470.804154:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429470.804177:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263615d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.804250:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1c00/0xb4c3dad7263615c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x84:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6ec expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.804266:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263615d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6ec expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429470.804272:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f2076a900) 00010000:00010000:2.0:1789429470.804275:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789429470.804277:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0600, rc 0) 00000100:00100000:2.0:1789429470.804303:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:41983:x1876351635059840:12345-192.168.203.39@tcp:101:cp.0 Request processed in 19369us (19487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429470.804309:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21252 00000100:00100000:1.0:1789429470.817893:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429470.824153:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635060224 00000100:00100000:1.0:1789429470.824168:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635060224 00000100:00100000:1.0:1789429470.824265:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 270 00000100:00100000:1.0:1789429470.824276:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05ace450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:41983:x1876351635060224:12345-192.168.203.39@tcp:35:cp.0 00000100:00100000:1.0:1789429470.824643:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05ace450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:41983:x1876351635060224:12345-192.168.203.39@tcp:35:cp.0 Request processed in 368us (6758us total) trans 4294977186 rc 0/0 00000100:00100000:1.0:1789429470.824651:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 270 00000001:00080000:0.0:1789429470.858155:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969270 is committed 00010000:00010000:2.0:1789429471.465939:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429471.956977:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429471.957258:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635060352 00000100:00100000:3.0:1789429471.957269:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635060352 00000100:00100000:3.0:1789429471.957317:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21253 00000100:00100000:3.0:1789429471.957327:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:41994:x1876351635060352:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:3.0:1789429471.957346:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429471.957366:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad7263615d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6f3 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429471.957427:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429471.957441:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429471.957452:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429471.957496:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429471.957499:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429471.957538:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429471.957560:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad7263615d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6f3 expref: 17 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429471.957586:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6f3 expref: 16 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429471.957595:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:3.0:1789429471.957597:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429471.957601:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0a00, rc 0) 00000100:00100000:3.0:1789429471.957651:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:41994:x1876351635060352:12345-192.168.203.39@tcp:101:cat.0 Request processed in 325us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429471.957657:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21253 00000100:00100000:2.0:1789429471.966903:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429471.966967:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635060480 00000100:00100000:1.0:1789429471.966976:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635060480 00000100:00100000:1.0:1789429471.967032:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21254 00000100:00100000:1.0:1789429471.967041:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:41994:x1876351635060480:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:1.0:1789429471.967060:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429471.967080:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c6fa expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967138:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263615ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967151:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263615ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967163:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263615ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967178:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967185:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967192:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967307:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad7263615fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967316:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad7263615fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967323:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad7263615fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429471.967351:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x83:0x0]: returning size 16384 00000004:00200000:1.0:1789429471.967354:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429471.967374:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad7263615fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967385:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263615ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967392:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263615ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967399:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263615ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967405:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429471.967409:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263615ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967416:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263615ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967427:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:1.0:1789429471.967429:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429471.967434:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263615ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967440:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263615ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967451:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967462:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967468:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967473:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429471.967475:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967481:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967487:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf71a3c7c (ffff946f0970cc00) 00010000:00010000:1.0:1789429471.967489:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429471.967492:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967497:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263615f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf71a3c7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967522:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263615e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6fa expref: 18 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967534:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad7263615fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x83:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6fa expref: 17 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429471.967541:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x83:0x0].0x0 (ffff946f2076a600) 00010000:00010000:1.0:1789429471.967543:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789429471.967546:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030000, rc 0) 00000100:00100000:1.0:1789429471.967601:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:41994:x1876351635060480:12345-192.168.203.39@tcp:101:cat.0 Request processed in 561us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429471.967608:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21254 00000100:00100000:1.0:1789429471.972328:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429471.972501:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635060736 00000100:00100000:2.0:1789429471.972512:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635060736 00000100:00100000:2.0:1789429471.972565:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21255 00000100:00100000:2.0:1789429471.972585:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:41994:x1876351635060736:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:2.0:1789429471.972606:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429471.972625:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726361601 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c701 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.972691:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361608 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.972706:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.972718:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973329:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636160f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973342:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636160f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973351:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636160f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973460:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726361616 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x84:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973469:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726361616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973476:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726361616 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429471.973491:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x84:0x0]: returning size 158 00010000:00010000:2.0:1789429471.973687:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361608 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973696:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361608 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973704:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361608 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973711:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429471.973715:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361608 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973724:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361608 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973745:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x83:0x0].0x0 (ffff946f2076a600) 00010000:00010000:2.0:1789429471.973756:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429471.973761:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361608 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.973768:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361608 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.974325:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636160f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.974337:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636160f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.974348:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636160f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.974354:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429471.974357:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636160f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.974365:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636160f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.974375:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x83:0x0].0xf8942489 (ffff946f051efe00) 00010000:00010000:2.0:1789429471.974377:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429471.974381:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636160f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.974388:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad72636160f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x83:0x0].0xf8942489 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.974442:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726361601 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x83:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c701 expref: 20 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.974457:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726361616 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c701 expref: 19 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429471.974465:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f2076a900) 00010000:00010000:2.0:1789429471.974467:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789429471.974470:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547200, rc 0) 00000100:00100000:2.0:1789429471.974540:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:41994:x1876351635060736:12345-192.168.203.39@tcp:101:cat.0 Request processed in 1957us (2222us total) trans 4294977187 rc 0/0 00000100:00100000:2.0:1789429471.974552:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21255 00000100:00100000:2.0:1789429471.987495:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429471.987578:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635060864 00000100:00100000:1.0:1789429471.987588:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635060864 00000100:00100000:1.0:1789429471.987654:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5807 00000100:00100000:1.0:1789429471.987665:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2369:x1876351635060864:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:1.0:1789429471.987682:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429471.987700:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b66b031/0xb4c3dad726361624 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c708 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429471.987774:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648386944:192.168.203.39@tcp:106: 00000100:00100000:1.0:1789429471.987867:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f341a2780 going to sleep for 11 seconds 00000100:00080000:2.0:1789429471.988103:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1789429472.005591:0:20986:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb size: 0 -> 158 00002000:00010000:1.0:1789429472.005598:0:20986:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb atime: 0 -> 1789429470 00002000:00010000:1.0:1789429472.005613:0:20986:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x35:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:1.0:1789429472.005624:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648386944:192.168.203.39@tcp:106: 00010000:00010000:1.0:1789429472.005658:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b66b031/0xb4c3dad726361624 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c708 expref: 9 pid: 20986 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429472.005681:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b66b031/0xb4c3dad726361624 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c708 expref: 9 pid: 20986 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429472.005693:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031000, rc 0) 00000100:00100000:1.0:1789429472.005760:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2369:x1876351635060864:12345-192.168.203.39@tcp:101:cat.0 Request processed in 18096us (18274us total) trans 0 rc 301/301 00000100:00100000:1.0:1789429472.005769:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5807 00000100:00100000:0.0:1789429472.011142:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429472.011878:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635060992 00000100:00100000:2.0:1789429472.011889:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635060992 00000100:00100000:2.0:1789429472.011944:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5808 00000100:00100000:2.0:1789429472.011954:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:41994:x1876351635060992:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:2.0:1789429472.011972:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429472.011990:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad72636162b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c70f expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429472.012019:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 6 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429472.012029:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x35:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789429472.012034:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789429472.012039:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad72636162b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c70f expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429472.012072:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 6 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429472.012086:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 6 pid: 13238 timeout: 1269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429472.012099:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:20745:1876351648387072:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429472.012178:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f2bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789429472.020228:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429472.021274:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635061120 00000100:00100000:3.0:1789429472.021288:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635061120 00002000:00100000:3.0:1789429472.021352:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x35:0x0] (0->157) req@ffff946f2f094e00 x1876351635061120/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:208/0 lens 648/0 e 0 to 0 dl 1789429483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429472.021362:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f094e00 with x1876351635061120 ext(0->157) 00010000:00010000:3.0:1789429472.021371:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 7 pid: 13238 timeout: 1269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429472.021389:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 7 pid: 13238 timeout: 1270 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429472.021397:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f2f094e00 00000100:00100000:3.0:1789429472.021424:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1405 00000100:00100000:3.0:1789429472.021433:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+7:2368:x1876351635061120:12345-192.168.203.39@tcp:4:cp.0 00000100:00100000:3.0:1789429472.022702:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351635061120:12345-192.168.203.39@tcp:4:cp.0 Request processed in 1265us (2501us total) trans 4294969271 rc 0/0 00000100:00100000:3.0:1789429472.022714:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1405 00002000:00100000:3.0:1789429472.025879:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x35:0x0] (0->157) req@ffff946f2f094e00 x1876351635061120/t4294969271(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:208/0 lens 648/448 e 0 to 0 dl 1789429483 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429472.025893:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f094e00 with x1876351635061120 ext(0->157) 00010000:00010000:3.0:1789429472.025904:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 9 pid: 13238 timeout: 1270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429472.025923:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 9 pid: 13238 timeout: 1270 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429472.025938:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f2f094e00 00000100:00080000:3.0:1789429472.026821:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429472.032685:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429472.032919:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635061248 00000100:00100000:2.0:1789429472.032929:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635061248 00010000:00010000:2.0:1789429472.032970:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 9 pid: 13238 timeout: 1270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429472.033020:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6214 00000100:00100000:2.0:1789429472.033031:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:5596:x1876351635061248:12345-192.168.203.39@tcp:103:ldlm_cb00_000.0 00010000:00010000:2.0:1789429472.033045:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429472.033066:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 9 pid: 13238 timeout: 1270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429472.033081:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 9 pid: 13238 timeout: 1270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429472.033105:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1789429472.033110:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789429472.033118:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad72636162b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c70f expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429472.033129:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad72636162b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c70f expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429472.033178:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad72636162b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x35:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c70f expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429472.033228:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648387200:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429472.033304:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f2bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789429472.035544:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648387200:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429472.035569:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429472.035627:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:5596:x1876351635061248:12345-192.168.203.39@tcp:103:ldlm_cb00_000.0 Request processed in 2598us (2950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429472.035637:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6214 00010000:00010000:2.0:1789429472.045111:0:20745:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.39@tcp) returned -22 from blocking AST (req@00000000d86bdd22 x1876351648387072) - normal race ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 8 pid: 13238 timeout: 1270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429472.045150:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021b7f35e/0xb4c3dad7263615c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6e5 expref: 8 pid: 13238 timeout: 1270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429472.045165:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:20745:1876351648387072:192.168.203.39@tcp:104: 00010000:02000000:2.0:1789429472.045184:0:20745:0:(ldlm_lock.c:2060:ldlm_handle_conflict_lock()) *** cfs_fail_loc=316, val=0*** 00000020:00080000:2.0:1789429472.050396:0:20745:0:(genops.c:1633:class_fail_export()) disconnecting export ffff946e05c1a000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:2.0:1789429472.050410:0:20745:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad726360d3a 00000020:00010000:2.0:1789429472.050419:0:20745:0:(genops.c:1920:obd_stale_export_put()) Put export ffff946e05c1a000: total 0 00000100:00080000:2.0:1789429472.050425:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946e05c1e800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1789429472.050530:0:5827:0:(genops.c:1906:obd_stale_export_get()) Get export ffff946e05c1a000: total 0 00010000:00010000:3.0:1789429472.050575:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946e05c1a000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1789429472.050625:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b5e3d9/0xb4c3dad726361273 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5c6 expref: 9 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429472.050662:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086639b0c/0xb4c3dad726360d87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c453 expref: 8 pid: 20745 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429472.050674:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1789429472.050677:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb mtime from disk: 0 -> 1789429439 00002000:00010000:3.0:1789429472.050680:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb ctime from disk: 0 -> 1789429439 00002000:00010000:3.0:1789429472.050682:0:5827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x34:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1789429472.050689:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca262c9c/0xb4c3dad726361441 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1150975) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c66e expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429472.050700:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946e05c1a000, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1789429472.050709:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429472.050711:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429472.050712:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789429472.050725:0:20745:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969271 00000020:00080000:3.0:1789429472.050902:0:20745:0:(genops.c:1650:class_fail_export()) disconnected export ffff946e05c1a000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00010000:00010000:3.0:1789429472.050911:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad72636162b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c70f expref: 3 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429472.050922:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad72636162b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c70f expref: 3 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429472.050933:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546e00, rc -11) 00000100:00100000:3.0:1789429472.051007:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05472a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+2:41994:x1876351635060992:12345-192.168.203.39@tcp:101:cat.0 Request processed in 39053us (39871us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429472.051016:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5808 00000100:00100000:3.0:1789429472.056861:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429472.063223:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635061504 00000100:00100000:0.0:1789429472.063241:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635061504 00000100:00100000:0.0:1789429472.063307:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 271 00000100:00100000:0.0:1789429472.063319:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:41994:x1876351635061504:12345-192.168.203.39@tcp:35:cat.0 00000100:00080000:3.0:1789429472.063727:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429472.063993:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:41994:x1876351635061504:12345-192.168.203.39@tcp:35:cat.0 Request processed in 675us (7140us total) trans 4294977188 rc 0/0 00000100:00100000:0.0:1789429472.064001:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 271 00010000:00010000:2.0:1789429472.484397:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429473.047303:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000400:00000100:2.0:1789429473.047390:0:3291:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-192.168.203.39@tcp portal 16 match 1876351648387200 offset 224 length 224: 4 00000100:00100000:3.0:1789429473.047857:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635061632 00000100:00100000:3.0:1789429473.047867:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635061632 00000100:00100000:3.0:1789429473.048031:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11516 00000100:00100000:3.0:1789429473.048040:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0+-99:2371:x1876351635061632:12345-192.168.203.39@tcp:4:cp.0 00000020:00080000:3.0:1789429473.048049:0:19371:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.203.39@tcp 00000100:00100000:3.0:1789429473.048116:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:0+-99:2371:x1876351635061632:12345-192.168.203.39@tcp:4:cp.0 Request processed in 75us (820us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789429473.048124:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11516 00000100:00100000:3.0:1789429473.083436:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429473.083489:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635061760 00000100:00100000:2.0:1789429473.083500:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635061760 00000100:00100000:2.0:1789429473.083564:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21256 00000100:00100000:2.0:1789429473.083576:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:42004:x1876351635061760:12345-192.168.203.39@tcp:41:df.0 00000004:00000024:2.0:1789429473.083636:0:6704:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7683964928 avail 7679770624 00000100:00100000:2.0:1789429473.083731:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:42004:x1876351635061760:12345-192.168.203.39@tcp:41:df.0 Request processed in 157us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429473.084081:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21256 00000100:00100000:2.0:1789429473.090010:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429473.090086:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635061888 00000100:00100000:1.0:1789429473.090096:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635061888 00000100:00100000:1.0:1789429473.090176:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5809 00000100:00100000:1.0:1789429473.090185:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2367:x1876351635061888:12345-192.168.203.39@tcp:8:ptlrpcd_01_01.0 00010000:00080000:1.0:1789429473.090261:0:6681:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1171 last 0 00000020:00000080:1.0:1789429473.090293:0:6681:0:(genops.c:1384:class_connect()) connect: client 217af837-ec0e-4ad4-94fa-9fc2e0e9f711, cookie 0xb4c3dad726361632 00002000:00100000:1.0:1789429473.090305:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 217af837-ec0e-4ad4-94fa-9fc2e0e9f711/ffff946f3f330000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 1703936 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789429473.090315:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789429473.090422:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789429473.090450:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946f3f334000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789429473.090513:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2367:x1876351635061888:12345-192.168.203.39@tcp:8:ptlrpcd_01_01.0 Request processed in 327us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429473.090521:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5809 00010000:00010000:3.0:1789429473.507744:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429473.540266:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977188 is committed 00000001:00080000:0.0:1789429473.540296:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977186 is committed 00000100:00100000:1.0:1789429474.076087:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429474.076131:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429474.076162:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429474.076185:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429474.076228:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429474.076249:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429474.076541:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635062272 00000100:00100000:0.0:1789429474.076561:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635062272 00000100:00100000:0.0:1789429474.076623:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635062784 00000100:00100000:0.0:1789429474.076627:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635062784 00000100:00100000:0.0:1789429474.076645:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635062400 00000100:00100000:0.0:1789429474.076648:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635062400 00000100:00100000:0.0:1789429474.076670:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 906 00000100:00100000:0.0:1789429474.076680:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635062272:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429474.076765:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635062272:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 86us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429474.076773:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 906 00000100:00100000:0.0:1789429474.076790:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 907 00000100:00100000:0.0:1789429474.076796:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635062784:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429474.076823:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635062784:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429474.076829:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 907 00000100:00100000:0.0:1789429474.076841:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 908 00000100:00100000:0.0:1789429474.076847:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635062400:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429474.076867:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635062400:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429474.076872:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 908 00000100:00080000:0.0:1789429474.076887:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429474.076891:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429474.076922:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635062528 00000100:00100000:0.0:1789429474.076925:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635062528 00000100:00100000:0.0:1789429474.076956:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635062144 00000100:00100000:0.0:1789429474.076959:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635062144 00000100:00100000:0.0:1789429474.076975:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 868 00000100:00100000:0.0:1789429474.076981:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351635062528:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429474.077008:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351635062528:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429474.077014:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 868 00000100:00100000:0.0:1789429474.077026:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 869 00000100:00100000:0.0:1789429474.077032:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351635062144:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429474.077060:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351635062144:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429474.077065:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 869 00000100:00080000:0.0:1789429474.077082:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429474.077247:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635062016 00000100:00100000:2.0:1789429474.077253:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635062016 00000100:00100000:2.0:1789429474.077294:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 595 00000100:00100000:2.0:1789429474.077301:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635062016:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429474.077326:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635062016:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429474.077331:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 595 00000100:00100000:1.0:1789429474.077427:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429474.077447:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635062656 00000100:00100000:1.0:1789429474.077450:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635062656 00000100:00100000:1.0:1789429474.077475:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 909 00000100:00100000:1.0:1789429474.077482:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635062656:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429474.077505:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635062656:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429474.077511:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 909 00000100:00080000:1.0:1789429474.077523:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429474.470589:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648387456:0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.470653:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429474.470713:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648387968:0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.470756:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429474.470786:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789429474.470793:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648387328:0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.470823:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429474.470845:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648387840:0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.470865:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429474.470888:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648387584:0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.470907:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429474.470921:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429474.470925:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648387712:0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.470943:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429474.470968:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648387328 00000100:00100000:2.0:1789429474.470976:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648387328 00000100:00100000:2.0:1789429474.471018:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1789429474.471043:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648387328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.471088:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648387328:12345-0@lo:400:kworker.0 Request processed in 48us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429474.471095:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1789429474.471124:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648387456 00000100:00100000:2.0:1789429474.471127:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648387456 00000100:00100000:2.0:1789429474.471147:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648387840 00000100:00100000:2.0:1789429474.471150:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648387840 00000100:00100000:2.0:1789429474.471174:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648387584 00000100:00100000:2.0:1789429474.471177:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648387584 00000100:00100000:2.0:1789429474.471194:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:2.0:1789429474.471222:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648387456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.471253:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648387456:12345-0@lo:400:kworker.0 Request processed in 54us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429474.471259:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:2.0:1789429474.471271:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1789429474.471276:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648387840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.471303:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648387840:12345-0@lo:400:kworker.0 Request processed in 27us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429474.471309:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1789429474.471321:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1789429474.471327:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648387584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.471358:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648387584:12345-0@lo:400:kworker.0 Request processed in 32us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429474.471363:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00080000:2.0:1789429474.471380:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429474.471409:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648387584:0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.471434:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648387328:0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.471443:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648387840:0@lo:400:kworker.0 00000100:00100000:2.0:1789429474.471451:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648387456:0@lo:400:kworker.0 00000100:00100000:0.0:1789429474.471843:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648387968 00000100:00100000:0.0:1789429474.471848:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648387968 00000100:00100000:0.0:1789429474.471890:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648387712 00000100:00100000:0.0:1789429474.471894:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648387712 00000100:00100000:0.0:1789429474.471913:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1789429474.471920:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648387968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429474.471962:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648387968:12345-0@lo:400:kworker.0 Request processed in 43us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429474.471969:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1789429474.471981:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1789429474.471986:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c08e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648387712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429474.472017:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c08e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648387712:12345-0@lo:400:kworker.0 Request processed in 31us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429474.472026:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:0.0:1789429474.472232:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648387712:0@lo:400:kworker.0 00000100:00100000:0.0:1789429474.472256:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648387968:0@lo:400:kworker.0 00000100:00080000:2.0:1789429474.472403:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429474.472406:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789429474.543300:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429474.984219:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648388096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429474.984289:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429474.984367:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648388096 00000100:00100000:2.0:1789429474.984375:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648388096 00000100:00100000:2.0:1789429474.984425:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1789429474.984434:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648388096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429474.984468:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429474.984517:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648388096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429474.984524:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1789429474.984580:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648388096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429474.984802:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429474.984811:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648388224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429474.984839:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429474.984867:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648388224 00000100:00100000:1.0:1789429474.984871:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648388224 00000100:00100000:1.0:1789429474.984895:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1789429474.984902:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648388224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429474.984932:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49479680 pending 1703936 free 3855613952 avail 3853516800 00000100:00100000:1.0:1789429474.984966:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648388224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429474.984973:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1789429474.985002:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648388224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789429475.555910:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429476.580014:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789429477.083438:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000001:00100000:0.0:1789429477.083467:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:0.0:1789429477.083471:0:6707:0:(genops.c:885:class_export_put()) final put ffff946e05c1a000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000001:00080000:0.0:1789429477.083497:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969271 is committed 00000020:00000080:2.0:1789429477.083899:0:22526:0:(genops.c:844:class_export_destroy()) destroying export ffff946e05c1a000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 for lustre-OST0000 00000020:00000080:2.0:1789429477.083974:0:22526:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946e05c1e800 for lustre-OST0000 00010000:00010000:3.0:1789429477.603478:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429478.628881:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429479.190441:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429479.190541:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429479.190579:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429479.190610:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429479.190631:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429479.190663:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429479.190688:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429479.190722:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635063168 00000100:00100000:0.0:1789429479.190732:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635063168 00000100:00100000:0.0:1789429479.190784:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635063680 00000100:00100000:0.0:1789429479.190787:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635063680 00000100:00100000:0.0:1789429479.190803:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635063296 00000100:00100000:0.0:1789429479.190806:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635063296 00000100:00100000:0.0:1789429479.190823:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635063552 00000100:00100000:0.0:1789429479.190826:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635063552 00000100:00100000:0.0:1789429479.190842:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 912 00000100:00100000:0.0:1789429479.190851:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635063168:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429479.190924:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635063168:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 74us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429479.190932:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 912 00000100:00100000:0.0:1789429479.190962:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 913 00000100:00100000:0.0:1789429479.190969:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635063680:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429479.190992:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635063680:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429479.190998:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 913 00000100:00100000:0.0:1789429479.191008:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 914 00000100:00100000:0.0:1789429479.191014:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635063296:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429479.191030:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635063296:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 16us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429479.191035:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 914 00000100:00100000:0.0:1789429479.191043:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 915 00000100:00100000:0.0:1789429479.191049:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635063552:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429479.191065:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635063552:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 16us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429479.191070:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 915 00000100:00100000:2.0:1789429479.191289:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635063424 00000100:00100000:2.0:1789429479.191294:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635063424 00000100:00100000:2.0:1789429479.191334:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635063040 00000100:00100000:2.0:1789429479.191337:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635063040 00000100:00100000:2.0:1789429479.191354:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 873 00000100:00100000:2.0:1789429479.191360:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2369:x1876351635063424:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429479.191393:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2369:x1876351635063424:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429479.191399:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 873 00000100:00100000:2.0:1789429479.191411:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 874 00000100:00100000:2.0:1789429479.191416:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+21:2369:x1876351635063040:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429479.191434:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+21:2369:x1876351635063040:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 19us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429479.191440:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 874 00000100:00080000:2.0:1789429479.191453:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429479.191457:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429479.191459:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429479.192020:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635062912 00000100:00100000:1.0:1789429479.192025:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635062912 00000100:00100000:1.0:1789429479.192094:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 597 00000100:00100000:1.0:1789429479.192102:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635062912:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429479.192150:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635062912:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 49us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429479.192157:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 597 00000100:00100000:3.0:1789429479.587516:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648388608:0@lo:400:kworker.0 00000100:00100000:2.0:1789429479.587562:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648388480:0@lo:400:kworker.0 00000100:00100000:3.0:1789429479.587588:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429479.587607:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648388736:0@lo:400:kworker.0 00000100:00100000:0.0:1789429479.587680:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648388352:0@lo:400:kworker.0 00000100:00100000:1.0:1789429479.587742:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648388608 00000100:00100000:1.0:1789429479.587751:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648388608 00000100:00100000:1.0:1789429479.587817:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1789429479.587826:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648388608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429479.588921:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789429479.588997:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429479.589010:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429479.589038:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648388992:0@lo:400:kworker.0 00000100:00100000:2.0:1789429479.589066:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429479.589101:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648388736 00000100:00100000:2.0:1789429479.589106:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648388736 00000100:00100000:2.0:1789429479.589155:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648388992 00000100:00100000:2.0:1789429479.589158:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648388992 00000100:00100000:2.0:1789429479.589183:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:2.0:1789429479.589190:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648388736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429479.589250:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648388736:12345-0@lo:400:kworker.0 Request processed in 61us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429479.589257:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:2.0:1789429479.589275:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:2.0:1789429479.589281:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648388992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429479.589313:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648388992:12345-0@lo:400:kworker.0 Request processed in 32us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429479.589318:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00080000:2.0:1789429479.589336:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429479.589339:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429479.589362:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648388992:0@lo:400:kworker.0 00000100:00100000:2.0:1789429479.589384:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648388480 00000100:00100000:2.0:1789429479.589387:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648388480 00000100:00100000:2.0:1789429479.589414:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:2.0:1789429479.589420:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648388480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429479.589468:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648388480:12345-0@lo:400:kworker.0 Request processed in 34us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429479.589475:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:2.0:1789429479.589500:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648388480:0@lo:400:kworker.0 00000100:00100000:2.0:1789429479.589521:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648388736:0@lo:400:kworker.0 00000100:00100000:1.0:1789429479.592930:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648388608:12345-0@lo:400:kworker.0 Request processed in 5098us (5335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429479.592944:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1789429479.593066:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429479.593078:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648388608:0@lo:400:kworker.0 00000100:00100000:0.0:1789429479.593117:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648388864:0@lo:400:kworker.0 00000100:00100000:2.0:1789429479.593124:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648388352 00000100:00100000:2.0:1789429479.593132:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648388352 00000100:00100000:0.0:1789429479.593171:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429479.593182:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1789429479.593191:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648388352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429479.593273:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648388352:12345-0@lo:400:kworker.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429479.593280:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1789429479.593358:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648388352:0@lo:400:kworker.0 00000100:00100000:3.0:1789429479.593392:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648388864 00000100:00100000:3.0:1789429479.593397:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648388864 00000100:00100000:3.0:1789429479.593448:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1789429479.593457:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648388864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429479.593503:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648388864:12345-0@lo:400:kworker.0 Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429479.593511:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1789429479.593527:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648388864:0@lo:400:kworker.0 00000100:00080000:2.0:1789429479.593627:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789429479.652185:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429480.099634:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648389120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429480.099710:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429480.099764:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648389120 00000100:00100000:1.0:1789429480.099772:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648389120 00000100:00100000:1.0:1789429480.099833:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1789429480.099843:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648389120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429480.099874:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47775744 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1789429480.099979:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648389120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429480.099987:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1789429480.100747:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648389248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429480.100785:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429480.100867:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648389248 00000100:00100000:3.0:1789429480.100872:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648389248 00000100:00100000:3.0:1789429480.100913:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1789429480.100921:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648389248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429480.100942:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429480.100986:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648389248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429480.100992:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1789429480.101069:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648389248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429480.101772:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648389120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789429480.677384:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789429480.903948:0:24846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 31r: open-rename(replace) race =========== 19:44:39 (1789429479) 00000100:00100000:0.0:1789429480.985394:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429480.985475:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635063936 00000100:00100000:1.0:1789429480.985484:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635063936 00000100:00100000:1.0:1789429480.985534:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21257 00000100:00100000:1.0:1789429480.985545:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+21:42563:x1876351635063936:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:1.0:1789429480.985566:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429480.985569:0:15669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789429480.985594:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726361521 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6ad expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429480.985609:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:1.0:1789429480.985614:0:15669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429480.985625:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361639 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c716 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429480.985862:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429480.985872:0:15669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6f3 expref: 17 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429480.985878:0:15669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429480.985904:0:15669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6f3 expref: 17 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429480.985915:0:15669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6f3 expref: 17 pid: 6704 timeout: 1278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429480.985925:0:15669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648389376:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429480.986001:0:15669:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e02408840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429480.997559:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429480.997610:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635064064 00000100:00100000:3.0:1789429480.997620:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635064064 00010000:00010000:3.0:1789429480.997655:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6f3 expref: 18 pid: 6704 timeout: 1278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429480.997706:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6215 00000100:00100000:3.0:1789429480.997716:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351635064064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429480.997733:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429480.997751:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6f3 expref: 18 pid: 6704 timeout: 1278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429480.997752:0:15669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648389376:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429480.997772:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6f3 expref: 18 pid: 6704 timeout: 1278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429480.997784:0:15669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429480.997795:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263615de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6f3 expref: 18 pid: 6704 timeout: 1278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429480.997811:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:3.0:1789429480.997816:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429480.997825:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429480.997833:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429480.997858:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429480.997905:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2371:x1876351635064064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 190us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429480.997912:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6215 00010000:00010000:1.0:1789429481.003745:0:15669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.003761:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.003791:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361647 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.003804:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.003816:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429481.024818:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x36:0x0], index 0: 0 00010000:00010000:1.0:1789429481.025408:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad72636164e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.025426:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad72636164e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.025442:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad72636164e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.025478:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.025485:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.025491:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.025497:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429481.025501:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.025523:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.025540:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdf00) 00010000:00010000:1.0:1789429481.025543:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429481.025547:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.025554:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361640 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429481.025567:0:15669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b3c9bff9 reply state 0000000013815621 transno 4294977189 ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429481.025576:0:15669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429481.025611:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361639 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c716 expref: 23 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.025632:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad72636164e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c716 expref: 22 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.025640:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x85:0x0].0x0 (ffff946f0970cd00) 00010000:00010000:1.0:1789429481.025642:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429481.025645:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030600, rc 0) 00000100:00100000:1.0:1789429481.025784:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+23:42563:x1876351635063936:12345-192.168.203.39@tcp:101:touch.0 Request processed in 40240us (40395us total) trans 4294977189 rc 0/0 00000100:00100000:1.0:1789429481.025793:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21257 00010000:00010000:3.0:1789429481.034133:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361647 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.034152:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361647 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.034165:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361647 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.034172:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429481.034177:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361647 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.034187:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361647 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.034221:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7bf5d484 (ffff946f0970c200) 00010000:00010000:3.0:1789429481.034226:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429481.034231:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361647 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.034239:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361647 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429481.038992:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429481.039792:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635064320 00000100:00100000:2.0:1789429481.039803:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635064320 00000100:00080000:0.0:1789429481.039932:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429481.040311:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21258 00000100:00100000:2.0:1789429481.040322:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+22:42563:x1876351635064320:12345-192.168.203.39@tcp:36:touch.0 00010000:00010000:2.0:1789429481.040377:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429481.040414:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad72636164e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c716 expref: 22 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.040431:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x85:0x0].0x0 (ffff946f0970cd00) 00010000:00010000:2.0:1789429481.040442:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429481.040482:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636165c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.040494:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636165c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.040514:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636165c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789429481.040643:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e4e5522d reply state 000000009bd7e469 transno 4294977190 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636165c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429481.040653:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789429481.041982:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:42563:x1876351635064320:12345-192.168.203.39@tcp:36:touch.0 Request processed in 1658us (3003us total) trans 4294977190 rc 0/0 00000100:00100000:2.0:1789429481.041992:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21258 00010000:00010000:3.0:1789429481.048920:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636165c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.048938:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636165c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.048945:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636165c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.048951:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429481.048956:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636165c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.048965:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636165c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.048980:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x85:0x0].0x0 (ffff946f051efd00) 00010000:00010000:3.0:1789429481.048984:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429481.048989:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636165c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429481.048994:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad72636165c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x85:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429481.049845:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429481.049939:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635064448 00000100:00100000:0.0:1789429481.049949:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635064448 00000100:00100000:0.0:1789429481.050030:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21259 00000100:00100000:0.0:1789429481.050039:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+22:42563:x1876351635064448:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:0.0:1789429481.050058:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429481.050076:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726361663 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x85:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c71d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.050126:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726361663 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x85:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c71d expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.050139:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726361663 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x85:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c71d expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.050155:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x85:0x0].0x0 (ffff946f120fde00) 00010000:00010000:0.0:1789429481.050159:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789429481.050161:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429481.050243:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:42563:x1876351635064448:12345-192.168.203.39@tcp:101:touch.0 Request processed in 204us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429481.050255:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21259 00000100:00100000:0.0:1789429481.052472:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429481.052812:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635064576 00000100:00100000:2.0:1789429481.052821:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635064576 00000100:00100000:2.0:1789429481.052883:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5810 00000100:00100000:2.0:1789429481.052892:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635064576:12345-192.168.203.39@tcp:2:touch.0 00000100:00100000:2.0:1789429481.053186:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635064576:12345-192.168.203.39@tcp:2:touch.0 Request processed in 294us (719us total) trans 4294969272 rc 0/0 00000100:00100000:2.0:1789429481.053193:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5810 00000100:00080000:0.0:1789429481.053633:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429481.060855:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429481.060981:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635064832 00000100:00100000:0.0:1789429481.060991:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635064832 00000100:00100000:0.0:1789429481.061044:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 272 00000100:00100000:0.0:1789429481.061053:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+23:42563:x1876351635064832:12345-192.168.203.39@tcp:35:touch.0 00000100:00100000:0.0:1789429481.061417:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+24:42563:x1876351635064832:12345-192.168.203.39@tcp:35:touch.0 Request processed in 364us (569us total) trans 4294977191 rc 0/0 00000100:00100000:0.0:1789429481.061425:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 272 00000100:00100000:3.0:1789429481.081126:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429481.081223:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635064960 00000100:00100000:2.0:1789429481.081233:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635064960 00000100:00100000:2.0:1789429481.081290:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21260 00000100:00100000:2.0:1789429481.081300:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+24:42569:x1876351635064960:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:2.0:1789429481.081323:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429481.081344:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636166a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c724 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.081401:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361671 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.081416:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.081427:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429481.081457:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429481.081460:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429481.081478:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361671 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.081500:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad72636166a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c724 expref: 26 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.081536:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361671 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c724 expref: 25 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.081544:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef900) 00010000:00010000:2.0:1789429481.081547:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429481.081551:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429481.081607:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+25:42569:x1876351635064960:12345-192.168.203.39@tcp:101:touch.0 Request processed in 308us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429481.081615:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21260 00000100:00100000:3.0:1789429481.093893:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429481.093993:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635065216 00000100:00100000:1.0:1789429481.094003:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635065216 00000100:00100000:1.0:1789429481.094056:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21261 00000100:00100000:1.0:1789429481.094066:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:42569:x1876351635065216:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:1.0:1789429481.094089:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429481.094092:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789429481.094117:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361671 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c724 expref: 25 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094137:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef900) 00010000:00010000:1.0:1789429481.094146:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429481.094160:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361678 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c72b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094297:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636167f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094310:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636167f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094320:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636167f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094332:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361686 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094339:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361686 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094346:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361686 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429481.094753:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x34:0x0], index 1: 0 00010000:00010000:1.0:1789429481.094900:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad72636168d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094910:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad72636168d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094916:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad72636168d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094945:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636167f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094951:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636167f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094957:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636167f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094962:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429481.094966:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636167f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094972:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636167f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094979:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429481.094981:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429481.094985:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636167f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.094990:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636167f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429481.094999:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002be87ed4 reply state 000000002680bc5c transno 4294977192 ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361686 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429481.095008:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429481.095030:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361678 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c72b expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.095046:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad72636168d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c72b expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429481.095053:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff946f0970c100) 00010000:00010000:1.0:1789429481.095055:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429481.095057:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030600, rc 0) 00000100:00100000:1.0:1789429481.095123:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+27:42569:x1876351635065216:12345-192.168.203.39@tcp:101:touch.0 Request processed in 1059us (1238us total) trans 4294977192 rc 0/0 00000100:00100000:1.0:1789429481.095130:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21261 00010000:00010000:2.0:1789429481.108722:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361686 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.108748:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361686 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.108762:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361686 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.108769:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429481.108773:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361686 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.108780:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361686 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.108797:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6cf40fa (ffff946f0970c500) 00010000:00010000:2.0:1789429481.108800:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429481.108804:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361686 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.108810:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361686 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429481.110292:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429481.110539:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635065472 00000100:00100000:0.0:1789429481.110549:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635065472 00000100:00100000:0.0:1789429481.110604:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21262 00000100:00100000:0.0:1789429481.110614:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+26:42569:x1876351635065472:12345-192.168.203.39@tcp:36:touch.0 00010000:00010000:0.0:1789429481.110686:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429481.110710:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad72636168d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c72b expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.110727:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff946f0970c100) 00010000:00010000:0.0:1789429481.110737:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429481.110786:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636169b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.110799:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636169b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.110808:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636169b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429481.110926:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000241491af reply state 00000000a8b9a2f8 transno 4294977193 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636169b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429481.110937:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429481.111017:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+27:42569:x1876351635065472:12345-192.168.203.39@tcp:36:touch.0 Request processed in 404us (731us total) trans 4294977193 rc 0/0 00000100:00100000:0.0:1789429481.111024:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21262 00000100:00100000:3.0:1789429481.115110:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429481.119519:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635065600 00000100:00100000:0.0:1789429481.119540:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635065600 00000100:00100000:0.0:1789429481.119602:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21263 00000100:00100000:0.0:1789429481.119611:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+27:42569:x1876351635065600:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:0.0:1789429481.119633:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429481.119654:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263616a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c732 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.119718:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263616a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c732 expref: 28 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.119734:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263616a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c732 expref: 28 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.119759:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:0.0:1789429481.119762:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789429481.119766:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac800, rc 0) 00000100:00100000:0.0:1789429481.119823:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+28:42569:x1876351635065600:12345-192.168.203.39@tcp:101:touch.0 Request processed in 213us (4719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429481.119833:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21263 00010000:00010000:2.0:1789429481.127535:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636169b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.127552:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636169b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.127561:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636169b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.127567:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ade00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429481.127572:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636169b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.127585:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636169b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.127602:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:2.0:1789429481.127605:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429481.127610:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636169b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.127616:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636169b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x86:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429481.131838:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429481.133010:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635065728 00000100:00100000:2.0:1789429481.133022:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635065728 00000100:00100000:2.0:1789429481.133094:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5811 00000100:00100000:2.0:1789429481.133105:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635065728:12345-192.168.203.39@tcp:2:touch.0 00000100:00100000:2.0:1789429481.133440:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635065728:12345-192.168.203.39@tcp:2:touch.0 Request processed in 336us (1610us total) trans 4294969605 rc 0/0 00000100:00100000:2.0:1789429481.133448:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5811 00000100:00080000:0.0:1789429481.133475:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429481.136283:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429481.136358:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635065984 00000100:00100000:2.0:1789429481.136367:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635065984 00000100:00100000:2.0:1789429481.136410:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 273 00000100:00100000:2.0:1789429481.136420:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+27:42569:x1876351635065984:12345-192.168.203.39@tcp:35:touch.0 00000100:00100000:2.0:1789429481.136931:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:42569:x1876351635065984:12345-192.168.203.39@tcp:35:touch.0 Request processed in 511us (656us total) trans 4294977194 rc 0/0 00000100:00100000:2.0:1789429481.136939:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 273 00000100:00100000:1.0:1789429481.179902:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429481.179999:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635066112 00000100:00100000:0.0:1789429481.180008:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635066112 00000100:00100000:0.0:1789429481.180066:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21264 00000100:00100000:0.0:1789429481.180075:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+28:42574:x1876351635066112:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:0.0:1789429481.180097:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429481.180120:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263616a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c739 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.180185:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.180235:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.180247:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429481.180279:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429481.180284:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429481.180303:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.180326:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263616a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c739 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.180345:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c739 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.180359:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:0.0:1789429481.180362:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429481.180365:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad600, rc 0) 00000100:00100000:0.0:1789429481.180426:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:42574:x1876351635066112:12345-192.168.203.39@tcp:101:ls.0 Request processed in 352us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429481.180434:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21264 00000100:00100000:3.0:1789429481.193146:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429481.193245:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635066240 00000100:00100000:0.0:1789429481.193254:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635066240 00000100:00100000:0.0:1789429481.193311:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21265 00000100:00100000:0.0:1789429481.193321:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:42574:x1876351635066240:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:0.0:1789429481.193340:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429481.193360:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263616b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c740 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193418:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193432:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193443:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193458:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193465:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193476:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193561:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x85:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193570:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193577:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429481.193608:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x85:0x0]: returning size 0 00000004:00200000:0.0:1789429481.193612:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429481.193631:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193641:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193650:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193657:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193663:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193668:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429481.193673:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193690:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193701:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:0.0:1789429481.193704:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429481.193709:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193715:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193728:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193734:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193750:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193756:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2acc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429481.193759:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193765:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193773:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7bf5d484 (ffff946f120fd600) 00010000:00010000:0.0:1789429481.193775:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429481.193777:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193786:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193812:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263616b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c740 expref: 31 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193825:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c740 expref: 30 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429481.193832:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x85:0x0].0x0 (ffff946f120fde00) 00010000:00010000:0.0:1789429481.193834:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429481.193836:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429481.193894:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+30:42574:x1876351635066240:12345-192.168.203.39@tcp:101:ls.0 Request processed in 574us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429481.193901:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21265 00000100:00100000:3.0:1789429481.201761:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429481.201873:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635066368 00000100:00100000:2.0:1789429481.201884:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635066368 00000100:00100000:2.0:1789429481.201940:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5812 00000100:00100000:2.0:1789429481.201950:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635066368:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:2.0:1789429481.201967:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429481.201988:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad7263616d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c747 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429481.202009:0:20745:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x6aa886e9, atime: 0x6aa886e9, ctime: 0x6aa886e9, blocks: 0x1 00010000:00010000:2.0:1789429481.202025:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=1179s v=(0 0) 00010000:00010000:2.0:1789429481.202028:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429481.202035:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad7263616d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c747 expref: 8 pid: 20745 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.202049:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad7263616d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c747 expref: 8 pid: 20745 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429481.202058:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546800, rc 0) 00000100:00100000:2.0:1789429481.202103:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635066368:12345-192.168.203.39@tcp:101:ls.0 Request processed in 156us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429481.202108:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5812 00010000:00010000:3.0:1789429481.699415:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429482.215491:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969272 is committed 00000001:00080000:1.0:1789429482.246420:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969605 is committed 00000100:00100000:1.0:1789429482.286340:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429482.286699:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635066496 00000100:00100000:0.0:1789429482.286710:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635066496 00000100:00100000:0.0:1789429482.286844:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21266 00000100:00100000:0.0:1789429482.286856:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:42580:x1876351635066496:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:0.0:1789429482.286875:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429482.286897:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263616da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c74e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.286958:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.286969:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.286978:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429482.287016:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429482.287019:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429482.287060:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.287084:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad7263616da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c74e expref: 19 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.287107:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c74e expref: 18 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.287116:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:0.0:1789429482.287119:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429482.287122:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429482.287186:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:42580:x1876351635066496:12345-192.168.203.39@tcp:101:mv.0 Request processed in 332us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429482.287194:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21266 00000100:00100000:3.0:1789429482.291127:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429482.291729:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635066624 00000100:00100000:0.0:1789429482.291740:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635066624 00000100:00100000:0.0:1789429482.291805:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21267 00000100:00100000:0.0:1789429482.291825:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:42580:x1876351635066624:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:0.0:1789429482.291844:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429482.291865:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c755 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.291928:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263616ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.291942:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263616ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.291953:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263616ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.291968:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263616f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.291975:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263616f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.291982:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263616f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292078:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263616fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292086:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263616fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292093:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263616fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429482.292125:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x86:0x0]: returning size 0 00000004:00200000:0.0:1789429482.292129:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429482.292146:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263616fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292161:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263616fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292169:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263616ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292175:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263616ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292182:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263616ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292187:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429482.292191:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263616ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292218:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263616ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292230:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:0.0:1789429482.292233:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429482.292237:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263616ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292244:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263616ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292257:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263616f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292264:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263616f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292270:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263616f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292275:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2adc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429482.292278:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263616f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292283:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263616f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292291:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6cf40fa (ffff946f120fdf00) 00010000:00010000:0.0:1789429482.292293:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429482.292296:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263616f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292301:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263616f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292328:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad7263616e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c755 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292342:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263616fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c755 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.292349:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:0.0:1789429482.292351:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429482.292353:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:0.0:1789429482.292412:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:42580:x1876351635066624:12345-192.168.203.39@tcp:101:mv.0 Request processed in 589us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429482.292421:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21267 00000100:00080000:2.0:1789429482.293589:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429482.297076:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429482.297160:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635066752 00000100:00100000:2.0:1789429482.297170:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635066752 00000100:00100000:2.0:1789429482.297284:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21268 00000100:00100000:2.0:1789429482.297294:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:42580:x1876351635066752:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:2.0:1789429482.297312:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429482.297332:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c75c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297392:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad72636170b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297405:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad72636170b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297416:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad72636170b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297429:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726361712 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297436:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726361712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297443:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726361712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297595:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361719 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x85:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297604:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297610:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429482.297642:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x85:0x0]: returning size 0 00000004:00200000:2.0:1789429482.297647:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429482.297684:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297697:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297706:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad72636170b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297713:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad72636170b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297720:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad72636170b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297727:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429482.297731:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad72636170b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297738:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad72636170b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297749:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:2.0:1789429482.297752:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429482.297757:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad72636170b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297764:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad72636170b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297776:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726361712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297781:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726361712 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297789:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726361712 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297794:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429482.297797:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726361712 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297803:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726361712 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297809:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7bf5d484 (ffff946f051ef300) 00010000:00010000:2.0:1789429482.297811:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429482.297814:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726361712 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297820:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547000/0xb4c3dad726361712 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297845:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c75c expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297859:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c75c expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.297867:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x85:0x0].0x0 (ffff946f120fde00) 00010000:00010000:2.0:1789429482.297869:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789429482.297872:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429482.297929:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:42580:x1876351635066752:12345-192.168.203.39@tcp:101:mv.0 Request processed in 637us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429482.297943:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21268 00000100:00100000:0.0:1789429482.307436:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429482.307513:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635066880 00000100:00100000:2.0:1789429482.307523:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635066880 00000100:00100000:2.0:1789429482.307587:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5813 00000100:00100000:2.0:1789429482.307596:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635066880:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:2.0:1789429482.307614:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429482.307629:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361720 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c763 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.307653:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789429482.307658:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429482.307666:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c763 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.307699:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c763 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.307710:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546400, rc 0) 00000100:00100000:2.0:1789429482.307770:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635066880:12345-192.168.203.39@tcp:101:mv.0 Request processed in 175us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429482.307776:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5813 00000100:00080000:0.0:1789429482.307837:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429482.311495:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429482.312921:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635067008 00000100:00100000:2.0:1789429482.312934:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635067008 00000100:00100000:2.0:1789429482.313028:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5814 00000100:00100000:2.0:1789429482.313039:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635067008:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:2.0:1789429482.313059:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429482.313080:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726361727 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c76a expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429482.313106:0:8085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x6aa886e9, atime: 0x6aa886e9, ctime: 0x6aa886e9, blocks: 0x1 00010000:00010000:2.0:1789429482.313128:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=1180s v=(0 0) 00010000:00010000:2.0:1789429482.313133:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429482.313142:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726361727 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c76a expref: 7 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.313160:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726361727 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c76a expref: 7 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.313173:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547000, rc 0) 00000100:00100000:2.0:1789429482.313266:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635067008:12345-192.168.203.39@tcp:101:mv.0 Request processed in 229us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429482.313273:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5814 00000100:00080000:0.0:1789429482.314097:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429482.321282:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429482.323857:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635067264 00000100:00100000:3.0:1789429482.323870:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635067264 00000100:00100000:3.0:1789429482.323929:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:3.0:1789429482.323939:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:42580:x1876351635067264:12345-192.168.203.39@tcp:36:mv.0 00010000:00010000:3.0:1789429482.323984:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789429482.324009:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361719 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c75c expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.324028:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x85:0x0].0x0 (ffff946f120fde00) 00010000:00010000:3.0:1789429482.324038:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263616fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c755 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.324047:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:3.0:1789429482.324054:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad7263616e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c74e expref: 18 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.324063:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:3.0:1789429482.324066:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429482.324091:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.324105:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c739 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.324114:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.324148:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c739 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.324163:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c739 expref: 29 pid: 5841 timeout: 1280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429482.324176:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0ab100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:5853:1876351648389504:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429482.324310:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0fb4d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429482.332608:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0ab100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:5853:1876351648389504:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429482.332637:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429482.333155:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429482.333458:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635067392 00000100:00100000:2.0:1789429482.333466:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635067392 00010000:00010000:2.0:1789429482.333504:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c739 expref: 30 pid: 5841 timeout: 1280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429482.333667:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6216 00000100:00100000:2.0:1789429482.333693:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351635067392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429482.333708:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429482.333725:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c739 expref: 30 pid: 5841 timeout: 1280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.333739:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c739 expref: 30 pid: 5841 timeout: 1280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.333760:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263616b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c739 expref: 30 pid: 5841 timeout: 1280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.333780:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:2.0:1789429482.333786:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.333794:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.333802:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.333840:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429482.333905:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351635067392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 215us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429482.333913:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6216 00010000:00010000:3.0:1789429482.333972:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.333983:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.334006:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361735 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.334017:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361735 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.334025:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361735 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.334040:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636173c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.334047:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636173c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.334054:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636173c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.334166:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x85:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.334182:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c740 expref: 28 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.334191:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.334244:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c740 expref: 28 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.334258:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c740 expref: 28 pid: 15700 timeout: 1280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429482.334272:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0ab100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:5853:1876351648389632:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429482.334411:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0fb4d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429482.337088:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0ab100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:5853:1876351648389632:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429482.337116:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429482.338122:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429482.338316:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635067520 00000100:00100000:3.0:1789429482.338324:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635067520 00010000:00010000:3.0:1789429482.338359:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c740 expref: 29 pid: 15700 timeout: 1280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429482.338399:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6217 00000100:00100000:3.0:1789429482.338408:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351635067520:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429482.338421:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429482.338429:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c740 expref: 29 pid: 15700 timeout: 1280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.338442:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c740 expref: 29 pid: 15700 timeout: 1280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.338463:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263616cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c740 expref: 29 pid: 15700 timeout: 1280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.338479:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x85:0x0].0x0 (ffff946f120fde00) 00010000:00010000:3.0:1789429482.338484:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.338505:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.338514:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.338543:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429482.338702:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.338710:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.338733:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad72636174a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.338743:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad72636174a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.338751:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad72636174a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789429482.339449:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].25, 64 off9792 00000004:00080000:1.0:1789429482.339459:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1180319258354ns, next at 1181319256383ns, rc = 0 00010000:00010000:1.0:1789429482.339559:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339569:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339576:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339582:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429482.339587:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339595:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339605:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x85:0x0].0x0 (ffff946f120fde00) 00010000:00010000:1.0:1789429482.339609:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789429482.339613:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339620:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361743 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x85:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429482.339636:0:5853:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000043dadd56 reply state 000000008106806f transno 4294977195 ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad72636174a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429482.339644:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429482.339650:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339657:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339663:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339667:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429482.339682:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339689:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339696:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fda00) 00010000:00010000:1.0:1789429482.339698:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429482.339701:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339707:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad72636172e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429482.339722:0:5853:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000043dadd56 reply state 000000008106806f transno 4294977195 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361735 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429482.339734:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00010000:1.0:1789429482.339737:0:5853:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000043dadd56 reply state 000000008106806f transno 4294977195 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636173c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429482.339743:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00010000:00010000:1.0:1789429482.339753:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361751 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x85:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339761:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339769:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361751 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339777:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361751 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339783:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361751 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339788:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429482.339802:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789429482.339910:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789429482.339918:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361751 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.339925:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00030600 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:0.0:1789429482.339928:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361751 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.339935:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361751 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.339944:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x85:0x0].0x0 (ffff946f120fde00) 00010000:00010000:0.0:1789429482.339947:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789429482.339950:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361751 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.339956:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361751 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x85:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429482.339966:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429482.339968:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429482.339970:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429482.340170:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+28:2370:x1876351635067520:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1757us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429482.340182:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6217 00000100:00100000:1.0:1789429482.340261:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:42580:x1876351635067264:12345-192.168.203.39@tcp:36:mv.0 Request processed in 16323us (18989us total) trans 4294977195 rc 0/0 00000100:00100000:1.0:1789429482.340269:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00010000:00010000:2.0:1789429482.343407:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636173c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343425:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636173c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343433:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636173c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343444:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429482.343449:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636173c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343457:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636173c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343471:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6cf40fa (ffff946f08640200) 00010000:00010000:2.0:1789429482.343474:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429482.343479:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636173c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343486:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636173c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6cf40fa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343558:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361735 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343565:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361735 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343571:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361735 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343576:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429482.343579:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361735 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343586:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361735 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343599:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7bf5d484 (ffff946f08640900) 00010000:00010000:2.0:1789429482.343601:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429482.343604:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361735 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343611:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361735 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343622:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad72636174a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343628:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad72636174a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343633:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad72636174a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343639:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429482.343642:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad72636174a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343648:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad72636174a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x86:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343655:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:2.0:1789429482.343717:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789429482.343722:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad72636174a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429482.343728:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad72636174a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x86:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429482.723339:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429483.750393:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789429483.759875:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977193 is committed 00000001:00080000:1.0:1789429483.759897:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977195 is committed 00000004:00080000:1.0:1789429483.759901:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 35 committed 00000001:00080000:1.0:1789429483.759937:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977194 is committed 00000100:00100000:1.0:1789429483.760290:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648389760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789429483.760358:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429483.760629:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648389760 00000100:00100000:3.0:1789429483.760637:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648389760 00000100:00100000:3.0:1789429483.760708:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5815 00000100:00100000:3.0:1789429483.760718:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648389760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789429483.760742:0:13238:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:54 count 1 00000100:00080000:0.0:1789429483.760838:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789429483.760986:0:13238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429483.761009:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad7263616d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c747 expref: 6 pid: 20745 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429483.761020:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361720 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c763 expref: 5 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429483.761029:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789429483.761034:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429483.761039:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429483.761068:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c763 expref: 5 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429483.761140:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c763 expref: 5 pid: 6681 timeout: 1281 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429483.761154:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648389888:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429483.761302:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad7263616d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c747 expref: 6 pid: 20745 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429483.761314:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad7263616d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c747 expref: 6 pid: 20745 timeout: 1281 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429483.761331:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648390016:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429483.761355:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f0fb4d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789429483.765565:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429483.766082:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648389888:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429483.766096:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0abb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648390016:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429483.766122:0:13238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429483.766470:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429483.767002:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635067648 00000100:00100000:0.0:1789429483.767011:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635067648 00010000:00010000:0.0:1789429483.767051:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c763 expref: 6 pid: 6681 timeout: 1281 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429483.767086:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635067776 00000100:00100000:0.0:1789429483.767089:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635067776 00000100:00100000:3.0:1789429483.767171:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6218 00000100:00100000:3.0:1789429483.767182:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635067648:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429483.767196:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429483.767223:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361720 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c763 expref: 6 pid: 6681 timeout: 1281 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429483.767238:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361720 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c763 expref: 6 pid: 6681 timeout: 1281 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429483.767269:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361720 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x36:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c763 expref: 6 pid: 6681 timeout: 1281 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429483.767287:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429483.767335:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635067648:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 154us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429483.767346:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6218 00010000:00010000:0.0:1789429483.767719:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad7263616d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c747 expref: 7 pid: 20745 timeout: 1281 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429483.767743:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6219 00000100:00100000:0.0:1789429483.767761:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635067776:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429483.767770:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429483.767775:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad7263616d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c747 expref: 7 pid: 20745 timeout: 1281 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.767786:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad7263616d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c747 expref: 7 pid: 20745 timeout: 1281 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.767801:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad7263616d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c747 expref: 7 pid: 20745 timeout: 1281 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.767813:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429483.767817:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429483.767823:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.767833:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.767858:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429483.767885:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635067776:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 134us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429483.767892:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6219 00010000:00010000:0.0:1789429483.768058:0:13238:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.768068:0:13238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.768078:0:13238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.768087:0:13238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.768104:0:13238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789429483.768721:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648389760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8003us (8361us total) trans 4294969273 rc 0/0 00000100:00100000:0.0:1789429483.768729:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5815 00010000:00010000:0.0:1789429483.768817:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789429483.768824:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.768832:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:0.0:1789429483.768837:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.768846:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.768859:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.768866:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361758 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429483.768883:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429483.768885:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429483.768887:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789429483.768996:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f1c0ab100/2, rc 0, transno 4294969273 00000100:00100000:0.0:1789429483.769003:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648389760:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1789429483.769588:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429484.294165:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429484.294913:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635068032 00000100:00100000:0.0:1789429484.294926:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635068032 00000100:00100000:0.0:1789429484.295064:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21269 00000100:00100000:0.0:1789429484.295076:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+22:42577:x1876351635068032:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:0.0:1789429484.295097:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429484.295120:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad72636175f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c771 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789429484.295378:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789429484.295443:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad72636175f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c771 expref: 23 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.295472:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd600) 00010000:00010000:0.0:1789429484.295475:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789429484.295481:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad72636175f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c771 expref: 23 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.295499:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01653800, rc 0) 00000100:00100000:0.0:1789429484.295558:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+22:42577:x1876351635068032:12345-192.168.203.39@tcp:101:cat.0 Request processed in 484us (1472us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429484.295566:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21269 00000100:00100000:0.0:1789429484.308438:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429484.309102:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635068160 00000100:00100000:1.0:1789429484.309112:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635068160 00000100:00100000:1.0:1789429484.309167:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21270 00000100:00100000:1.0:1789429484.309176:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+22:42577:x1876351635068160:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:1.0:1789429484.309194:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429484.309239:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c778 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429484.309296:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636176d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429484.309310:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636176d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429484.309322:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636176d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429484.309353:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429484.309356:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429484.309373:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636176d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429484.309393:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad726361766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c778 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429484.309416:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636176d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c778 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429484.309424:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c300) 00010000:00010000:1.0:1789429484.309427:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429484.309430:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031800, rc 0) 00000100:00100000:1.0:1789429484.309497:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+23:42577:x1876351635068160:12345-192.168.203.39@tcp:101:cat.0 Request processed in 323us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429484.309504:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21270 00000100:00100000:1.0:1789429484.317852:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429484.317980:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635068288 00000100:00100000:0.0:1789429484.317989:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635068288 00000100:00100000:0.0:1789429484.318049:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 599 00000100:00100000:0.0:1789429484.318058:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635068288:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429484.318133:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635068288:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 76us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429484.318140:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 599 00000100:00100000:0.0:1789429484.336848:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429484.338675:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635068416 00000100:00100000:2.0:1789429484.338688:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635068416 00000100:00100000:2.0:1789429484.338755:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 918 00000100:00100000:2.0:1789429484.338766:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635068416:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429484.339337:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635068416:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 571us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429484.339346:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 918 00000100:00100000:1.0:1789429484.340385:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429484.340779:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635069184 00000100:00100000:0.0:1789429484.340786:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635069184 00000100:00100000:0.0:1789429484.340834:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21271 00000100:00100000:0.0:1789429484.340842:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+23:42577:x1876351635069184:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:0.0:1789429484.340858:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429484.340878:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c77f expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.340951:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad72636177b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.340965:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad72636177b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.340978:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad72636177b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.340992:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361782 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.340999:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.341007:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.341345:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652c00/0xb4c3dad726361789 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.341356:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652c00/0xb4c3dad726361789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.341363:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652c00/0xb4c3dad726361789 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429484.341373:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x86:0x0]: returning size 0 00010000:00010000:0.0:1789429484.341504:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad72636177b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.341518:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad72636177b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.341525:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad72636177b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.341531:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429484.341536:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad72636177b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.341544:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad72636177b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342164:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c300) 00010000:00010000:0.0:1789429484.342169:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429484.342176:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad72636177b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342184:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad72636177b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342236:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342243:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361782 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342250:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342256:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429484.342260:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342266:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361782 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342276:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7bf5d484 (ffff946f120fd600) 00010000:00010000:0.0:1789429484.342279:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429484.342282:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361782 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342289:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361782 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bf5d484 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342336:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c77f expref: 26 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342352:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652c00/0xb4c3dad726361789 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c77f expref: 25 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429484.342360:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:0.0:1789429484.342363:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429484.342365:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652c00, rc 0) 00000100:00100000:0.0:1789429484.342419:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+25:42577:x1876351635069184:12345-192.168.203.39@tcp:101:cat.0 Request processed in 1577us (2036us total) trans 4294977196 rc 0/0 00000100:00100000:0.0:1789429484.342427:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21271 00000100:00100000:2.0:1789429484.365603:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429484.365664:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429484.365740:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429484.365773:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429484.365818:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635068672 00000100:00100000:1.0:1789429484.365829:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635068672 00000100:00100000:1.0:1789429484.365895:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 878 00000100:00100000:1.0:1789429484.365905:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351635068672:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429484.365979:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2370:x1876351635068672:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429484.365987:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 878 00000100:00080000:2.0:1789429484.367002:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429484.367759:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635068544 00000100:00100000:0.0:1789429484.367767:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635068544 00000100:00100000:0.0:1789429484.367821:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635068800 00000100:00100000:0.0:1789429484.367825:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635068800 00000100:00100000:0.0:1789429484.367844:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635068928 00000100:00100000:0.0:1789429484.367846:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635068928 00000100:00100000:0.0:1789429484.367867:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 919 00000100:00100000:0.0:1789429484.367875:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635068544:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429484.367931:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635068544:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 56us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429484.367938:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 919 00000100:00100000:0.0:1789429484.367952:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 920 00000100:00100000:0.0:1789429484.367958:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635068800:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429484.367980:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635068800:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (2335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429484.367985:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 920 00000100:00100000:0.0:1789429484.367998:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 921 00000100:00100000:0.0:1789429484.368004:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635068928:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429484.368022:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635068928:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 19us (2250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429484.368028:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 921 00000100:00080000:1.0:1789429484.368182:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429484.368185:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429484.369809:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429484.369889:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635069312 00000100:00100000:2.0:1789429484.369898:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635069312 00000100:00100000:2.0:1789429484.369971:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5816 00000100:00100000:2.0:1789429484.369980:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635069312:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:2.0:1789429484.369995:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429484.370013:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726361797 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c786 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429484.370037:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789429484.370042:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789429484.370050:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726361797 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c786 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429484.370085:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726361797 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c786 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429484.370104:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547a00, rc 0) 00000100:00100000:2.0:1789429484.370153:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635069312:12345-192.168.203.39@tcp:101:cat.0 Request processed in 174us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429484.370160:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5816 00000100:00100000:0.0:1789429484.375301:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429484.378759:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635069440 00000100:00100000:2.0:1789429484.378773:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635069440 00002000:00100000:2.0:1789429484.378830:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34:0x0] (0->4095) req@ffff946e10309f80 x1876351635069440/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:220/0 lens 488/0 e 0 to 0 dl 1789429495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429484.378841:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10309f80 with x1876351635069440 ext(0->4095) 00002000:00010000:2.0:1789429484.378848:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e10309f80 00000100:00100000:2.0:1789429484.378884:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11517 00000100:00100000:2.0:1789429484.378894:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635069440:12345-192.168.203.39@tcp:3:cat.0 00000100:00100000:2.0:1789429484.380248:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635069440:12345-192.168.203.39@tcp:3:cat.0 Request processed in 1350us (4952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429484.380258:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11517 00002000:00100000:2.0:1789429484.380267:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x34:0x0] (0->4095) req@ffff946e10309f80 x1876351635069440/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:220/0 lens 488/440 e 0 to 0 dl 1789429495 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429484.380277:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10309f80 with x1876351635069440 ext(0->4095) 00002000:00010000:2.0:1789429484.380281:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e10309f80 00000100:00100000:1.0:1789429484.385892:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429484.385981:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635069696 00000100:00100000:2.0:1789429484.385992:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635069696 00000100:00100000:2.0:1789429484.386108:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 274 00000100:00100000:2.0:1789429484.386118:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:42577:x1876351635069696:12345-192.168.203.39@tcp:35:cat.0 00000100:00100000:2.0:1789429484.387497:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:42577:x1876351635069696:12345-192.168.203.39@tcp:35:cat.0 Request processed in 1376us (1608us total) trans 4294977197 rc 0/0 00000100:00100000:2.0:1789429484.387507:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 274 00000100:00100000:3.0:1789429484.707442:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648390272:0@lo:400:kworker.0 00000100:00100000:3.0:1789429484.707521:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429484.707684:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648390144:0@lo:400:kworker.0 00000100:00100000:0.0:1789429484.707722:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429484.707769:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648390144 00000100:00100000:0.0:1789429484.707776:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648390144 00000100:00100000:0.0:1789429484.707823:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1789429484.707832:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648390144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429484.707882:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648390144:12345-0@lo:400:kworker.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429484.707890:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1789429484.707935:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648390144:0@lo:400:kworker.0 00000100:00100000:0.0:1789429484.707977:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648390272 00000100:00100000:0.0:1789429484.707980:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648390272 00000100:00100000:0.0:1789429484.708009:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1789429484.708015:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648390272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429484.708278:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648390400:0@lo:400:kworker.0 00000100:00100000:1.0:1789429484.708312:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429484.708351:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648390400 00000100:00100000:1.0:1789429484.708356:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648390400 00000100:00100000:1.0:1789429484.708405:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1789429484.708413:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648390400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429484.708448:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648390400:12345-0@lo:400:kworker.0 Request processed in 36us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429484.708455:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1789429484.708498:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648390400:0@lo:400:kworker.0 00000100:00080000:1.0:1789429484.708517:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429484.708771:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648390272:12345-0@lo:400:kworker.0 Request processed in 755us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429484.708778:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:3.0:1789429484.710535:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648390272:0@lo:400:kworker.0 00000100:00100000:0.0:1789429484.710854:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429484.711135:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648390656:0@lo:400:kworker.0 00000100:00100000:0.0:1789429484.711225:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429484.711264:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648390528:0@lo:400:kworker.0 00000100:00100000:0.0:1789429484.711291:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429484.711389:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648390528 00000100:00100000:3.0:1789429484.711397:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648390528 00000100:00100000:3.0:1789429484.711448:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:3.0:1789429484.711458:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648390528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429484.711522:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648390528:12345-0@lo:400:kworker.0 Request processed in 65us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429484.711530:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:3.0:1789429484.711566:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648390528:0@lo:400:kworker.0 00000100:00100000:1.0:1789429484.711749:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648390656 00000100:00100000:1.0:1789429484.711755:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648390656 00000100:00100000:1.0:1789429484.711807:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:1.0:1789429484.711813:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648390656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429484.711851:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648390656:12345-0@lo:400:kworker.0 Request processed in 38us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429484.711857:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:3.0:1789429484.711978:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648390656:0@lo:400:kworker.0 00000100:00080000:3.0:1789429484.711996:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429484.712904:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789429484.716031:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648390784:0@lo:400:kworker.0 00000100:00100000:1.0:1789429484.716111:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429484.722521:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648390784 00000100:00100000:0.0:1789429484.722538:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648390784 00000100:00100000:0.0:1789429484.722644:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:0.0:1789429484.722667:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648390784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429484.722772:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648390784:12345-0@lo:400:kworker.0 Request processed in 119us (6661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429484.722780:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00080000:3.0:1789429484.722979:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429484.723117:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648390784:0@lo:400:kworker.0 00010000:00010000:0.0:1789429484.771435:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429485.221299:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648390912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429485.221393:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429485.222792:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648390912 00000100:00100000:1.0:1789429485.222807:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648390912 00000100:00100000:1.0:1789429485.222892:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789429485.222906:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648390912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429485.222955:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47775744 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1789429485.223040:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648390912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429485.223048:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00080000:3.0:1789429485.223225:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429485.223287:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648390912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429485.235070:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789429485.235102:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648391040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429485.235192:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429485.235772:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648391040 00000100:00100000:1.0:1789429485.235785:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648391040 00000100:00100000:1.0:1789429485.235852:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1789429485.235863:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648391040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429485.235915:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429485.235993:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648391040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429485.236002:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1789429485.236153:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648391040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429485.797049:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429486.819427:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429487.352446:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969273 is committed 00010000:00010000:1.0:1789429487.845048:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429488.868468:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429488.869618:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977196 is committed 00000001:00080000:2.0:1789429488.869833:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977197 is committed 00000100:00100000:3.0:1789429489.429097:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429489.429157:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429489.429197:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429489.429279:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429489.429300:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429489.429323:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429489.429353:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429489.429395:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635070080 00000100:00100000:3.0:1789429489.429408:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635070080 00000100:00100000:1.0:1789429489.429632:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635069824 00000100:00100000:1.0:1789429489.429637:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635069824 00000100:00100000:1.0:1789429489.429688:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 601 00000100:00100000:1.0:1789429489.429699:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635069824:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429489.429792:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635069824:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 94us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429489.429800:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 601 00000100:00100000:2.0:1789429489.430249:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635070592 00000100:00100000:2.0:1789429489.430255:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635070592 00000100:00100000:2.0:1789429489.430293:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635070208 00000100:00100000:2.0:1789429489.430296:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635070208 00000100:00100000:2.0:1789429489.430313:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635070464 00000100:00100000:2.0:1789429489.430316:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635070464 00000100:00100000:0.0:1789429489.430603:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635070336 00000100:00100000:0.0:1789429489.430626:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635070336 00000100:00100000:2.0:1789429489.430649:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 924 00000100:00100000:2.0:1789429489.430665:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635070592:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429489.430700:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635069952 00000100:00100000:0.0:1789429489.430706:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635069952 00000100:00100000:2.0:1789429489.430733:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635070592:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 68us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429489.430746:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 882 00000100:00100000:2.0:1789429489.430746:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 924 00000100:00100000:0.0:1789429489.430769:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351635070336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429489.430779:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 925 00000100:00100000:2.0:1789429489.430791:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635070208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429489.430858:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351635070336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 93us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429489.430862:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 926 00000100:00100000:0.0:1789429489.430884:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 882 00000100:00100000:3.0:1789429489.430886:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635070464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429489.430915:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 883 00000100:00100000:0.0:1789429489.430924:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+24:2369:x1876351635069952:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429489.430963:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635070208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 171us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429489.430974:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+24:2369:x1876351635069952:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 47us (1668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429489.430984:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 925 00000100:00100000:0.0:1789429489.430994:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 883 00000100:00100000:2.0:1789429489.431012:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 927 00000100:00100000:2.0:1789429489.431026:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635070080:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429489.431065:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635070080:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 43us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429489.431073:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 927 00000100:00080000:2.0:1789429489.431166:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429489.431173:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429489.431176:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429489.431753:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635070464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 874us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429489.431763:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 926 00000100:00100000:2.0:1789429489.831416:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648391552:0@lo:400:kworker.0 00000100:00100000:2.0:1789429489.831485:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429489.831570:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789429489.831576:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648391168:0@lo:400:kworker.0 00000100:00100000:2.0:1789429489.831605:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429489.831642:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648391680:0@lo:400:kworker.0 00000100:00100000:2.0:1789429489.831665:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429489.831697:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648391168 00000100:00100000:2.0:1789429489.831706:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648391168 00000100:00100000:2.0:1789429489.831750:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1789429489.831759:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648391168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429489.831806:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648391168:12345-0@lo:400:kworker.0 Request processed in 47us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429489.831812:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1789429489.831842:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648391680 00000100:00100000:2.0:1789429489.831845:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648391680 00000100:00100000:2.0:1789429489.831880:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:2.0:1789429489.831886:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648391680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429489.831916:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648391680:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429489.831922:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00080000:2.0:1789429489.831940:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429489.831967:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648391168:0@lo:400:kworker.0 00000100:00100000:2.0:1789429489.831979:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648391680:0@lo:400:kworker.0 00000100:00100000:1.0:1789429489.832113:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648391552 00000100:00100000:1.0:1789429489.832118:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648391552 00000100:00100000:1.0:1789429489.832157:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1789429489.832164:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648391552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429489.832231:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648391552:12345-0@lo:400:kworker.0 Request processed in 36us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429489.832237:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00080000:2.0:1789429489.832445:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429489.832463:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969273 gen 2 00000004:00080000:2.0:1789429489.832469:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f1c0ab100, transno 4294969273 00000100:00100000:2.0:1789429489.832491:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648391552:0@lo:400:kworker.0 00000100:00100000:3.0:1789429489.832573:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648391296:0@lo:400:kworker.0 00000100:00100000:3.0:1789429489.832604:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429489.832641:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3407b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648391808:0@lo:400:kworker.0 00000100:00100000:3.0:1789429489.832660:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429489.832677:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429489.832682:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648391424:0@lo:400:kworker.0 00000100:00100000:3.0:1789429489.832698:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429489.832725:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648391296 00000100:00100000:3.0:1789429489.832729:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648391296 00000100:00100000:3.0:1789429489.832764:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648391424 00000100:00100000:3.0:1789429489.832768:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648391424 00000100:00100000:3.0:1789429489.832797:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1789429489.832802:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648391296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429489.832838:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648391296:12345-0@lo:400:kworker.0 Request processed in 36us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429489.832845:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1789429489.832858:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1789429489.832865:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648391424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429489.832889:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648391424:12345-0@lo:400:kworker.0 Request processed in 25us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429489.832894:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1789429489.832911:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648391808 00000100:00100000:3.0:1789429489.832914:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648391808 00000100:00100000:3.0:1789429489.832937:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:3.0:1789429489.832943:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648391808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429489.832970:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648391808:12345-0@lo:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429489.832977:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00080000:3.0:1789429489.832998:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429489.833001:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429489.833016:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34078a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648391424:0@lo:400:kworker.0 00000100:00100000:3.0:1789429489.833024:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648391296:0@lo:400:kworker.0 00000100:00100000:3.0:1789429489.833031:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3407b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648391808:0@lo:400:kworker.0 00010000:00010000:1.0:1789429489.891546:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429490.340366:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648391936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429490.340482:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429490.340691:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429490.340702:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3fbc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648392064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429490.340738:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429490.340776:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648391936 00000100:00100000:1.0:1789429490.341620:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648392064 00000100:00100000:1.0:1789429490.341630:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648392064 00000100:00100000:1.0:1789429490.341683:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1789429490.341693:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f418a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648392064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429490.341741:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429490.341817:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f418a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648392064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429490.341825:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789429490.342185:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648391936 00000100:00100000:2.0:1789429490.342244:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1789429490.342252:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648391936:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429490.342259:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3fbc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648392064:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429490.342284:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47775744 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429490.342340:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648391936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429490.342347:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1789429490.342388:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648391936:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789429490.915482:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429490.975406:0:25050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 19:44:49 (1789429489) 00000100:00100000:1.0:1789429491.008961:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.009062:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635070720 00000100:00100000:3.0:1789429491.009077:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635070720 00000100:00100000:3.0:1789429491.009237:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21272 00000100:00100000:3.0:1789429491.009251:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+24:43149:x1876351635070720:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429491.009290:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429491.009320:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636179e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c78d expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009407:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263617a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009426:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263617a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009440:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263617a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009458:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263617ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009467:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263617ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009474:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263617ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009927:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263617a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009938:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263617a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009946:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263617a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009952:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.009958:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263617a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009967:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263617a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009983:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c300) 00010000:00010000:3.0:1789429491.009986:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.009992:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263617a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.009998:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263617a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.010013:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263617ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.010019:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263617ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.010024:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263617ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.010029:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.010032:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263617ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.010038:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263617ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.010050:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30eac2f2 (ffff946f08640600) 00010000:00010000:3.0:1789429491.010053:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.010056:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263617ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.010062:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263617ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.010105:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636179e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c78d expref: 25 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.010117:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c300) 00010000:00010000:3.0:1789429491.010119:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.010123:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636179e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c78d expref: 25 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.010133:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1e00, rc 0) 00000100:00100000:3.0:1789429491.010234:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+24:43149:x1876351635070720:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 986us (1290us total) trans 0 rc 301/301 00000100:00100000:3.0:1789429491.010243:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21272 00000100:00080000:0.0:1789429491.014977:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429491.023936:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.024025:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635070976 00000100:00100000:3.0:1789429491.024039:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635070976 00000100:00100000:3.0:1789429491.024115:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21273 00000100:00100000:3.0:1789429491.024127:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+24:43149:x1876351635070976:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1789429491.024273:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429491.024313:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad72636176d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c778 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.024343:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c300) 00010000:00010000:3.0:1789429491.024357:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429491.024833:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263617b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.024852:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263617b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.024864:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263617b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.024877:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad7263617ba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.024884:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad7263617ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.024891:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad7263617ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429491.028701:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x87:0x0]: returning size 16384 00010000:00010000:3.0:1789429491.028795:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263617b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.028809:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263617b3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.028819:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263617b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.028826:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.028832:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263617b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.028842:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263617b3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.028862:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640e00) 00010000:00010000:3.0:1789429491.028865:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.028871:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263617b3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.028878:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263617b3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429491.028900:0:5840:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e6f5a6f0 reply state 000000004f7fcee9 transno 4294977198 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad7263617ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429491.028909:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789429491.029027:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+25:43149:x1876351635070976:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 4897us (5102us total) trans 4294977198 rc 0/0 00000100:00100000:3.0:1789429491.029038:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21273 00000100:00100000:1.0:1789429491.048410:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.048460:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635071104 00000100:00100000:1.0:1789429491.048472:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635071104 00000100:00100000:1.0:1789429491.048532:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21274 00000100:00100000:1.0:1789429491.048542:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+25:43150:x1876351635071104:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:1.0:1789429491.048574:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429491.048602:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263617c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c794 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.048697:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.048714:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.048728:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429491.048773:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429491.048777:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429491.048803:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.048835:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263617c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c794 expref: 27 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.048854:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c794 expref: 26 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.048863:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:1.0:1789429491.048866:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429491.048870:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031400, rc 0) 00000100:00100000:1.0:1789429491.048933:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+26:43150:x1876351635071104:12345-192.168.203.39@tcp:101:touch.0 Request processed in 393us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429491.048940:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21274 00010000:00010000:0.0:1789429491.049573:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad7263617ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.049585:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad7263617ba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.049593:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad7263617ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.049599:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429491.049615:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad7263617ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.049624:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad7263617ba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.049640:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30eac2f2 (ffff946f08640a00) 00010000:00010000:0.0:1789429491.049642:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429491.049647:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad7263617ba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.049653:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad7263617ba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429491.053594:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429491.053744:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635071232 00000100:00100000:2.0:1789429491.053758:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635071232 00000100:00100000:2.0:1789429491.053836:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21275 00000100:00100000:2.0:1789429491.053850:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+25:43150:x1876351635071232:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:2.0:1789429491.053879:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429491.053908:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263617cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c79b expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.053992:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263617d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054012:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263617d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054026:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263617d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054043:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263617dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054051:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263617dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054058:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263617dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054185:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054194:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054230:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429491.054267:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x87:0x0]: returning size 16384 00000004:00200000:2.0:1789429491.054270:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429491.054294:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054313:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263617d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054321:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263617d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054329:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263617d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054337:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.054342:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263617d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054352:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263617d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054367:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:2.0:1789429491.054370:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.054377:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263617d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054383:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad7263617d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054399:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263617dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054406:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263617dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054412:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263617dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054418:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.054422:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263617dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054442:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263617dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054451:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30eac2f2 (ffff946f051ef100) 00010000:00010000:2.0:1789429491.054454:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.054457:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263617dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054464:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad7263617dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054502:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad7263617cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c79b expref: 27 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054517:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c79b expref: 26 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.054526:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:2.0:1789429491.054529:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789429491.054531:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547400, rc 0) 00000100:00100000:2.0:1789429491.054620:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+26:43150:x1876351635071232:12345-192.168.203.39@tcp:101:touch.0 Request processed in 761us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429491.054629:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21275 00000100:00100000:2.0:1789429491.061713:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429491.062367:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635071488 00000100:00100000:0.0:1789429491.062383:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635071488 00000100:00100000:0.0:1789429491.062471:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21276 00000100:00100000:0.0:1789429491.062483:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+26:43150:x1876351635071488:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:0.0:1789429491.062512:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429491.062539:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad7263617eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7a2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.062715:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263617f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.062734:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263617f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.062749:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263617f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.063047:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad7263617f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x87:0x0].0xdc745943 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.063070:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad7263617f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.063084:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad7263617f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429491.066740:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x37:0x0], index 0: 0 00010000:00010000:1.0:1789429491.067102:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361800 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.067124:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.067140:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361800 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.067192:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263617f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.067239:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263617f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.067247:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263617f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.067255:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.067260:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263617f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.067267:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263617f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.067281:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:1.0:1789429491.067284:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.067289:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263617f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.067296:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263617f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429491.067309:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bc8de5f6 reply state 000000006d440603 transno 4294977199 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad7263617f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.067319:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429491.067763:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad7263617eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7a2 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.067786:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361800 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7a2 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.067794:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x88:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429491.067797:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429491.067799:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030600, rc 0) 00000100:00100000:1.0:1789429491.067904:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:43150:x1876351635071488:12345-192.168.203.39@tcp:101:touch.0 Request processed in 5421us (6199us total) trans 4294977199 rc 0/0 00000100:00100000:1.0:1789429491.067915:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21276 00010000:00010000:2.0:1789429491.071051:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad7263617f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.071074:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad7263617f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.071083:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad7263617f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.071092:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.071099:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad7263617f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.071109:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad7263617f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.071129:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0xdc745943 (ffff946f120fd600) 00010000:00010000:2.0:1789429491.071132:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.071138:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad7263617f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.071144:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad7263617f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429491.076960:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.077082:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635071744 00000100:00100000:1.0:1789429491.077095:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635071744 00000100:00100000:1.0:1789429491.077228:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21277 00000100:00100000:1.0:1789429491.077241:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+28:43150:x1876351635071744:12345-192.168.203.39@tcp:36:touch.0 00010000:00010000:1.0:1789429491.077319:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429491.077356:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361800 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7a2 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.077376:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x88:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429491.077389:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429491.077628:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636180e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.077644:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636180e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x88:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.077655:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636180e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x88:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429491.077831:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000562dd4dd reply state 00000000e79e54cd transno 4294977200 ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636180e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x88:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.077842:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429491.077970:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:43150:x1876351635071744:12345-192.168.203.39@tcp:36:touch.0 Request processed in 731us (1025us total) trans 4294977200 rc 0/0 00000100:00100000:1.0:1789429491.077980:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21277 00010000:00010000:0.0:1789429491.082235:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636180e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x88:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.082257:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1789429491.082258:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636180e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x88:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.082275:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636180e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x88:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.082282:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429491.082287:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636180e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x88:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.082296:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636180e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x88:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.082318:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x88:0x0].0x0 (ffff946f0970ca00) 00010000:00010000:0.0:1789429491.082323:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789429491.082325:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635071872 00010000:00010000:0.0:1789429491.082328:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636180e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x88:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.082336:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636180e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x88:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429491.082341:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635071872 00000100:00100000:2.0:1789429491.082445:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21278 00000100:00100000:2.0:1789429491.082457:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+28:43150:x1876351635071872:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:2.0:1789429491.082485:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429491.082511:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726361815 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x88:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7a9 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.082591:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726361815 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7a9 expref: 29 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.082622:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726361815 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x88:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7a9 expref: 29 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.082645:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x88:0x0].0x0 (ffff946f051ef100) 00010000:00010000:2.0:1789429491.082648:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789429491.082652:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547e00, rc 0) 00000100:00100000:2.0:1789429491.082739:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+29:43150:x1876351635071872:12345-192.168.203.39@tcp:101:touch.0 Request processed in 283us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429491.082746:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21278 00000100:00100000:3.0:1789429491.085495:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429491.085658:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635072000 00000100:00100000:0.0:1789429491.085671:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635072000 00000100:00100000:0.0:1789429491.085746:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5817 00000100:00100000:0.0:1789429491.085758:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635072000:12345-192.168.203.39@tcp:2:touch.0 00000100:00100000:0.0:1789429491.086069:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635072000:12345-192.168.203.39@tcp:2:touch.0 Request processed in 314us (584us total) trans 4294969274 rc 0/0 00000100:00100000:0.0:1789429491.086077:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5817 00000100:00080000:3.0:1789429491.086329:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429491.088572:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429491.092927:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635072256 00000100:00100000:0.0:1789429491.092942:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635072256 00000100:00100000:0.0:1789429491.093005:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 275 00000100:00100000:0.0:1789429491.093017:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:43150:x1876351635072256:12345-192.168.203.39@tcp:35:touch.0 00000100:00100000:0.0:1789429491.093367:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:43150:x1876351635072256:12345-192.168.203.39@tcp:35:touch.0 Request processed in 351us (4807us total) trans 4294977201 rc 0/0 00000100:00100000:0.0:1789429491.093376:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 275 00000100:00100000:1.0:1789429491.098910:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.099007:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635072384 00000100:00100000:3.0:1789429491.099021:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635072384 00000100:00100000:3.0:1789429491.099106:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21279 00000100:00100000:3.0:1789429491.099119:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:43151:x1876351635072384:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1789429491.099151:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429491.099178:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636181c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7b0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.099301:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.099332:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.099348:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429491.099393:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x87:0x0]: returning size 16384 00000004:00200000:3.0:1789429491.099398:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429491.099422:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.099464:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636181c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7b0 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.099486:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7b0 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.099831:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:3.0:1789429491.099836:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429491.099841:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1e00, rc 0) 00000100:00100000:3.0:1789429491.099941:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:43151:x1876351635072384:12345-192.168.203.39@tcp:101:bash.0 Request processed in 822us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429491.099951:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21279 00000100:00100000:3.0:1789429491.116712:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429491.116795:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635072512 00000100:00100000:2.0:1789429491.116816:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635072512 00000100:00100000:2.0:1789429491.116896:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21280 00000100:00100000:2.0:1789429491.116907:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:43153:x1876351635072512:12345-192.168.203.39@tcp:101:tail.0 00010000:00010000:2.0:1789429491.116927:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429491.116950:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad72636182a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117015:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361831 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117030:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117043:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117060:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361838 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117067:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117074:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117425:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361831 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117558:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361831 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117566:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117572:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.117577:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361831 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117584:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361831 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.117993:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:2.0:1789429491.117998:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.118004:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361831 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.118011:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361831 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.118044:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361838 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.118052:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361838 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.118058:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.118063:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.118540:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361838 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.118552:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361838 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.118562:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0xeddcfc6c (ffff946f051ef700) 00010000:00010000:2.0:1789429491.118565:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.118569:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361838 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.118575:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361838 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.118692:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad72636182a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7b7 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.118703:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:2.0:1789429491.118706:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789429491.118710:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad72636182a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7b7 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.118721:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546600, rc 0) 00000100:00100000:2.0:1789429491.118792:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:43153:x1876351635072512:12345-192.168.203.39@tcp:101:tail.0 Request processed in 1886us (2094us total) trans 0 rc 301/301 00000100:00100000:2.0:1789429491.118801:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21280 00000100:00100000:2.0:1789429491.122807:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.122931:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635072640 00000100:00100000:3.0:1789429491.122941:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635072640 00000100:00100000:3.0:1789429491.123027:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21281 00000100:00100000:3.0:1789429491.123037:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:43153:x1876351635072640:12345-192.168.203.39@tcp:101:tail.0 00010000:00010000:3.0:1789429491.123057:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429491.123077:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636183f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7be expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123148:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361846 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123162:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123174:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123279:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636184d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123290:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636184d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123299:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636184d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123348:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361846 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123356:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361846 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123364:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361846 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123371:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.123375:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361846 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123383:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361846 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123394:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:3.0:1789429491.123397:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.123402:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361846 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123409:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361846 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123421:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636184d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123427:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636184d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123446:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636184d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123451:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.123454:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636184d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123467:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636184d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123479:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x3491cd4c (ffff946f08640e00) 00010000:00010000:3.0:1789429491.123481:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.123485:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636184d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123490:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636184d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123520:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636183f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7be expref: 32 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123531:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:3.0:1789429491.123533:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789429491.123536:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636183f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7be expref: 32 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.123544:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:3.0:1789429491.123627:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:43153:x1876351635072640:12345-192.168.203.39@tcp:101:tail.0 Request processed in 591us (828us total) trans 0 rc 301/301 00000100:00100000:3.0:1789429491.123635:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21281 00000100:00100000:0.0:1789429491.127376:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.127697:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635072768 00000100:00100000:1.0:1789429491.127711:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635072768 00000100:00100000:1.0:1789429491.127813:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21282 00000100:00100000:1.0:1789429491.127824:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:43153:x1876351635072768:12345-192.168.203.39@tcp:101:tail.0 00010000:00010000:1.0:1789429491.127842:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429491.127864:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361854 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7c5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.127939:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636185b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.127955:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636185b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.127968:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636185b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.127983:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361862 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.127990:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.127996:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128051:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636185b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128063:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636185b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128069:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636185b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128075:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.128080:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636185b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128086:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636185b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128097:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:1.0:1789429491.128101:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.128105:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636185b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128111:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad72636185b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128123:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128129:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361862 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128134:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128139:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.128142:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128148:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361862 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128155:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x3735a305 (ffff946f0970c400) 00010000:00010000:1.0:1789429491.128157:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.128160:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361862 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128165:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361862 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128227:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361854 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7c5 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128239:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:1.0:1789429491.128241:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789429491.128245:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361854 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7c5 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.128256:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00030600, rc 0) 00000100:00100000:1.0:1789429491.128318:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:43153:x1876351635072768:12345-192.168.203.39@tcp:101:tail.0 Request processed in 497us (950us total) trans 0 rc 301/301 00000100:00100000:1.0:1789429491.128326:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21282 00000100:00100000:0.0:1789429491.135147:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.137884:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635073024 00000100:00100000:1.0:1789429491.137894:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635073024 00000100:00100000:1.0:1789429491.138000:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21283 00000100:00100000:1.0:1789429491.138011:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:43153:x1876351635073024:12345-192.168.203.39@tcp:101:tail.0 00010000:00010000:1.0:1789429491.138031:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429491.138050:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361869 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7cc expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138124:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361870 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138138:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361870 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138149:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361870 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138166:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138173:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138178:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138242:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361870 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138249:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361870 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138256:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361870 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138262:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01506200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.138282:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361870 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138290:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361870 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138300:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:1.0:1789429491.138303:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.138307:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361870 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138314:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361870 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138333:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138340:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361877 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138351:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138357:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01507200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.138360:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138367:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138375:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x820cea43 (ffff946f0970c900) 00010000:00010000:1.0:1789429491.138378:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.138382:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361877 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138388:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138424:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361869 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7cc expref: 32 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138434:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:1.0:1789429491.138437:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789429491.138441:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361869 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7cc expref: 32 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.138452:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031800, rc 0) 00000100:00100000:1.0:1789429491.138512:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:43153:x1876351635073024:12345-192.168.203.39@tcp:101:tail.0 Request processed in 504us (3376us total) trans 0 rc 301/301 00000100:00100000:1.0:1789429491.138520:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21283 00000100:00100000:0.0:1789429491.144829:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.144914:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635073280 00000100:00100000:3.0:1789429491.144925:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635073280 00000100:00100000:3.0:1789429491.144982:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21284 00000100:00100000:3.0:1789429491.144992:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:43153:x1876351635073280:12345-192.168.203.39@tcp:101:tail.0 00010000:00010000:3.0:1789429491.145010:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429491.145028:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636187e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7d3 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145106:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361885 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145122:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145134:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145149:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636188c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0xdc745943 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145156:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636188c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145162:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636188c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145310:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x88:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145320:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145329:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429491.145338:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x88:0x0]: returning size 0 00010000:00010000:3.0:1789429491.145430:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145443:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361885 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145451:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145457:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.145461:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145469:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361885 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145480:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:3.0:1789429491.145483:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.145488:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361885 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145494:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361885 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145505:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636188c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145513:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636188c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145519:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636188c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145525:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.145529:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636188c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145535:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636188c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145542:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0xdc745943 (ffff946f08640e00) 00010000:00010000:3.0:1789429491.145545:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.145548:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636188c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145554:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636188c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xdc745943 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145775:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad72636187e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7d3 expref: 34 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145793:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7d3 expref: 33 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.145801:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x88:0x0].0x0 (ffff946f051ef100) 00010000:00010000:3.0:1789429491.145803:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429491.145806:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1400, rc 0) 00000100:00100000:3.0:1789429491.146028:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+33:43153:x1876351635073280:12345-192.168.203.39@tcp:101:tail.0 Request processed in 1036us (1207us total) trans 4294977202 rc 0/0 00000100:00100000:3.0:1789429491.146037:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21284 00000100:00100000:0.0:1789429491.148937:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.149002:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635073408 00000100:00100000:3.0:1789429491.149011:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635073408 00000100:00100000:3.0:1789429491.149065:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5818 00000100:00100000:3.0:1789429491.149074:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635073408:12345-192.168.203.39@tcp:101:tail.0 00010000:00010000:3.0:1789429491.149091:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429491.149111:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003847d626/0xb4c3dad7263618a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7da expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429491.149138:0:20986:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x6aa886f3, atime: 0x6aa886f3, ctime: 0x6aa886f3, blocks: 0x1 00010000:00010000:3.0:1789429491.149157:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=1189s v=(0 0) 00010000:00010000:3.0:1789429491.149163:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429491.149172:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003847d626/0xb4c3dad7263618a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7da expref: 8 pid: 20986 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.149193:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003847d626/0xb4c3dad7263618a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7da expref: 8 pid: 20986 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.149358:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1c00, rc 0) 00000100:00100000:3.0:1789429491.149443:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635073408:12345-192.168.203.39@tcp:101:tail.0 Request processed in 369us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429491.149451:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5818 00000100:00100000:3.0:1789429491.163546:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.163591:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635073536 00000100:00100000:3.0:1789429491.163613:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635073536 00002000:00100000:3.0:1789429491.163661:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37:0x0] (0->4095) req@ffff946f1c1a8000 x1876351635073536/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:227/0 lens 488/0 e 0 to 0 dl 1789429502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'tail.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429491.163674:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a8000 with x1876351635073536 ext(0->4095) 00002000:00010000:3.0:1789429491.163679:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1a8000 00000100:00100000:3.0:1789429491.163706:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11518 00000100:00100000:3.0:1789429491.163714:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2369:x1876351635073536:12345-192.168.203.39@tcp:3:tail.0 00000100:00100000:3.0:1789429491.164078:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2369:x1876351635073536:12345-192.168.203.39@tcp:3:tail.0 Request processed in 363us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429491.164086:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11518 00002000:00100000:3.0:1789429491.164094:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x37:0x0] (0->4095) req@ffff946f1c1a8000 x1876351635073536/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:227/0 lens 488/440 e 0 to 0 dl 1789429502 ref 1 fl Complete:/600/0 rc 0/0 job:'tail.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429491.164108:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a8000 with x1876351635073536 ext(0->4095) 00002000:00010000:3.0:1789429491.164112:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1a8000 00000100:00100000:0.0:1789429491.181788:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429491.182299:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635073664 00000100:00100000:2.0:1789429491.182310:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635073664 00000100:00100000:2.0:1789429491.182367:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21285 00000100:00100000:2.0:1789429491.182378:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+33:43153:x1876351635073664:12345-192.168.203.39@tcp:41:tail.0 00000004:00000024:2.0:1789429491.182450:0:5840:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7683964928 avail 7679770624 00000100:00100000:2.0:1789429491.183722:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+33:43153:x1876351635073664:12345-192.168.203.39@tcp:41:tail.0 Request processed in 1340us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429491.183733:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21285 00000100:00100000:0.0:1789429491.636995:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.637793:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635073792 00000100:00100000:3.0:1789429491.637804:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635073792 00000100:00100000:3.0:1789429491.637887:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21286 00000100:00100000:3.0:1789429491.637897:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:43157:x1876351635073792:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:3.0:1789429491.637916:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429491.637935:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.637994:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263618af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.638006:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263618af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.638017:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263618af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429491.638051:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429491.638055:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429491.638078:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263618af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.638107:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7e1 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.638126:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263618af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7e1 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.638134:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:3.0:1789429491.638137:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429491.638141:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:3.0:1789429491.638255:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:43157:x1876351635073792:12345-192.168.203.39@tcp:101:mv.0 Request processed in 359us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429491.638261:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21286 00000100:00080000:0.0:1789429491.638370:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429491.650722:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.653702:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635073920 00000100:00100000:3.0:1789429491.653718:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635073920 00000100:00100000:2.0:1789429491.654406:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21287 00000100:00100000:2.0:1789429491.654418:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:43157:x1876351635073920:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:2.0:1789429491.654438:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429491.654459:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263618b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7e8 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654520:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad7263618bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654534:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad7263618bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654547:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad7263618bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654562:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263618c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654569:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263618c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654576:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263618c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654671:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263618cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654680:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263618cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654687:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263618cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429491.654715:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x87:0x0]: returning size 16384 00000004:00200000:2.0:1789429491.654720:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429491.654738:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263618cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654751:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad7263618bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654757:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad7263618bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654769:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad7263618bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654776:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.654780:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad7263618bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654787:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad7263618bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654799:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:2.0:1789429491.654803:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.654808:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad7263618bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654814:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad7263618bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654827:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263618c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654834:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263618c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654839:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263618c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654844:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.654846:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263618c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654857:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263618c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654864:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30eac2f2 (ffff946f051ef700) 00010000:00010000:2.0:1789429491.654867:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.654869:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263618c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654875:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad7263618c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654905:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263618b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7e8 expref: 20 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654920:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263618cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7e8 expref: 19 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.654927:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:2.0:1789429491.654930:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429491.654932:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429491.655005:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43157:x1876351635073920:12345-192.168.203.39@tcp:101:mv.0 Request processed in 589us (4291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429491.655012:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21287 00000100:00100000:2.0:1789429491.658534:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429491.658636:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635074048 00000100:00100000:0.0:1789429491.658647:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635074048 00000100:00100000:0.0:1789429491.658732:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21288 00000100:00100000:0.0:1789429491.658742:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43157:x1876351635074048:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:0.0:1789429491.658763:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429491.658785:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7ef expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658853:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658866:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658876:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658889:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658896:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658903:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658951:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658957:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658963:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658969:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429491.658973:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658981:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.658992:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:0.0:1789429491.658995:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429491.659000:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.659006:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.659018:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.659023:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.659028:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.659033:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429491.659036:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.659042:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.659049:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77b4e83d (ffff946f120fdf00) 00010000:00010000:0.0:1789429491.659051:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429491.659054:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.659060:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.659090:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7ef expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.659100:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:0.0:1789429491.659102:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429491.659105:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7ef expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.659116:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01653a00, rc 0) 00000100:00100000:0.0:1789429491.659180:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43157:x1876351635074048:12345-192.168.203.39@tcp:101:mv.0 Request processed in 440us (655us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429491.659188:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21288 00000100:00100000:0.0:1789429491.672598:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.672862:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635074304 00000100:00100000:3.0:1789429491.672872:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635074304 00000100:00100000:3.0:1789429491.672986:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:3.0:1789429491.672998:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43157:x1876351635074304:12345-192.168.203.39@tcp:36:mv.0 00010000:00010000:3.0:1789429491.673044:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789429491.673071:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263618cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7e8 expref: 19 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.673091:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:3.0:1789429491.673102:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263618af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7e1 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.673117:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:3.0:1789429491.673121:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429491.673148:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.673162:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c794 expref: 32 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.673171:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.673245:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c794 expref: 32 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.673259:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c794 expref: 32 pid: 15700 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429491.673273:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:5854:1876351648392192:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429491.673386:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f10b2e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429491.682292:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a9500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:5854:1876351648392192:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429491.682321:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429491.685938:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429491.686155:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635074432 00000100:00100000:2.0:1789429491.686164:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635074432 00010000:00010000:2.0:1789429491.686222:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c794 expref: 33 pid: 15700 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429491.686309:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6220 00000100:00100000:2.0:1789429491.686319:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+33:2370:x1876351635074432:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429491.686334:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429491.686340:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c794 expref: 33 pid: 15700 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.686353:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c794 expref: 33 pid: 15700 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.686372:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad7263617c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c794 expref: 33 pid: 15700 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.686389:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:2.0:1789429491.686394:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.686404:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.686411:0:11354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.686441:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429491.686505:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:2370:x1876351635074432:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 187us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429491.686513:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6220 00010000:00010000:0.0:1789429491.686627:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.686636:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.686661:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618ee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.686670:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.686679:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.686693:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618f5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.686700:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.686706:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.687091:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.687103:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c79b expref: 31 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.687112:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7b0 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.687119:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 5/0,1 mode: --/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.687146:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7b0 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.687159:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7b0 expref: 31 pid: 5840 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429491.687172:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:5854:1876351648392320:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429491.687257:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c79b expref: 31 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.687267:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c79b expref: 31 pid: 15669 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429491.687276:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:5854:1876351648392448:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429491.687303:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c3c8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429491.689770:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.689864:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635074560 00000100:00100000:1.0:1789429491.689871:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635074560 00010000:00010000:1.0:1789429491.689903:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7b0 expref: 32 pid: 5840 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.689937:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6221 00000100:00100000:1.0:1789429491.689946:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:2369:x1876351635074560:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429491.689958:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429491.689964:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7b0 expref: 32 pid: 5840 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.689981:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7b0 expref: 32 pid: 5840 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.690000:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:1.0:1789429491.690005:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.690013:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.690018:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429491.690063:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:2369:x1876351635074560:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 117us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429491.690074:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6221 00010000:00010000:3.0:1789429491.690531:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361823 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7b0 expref: 31 pid: 5840 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429491.690547:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:5854:1876351648392320:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429491.690731:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449a300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:5854:1876351648392448:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429491.691624:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.691914:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.691973:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635074688 00000100:00100000:3.0:1789429491.691979:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635074688 00010000:00010000:3.0:1789429491.692008:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c79b expref: 31 pid: 15669 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429491.692044:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6222 00000100:00100000:3.0:1789429491.692052:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635074688:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429491.692065:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429491.692071:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c79b expref: 31 pid: 15669 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.692081:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c79b expref: 31 pid: 15669 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.692099:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad7263617e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c79b expref: 31 pid: 15669 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.692111:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:3.0:1789429491.692115:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.692123:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.692130:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.692157:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429491.692273:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.692281:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429491.692820:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000091bfc5bb reply state 00000000e3ad3f19 transno 4294977203 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.692835:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1789429491.692841:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000091bfc5bb reply state 00000000e3ad3f19 transno 4294977203 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.692846:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1789429491.692850:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.692857:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.692863:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.692869:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.692873:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.692881:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.692891:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:1.0:1789429491.692894:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.692897:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.692903:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad7263618e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429491.692918:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000091bfc5bb reply state 00000000e3ad3f19 transno 4294977203 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.692929:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1789429491.693224:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2368:x1876351635074688:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1169us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429491.693233:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6222 00000100:00100000:1.0:1789429491.693631:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43157:x1876351635074304:12345-192.168.203.39@tcp:36:mv.0 Request processed in 20634us (21042us total) trans 4294977203 rc 0/0 00000100:00100000:1.0:1789429491.693639:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00010000:00010000:2.0:1789429491.695068:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695082:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618ee lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695090:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695096:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01653a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.695101:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695108:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618ee lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695123:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30eac2f2 (ffff946f120fdf00) 00010000:00010000:2.0:1789429491.695126:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.695130:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618ee lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695137:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad7263618ee lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695157:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618f5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695163:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618f5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695169:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695175:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.695178:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618f5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695185:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618f5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695191:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77b4e83d (ffff946f120fd200) 00010000:00010000:2.0:1789429491.695193:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.695196:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618f5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695240:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad7263618f5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695252:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695257:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695264:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695269:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.695272:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695278:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695293:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f051ef400) 00010000:00010000:2.0:1789429491.695295:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789429491.695299:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.695311:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad7263618fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.715774:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.716624:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635074816 00000100:00100000:3.0:1789429491.716636:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635074816 00000100:00100000:3.0:1789429491.716699:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21289 00000100:00100000:3.0:1789429491.716710:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:43158:x1876351635074816:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429491.716735:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429491.716757:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7f6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.716818:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636190a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.716832:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636190a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.716845:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636190a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429491.716878:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429491.716882:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429491.716899:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636190a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.716923:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7f6 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.716942:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636190a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7f6 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.716951:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640e00) 00010000:00010000:3.0:1789429491.716954:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429491.716957:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:3.0:1789429491.717011:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43158:x1876351635074816:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 303us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429491.717018:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21289 00000100:00100000:1.0:1789429491.722755:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429491.722847:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635074944 00000100:00100000:2.0:1789429491.722857:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635074944 00000100:00100000:2.0:1789429491.722955:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21290 00000100:00100000:2.0:1789429491.722965:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43158:x1876351635074944:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1789429491.722984:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429491.723006:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361911 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c7fd expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723062:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361918 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723073:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361918 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723081:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361918 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723090:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636191f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723095:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636191f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723099:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636191f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723145:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361918 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723150:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361918 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723154:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361918 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723157:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.723160:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361918 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723165:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361918 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723172:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640e00) 00010000:00010000:2.0:1789429491.723174:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.723178:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361918 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723182:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361918 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723190:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636191f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723193:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636191f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723197:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636191f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723235:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.723238:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636191f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723244:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636191f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723252:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30eac2f2 (ffff946f051ef400) 00010000:00010000:2.0:1789429491.723255:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.723257:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636191f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723263:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad72636191f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723394:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361911 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7fd expref: 20 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723405:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640e00) 00010000:00010000:2.0:1789429491.723407:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.723411:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361911 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7fd expref: 20 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.723421:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546c00, rc 0) 00000100:00100000:2.0:1789429491.723541:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43158:x1876351635074944:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 576us (795us total) trans 0 rc 301/301 00000100:00100000:2.0:1789429491.723549:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21290 00000100:00100000:0.0:1789429491.731859:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429491.731933:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635075072 00000100:00100000:2.0:1789429491.731943:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635075072 00000100:00100000:2.0:1789429491.731999:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21291 00000100:00100000:2.0:1789429491.732008:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:43158:x1876351635075072:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1789429491.732027:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429491.732046:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c804 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.732105:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.732119:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.732130:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429491.732161:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429491.732165:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429491.732183:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.732266:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c804 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.732281:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c804 expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.732997:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640e00) 00010000:00010000:2.0:1789429491.732999:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429491.733002:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547400, rc 0) 00000100:00100000:2.0:1789429491.733069:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:43158:x1876351635075072:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1060us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429491.733077:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21291 00000100:00100000:1.0:1789429491.742289:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.742372:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635075328 00000100:00100000:3.0:1789429491.742382:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635075328 00000100:00100000:3.0:1789429491.742479:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21292 00000100:00100000:0.0:1789429491.742554:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43158:x1876351635075328:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1789429491.743143:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429491.743171:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad72636190a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7f6 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.743192:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640e00) 00010000:00010000:0.0:1789429491.743197:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429491.743305:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.743320:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c804 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.743330:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.743366:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c804 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.743380:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c804 expref: 30 pid: 5840 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429491.743394:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648392576:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429491.745256:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c3c8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429491.755029:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5839:1876351648392576:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429491.755063:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.757359:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429491.757643:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635075456 00000100:00100000:2.0:1789429491.757655:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635075456 00010000:00010000:2.0:1789429491.757708:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c804 expref: 31 pid: 5840 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429491.757746:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6223 00000100:00100000:2.0:1789429491.757757:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635075456:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429491.757773:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429491.757780:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c804 expref: 31 pid: 5840 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.758551:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c804 expref: 31 pid: 5840 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.758574:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad72636192d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c804 expref: 31 pid: 5840 timeout: 1289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.758590:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640e00) 00010000:00010000:2.0:1789429491.758596:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.758671:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.758679:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.758717:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429491.758770:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351635075456:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1015us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429491.758778:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6223 00010000:00010000:1.0:1789429491.759232:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.759242:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.759268:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636193b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.759277:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636193b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.759286:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636193b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429491.765054:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 16384 00010000:00010000:1.0:1789429491.765077:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.765087:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.765099:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.765104:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.765108:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.765115:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.765132:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640e00) 00010000:00010000:1.0:1789429491.765135:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.765140:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.765147:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361934 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429491.765169:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000093f00fa1 reply state 00000000aad1aadf transno 4294977204 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636193b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.765177:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429491.767177:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:43158:x1876351635075328:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 24680us (24887us total) trans 4294977204 rc 0/0 00000100:00100000:1.0:1789429491.767189:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21292 00010000:00010000:0.0:1789429491.777243:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636193b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.777261:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636193b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.777270:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636193b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.777277:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01506000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429491.777282:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636193b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.777294:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636193b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.777310:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30eac2f2 (ffff946f0970ce00) 00010000:00010000:0.0:1789429491.777312:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429491.777317:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636193b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.777323:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636193b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429491.791010:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.791099:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635075584 00000100:00100000:1.0:1789429491.791109:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635075584 00000100:00100000:1.0:1789429491.791168:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21293 00000100:00100000:1.0:1789429491.791178:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43159:x1876351635075584:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:1.0:1789429491.791257:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429491.791280:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361942 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c80b expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.791341:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361949 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.791354:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.791365:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429491.791399:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429491.791402:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429491.791420:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.791451:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c80b expref: 21 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.791468:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361949 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c80b expref: 20 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.791476:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c900) 00010000:00010000:1.0:1789429491.791479:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429491.791482:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01506200, rc 0) 00000100:00100000:1.0:1789429491.791543:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:43159:x1876351635075584:12345-192.168.203.39@tcp:101:mv.0 Request processed in 366us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429491.791550:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21293 00000100:00100000:1.0:1789429491.801462:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429491.801558:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635075712 00000100:00100000:0.0:1789429491.801569:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635075712 00000100:00100000:0.0:1789429491.801638:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21294 00000100:00100000:0.0:1789429491.801649:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:43159:x1876351635075712:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:0.0:1789429491.801668:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429491.801691:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c812 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801750:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361957 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801764:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801776:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801789:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad72636195e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801797:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad72636195e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801803:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad72636195e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801882:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361965 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801890:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801897:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429491.801924:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x87:0x0]: returning size 16384 00000004:00200000:0.0:1789429491.801927:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429491.801945:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801956:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801962:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361957 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801968:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361957 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801974:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429491.801978:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361957 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801986:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361957 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.801997:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c900) 00010000:00010000:0.0:1789429491.802000:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429491.802004:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.802011:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.802024:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad72636195e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.802031:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad72636195e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.802036:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad72636195e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.802041:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429491.802044:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad72636195e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.802049:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad72636195e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.802057:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77b4e83d (ffff946f120fd000) 00010000:00010000:0.0:1789429491.802059:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429491.802062:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad72636195e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.802072:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad72636195e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.802107:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c812 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.802121:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c812 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.802127:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f120fd500) 00010000:00010000:0.0:1789429491.802129:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429491.802132:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652200, rc 0) 00000100:00100000:0.0:1789429491.802196:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:43159:x1876351635075712:12345-192.168.203.39@tcp:101:mv.0 Request processed in 549us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429491.802248:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21294 00000100:00100000:3.0:1789429491.806721:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.806807:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635075840 00000100:00100000:1.0:1789429491.806817:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635075840 00000100:00100000:1.0:1789429491.806936:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21295 00000100:00100000:1.0:1789429491.806947:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:43159:x1876351635075840:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:1.0:1789429491.806968:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429491.806989:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad72636196c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c819 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807051:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807066:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807077:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807092:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636197a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807100:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636197a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807107:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636197a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807268:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361981 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807277:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361981 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807285:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361981 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429491.807314:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 16384 00000004:00200000:1.0:1789429491.807318:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429491.807337:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361981 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807350:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807371:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361973 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807378:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807386:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01507e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.807390:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807399:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361973 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807410:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c900) 00010000:00010000:1.0:1789429491.807413:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.807418:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807434:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807452:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636197a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807459:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636197a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807465:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636197a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807470:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01506000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.807472:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636197a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807478:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636197a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807486:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30eac2f2 (ffff946f0970c400) 00010000:00010000:1.0:1789429491.807488:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.807492:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636197a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807498:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad72636197a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807527:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad72636196c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c819 expref: 23 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807541:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361981 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c819 expref: 22 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.807552:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff946f0970c700) 00010000:00010000:1.0:1789429491.807555:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429491.807557:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01507400, rc 0) 00000100:00100000:0.0:1789429491.807699:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:43159:x1876351635075840:12345-192.168.203.39@tcp:101:mv.0 Request processed in 753us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429491.807708:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21295 00000100:00100000:1.0:1789429491.815525:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.815749:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635075968 00000100:00100000:3.0:1789429491.815759:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635075968 00000100:00100000:3.0:1789429491.815822:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21296 00000100:00100000:3.0:1789429491.815833:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:43159:x1876351635075968:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:3.0:1789429491.815854:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429491.815874:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361988 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c820 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.815937:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636198f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.815951:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636198f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.815961:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636198f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816018:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361996 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816027:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816033:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816089:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636198f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816096:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636198f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816102:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636198f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816107:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.816111:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636198f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816118:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636198f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816128:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff946f0970c700) 00010000:00010000:3.0:1789429491.816131:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.816136:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636198f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816142:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad72636198f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816155:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816160:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361996 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816165:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361996 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816170:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.816172:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361996 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816177:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361996 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816184:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x77b4e83d (ffff946f08640700) 00010000:00010000:3.0:1789429491.816186:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.816189:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361996 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816195:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361996 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816255:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361988 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c820 expref: 23 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816264:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff946f0970c700) 00010000:00010000:3.0:1789429491.816266:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.816269:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361988 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c820 expref: 23 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.816278:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1e00, rc 0) 00000100:00100000:3.0:1789429491.816333:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3407b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:43159:x1876351635075968:12345-192.168.203.39@tcp:101:mv.0 Request processed in 503us (818us total) trans 0 rc 301/301 00000100:00100000:3.0:1789429491.816340:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21296 00000100:00100000:1.0:1789429491.829846:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429491.829961:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635076224 00000100:00100000:3.0:1789429491.829971:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635076224 00000100:00100000:3.0:1789429491.830034:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:3.0:1789429491.830044:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:43159:x1876351635076224:12345-192.168.203.39@tcp:36:mv.0 00010000:00010000:3.0:1789429491.830093:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789429491.830120:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361965 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c812 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830141:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f120fd500) 00010000:00010000:3.0:1789429491.830159:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361981 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c819 expref: 21 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830169:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff946f0970c700) 00010000:00010000:3.0:1789429491.830179:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361949 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c80b expref: 20 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830187:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c900) 00010000:00010000:3.0:1789429491.830192:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429491.830267:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636199d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830280:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636199d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830290:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636199d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830302:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263619a4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830309:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263619a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830316:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263619a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830327:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263619ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830334:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263619ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830340:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263619ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830352:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263619b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830358:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263619b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830364:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263619b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830479:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263619b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830487:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263619b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830495:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263619b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830515:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619c0 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830523:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619c0 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.830530:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619c0 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429491.831124:0:5852:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c3025179 reply state 00000000ac8ad322 transno 4294977205 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263619b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429491.831134:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789429491.831139:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263619ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831145:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263619ab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831152:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263619ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831158:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.831162:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263619ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831169:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263619ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831177:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff946f08640200) 00010000:00010000:3.0:1789429491.831180:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.831184:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263619ab lrc: 2/0,0 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831190:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad7263619ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x27:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429491.831747:0:5852:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c3025179 reply state 00000000ac8ad322 transno 4294977205 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263619b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429491.831756:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00010000:3.0:1789429491.831759:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636199d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831765:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636199d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831772:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636199d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831777:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.831780:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636199d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831786:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636199d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831796:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640700) 00010000:00010000:3.0:1789429491.831798:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.831801:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636199d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831807:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad72636199d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429491.831817:0:5852:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c3025179 reply state 00000000ac8ad322 transno 4294977205 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263619a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429491.831827:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00010000:00010000:3.0:1789429491.831830:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619c0 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831836:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619c0 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831841:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619c0 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831846:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.831848:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619c0 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831853:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619c0 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831860:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff946f08640f00) 00010000:00010000:3.0:1789429491.831862:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.831864:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619c0 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.831868:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619c0 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429491.832052:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:43159:x1876351635076224:12345-192.168.203.39@tcp:36:mv.0 Request processed in 2007us (2212us total) trans 4294977205 rc 0/0 00000100:00100000:3.0:1789429491.832062:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00010000:00010000:2.0:1789429491.839076:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263619a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839094:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263619a4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839103:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263619a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839110:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.839116:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263619a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839124:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263619a4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839140:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77b4e83d (ffff946f08640900) 00010000:00010000:2.0:1789429491.839144:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.839149:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263619a4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839155:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad7263619a4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839177:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263619b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839189:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263619b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839195:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263619b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839239:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.839243:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263619b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839249:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263619b2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839258:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x77b4e83d (ffff946f08640100) 00010000:00010000:2.0:1789429491.839260:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.839263:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263619b2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839268:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad7263619b2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x27:0x0].0x77b4e83d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839280:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263619b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839285:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263619b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839290:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263619b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839295:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.839298:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263619b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839304:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263619b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839311:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f08640c00) 00010000:00010000:2.0:1789429491.839314:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789429491.839316:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263619b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.839322:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad7263619b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x87:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429491.889495:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429491.889597:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635076480 00000100:00100000:0.0:1789429491.889617:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635076480 00000100:00100000:0.0:1789429491.889675:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 276 00000100:00100000:0.0:1789429491.889685:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05acd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:43153:x1876351635076480:12345-192.168.203.39@tcp:35:tail.0 00000100:00100000:0.0:1789429491.889999:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05acd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:43153:x1876351635076480:12345-192.168.203.39@tcp:35:tail.0 Request processed in 314us (511us total) trans 4294977206 rc 0/0 00000100:00100000:0.0:1789429491.890007:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 276 00000100:00100000:0.0:1789429491.903825:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.904772:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635076608 00000100:00100000:1.0:1789429491.904782:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635076608 00000100:00100000:1.0:1789429491.905730:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21297 00000100:00100000:1.0:1789429491.905744:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:43151:x1876351635076608:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1789429491.905768:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429491.905793:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263619c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c827 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.906920:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263619ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.906937:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263619ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.906949:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263619ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429491.906976:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x87:0x0]: returning size 16384 00000004:00200000:1.0:1789429491.906979:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429491.906998:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263619ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.907034:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263619c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c827 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.907054:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263619ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c827 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.907062:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429491.907065:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429491.907068:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031200, rc 0) 00000100:00100000:1.0:1789429491.907240:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:43151:x1876351635076608:12345-192.168.203.39@tcp:101:bash.0 Request processed in 1499us (3422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429491.907247:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21297 00000100:00100000:2.0:1789429491.925319:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.928095:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635076736 00000100:00100000:1.0:1789429491.928107:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635076736 00000100:00100000:2.0:1789429491.929951:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21298 00000100:00100000:2.0:1789429491.929967:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635076736:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:2.0:1789429491.929988:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429491.930009:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad7263619d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c82e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930089:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263619dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930103:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263619dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930113:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263619dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930126:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263619e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930133:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263619e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930139:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263619e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930190:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263619dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930216:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263619dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930224:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263619dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930230:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.930234:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263619dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930242:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263619dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930252:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:2.0:1789429491.930255:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.930260:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263619dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930267:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad7263619dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930280:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263619e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930286:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263619e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930292:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263619e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930297:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.930299:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263619e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930305:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263619e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930312:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0xeddcfc6c (ffff946f051ef400) 00010000:00010000:2.0:1789429491.930315:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.930318:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263619e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930323:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad7263619e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930354:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad7263619d5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c82e expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930364:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:2.0:1789429491.930366:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789429491.930369:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad7263619d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c82e expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.930383:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429491.930459:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635076736:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 496us (5149us total) trans 0 rc 301/301 00000100:00100000:2.0:1789429491.930466:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21298 00000100:00100000:3.0:1789429491.936299:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.936387:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635076864 00000100:00100000:1.0:1789429491.936397:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635076864 00000100:00100000:1.0:1789429491.936456:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21299 00000100:00100000:1.0:1789429491.936466:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635076864:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:1.0:1789429491.936486:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429491.936508:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263619ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c835 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936572:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263619f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936596:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263619f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936619:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263619f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936635:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263619f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936642:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263619f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936649:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263619f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936695:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263619f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936701:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263619f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936708:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263619f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936714:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00030600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.936719:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263619f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936727:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263619f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936738:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429491.936742:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.936747:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263619f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936754:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad7263619f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936768:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263619f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936773:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263619f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936779:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263619f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936783:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.936786:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263619f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936792:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263619f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936800:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x3491cd4c (ffff946f0970c000) 00010000:00010000:1.0:1789429491.936803:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.936806:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263619f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936811:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad7263619f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936854:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263619ea lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c835 expref: 33 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936869:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429491.936871:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789429491.936874:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad7263619ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c835 expref: 33 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.936884:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031000, rc 0) 00000100:00100000:1.0:1789429491.937092:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635076864:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 626us (800us total) trans 0 rc 301/301 00000100:00100000:1.0:1789429491.937101:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21299 00010000:00010000:1.0:1789429491.939415:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429491.943963:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429491.944773:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635076992 00000100:00100000:2.0:1789429491.944786:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635076992 00000100:00100000:3.0:1789429491.945105:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21300 00000100:00100000:3.0:1789429491.945118:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635076992:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:3.0:1789429491.945138:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429491.945158:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c83c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945245:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361a06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945259:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361a06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945269:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361a06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945282:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361a0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945289:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945295:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945345:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361a06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945353:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361a06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945360:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361a06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945366:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.945370:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361a06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945379:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361a06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945390:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:3.0:1789429491.945393:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.945398:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361a06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945404:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361a06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945416:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361a0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945529:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361a0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945536:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361a0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945542:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429491.945545:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361a0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945551:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361a0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945563:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x3735a305 (ffff946f08640f00) 00010000:00010000:3.0:1789429491.945565:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429491.945568:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361a0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945574:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361a0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945681:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619ff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c83c expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945691:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:3.0:1789429491.945694:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789429491.945697:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad7263619ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c83c expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429491.945706:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:3.0:1789429491.945809:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635076992:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 693us (1854us total) trans 0 rc 301/301 00000100:00100000:3.0:1789429491.945816:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21300 00000100:00100000:3.0:1789429491.954384:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429491.958594:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635077248 00000100:00100000:0.0:1789429491.958616:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635077248 00000100:00100000:0.0:1789429491.958688:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21301 00000100:00100000:0.0:1789429491.958699:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635077248:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:0.0:1789429491.958720:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429491.958740:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361a14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c843 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.958808:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.958823:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.958947:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959009:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3e9f33b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959017:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959022:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959072:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959079:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959092:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959098:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429491.959102:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959109:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959120:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:0.0:1789429491.959123:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429491.959127:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959133:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959147:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959152:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959158:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959163:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429491.959165:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959174:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959180:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x3e9f33b0 (ffff946f120fd000) 00010000:00010000:0.0:1789429491.959183:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429491.959186:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959191:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x3e9f33b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959309:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361a14 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c843 expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959321:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:0.0:1789429491.959323:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789429491.959327:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361a14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c843 expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.959337:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652a00, rc 0) 00000100:00100000:0.0:1789429491.959904:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635077248:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 1205us (5526us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429491.959913:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21301 00000100:00100000:0.0:1789429491.973290:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429491.973383:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635077504 00000100:00100000:2.0:1789429491.973394:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635077504 00000100:00100000:2.0:1789429491.973469:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21302 00000100:00100000:2.0:1789429491.973481:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635077504:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:2.0:1789429491.973500:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429491.973520:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361a29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c84a expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973590:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973848:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973860:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973877:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x2ad43c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973884:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973896:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973946:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973954:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973960:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973966:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.973970:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973977:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.973988:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:2.0:1789429491.973991:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.973996:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.974003:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.974015:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.974021:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.974027:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.974031:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.974034:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.974039:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.974045:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x2ad43c78 (ffff946f051ef400) 00010000:00010000:2.0:1789429491.974047:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.974050:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.974056:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x2ad43c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.974084:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361a29 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c84a expref: 33 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.974093:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:2.0:1789429491.974095:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789429491.974099:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361a29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c84a expref: 33 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.974107:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429491.974171:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635077504:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 693us (891us total) trans 0 rc 301/301 00000100:00100000:2.0:1789429491.974182:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21302 00000100:00100000:3.0:1789429491.979958:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.980273:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635077760 00000100:00100000:1.0:1789429491.980283:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635077760 00000100:00100000:1.0:1789429491.980376:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21303 00000100:00100000:1.0:1789429491.980386:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635077760:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:1.0:1789429491.980407:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429491.980440:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361a3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c851 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980522:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980536:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980547:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980623:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0xbfff8436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980631:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980638:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980685:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980692:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980697:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980813:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.980817:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980838:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980849:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429491.980852:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.980856:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980863:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980878:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980884:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980890:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980894:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00030600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.980897:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980903:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980910:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0xbfff8436 (ffff946f0970c000) 00010000:00010000:1.0:1789429491.980912:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.980915:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980921:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xbfff8436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980957:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361a3e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c851 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980967:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429491.980970:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789429491.980974:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361a3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c851 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.980983:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031000, rc 0) 00000100:00100000:1.0:1789429491.981045:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635077760:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 660us (1097us total) trans 0 rc 301/301 00000100:00100000:1.0:1789429491.981052:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21303 00000100:00100000:3.0:1789429491.986812:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429491.986995:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635078016 00000100:00100000:0.0:1789429491.987006:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635078016 00000100:00100000:0.0:1789429491.987057:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21304 00000100:00100000:0.0:1789429491.987067:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635078016:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:0.0:1789429491.987087:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429491.987107:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c858 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987175:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987189:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987231:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987247:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x594a0ca2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987254:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987260:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987311:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987319:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987326:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987332:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429491.987337:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987345:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987357:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:0.0:1789429491.987360:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429491.987365:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987370:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361a5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987382:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987388:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987393:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987398:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01653a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429491.987401:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987406:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987412:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x594a0ca2 (ffff946f120fd000) 00010000:00010000:0.0:1789429491.987415:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429491.987417:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987434:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x594a0ca2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987482:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a53 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c858 expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987492:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:0.0:1789429491.987494:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789429491.987498:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c858 expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429491.987507:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652800, rc 0) 00000100:00100000:0.0:1789429491.987564:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635078016:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 498us (762us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429491.987571:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21304 00000100:00100000:0.0:1789429491.993687:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429491.993822:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635078272 00000100:00100000:1.0:1789429491.993840:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635078272 00000100:00100000:1.0:1789429491.993895:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21305 00000100:00100000:1.0:1789429491.993904:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635078272:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:1.0:1789429491.993921:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429491.993943:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361a68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c85f expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994008:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994020:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994030:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994043:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994050:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994056:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994102:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994109:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994115:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994120:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00030600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.994124:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994131:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994141:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429491.994144:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.994148:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994154:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361a6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994166:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994171:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994176:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994181:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429491.994184:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994189:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994194:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0xce5b6a33 (ffff946f0970c000) 00010000:00010000:1.0:1789429491.994196:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429491.994235:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994241:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361a76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994269:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361a68 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c85f expref: 33 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994277:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429491.994279:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789429491.994283:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361a68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c85f expref: 33 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429491.994291:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031000, rc 0) 00000100:00100000:1.0:1789429491.994350:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635078272:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 446us (670us total) trans 0 rc 301/301 00000100:00100000:1.0:1789429491.994358:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21305 00000100:00100000:3.0:1789429491.999383:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429491.999619:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635078528 00000100:00100000:2.0:1789429491.999630:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635078528 00000100:00100000:2.0:1789429491.999687:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21306 00000100:00100000:2.0:1789429491.999698:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635078528:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:2.0:1789429491.999727:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429491.999746:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361a7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c866 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999814:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999837:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999849:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999863:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0xfe67841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999870:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999877:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999925:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999943:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999950:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999957:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429491.999961:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999969:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999980:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:2.0:1789429491.999984:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429491.999989:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429491.999995:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547800/0xb4c3dad726361a84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.000008:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.000020:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.000027:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.000032:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429492.000036:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.000042:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.000050:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0xfe67841 (ffff946f051ef400) 00010000:00010000:2.0:1789429492.000053:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429492.000055:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.000062:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361a8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xfe67841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.000094:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361a7d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c866 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.000104:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:2.0:1789429492.000106:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789429492.000110:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361a7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c866 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.000119:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429492.000184:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635078528:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 488us (811us total) trans 0 rc 301/301 00000100:00100000:2.0:1789429492.000191:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21306 00000100:00100000:3.0:1789429492.007501:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429492.007642:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635078784 00000100:00100000:0.0:1789429492.007652:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635078784 00000100:00100000:0.0:1789429492.007720:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21307 00000100:00100000:0.0:1789429492.007741:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635078784:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:0.0:1789429492.007761:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429492.007781:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c86d expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.007862:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.007878:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.007892:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.007907:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.007919:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.007926:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.007976:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.007984:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.007992:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.007998:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01653a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429492.008002:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008009:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008020:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:0.0:1789429492.008024:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429492.008029:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008035:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361a99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008049:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008055:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008061:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008066:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429492.008069:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008075:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008082:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x820cea43 (ffff946f120fd000) 00010000:00010000:0.0:1789429492.008085:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429492.008088:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361aa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008095:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008127:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a92 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c86d expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008138:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:0.0:1789429492.008141:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789429492.008145:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361a92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c86d expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.008155:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652800, rc 0) 00000100:00100000:0.0:1789429492.008259:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635078784:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 530us (767us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429492.008267:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21307 00000100:00100000:3.0:1789429492.015057:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429492.017827:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635079040 00000100:00100000:1.0:1789429492.017843:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635079040 00000100:00100000:1.0:1789429492.017982:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21308 00000100:00100000:1.0:1789429492.017993:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635079040:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:1.0:1789429492.018015:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429492.018035:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361aa7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c874 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018105:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361aae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018120:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361aae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018132:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361aae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018146:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361ab5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018153:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018160:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018240:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361aae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018248:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361aae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018255:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361aae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018261:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00031800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429492.018266:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361aae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018273:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361aae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018284:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429492.018287:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429492.018292:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361aae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018298:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361aae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018311:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018317:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018323:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018327:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00030600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429492.018330:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018336:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018346:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x90ba0166 (ffff946f0970c000) 00010000:00010000:1.0:1789429492.018349:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429492.018352:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361ab5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018357:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018388:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361aa7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c874 expref: 33 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018398:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:1.0:1789429492.018400:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789429492.018404:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361aa7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c874 expref: 33 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429492.018412:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031000, rc 0) 00000100:00100000:1.0:1789429492.018479:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635079040:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 488us (3430us total) trans 0 rc 301/301 00000100:00100000:1.0:1789429492.018487:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21308 00000100:00100000:3.0:1789429492.023712:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429492.023892:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635079296 00000100:00100000:0.0:1789429492.023902:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635079296 00000100:00100000:0.0:1789429492.023962:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21309 00000100:00100000:0.0:1789429492.023973:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635079296:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:0.0:1789429492.023994:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429492.024021:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361abc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c87b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024098:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361ac3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024113:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361ac3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024126:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361ac3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024139:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361aca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x87:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024146:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024152:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024228:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361ac3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024236:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361ac3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024242:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361ac3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024249:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429492.024253:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361ac3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024260:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361ac3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024270:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:0.0:1789429492.024273:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429492.024278:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361ac3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024284:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361ac3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024297:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024303:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361aca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024309:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361aca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024314:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01653a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429492.024316:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361aca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024322:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361aca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x87:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024329:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0xaf3dc4c9 (ffff946f120fd000) 00010000:00010000:0.0:1789429492.024332:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429492.024334:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361aca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024340:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361aca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024375:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361abc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c87b expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024385:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:0.0:1789429492.024387:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789429492.024390:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361abc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x87:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c87b expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.024405:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652800, rc 0) 00000100:00100000:0.0:1789429492.024454:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635079296:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 483us (763us total) trans 0 rc 301/301 00000100:00100000:0.0:1789429492.024461:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21309 00000100:00100000:3.0:1789429492.030927:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429492.030992:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635079552 00000100:00100000:0.0:1789429492.031003:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635079552 00000100:00100000:0.0:1789429492.031063:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21310 00000100:00100000:0.0:1789429492.031074:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+32:43161:x1876351635079552:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:0.0:1789429492.031094:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429492.031117:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361ad1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c882 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429492.031249:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x87:0x0]: returning size 16384 00010000:00010000:0.0:1789429492.031359:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361ad1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c882 expref: 34 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.031375:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fdc00) 00010000:00010000:0.0:1789429492.031378:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789429492.031383:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361ad1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c882 expref: 34 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.031404:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01653800, rc 0) 00000100:00100000:0.0:1789429492.031521:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+33:43161:x1876351635079552:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 448us (602us total) trans 4294977207 rc 301/301 00000100:00100000:0.0:1789429492.031529:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21310 00000100:00100000:3.0:1789429492.034166:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429492.034257:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635079808 00000100:00100000:0.0:1789429492.034267:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635079808 00000100:00100000:0.0:1789429492.034320:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 277 00000100:00100000:0.0:1789429492.034329:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+33:43161:x1876351635079808:12345-192.168.203.39@tcp:35:multiop.0 00000100:00100000:0.0:1789429492.034530:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+34:43161:x1876351635079808:12345-192.168.203.39@tcp:35:multiop.0 Request processed in 202us (372us total) trans 4294977208 rc 0/0 00000100:00100000:0.0:1789429492.034538:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 277 00000100:00100000:3.0:1789429492.081344:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429492.082033:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635079936 00000100:00100000:2.0:1789429492.082102:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635079936 00000100:00100000:2.0:1789429492.082935:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21311 00000100:00100000:2.0:1789429492.082950:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+34:43162:x1876351635079936:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:2.0:1789429492.082977:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429492.083003:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361adf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c889 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.083078:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361ae6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.083093:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.083106:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429492.083143:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429492.083147:0:15669:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429492.083165:0:15669:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.083309:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546000/0xb4c3dad726361adf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c889 expref: 36 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.083329:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c889 expref: 35 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429492.083337:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef400) 00010000:00010000:2.0:1789429492.083340:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429492.083343:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429492.083753:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+35:43162:x1876351635079936:12345-192.168.203.39@tcp:101:ls.0 Request processed in 471us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429492.083766:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21311 00000100:00100000:3.0:1789429492.088806:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429492.088980:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635080064 00000100:00100000:0.0:1789429492.088991:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635080064 00000100:00100000:0.0:1789429492.089118:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21312 00000100:00100000:0.0:1789429492.089129:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+35:43162:x1876351635080064:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:0.0:1789429492.089149:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429492.089171:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361aed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c890 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.089364:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361af4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.089378:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.089389:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.089405:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361afb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.090176:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.090348:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.090867:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361b02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.090879:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361b02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.090886:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361b02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429492.090917:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 16384 00000004:00200000:0.0:1789429492.090920:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429492.090939:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361b02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.090950:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361af4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.090957:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361af4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.090964:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361af4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.090970:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429492.090974:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361af4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.090982:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361af4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.090993:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef400) 00010000:00010000:0.0:1789429492.090996:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429492.091002:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361af4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.091008:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361af4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.091022:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361afb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.091028:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361afb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.091033:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361afb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.091165:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01653a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429492.091170:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361afb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.091177:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361afb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.091194:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x30eac2f2 (ffff946f120fdc00) 00010000:00010000:0.0:1789429492.091224:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429492.091228:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361afb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.091234:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361afb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x30eac2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.091282:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361aed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c890 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.091297:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361b02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c890 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.091304:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff946f120fd000) 00010000:00010000:0.0:1789429492.091306:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429492.091309:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652000, rc 0) 00000100:00100000:0.0:1789429492.091382:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+36:43162:x1876351635080064:12345-192.168.203.39@tcp:101:ls.0 Request processed in 2254us (2596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429492.091391:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21312 00000100:00100000:3.0:1789429492.096804:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429492.096881:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635080320 00000100:00100000:0.0:1789429492.096893:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635080320 00000100:00100000:0.0:1789429492.096953:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21313 00000100:00100000:0.0:1789429492.096964:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+36:43162:x1876351635080320:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:0.0:1789429492.096984:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429492.097006:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361b09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c897 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429492.097103:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x27:0x0]: returning size 16384 00010000:00010000:0.0:1789429492.097273:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361b09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c897 expref: 38 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.097294:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef400) 00010000:00010000:0.0:1789429492.097298:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789429492.097306:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361b09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c897 expref: 38 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429492.097321:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652a00, rc 0) 00000100:00100000:0.0:1789429492.097383:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+37:43162:x1876351635080320:12345-192.168.203.39@tcp:101:ls.0 Request processed in 420us (587us total) trans 4294977209 rc 301/301 00000100:00100000:0.0:1789429492.097391:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21313 00000100:00100000:3.0:1789429492.105315:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429492.105858:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635080448 00000100:00100000:1.0:1789429492.105869:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635080448 00000100:00100000:1.0:1789429492.105926:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 278 00000100:00100000:1.0:1789429492.105936:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+37:43162:x1876351635080448:12345-192.168.203.39@tcp:37:ls.0 00000100:00100000:1.0:1789429492.113781:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+37:43162:x1876351635080448:12345-192.168.203.39@tcp:37:ls.0 Request processed in 7837us (8466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429492.113794:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 278 00000100:00100000:0.0:1789429492.118632:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429492.118791:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635080704 00000100:00100000:2.0:1789429492.118802:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635080704 00000100:00100000:2.0:1789429492.118861:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 279 00000100:00100000:2.0:1789429492.118871:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+37:43162:x1876351635080704:12345-192.168.203.39@tcp:35:ls.0 00000100:00100000:2.0:1789429492.119120:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+38:43162:x1876351635080704:12345-192.168.203.39@tcp:35:ls.0 Request processed in 250us (497us total) trans 4294977210 rc 0/0 00000100:00100000:2.0:1789429492.119128:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 279 00000001:00080000:0.0:1789429492.464520:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969274 is committed 00010000:00010000:0.0:1789429492.963831:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429493.984917:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977209 is committed 00000001:00080000:2.0:1789429493.985028:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977204 is committed 00000001:00080000:2.0:1789429493.985116:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977210 is committed 00000001:00080000:2.0:1789429493.985266:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977205 is committed 00010000:00010000:1.0:1789429493.987931:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429494.549906:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429494.549956:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429494.549999:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429494.550023:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429494.550045:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429494.550064:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429494.550084:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429494.550114:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635081344 00000100:00100000:3.0:1789429494.550124:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635081344 00000100:00100000:3.0:1789429494.550176:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635080960 00000100:00100000:3.0:1789429494.550180:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635080960 00000100:00100000:3.0:1789429494.550227:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 887 00000100:00100000:3.0:1789429494.550238:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351635081344:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429494.550310:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2369:x1876351635081344:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 73us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429494.550318:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 887 00000100:00100000:1.0:1789429494.550324:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635081088 00000100:00100000:1.0:1789429494.550330:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635081088 00000100:00100000:3.0:1789429494.550341:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 888 00000100:00100000:3.0:1789429494.550352:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+28:2369:x1876351635080960:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429494.550363:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635081600 00000100:00100000:1.0:1789429494.550367:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635081600 00000100:00100000:3.0:1789429494.550385:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+28:2369:x1876351635080960:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 36us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429494.550391:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635081216 00000100:00100000:3.0:1789429494.550393:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 888 00000100:00100000:1.0:1789429494.550396:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635081216 00000100:00100000:1.0:1789429494.550419:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635081472 00000100:00100000:1.0:1789429494.550422:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635081472 00000100:00100000:3.0:1789429494.550439:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 930 00000100:00100000:1.0:1789429494.550446:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 931 00000100:00100000:3.0:1789429494.550451:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635081088:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429494.550471:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635081600:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429494.550496:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635081088:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 48us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429494.550503:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 930 00000100:00100000:1.0:1789429494.550511:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635081600:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 54us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429494.550519:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 931 00000100:00100000:0.0:1789429494.550653:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635080832 00000100:00100000:0.0:1789429494.550658:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635080832 00000100:00100000:0.0:1789429494.550691:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 603 00000100:00100000:0.0:1789429494.550700:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635080832:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429494.550730:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635080832:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429494.550737:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 603 00000100:00100000:3.0:1789429494.550792:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 932 00000100:00100000:3.0:1789429494.550801:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635081216:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429494.550833:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635081216:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 34us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429494.550838:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 932 00000100:00100000:3.0:1789429494.550852:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 933 00000100:00100000:3.0:1789429494.550857:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635081472:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429494.550881:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635081472:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429494.550887:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 933 00000100:00080000:3.0:1789429494.551070:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429494.551075:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429494.551077:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429494.948281:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648392704:0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.948348:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429494.948391:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648393216:0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.948415:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429494.948438:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789429494.948444:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648393088:0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.948465:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429494.948492:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648392832:0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.948515:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429494.948532:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648393344:0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.948551:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429494.948569:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429494.948574:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648392960:0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.948605:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429494.948640:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648392704 00000100:00100000:1.0:1789429494.948648:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648392704 00000100:00100000:1.0:1789429494.948689:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1789429494.948697:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648392704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.948745:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648392704:12345-0@lo:400:kworker.0 Request processed in 48us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429494.948752:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1789429494.948781:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648393216 00000100:00100000:1.0:1789429494.948785:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648393216 00000100:00100000:1.0:1789429494.948812:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648392832 00000100:00100000:1.0:1789429494.948814:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648392832 00000100:00100000:1.0:1789429494.948826:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648392960 00000100:00100000:1.0:1789429494.948828:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648392960 00000100:00100000:1.0:1789429494.948845:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1789429494.948850:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648393216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.948876:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648393216:12345-0@lo:400:kworker.0 Request processed in 26us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429494.948882:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1789429494.948892:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1789429494.948897:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648392832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.948924:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648392832:12345-0@lo:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429494.948930:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1789429494.948940:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1789429494.948946:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648392960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.948971:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648392960:12345-0@lo:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429494.948977:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1789429494.948993:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648393088 00000100:00100000:1.0:1789429494.948996:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648393088 00000100:00100000:1.0:1789429494.949018:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648393344 00000100:00100000:1.0:1789429494.949020:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648393344 00000100:00100000:1.0:1789429494.949036:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:1.0:1789429494.949041:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648393088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.949066:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648393088:12345-0@lo:400:kworker.0 Request processed in 25us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429494.949071:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:1.0:1789429494.949080:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:1.0:1789429494.949085:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648393344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.949104:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648393344:12345-0@lo:400:kworker.0 Request processed in 20us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429494.949109:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00080000:1.0:1789429494.949129:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429494.949133:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429494.949135:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429494.949168:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648392960:0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.949177:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648392832:0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.949184:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648393344:0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.949229:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29dead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648393088:0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.949236:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648392704:0@lo:400:kworker.0 00000100:00100000:1.0:1789429494.949244:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648393216:0@lo:400:kworker.0 00010000:00010000:0.0:1789429495.011344:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429495.460912:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648393600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429495.460981:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429495.461120:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648393600 00000100:00100000:2.0:1789429495.461129:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648393600 00000100:00100000:2.0:1789429495.461181:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789429495.461191:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648393600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429495.461246:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47775744 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429495.461305:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648393600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429495.461313:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1789429495.461326:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429495.461341:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648393472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429495.461374:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429495.461503:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648393472 00000100:00100000:2.0:1789429495.461508:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648393472 00000100:00100000:2.0:1789429495.461627:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789429495.461637:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648393472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429495.461656:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429495.461691:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648393472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429495.461697:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1789429495.462106:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648393472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429495.462155:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f4e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648393600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789429496.037725:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429497.061643:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429498.083535:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429498.228863:0:25250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 19:44:57 (1789429497) 00000100:00100000:3.0:1789429498.279771:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429498.279825:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635081856 00000100:00100000:3.0:1789429498.279838:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635081856 00000100:00100000:3.0:1789429498.279915:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21314 00000100:00100000:3.0:1789429498.279926:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:43729:x1876351635081856:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:3.0:1789429498.279954:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429498.279957:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789429498.279995:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361ae6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c889 expref: 28 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.280017:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef400) 00010000:00010000:3.0:1789429498.280031:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429498.280051:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361b17 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c89e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.280439:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b1e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.280455:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.280467:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.280482:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b25 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.280489:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.280496:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789429498.281373:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x35:0x0], index 1: 0 00010000:00010000:3.0:1789429498.281695:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361b2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x89:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.281711:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.281726:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.281770:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.281777:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b1e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.281784:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.281790:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429498.281796:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.281804:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b1e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.281816:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640f00) 00010000:00010000:3.0:1789429498.281819:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429498.281825:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b1e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.281831:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b1e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429498.281846:0:5839:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000683c17be reply state 0000000073053115 transno 4294977211 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429498.281855:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789429498.281892:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361b17 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c89e expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.281914:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361b2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c89e expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.281922:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x89:0x0].0x0 (ffff946f08640c00) 00010000:00010000:3.0:1789429498.281924:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429498.281926:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1e00, rc 0) 00000100:00100000:3.0:1789429498.282031:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:43729:x1876351635081856:12345-192.168.203.39@tcp:101:touch.0 Request processed in 2106us (2274us total) trans 4294977211 rc 0/0 00000100:00100000:3.0:1789429498.282042:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21314 00000100:00080000:3.0:1789429498.282094:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429498.285764:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429498.285923:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635082112 00000100:00100000:1.0:1789429498.285936:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635082112 00000100:00100000:1.0:1789429498.285995:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21315 00000100:00100000:1.0:1789429498.286006:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+30:43729:x1876351635082112:12345-192.168.203.39@tcp:36:touch.0 00010000:00010000:1.0:1789429498.286077:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429498.286109:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361b2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c89e expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.286127:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x89:0x0].0x0 (ffff946f08640c00) 00010000:00010000:1.0:1789429498.286140:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429498.286190:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x89:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.286229:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x89:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.286240:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x89:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429498.286423:0:6704:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c585f7cb reply state 0000000091b7ca22 transno 4294977212 ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x89:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429498.286433:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429498.286540:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:43729:x1876351635082112:12345-192.168.203.39@tcp:36:touch.0 Request processed in 535us (786us total) trans 4294977212 rc 0/0 00000100:00100000:1.0:1789429498.286547:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21315 00010000:00010000:0.0:1789429498.288688:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429498.288733:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b25 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429498.288742:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429498.288749:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429498.288755:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429498.288763:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b25 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429498.288783:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ad1bd80 (ffff946f08640200) 00010000:00010000:0.0:1789429498.288787:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429498.288793:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b25 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429498.288800:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b25 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429498.294778:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429498.294992:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635082240 00000100:00100000:1.0:1789429498.295005:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635082240 00000100:00100000:1.0:1789429498.295072:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21316 00000100:00100000:1.0:1789429498.295083:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:43729:x1876351635082240:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:1.0:1789429498.295113:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429498.295139:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361b41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x89:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8a5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.295248:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361b41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x89:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8a5 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.295265:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361b41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x89:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8a5 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.295287:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x89:0x0].0x0 (ffff946f0970c000) 00010000:00010000:1.0:1789429498.295291:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789429498.295296:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031000, rc 0) 00000100:00100000:1.0:1789429498.295360:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:43729:x1876351635082240:12345-192.168.203.39@tcp:101:touch.0 Request processed in 278us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429498.295368:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21316 00010000:00010000:2.0:1789429498.295959:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429498.295972:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429498.295980:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429498.295986:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f00030600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429498.295991:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429498.296000:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429498.296015:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x89:0x0].0x0 (ffff946f0970c000) 00010000:00010000:2.0:1789429498.296018:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429498.296022:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429498.296028:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x89:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429498.306733:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429498.306977:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635082368 00000100:00100000:3.0:1789429498.306992:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635082368 00000100:00100000:3.0:1789429498.307095:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5819 00000100:00100000:3.0:1789429498.307108:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635082368:12345-192.168.203.39@tcp:2:touch.0 00000100:00100000:3.0:1789429498.307628:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635082368:12345-192.168.203.39@tcp:2:touch.0 Request processed in 521us (908us total) trans 4294969606 rc 0/0 00000100:00100000:3.0:1789429498.307638:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5819 00000100:00080000:1.0:1789429498.307968:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429498.327640:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429498.327761:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635082624 00000100:00100000:2.0:1789429498.327775:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635082624 00000100:00100000:2.0:1789429498.327853:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 280 00000100:00100000:2.0:1789429498.327865:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:43729:x1876351635082624:12345-192.168.203.39@tcp:35:touch.0 00000100:00100000:2.0:1789429498.328346:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:43729:x1876351635082624:12345-192.168.203.39@tcp:35:touch.0 Request processed in 482us (718us total) trans 4294977213 rc 0/0 00000100:00100000:2.0:1789429498.328356:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 280 00000100:00100000:3.0:1789429498.344296:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429498.344425:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635082752 00000100:00100000:1.0:1789429498.344439:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635082752 00000100:00100000:1.0:1789429498.344506:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21317 00000100:00100000:1.0:1789429498.344517:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:43731:x1876351635082752:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:1.0:1789429498.344564:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429498.344595:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361b48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8ac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.344681:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.344699:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.344714:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429498.344905:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429498.344910:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429498.344937:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.344967:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ac expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.344988:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ac expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429498.344998:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:1.0:1789429498.345001:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429498.345005:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031800, rc 0) 00000100:00100000:1.0:1789429498.345085:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:43731:x1876351635082752:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 570us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429498.345094:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21317 00000100:00100000:1.0:1789429498.353490:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429498.353695:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635083008 00000100:00100000:3.0:1789429498.353708:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635083008 00000100:00100000:3.0:1789429498.353787:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21318 00000100:00100000:3.0:1789429498.353801:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:43731:x1876351635083008:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:3.0:1789429498.353835:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429498.353868:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361b56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8b3 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.353977:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.353999:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354014:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354030:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361b64 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354037:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361b64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354044:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361b64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354241:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x89:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354250:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354258:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429498.354270:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x89:0x0]: returning size 0 00010000:00010000:3.0:1789429498.354405:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b5d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354414:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b5d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354430:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354437:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429498.354442:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b5d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354450:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b5d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354463:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:3.0:1789429498.354466:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429498.354472:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354479:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361b5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354496:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361b64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354502:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361b64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354509:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361b64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354518:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429498.354521:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361b64 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354527:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361b64 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354534:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ad1bd80 (ffff946f08640f00) 00010000:00010000:3.0:1789429498.354536:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429498.354539:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361b64 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354545:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361b64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354601:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361b56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8b3 expref: 35 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354616:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8b3 expref: 34 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429498.354624:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x89:0x0].0x0 (ffff946f0970c000) 00010000:00010000:3.0:1789429498.354627:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429498.354630:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:3.0:1789429498.354710:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+34:43731:x1876351635083008:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 912us (1235us total) trans 4294977214 rc 0/0 00000100:00100000:3.0:1789429498.354718:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21318 00010000:00010000:1.0:1789429499.108705:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429499.130234:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977212 is committed 00000001:00080000:2.0:1789429499.130259:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977213 is committed 00000001:00080000:2.0:1789429499.130268:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977214 is committed 00000100:00100000:2.0:1789429499.387294:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429499.388343:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635083136 00000100:00100000:1.0:1789429499.388361:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635083136 00000100:00080000:3.0:1789429499.388634:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429499.388720:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21319 00000100:00100000:1.0:1789429499.388737:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:43735:x1876351635083136:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:1.0:1789429499.388767:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429499.388883:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8ba expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.388969:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361b80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.388992:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361b80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.389009:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361b80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429499.389068:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429499.389140:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429499.389177:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361b80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.389643:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030600/0xb4c3dad726361b79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ba expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.389668:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361b80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ba expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.389678:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:1.0:1789429499.389682:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429499.389687:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f00031400, rc 0) 00000100:00100000:1.0:1789429499.389778:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:43735:x1876351635083136:12345-192.168.203.39@tcp:101:mv.0 Request processed in 1047us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429499.389785:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21319 00000100:00100000:0.0:1789429499.395566:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429499.395766:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635083264 00000100:00100000:1.0:1789429499.395779:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635083264 00000100:00100000:1.0:1789429499.395854:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21320 00000100:00100000:1.0:1789429499.395865:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:43735:x1876351635083264:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:1.0:1789429499.395895:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429499.395922:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8c1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396011:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361b8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396031:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396047:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396065:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361b95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396087:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396099:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396732:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361b9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x89:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396747:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396756:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429499.396805:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x89:0x0]: returning size 0 00000004:00200000:1.0:1789429499.396810:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429499.396836:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396849:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396858:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396865:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361b8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396873:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396879:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01507400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429499.396883:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396892:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361b8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396906:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:1.0:1789429499.396909:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429499.396915:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361b8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396922:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361b8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396937:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396943:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361b95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396950:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396955:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01507200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429499.396959:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396966:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361b95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396973:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ad1bd80 (ffff946f0970c600) 00010000:00010000:1.0:1789429499.396976:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429499.396979:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361b95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.396988:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361b95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.398045:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8c1 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.398076:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361b9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8c1 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.398086:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x89:0x0].0x0 (ffff946f0970c000) 00010000:00010000:1.0:1789429499.398089:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429499.398092:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01506000, rc 0) 00000100:00100000:1.0:1789429499.398224:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43735:x1876351635083264:12345-192.168.203.39@tcp:101:mv.0 Request processed in 2332us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429499.398240:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21320 00000100:00100000:2.0:1789429499.401275:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429499.401380:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635083392 00000100:00100000:3.0:1789429499.401391:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635083392 00000100:00100000:3.0:1789429499.401469:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21321 00000100:00100000:3.0:1789429499.401481:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43735:x1876351635083392:12345-192.168.203.39@tcp:101:mv.0 00010000:00010000:3.0:1789429499.401509:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429499.401538:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361ba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8c8 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.401632:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361baa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.401650:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361baa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.401663:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361baa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.401681:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.401688:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.401694:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.401952:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361baa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.401961:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361baa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.401973:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361baa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.401980:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429499.401984:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361baa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.401992:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361baa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402006:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:3.0:1789429499.402010:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429499.402016:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402022:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402037:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402044:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402050:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402055:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429499.402059:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402069:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402077:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x582ed9b5 (ffff946f08640100) 00010000:00010000:3.0:1789429499.402079:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429499.402082:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402087:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402123:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361ba3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8c8 expref: 20 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402133:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:3.0:1789429499.402136:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429499.402140:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361ba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8c8 expref: 20 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.402149:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1e00, rc 0) 00000100:00100000:3.0:1789429499.402254:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43735:x1876351635083392:12345-192.168.203.39@tcp:101:mv.0 Request processed in 774us (994us total) trans 0 rc 301/301 00000100:00100000:3.0:1789429499.402263:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21321 00000100:00100000:2.0:1789429499.406276:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429499.406387:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635083648 00000100:00100000:1.0:1789429499.406401:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635083648 00000100:00100000:1.0:1789429499.406485:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1789429499.406497:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43735:x1876351635083648:12345-192.168.203.39@tcp:36:mv.0 00010000:00010000:1.0:1789429499.406758:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789429499.406794:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361b9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8c1 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.406819:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x89:0x0].0x0 (ffff946f0970c000) 00010000:00010000:1.0:1789429499.406832:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031400/0xb4c3dad726361b80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ba expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.406849:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:1.0:1789429499.406853:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429499.406887:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.406903:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ac expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.406913:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.406956:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ac expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.406973:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ac expref: 29 pid: 5839 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429499.406989:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34078380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:5853:1876351648393728:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429499.407110:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f3f32c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429499.415789:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34078380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:5853:1876351648393728:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429499.415838:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429499.416031:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429499.417731:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635083776 00000100:00100000:0.0:1789429499.417750:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635083776 00010000:00010000:0.0:1789429499.417817:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ac expref: 30 pid: 5839 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429499.417872:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6224 00000100:00100000:0.0:1789429499.417884:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2371:x1876351635083776:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429499.417906:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429499.417914:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ac expref: 30 pid: 5839 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.417930:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ac expref: 30 pid: 5839 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.417959:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031800/0xb4c3dad726361b4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8ac expref: 30 pid: 5839 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.417983:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:0.0:1789429499.417990:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.418004:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.418012:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.418044:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429499.418125:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351635083776:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 242us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429499.418133:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6224 00010000:00010000:2.0:1789429499.418741:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.418753:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.418786:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361bbf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.418798:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361bbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.418808:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361bbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.418827:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361bc6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.418835:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.418842:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.421335:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x89:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.421430:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8b3 expref: 28 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.421441:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.421498:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8b3 expref: 28 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.421515:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8b3 expref: 28 pid: 6704 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429499.421648:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c349c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:5853:1876351648393856:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429499.421812:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e02408300 going to sleep for 11 seconds 00000100:00100000:1.0:1789429499.425804:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c349c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000_UUID:5853:1876351648393856:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429499.425843:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429499.428116:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429499.428239:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635083904 00000100:00100000:2.0:1789429499.428251:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635083904 00010000:00010000:2.0:1789429499.428306:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8b3 expref: 29 pid: 6704 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429499.428353:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6225 00000100:00100000:2.0:1789429499.428375:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351635083904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429499.428395:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429499.428403:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8b3 expref: 29 pid: 6704 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.428424:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8b3 expref: 29 pid: 6704 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.428450:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361b6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8b3 expref: 29 pid: 6704 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.428481:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x89:0x0].0x0 (ffff946f0970c000) 00010000:00010000:2.0:1789429499.428487:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.428500:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.428509:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.428852:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429499.428932:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:2370:x1876351635083904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 566us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429499.428944:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6225 00010000:00010000:1.0:1789429499.429015:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.429025:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429499.430292:0:5853:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fb881926 reply state 00000000d78ec390 transno 4294977215 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429499.430307:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1789429499.430314:0:5853:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fb881926 reply state 00000000d78ec390 transno 4294977215 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429499.430321:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1789429499.430327:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.430334:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.430342:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.430349:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01507e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429499.430355:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.430364:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.430381:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:1.0:1789429499.430385:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429499.430391:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.430398:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361bb8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429499.430418:0:5853:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fb881926 reply state 00000000d78ec390 transno 4294977215 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361bbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429499.430423:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1789429499.430511:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43735:x1876351635083648:12345-192.168.203.39@tcp:36:mv.0 Request processed in 24013us (24307us total) trans 4294977215 rc 0/0 00000100:00100000:1.0:1789429499.430520:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00010000:00010000:0.0:1789429499.436014:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361bbf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436038:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361bbf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436048:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361bbf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436054:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429499.436060:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361bbf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436069:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361bbf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436088:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ad1bd80 (ffff946f051ef800) 00010000:00010000:0.0:1789429499.436091:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429499.436097:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361bbf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436104:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546800/0xb4c3dad726361bbf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436131:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436139:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361bc6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436145:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436150:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429499.436153:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436163:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361bc6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436170:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x582ed9b5 (ffff946f051efd00) 00010000:00010000:0.0:1789429499.436172:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429499.436175:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361bc6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436181:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361bc6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x582ed9b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436193:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436237:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436245:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436250:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429499.436253:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436260:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436267:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x89:0x0].0x0 (ffff946f0970c000) 00010000:00010000:0.0:1789429499.436270:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789429499.436273:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.436284:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361bcd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x89:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429499.450668:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429499.450872:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635084032 00000100:00100000:3.0:1789429499.450887:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635084032 00000100:00100000:3.0:1789429499.450966:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21322 00000100:00100000:3.0:1789429499.450978:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:43736:x1876351635084032:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:3.0:1789429499.451017:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429499.451047:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361bd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8cf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.451136:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.451154:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.451169:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429499.451277:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429499.451283:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429499.451311:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.451352:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361bd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8cf expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.451377:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8cf expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.451387:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640100) 00010000:00010000:3.0:1789429499.451390:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429499.451396:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1000, rc 0) 00000100:00100000:3.0:1789429499.451467:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43736:x1876351635084032:12345-192.168.203.39@tcp:101:touch.0 Request processed in 491us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429499.451480:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21322 00000100:00100000:2.0:1789429499.458680:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429499.460654:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635084288 00000100:00100000:3.0:1789429499.460675:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635084288 00000100:00100000:3.0:1789429499.460807:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21323 00000100:00100000:3.0:1789429499.460821:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:43736:x1876351635084288:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:3.0:1789429499.460852:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429499.460856:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789429499.460890:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361bdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8cf expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.460912:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640100) 00010000:00010000:3.0:1789429499.460925:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429499.460946:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361be2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8d6 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.461105:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361be9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.461121:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361be9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.461133:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361be9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.461145:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361bf0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.461152:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.461163:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789429499.465413:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x38:0x0], index 0: 0 00010000:00010000:3.0:1789429499.465707:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361bf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.465730:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.465745:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.465795:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361be9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.465802:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361be9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.465809:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361be9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.465816:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429499.465821:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361be9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.465830:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361be9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.465844:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640f00) 00010000:00010000:3.0:1789429499.465847:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429499.465855:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361be9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.465863:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361be9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429499.465879:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002a5550f7 reply state 000000005386d332 transno 4294977216 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429499.465890:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789429499.465941:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1e00/0xb4c3dad726361be2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8d6 expref: 21 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.465965:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8d6 expref: 20 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.465973:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff946f08640e00) 00010000:00010000:3.0:1789429499.465976:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429499.465978:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:3.0:1789429499.466080:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:43736:x1876351635084288:12345-192.168.203.39@tcp:101:touch.0 Request processed in 5263us (7416us total) trans 4294977216 rc 0/0 00000100:00100000:3.0:1789429499.466090:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21323 00010000:00010000:2.0:1789429499.470313:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361bf0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.470342:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361bf0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.470351:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361bf0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.470360:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429499.470374:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361bf0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.470384:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361bf0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.470405:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ad1bd80 (ffff946f08640900) 00010000:00010000:2.0:1789429499.470409:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429499.470416:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361bf0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429499.470423:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0c00/0xb4c3dad726361bf0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429499.471980:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429499.472318:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635084544 00000100:00100000:3.0:1789429499.472332:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635084544 00000100:00100000:3.0:1789429499.472426:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21324 00000100:00100000:3.0:1789429499.472442:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:43736:x1876351635084544:12345-192.168.203.39@tcp:36:touch.0 00010000:00010000:3.0:1789429499.472696:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429499.472735:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361bf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8d6 expref: 20 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.472775:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff946f08640e00) 00010000:00010000:3.0:1789429499.472795:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429499.472868:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.472890:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.472907:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789429499.473113:0:6704:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e0d0df06 reply state 0000000096467e4a transno 4294977217 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429499.473126:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789429499.473287:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:43736:x1876351635084544:12345-192.168.203.39@tcp:36:touch.0 Request processed in 850us (1319us total) trans 4294977217 rc 0/0 00000100:00100000:3.0:1789429499.473295:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21324 00010000:00010000:3.0:1789429499.475805:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.475829:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c05 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.475839:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.475845:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c1800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429499.475851:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c05 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.475861:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c05 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.475883:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff946f08640200) 00010000:00010000:3.0:1789429499.475886:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429499.475893:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c05 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.475900:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c05 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429499.478491:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429499.478687:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635084672 00000100:00100000:3.0:1789429499.478699:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635084672 00000100:00100000:3.0:1789429499.478772:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21325 00000100:00100000:3.0:1789429499.478784:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:43736:x1876351635084672:12345-192.168.203.39@tcp:101:touch.0 00010000:00010000:3.0:1789429499.478816:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429499.478846:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361c0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8dd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.478926:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361c0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8dd expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.478945:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361c0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8dd expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.478969:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff946f08640100) 00010000:00010000:3.0:1789429499.478972:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789429499.478977:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1000, rc 0) 00000100:00100000:3.0:1789429499.479043:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c349c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:43736:x1876351635084672:12345-192.168.203.39@tcp:101:touch.0 Request processed in 261us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429499.479050:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21325 00000100:00100000:0.0:1789429499.482349:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429499.482562:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635084800 00000100:00100000:3.0:1789429499.482576:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635084800 00000100:00100000:3.0:1789429499.482665:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5820 00000100:00100000:3.0:1789429499.482677:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635084800:12345-192.168.203.39@tcp:2:touch.0 00000100:00100000:3.0:1789429499.483139:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635084800:12345-192.168.203.39@tcp:2:touch.0 Request processed in 462us (802us total) trans 4294969275 rc 0/0 00000100:00100000:3.0:1789429499.483148:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5820 00000100:00080000:1.0:1789429499.483552:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429499.486501:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429499.486743:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635085056 00000100:00100000:3.0:1789429499.486756:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635085056 00000100:00100000:3.0:1789429499.486828:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 281 00000100:00100000:3.0:1789429499.486841:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:43736:x1876351635085056:12345-192.168.203.39@tcp:35:touch.0 00000100:00100000:0.0:1789429499.487810:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:43736:x1876351635085056:12345-192.168.203.39@tcp:35:touch.0 Request processed in 965us (1318us total) trans 4294977218 rc 0/0 00000100:00100000:0.0:1789429499.487822:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 281 00000100:00100000:0.0:1789429499.499303:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429499.499417:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635085184 00000100:00100000:1.0:1789429499.499432:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635085184 00000100:00100000:1.0:1789429499.499647:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21326 00000100:00100000:1.0:1789429499.499660:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:43737:x1876351635085184:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:1.0:1789429499.499694:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429499.499729:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.499818:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.499836:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.499851:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429499.499908:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429499.499912:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429499.499937:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.499965:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8e4 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.499985:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8e4 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429499.499993:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:1.0:1789429499.499996:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429499.500000:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01506000, rc 0) 00000100:00100000:1.0:1789429499.500081:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:43737:x1876351635085184:12345-192.168.203.39@tcp:101:stat.0 Request processed in 424us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429499.500088:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21326 00000100:00100000:3.0:1789429499.503046:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429499.503349:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635085312 00000100:00100000:1.0:1789429499.503361:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635085312 00000100:00100000:0.0:1789429499.503819:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21327 00000100:00100000:0.0:1789429499.503833:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:43737:x1876351635085312:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:0.0:1789429499.503859:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429499.503889:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8eb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.503973:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.503990:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504003:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504020:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504031:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504037:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504158:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361c36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504167:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361c36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504174:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361c36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429499.504259:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 0 00000004:00200000:0.0:1789429499.504265:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429499.504290:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361c36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504303:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361c36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504312:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504319:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c28 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504326:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504338:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01653800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429499.504344:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504352:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504761:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:0.0:1789429499.504768:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429499.504776:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504784:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504804:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504810:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504817:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504823:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429499.504826:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504832:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504845:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ad1bd80 (ffff946f120fdd00) 00010000:00010000:0.0:1789429499.504848:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429499.504851:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504857:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504901:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8eb expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504918:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361c36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8eb expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.504925:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff946f08640100) 00010000:00010000:0.0:1789429499.504927:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429499.504930:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652800, rc 0) 00000100:00100000:0.0:1789429499.505072:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:43737:x1876351635085312:12345-192.168.203.39@tcp:101:stat.0 Request processed in 1241us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429499.505082:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21327 00000100:00100000:1.0:1789429499.510316:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429499.510401:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635085440 00000100:00100000:3.0:1789429499.510415:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635085440 00000100:00100000:3.0:1789429499.510774:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21328 00000100:00100000:3.0:1789429499.510787:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+28:43731:x1876351635085440:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:3.0:1789429499.510819:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429499.510848:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x89:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8f2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.510972:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361c44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x89:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.510989:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.511005:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429499.511038:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x89:0x0]: returning size 0 00000004:00200000:3.0:1789429499.511044:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429499.511069:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.511101:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x89:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8f2 expref: 30 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.511122:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8f2 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.511132:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x89:0x0].0x0 (ffff946f0970c000) 00010000:00010000:3.0:1789429499.511135:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429499.511141:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0000, rc 0) 00000100:00100000:3.0:1789429499.511322:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+29:43731:x1876351635085440:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 537us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429499.511330:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21328 00000100:00100000:2.0:1789429499.515320:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429499.515441:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635085568 00000100:00100000:3.0:1789429499.515470:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635085568 00000100:00100000:3.0:1789429499.515559:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5821 00000100:00100000:3.0:1789429499.515573:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635085568:12345-192.168.203.39@tcp:101:multiop.0 00010000:00010000:3.0:1789429499.515597:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429499.515624:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000282fa1cf/0xb4c3dad726361c4b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c8f9 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429499.515663:0:8085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x6aa886fa, atime: 0x6aa886fa, ctime: 0x6aa886fa, blocks: 0x1 00010000:00010000:3.0:1789429499.515689:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=1197s v=(0 0) 00010000:00010000:3.0:1789429499.515694:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429499.515704:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000282fa1cf/0xb4c3dad726361c4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8f9 expref: 9 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.515724:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000282fa1cf/0xb4c3dad726361c4b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8f9 expref: 9 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.515738:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1e00, rc 0) 00000100:00100000:3.0:1789429499.515802:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+9:2371:x1876351635085568:12345-192.168.203.39@tcp:101:multiop.0 Request processed in 233us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429499.515808:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5821 00000100:00100000:1.0:1789429499.522013:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429499.522113:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635085824 00000100:00100000:2.0:1789429499.522128:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635085824 00000100:00100000:2.0:1789429499.522381:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 282 00000100:00100000:2.0:1789429499.522395:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05acf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+29:43731:x1876351635085824:12345-192.168.203.39@tcp:35:multiop.0 00000100:00100000:2.0:1789429499.523006:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05acf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:43731:x1876351635085824:12345-192.168.203.39@tcp:35:multiop.0 Request processed in 611us (1006us total) trans 4294977219 rc 0/0 00000100:00100000:2.0:1789429499.523016:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 282 00000100:00100000:0.0:1789429499.537517:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429499.537877:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635085952 00000100:00100000:3.0:1789429499.537892:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635085952 00000100:00100000:3.0:1789429499.537979:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21329 00000100:00100000:3.0:1789429499.537991:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+30:43738:x1876351635085952:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:3.0:1789429499.538024:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429499.538055:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361c52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c900 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.538137:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.538154:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.538171:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429499.538269:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429499.538274:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429499.538299:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.538327:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361c52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c900 expref: 32 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.538351:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c900 expref: 31 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429499.538360:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:3.0:1789429499.538364:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429499.538368:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1800, rc 0) 00000100:00100000:3.0:1789429499.538440:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:43738:x1876351635085952:12345-192.168.203.39@tcp:101:stat.0 Request processed in 450us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429499.538448:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21329 00000100:00100000:3.0:1789429499.542032:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429499.542155:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635086080 00000100:00100000:0.0:1789429499.542171:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635086080 00000100:00100000:0.0:1789429499.542296:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21330 00000100:00100000:0.0:1789429499.542310:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:43738:x1876351635086080:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:0.0:1789429499.542337:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429499.542676:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c907 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.542767:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.542787:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.542802:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.542821:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.542829:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.542836:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.542970:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361c75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.542980:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.542988:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429499.543035:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x28:0x0]: returning size 0 00000004:00200000:0.0:1789429499.543041:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429499.543064:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.543083:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361c75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.543093:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.543101:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.543109:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.543117:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01653800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429499.543123:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.543132:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.543148:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:0.0:1789429499.543152:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429499.543158:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.543165:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.543181:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.543187:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.543193:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.547724:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01653a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429499.547734:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.547749:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.547773:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4ad1bd80 (ffff946f120fdd00) 00010000:00010000:0.0:1789429499.547777:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429499.547784:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.547792:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361c6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4ad1bd80 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.547883:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c907 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.547903:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361c75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c907 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429499.547911:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff946f08640100) 00010000:00010000:0.0:1789429499.547913:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429499.547916:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652200, rc 0) 00000100:00100000:0.0:1789429499.548027:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:43738:x1876351635086080:12345-192.168.203.39@tcp:101:stat.0 Request processed in 5719us (6009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429499.548041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21330 00000100:00100000:0.0:1789429499.670790:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429499.670977:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429499.672860:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635086208 00000100:00100000:3.0:1789429499.672879:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635086208 00000100:00100000:3.0:1789429499.672982:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 605 00000100:00100000:3.0:1789429499.672996:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635086208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429499.673114:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635086208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 121us (2339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429499.673126:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 605 00000100:00100000:2.0:1789429499.673856:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429499.673949:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635086464 00000100:00100000:1.0:1789429499.673956:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635086464 00000100:00100000:1.0:1789429499.674025:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635086336 00000100:00100000:1.0:1789429499.674028:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635086336 00000100:00100000:1.0:1789429499.674054:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 936 00000100:00100000:1.0:1789429499.674063:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635086464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429499.674122:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635086464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 59us (3145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429499.674129:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 936 00000100:00100000:1.0:1789429499.674145:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 937 00000100:00100000:1.0:1789429499.674151:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635086336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429499.674176:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635086336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429499.674183:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 937 00000100:00080000:2.0:1789429499.674298:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429499.674303:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429500.068910:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789429500.068917:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648394112:0@lo:400:kworker.0 00000100:00100000:0.0:1789429500.068932:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648393984:0@lo:400:kworker.0 00000100:00100000:1.0:1789429500.069032:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648394240:0@lo:400:kworker.0 00000100:00100000:0.0:1789429500.080790:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429500.080896:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648394368:0@lo:400:kworker.0 00000100:00100000:0.0:1789429500.080950:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429500.080974:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789429500.080982:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648394496:0@lo:400:kworker.0 00000100:00100000:0.0:1789429500.081011:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429500.081070:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648394496 00000100:00100000:0.0:1789429500.081079:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648394496 00000100:00100000:0.0:1789429500.081160:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1789429500.081173:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648394496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429500.081254:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648394496:12345-0@lo:400:kworker.0 Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429500.081262:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1789429500.081314:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648394496:0@lo:400:kworker.0 00000100:00100000:2.0:1789429500.081466:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648393984 00000100:00100000:2.0:1789429500.081472:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648393984 00000100:00100000:2.0:1789429500.081518:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1789429500.081546:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648393984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429500.081606:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648393984:12345-0@lo:400:kworker.0 Request processed in 70us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429500.081613:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1789429500.081647:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648394368 00000100:00100000:2.0:1789429500.081651:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648394368 00000100:00100000:2.0:1789429500.081686:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:2.0:1789429500.081693:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648394368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429500.081727:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648394368:12345-0@lo:400:kworker.0 Request processed in 36us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429500.081734:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00080000:2.0:1789429500.081757:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429500.081764:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429500.081784:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648394368:0@lo:400:kworker.0 00000100:00100000:2.0:1789429500.081795:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648393984:0@lo:400:kworker.0 00000100:00100000:3.0:1789429500.082334:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429500.082377:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648394624:0@lo:400:kworker.0 00000100:00100000:3.0:1789429500.082411:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429500.082732:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648394624 00000100:00100000:0.0:1789429500.082738:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648394624 00000100:00100000:0.0:1789429500.082793:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:0.0:1789429500.082812:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648394624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429500.082862:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648394624:12345-0@lo:400:kworker.0 Request processed in 62us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429500.082873:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1789429500.082957:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648394112 00000100:00100000:2.0:1789429500.082962:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648394112 00000100:00100000:2.0:1789429500.083004:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1789429500.083012:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648394112:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789429500.083014:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429500.083050:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648394112:12345-0@lo:400:kworker.0 Request processed in 39us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429500.083056:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:3.0:1789429500.083256:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648394624:0@lo:400:kworker.0 00000100:00100000:3.0:1789429500.083269:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648394112:0@lo:400:kworker.0 00000100:00100000:1.0:1789429500.085814:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429500.086007:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648394240 00000100:00100000:2.0:1789429500.086020:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648394240 00000100:00100000:2.0:1789429500.086124:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1789429500.086136:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648394240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429500.086241:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648394240:12345-0@lo:400:kworker.0 Request processed in 108us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429500.086249:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1789429500.086452:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648394240:0@lo:400:kworker.0 00000100:00080000:3.0:1789429500.086684:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789429500.132126:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429500.579475:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429500.579503:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648394752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429500.581084:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429500.581186:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648394752 00000100:00100000:2.0:1789429500.581197:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648394752 00000100:00100000:2.0:1789429500.581284:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1789429500.581294:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648394752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429500.581343:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47775744 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429500.581401:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648394752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429500.581415:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1789429500.581447:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648394880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429500.581479:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429500.581530:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648394880 00000100:00100000:1.0:1789429500.581549:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648394880 00000100:00100000:1.0:1789429500.581653:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1789429500.581664:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648394880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429500.581690:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429500.581734:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648394880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429500.581742:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1789429500.582121:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648394880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429500.582171:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648394752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789429501.156555:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429502.185502:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429502.703744:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969275 is committed 00000001:00080000:2.0:1789429502.708618:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969606 is committed 00010000:00010000:1.0:1789429503.204910:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429504.222094:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977215 is committed 00000001:00080000:2.0:1789429504.222192:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977219 is committed 00000001:00080000:2.0:1789429504.222431:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977218 is committed 00010000:00010000:1.0:1789429504.228922:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429504.803674:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429504.803725:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429504.803759:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429504.803834:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429504.803857:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429504.803911:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635086848 00000100:00100000:1.0:1789429504.803922:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635086848 00000100:00100000:1.0:1789429504.803979:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635087360 00000100:00100000:1.0:1789429504.803982:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635087360 00000100:00100000:1.0:1789429504.804008:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 940 00000100:00100000:1.0:1789429504.804018:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635086848:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429504.804089:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635086848:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 72us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429504.804097:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 940 00000100:00100000:1.0:1789429504.804113:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 941 00000100:00100000:1.0:1789429504.804119:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635087360:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429504.804143:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635087360:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429504.804149:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 941 00000100:00080000:1.0:1789429504.804165:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429504.804169:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429504.804699:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635086592 00000100:00100000:2.0:1789429504.804705:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635086592 00000100:00100000:2.0:1789429504.804744:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 607 00000100:00100000:2.0:1789429504.804751:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635086592:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429504.804789:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635086592:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 37us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429504.804796:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 607 00000100:00100000:0.0:1789429504.814908:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429504.814941:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429504.814970:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635086976 00000100:00100000:0.0:1789429504.814979:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635086976 00000100:00100000:0.0:1789429504.815033:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635087232 00000100:00100000:0.0:1789429504.815036:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635087232 00000100:00100000:0.0:1789429504.815059:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 942 00000100:00100000:0.0:1789429504.815069:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635086976:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429504.815139:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635086976:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429504.815146:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 942 00000100:00100000:0.0:1789429504.815177:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 943 00000100:00100000:0.0:1789429504.815185:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635087232:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429504.815239:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635087232:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 55us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429504.815245:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 943 00000100:00080000:2.0:1789429504.815394:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429504.815398:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429504.821031:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635087104 00000100:00100000:3.0:1789429504.821046:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635087104 00000100:00100000:3.0:1789429504.821137:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635086720 00000100:00100000:3.0:1789429504.821141:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635086720 00000100:00100000:3.0:1789429504.821186:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 895 00000100:00100000:3.0:1789429504.821196:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351635087104:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:2.0:1789429504.821344:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429504.821373:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 896 00000100:00100000:2.0:1789429504.821382:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351635086720:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429504.821480:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351635086720:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 100us (17620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429504.821488:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 896 00000100:00100000:3.0:1789429504.821802:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351635087104:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 606us (18040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429504.821813:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 895 00000100:00100000:3.0:1789429505.189839:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648395136:0@lo:400:kworker.0 00000100:00100000:0.0:1789429505.189844:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648395264:0@lo:400:kworker.0 00000100:00100000:2.0:1789429505.189899:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648395008:0@lo:400:kworker.0 00000100:00100000:1.0:1789429505.191658:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648395392:0@lo:400:kworker.0 00000100:00100000:3.0:1789429505.195101:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429505.196259:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648395648:0@lo:400:kworker.0 00000100:00100000:3.0:1789429505.196314:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429505.196704:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648395136 00000100:00100000:3.0:1789429505.196713:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648395136 00000100:00100000:3.0:1789429505.196862:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1789429505.196873:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648395136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429505.196933:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648395136:12345-0@lo:400:kworker.0 Request processed in 63us (1839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429505.196941:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1789429505.196982:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f50b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648395136:0@lo:400:kworker.0 00000100:00100000:2.0:1789429505.199585:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429505.199634:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648395008 00000100:00100000:2.0:1789429505.199644:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648395008 00000100:00100000:2.0:1789429505.199693:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1789429505.199702:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648395008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429505.199751:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648395008:12345-0@lo:400:kworker.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429505.199759:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1789429505.199814:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648395008:0@lo:400:kworker.0 00000100:00100000:2.0:1789429505.199825:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648395520:0@lo:400:kworker.0 00000100:00100000:2.0:1789429505.199854:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429505.199877:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648395520 00000100:00100000:2.0:1789429505.199880:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648395520 00000100:00100000:2.0:1789429505.199917:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1789429505.199925:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648395520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429505.199962:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648395520:12345-0@lo:400:kworker.0 Request processed in 38us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429505.199967:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00080000:2.0:1789429505.199984:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429505.200006:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648395520:0@lo:400:kworker.0 00000100:00100000:0.0:1789429505.201442:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429505.201488:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648395264 00000100:00100000:0.0:1789429505.201494:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648395264 00000100:00100000:0.0:1789429505.201557:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:0.0:1789429505.201567:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648395264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429505.201616:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648395264:12345-0@lo:400:kworker.0 Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429505.201622:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:0.0:1789429505.201658:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f509880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648395264:0@lo:400:kworker.0 00000100:00100000:0.0:1789429505.201699:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648395648 00000100:00100000:0.0:1789429505.201703:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648395648 00000100:00100000:0.0:1789429505.201733:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1789429505.201740:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648395648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429505.201778:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648395648:12345-0@lo:400:kworker.0 Request processed in 39us (5464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429505.201783:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1789429505.201811:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f50a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648395648:0@lo:400:kworker.0 00000100:00080000:2.0:1789429505.203303:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429505.203311:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429505.204179:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429505.207603:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648395392 00000100:00100000:0.0:1789429505.207617:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648395392 00000100:00100000:0.0:1789429505.207689:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:0.0:1789429505.207700:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648395392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429505.207788:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648395392:12345-0@lo:400:kworker.0 Request processed in 90us (3611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429505.207795:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00080000:3.0:1789429505.207863:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429505.208063:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648395392:0@lo:400:kworker.0 00010000:00010000:1.0:1789429505.252478:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429505.699344:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429505.699363:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f119d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648395776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429505.699435:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429505.699692:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648395904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429505.699718:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429505.699753:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648395776 00000100:00100000:1.0:1789429505.699759:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648395776 00000100:00100000:1.0:1789429505.699799:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648395904 00000100:00100000:1.0:1789429505.699802:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648395904 00000100:00100000:0.0:1789429505.699807:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1789429505.699820:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1789429505.699823:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648395776:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429505.699831:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648395904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429505.699861:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47775744 pending 0 free 3855613952 avail 3853516800 00002000:00000024:1.0:1789429505.699861:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429505.699913:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648395904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429505.699923:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648395776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429505.699937:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1789429505.700334:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f119d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648395776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429505.702099:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648395904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429505.707981:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000001:02000400:0.0:1789429505.775898:0:25448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 32b: lockless i/o ======================== 19:45:04 (1789429504) 00010000:00010000:1.0:1789429506.279345:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429507.312662:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789429507.704725:0:25496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_32b max_nolock_bytes is removed >= 2.17.53 00010000:00010000:1.0:1789429508.325253:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429509.348548:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789429509.388643:0:25548:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 32c: contention detection ================ 19:45:08 (1789429508) 00000100:00100000:2.0:1789429509.909900:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429509.909949:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429509.909982:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429509.910005:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429509.910030:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635087744 00000100:00100000:2.0:1789429509.910040:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635087744 00000100:00100000:2.0:1789429509.910094:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635088256 00000100:00100000:2.0:1789429509.910098:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635088256 00000100:00100000:2.0:1789429509.910121:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 946 00000100:00100000:2.0:1789429509.910132:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635087744:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429509.910624:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635087488 00000100:00100000:3.0:1789429509.910630:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635087488 00000100:00100000:3.0:1789429509.910664:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 609 00000100:00100000:3.0:1789429509.910672:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635087488:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429509.910703:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635087488:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429509.910710:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 609 00000100:00100000:3.0:1789429509.910880:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635088000 00000100:00100000:3.0:1789429509.910885:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635088000 00000100:00100000:3.0:1789429509.910916:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 900 00000100:00100000:3.0:1789429509.910923:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351635088000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429509.910952:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351635088000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429509.910958:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 900 00000100:00100000:3.0:1789429509.910996:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429509.911062:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429509.911135:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429509.911182:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635087616 00000100:00100000:3.0:1789429509.911186:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635087616 00000100:00100000:3.0:1789429509.911239:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 901 00000100:00100000:3.0:1789429509.911247:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635087616:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429509.911281:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635087616:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 35us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429509.911287:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 901 00000100:00100000:3.0:1789429509.911304:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635087872 00000100:00100000:3.0:1789429509.911307:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635087872 00000100:00100000:3.0:1789429509.911328:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635088128 00000100:00100000:3.0:1789429509.911331:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635088128 00000100:00100000:3.0:1789429509.911347:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 947 00000100:00100000:3.0:1789429509.911353:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635088256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429509.911638:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 948 00000100:00100000:0.0:1789429509.911649:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+8:2368:x1876351635087872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429509.911677:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+8:2368:x1876351635087872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429509.911683:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 948 00000100:00100000:0.0:1789429509.911698:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 949 00000100:00100000:0.0:1789429509.911704:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635088128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429509.911741:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635088128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 38us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429509.911746:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 949 00000100:00100000:2.0:1789429509.912337:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635087744:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 2206us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429509.912349:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 946 00000100:00080000:2.0:1789429509.912372:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429509.912377:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429509.912379:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429509.913185:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635088256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429509.913222:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 947 00000100:00100000:1.0:1789429510.310488:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648396160:0@lo:400:kworker.0 00000100:00100000:3.0:1789429510.310508:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648396032:0@lo:400:kworker.0 00000100:00100000:1.0:1789429510.310961:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429510.311015:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648396672:0@lo:400:kworker.0 00000100:00100000:1.0:1789429510.311043:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429510.311073:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429510.311080:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648396288:0@lo:400:kworker.0 00000100:00100000:1.0:1789429510.311101:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429510.311133:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648396160 00000100:00100000:1.0:1789429510.311140:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648396160 00000100:00100000:1.0:1789429510.311181:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648396288 00000100:00100000:1.0:1789429510.311184:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648396288 00000100:00100000:1.0:1789429510.311240:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1789429510.311248:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648396160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429510.311397:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648396160:12345-0@lo:400:kworker.0 Request processed in 147us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429510.311405:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1789429510.311425:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:1.0:1789429510.311432:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648396288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429510.311472:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648396288:12345-0@lo:400:kworker.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429510.311478:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:1.0:1789429510.311497:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648396672 00000100:00100000:1.0:1789429510.311501:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648396672 00000100:00100000:1.0:1789429510.311530:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:1.0:1789429510.311537:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648396672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429510.311569:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648396672:12345-0@lo:400:kworker.0 Request processed in 32us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429510.311575:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00080000:1.0:1789429510.311599:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429510.311604:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429510.311637:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648396288:0@lo:400:kworker.0 00000100:00100000:1.0:1789429510.311649:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648396160:0@lo:400:kworker.0 00000100:00100000:1.0:1789429510.311659:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34021180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648396672:0@lo:400:kworker.0 00000100:00100000:2.0:1789429510.311940:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648396416:0@lo:400:kworker.0 00000100:00100000:2.0:1789429510.311980:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429510.315554:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648396416 00000100:00100000:0.0:1789429510.315569:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648396416 00000100:00100000:0.0:1789429510.315633:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1789429510.315643:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648396416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429510.315725:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648396416:12345-0@lo:400:kworker.0 Request processed in 84us (3744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429510.315733:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00080000:2.0:1789429510.315897:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429510.315940:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648396416:0@lo:400:kworker.0 00000100:00100000:3.0:1789429510.319906:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429510.320086:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648396032 00000100:00100000:0.0:1789429510.320097:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648396032 00000100:00100000:0.0:1789429510.320161:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1789429510.320171:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648396032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429510.320271:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648396032:12345-0@lo:400:kworker.0 Request processed in 102us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429510.320278:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1789429510.320344:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648396032:0@lo:400:kworker.0 00000100:00100000:0.0:1789429510.320356:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648396544:0@lo:400:kworker.0 00000100:00100000:0.0:1789429510.320386:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429510.320579:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648396544 00000100:00100000:2.0:1789429510.320583:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648396544 00000100:00100000:2.0:1789429510.320624:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:2.0:1789429510.320630:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648396544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429510.320671:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648396544:12345-0@lo:400:kworker.0 Request processed in 41us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429510.320677:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00080000:2.0:1789429510.320697:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429510.320718:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648396544:0@lo:400:kworker.0 00010000:00010000:1.0:1789429510.374057:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429510.584715:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429510.584796:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635088512 00000100:00100000:1.0:1789429510.584806:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635088512 00000100:00100000:1.0:1789429510.584859:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21331 00000100:00100000:1.0:1789429510.584870:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:44645:x1876351635088512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429510.584892:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429510.584896:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789429510.584923:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1800/0xb4c3dad726361c59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c900 expref: 31 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.584941:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:1.0:1789429510.584947:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429510.584961:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361c7c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c90e expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.585263:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.585277:0:15700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8e4 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.585286:0:15700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.585430:0:15700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8e4 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.585444:0:15700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8e4 expref: 19 pid: 5839 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429510.585458:0:15700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34020a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648396800:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429510.585601:0:15700:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c37ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789429510.589513:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429510.589581:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635088640 00000100:00100000:3.0:1789429510.589591:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635088640 00010000:00010000:3.0:1789429510.589629:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8e4 expref: 20 pid: 5839 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429510.589668:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6226 00000100:00100000:3.0:1789429510.589678:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351635088640:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429510.589692:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429510.589699:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8e4 expref: 20 pid: 5839 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.589712:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8e4 expref: 20 pid: 5839 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.589731:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:3.0:1789429510.589736:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.589745:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.589753:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.589772:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429510.589823:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351635088640:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 145us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429510.589830:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6226 00010000:00010000:1.0:1789429510.590083:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361c1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8e4 expref: 19 pid: 5839 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429510.590098:0:15700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34020a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648396800:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429510.590118:0:15700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.590128:0:15700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.590138:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.590189:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361c8a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.590215:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361c8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.590224:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361c8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.591124:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361c91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.591136:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361c91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.591144:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361c91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429510.591154:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8a:0x0]: returning size 0 00010000:00010000:1.0:1789429510.591178:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.591186:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.591192:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.591233:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01507e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429510.591238:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.591247:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.591258:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cb00) 00010000:00010000:1.0:1789429510.591261:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429510.591265:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.591270:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361c83 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429510.591280:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cd16b331 reply state 000000005980c33d transno 4294977220 ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361c8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429510.591288:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429510.591321:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507200/0xb4c3dad726361c7c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c90e expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.591341:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361c91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c90e expref: 32 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429510.591348:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f0970cf00) 00010000:00010000:1.0:1789429510.591351:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429510.591353:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01507400, rc 0) 00000100:00100000:1.0:1789429510.591423:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+33:44645:x1876351635088512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 6554us (6717us total) trans 4294977220 rc 0/0 00000100:00100000:1.0:1789429510.591431:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21331 00010000:00010000:2.0:1789429510.596974:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361c8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.596991:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361c8a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.597000:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361c8a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.597006:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01506200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429510.597012:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361c8a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.597020:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361c8a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.597037:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b086329 (ffff946f0970c900) 00010000:00010000:2.0:1789429510.597040:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429510.597045:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361c8a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.597053:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506200/0xb4c3dad726361c8a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429510.597110:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429510.597243:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635088896 00000100:00100000:3.0:1789429510.597254:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635088896 00000100:00100000:3.0:1789429510.597314:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21332 00000100:00100000:3.0:1789429510.597323:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+32:44645:x1876351635088896:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429510.597346:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429510.597364:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361c9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c915 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.597475:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.597488:0:15669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361c91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c90e expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.597505:0:15669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.597536:0:15669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361c91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c90e expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.597549:0:15669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361c91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c90e expref: 33 pid: 15700 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429510.597563:0:15669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648396928:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429510.597649:0:15669:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f08635840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429510.599679:0:15669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648396928:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429510.599708:0:15669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429510.600051:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429510.600111:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635089024 00000100:00100000:2.0:1789429510.600118:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635089024 00010000:00010000:2.0:1789429510.600152:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361c91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c90e expref: 34 pid: 15700 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429510.600190:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6227 00000100:00100000:2.0:1789429510.600224:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+34:2371:x1876351635089024:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429510.600238:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429510.600245:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361c91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c90e expref: 34 pid: 15700 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.600256:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361c91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c90e expref: 34 pid: 15700 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.600276:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507400/0xb4c3dad726361c91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c90e expref: 34 pid: 15700 timeout: 1308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.600301:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f0970cf00) 00010000:00010000:2.0:1789429510.600306:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.600314:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.600321:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429510.600341:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429510.600392:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+33:2371:x1876351635089024:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 194us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429510.600399:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6227 00010000:00010000:3.0:1789429510.600530:0:15669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.600537:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429510.600555:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8a:0x0]: returning size 0 00000004:00080000:3.0:1789429510.600844:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x39:0x0], index 0: 0 00010000:00010000:3.0:1789429510.601001:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.601010:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.601017:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.601023:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429510.601028:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.601035:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.601045:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f0970cf00) 00010000:00010000:3.0:1789429510.601048:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789429510.601052:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.601058:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361ca6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.601108:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361c9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c915 expref: 33 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.601117:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f08640f00) 00010000:00010000:3.0:1789429510.601119:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789429510.601122:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361c9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c915 expref: 33 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429510.601136:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0a00, rc 0) 00000100:00100000:3.0:1789429510.601183:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+32:44645:x1876351635088896:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3861us (4670us total) trans 4294977221 rc 301/301 00000100:00100000:3.0:1789429510.601189:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21332 00000100:00100000:0.0:1789429510.607542:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429510.607974:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635089280 00000100:00100000:1.0:1789429510.607985:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635089280 00000100:00100000:1.0:1789429510.608038:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 283 00000100:00100000:1.0:1789429510.608048:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:44645:x1876351635089280:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1789429510.608864:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+33:44645:x1876351635089280:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 814us (1327us total) trans 4294977222 rc 0/0 00000100:00100000:1.0:1789429510.608872:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 283 00000100:00100000:2.0:1789429510.617142:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429510.617237:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635089408 00000100:00100000:0.0:1789429510.617248:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635089408 00000100:00100000:0.0:1789429510.617300:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21333 00000100:00100000:0.0:1789429510.617310:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+33:44645:x1876351635089408:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429510.617332:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429510.617352:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361cb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c91c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429510.617409:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c91c expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429510.617424:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c91c expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429510.617448:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429510.617451:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789429510.617455:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652600, rc 0) 00000100:00100000:0.0:1789429510.617681:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+34:44645:x1876351635089408:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 371us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429510.617688:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21333 00000100:00100000:2.0:1789429510.622261:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429510.622309:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635089664 00000100:00100000:2.0:1789429510.622319:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635089664 00000100:00100000:2.0:1789429510.622366:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 284 00000100:00100000:2.0:1789429510.622376:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+34:44645:x1876351635089664:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1789429510.623512:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+35:44645:x1876351635089664:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 1133us (1256us total) trans 4294977223 rc 0/0 00000100:00100000:2.0:1789429510.623523:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 284 00000100:00100000:3.0:1789429510.819466:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648397056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429510.819536:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429510.819808:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f34020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648397184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429510.819838:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429510.819908:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648397056 00000100:00100000:0.0:1789429510.819915:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648397056 00000100:00100000:0.0:1789429510.819965:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648397184 00000100:00100000:0.0:1789429510.819968:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648397184 00000100:00100000:0.0:1789429510.819985:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1789429510.819993:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648397056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429510.820028:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47775744 pending 0 free 3855613952 avail 3853516800 00000100:00100000:0.0:1789429510.820069:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648397056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429510.820076:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1789429510.820093:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1789429510.820099:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648397184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429510.820117:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429510.820147:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648397184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429510.820154:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:1.0:1789429510.820578:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f34020a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648397184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429510.820712:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648397056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789429511.401638:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429512.424770:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429512.433088:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429512.433152:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635089792 00000100:00100000:1.0:1789429512.433162:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635089792 00000100:00100000:1.0:1789429512.433243:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21334 00000100:00100000:1.0:1789429512.433254:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+35:44663:x1876351635089792:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429512.433285:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429512.433306:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361cbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c923 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429512.433362:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361cc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429512.433375:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429512.433385:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429512.433791:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429512.433796:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429512.433819:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429512.433843:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01506000/0xb4c3dad726361cbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c923 expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429512.433861:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c923 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429512.433870:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c700) 00010000:00010000:1.0:1789429512.433873:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429512.433877:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01507e00, rc 0) 00000100:00100000:1.0:1789429512.433945:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+36:44663:x1876351635089792:12345-192.168.203.39@tcp:101:dd.0 Request processed in 693us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429512.433952:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21334 00000100:00080000:3.0:1789429512.434394:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429512.445425:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429512.445527:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635090048 00000100:00100000:0.0:1789429512.445536:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635090048 00000100:00100000:0.0:1789429512.445595:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21335 00000100:00100000:0.0:1789429512.445604:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+36:44663:x1876351635090048:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429512.445624:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429512.445627:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789429512.445652:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01507e00/0xb4c3dad726361cc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c923 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.445668:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c700) 00010000:00010000:0.0:1789429512.445677:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429512.445692:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361cc9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c92a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.445821:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361cd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.445833:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.445842:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.445855:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361cd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.445862:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.445868:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.445939:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726361cde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.445949:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726361cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.445956:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726361cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429512.445964:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8a:0x0]: returning size 0 00010000:00010000:0.0:1789429512.446051:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446058:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361cd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446065:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446070:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429512.446074:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446081:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361cd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446090:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd900) 00010000:00010000:0.0:1789429512.446093:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429512.446096:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446101:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446111:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446118:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446122:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446128:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01653800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429512.446131:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446136:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446143:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b086329 (ffff946f120fd100) 00010000:00010000:0.0:1789429512.446145:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429512.446147:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361cd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446152:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361cd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446190:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361cc9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c92a expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446238:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726361cde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c92a expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429512.446246:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429512.446249:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429512.446252:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429512.446320:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+37:44663:x1876351635090048:12345-192.168.203.39@tcp:101:dd.0 Request processed in 716us (904us total) trans 4294977224 rc 0/0 00000100:00100000:0.0:1789429512.446327:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21335 00000100:00100000:1.0:1789429512.455530:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429512.455595:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635090304 00000100:00100000:2.0:1789429512.455604:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635090304 00000100:00100000:2.0:1789429512.455662:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21336 00000100:00100000:2.0:1789429512.455672:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+37:44663:x1876351635090304:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:2.0:1789429512.455725:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429512.455751:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726361cde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c92a expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429512.455767:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:2.0:1789429512.455772:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429512.456008:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361cec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429512.456021:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429512.456031:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789429512.456082:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977225 00000004:00010000:2.0:1789429512.456115:0:6704:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000967d84c4 reply state 0000000037304500 transno 4294977226 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429512.456123:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789429512.456237:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+39:44663:x1876351635090304:12345-192.168.203.39@tcp:36:dd.0 Request processed in 566us (720us total) trans 4294977226 rc 0/0 00000100:00100000:2.0:1789429512.456244:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21336 00000020:00080000:2.0:1789429512.456249:0:6704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789429512.463036:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429512.463054:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361cec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429512.463062:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361cec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429512.463067:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429512.463072:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361cec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429512.463080:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361cec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429512.463094:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:3.0:1789429512.463098:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429512.463102:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361cec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429512.463107:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546c00/0xb4c3dad726361cec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429512.464144:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429512.464286:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635090432 00000100:00100000:3.0:1789429512.464297:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635090432 00000100:00100000:3.0:1789429512.464361:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5822 00000100:00100000:3.0:1789429512.464370:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+7:44663:x1876351635090432:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429512.464387:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429512.464421:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361cf3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c931 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429512.464490:0:20745:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789429512.464511:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=1210s v=(0 0) 00010000:00010000:3.0:1789429512.464517:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429512.464525:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361cf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c931 expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429512.464540:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361cf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c931 expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429512.464552:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0a00, rc 0) 00000100:00100000:3.0:1789429512.464608:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+8:44663:x1876351635090432:12345-192.168.203.39@tcp:101:dd.0 Request processed in 239us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429512.464615:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5822 00000100:00080000:2.0:1789429512.464908:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429512.480747:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429512.480957:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635090560 00000100:00100000:0.0:1789429512.480968:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635090560 00002000:00010000:0.0:1789429512.481006:0:20672:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:0.0:1789429512.481012:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073b80 with x1876351635090560 ext(0->18446744073709551615) 00002000:00010000:0.0:1789429512.481023:0:20672:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34073b80. 00000100:00100000:0.0:1789429512.481054:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11519 00000100:00100000:0.0:1789429512.481063:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635090560:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:0.0:1789429512.481401:0:20672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789429512.481406:0:20672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 0 -> 1789429512 00002000:00010000:0.0:1789429512.481409:0:20672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789429512.481411:0:20672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 0 -> 1789429512 00002000:00010000:0.0:1789429512.481414:0:20672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789429512.481490:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351635090560:12345-192.168.203.39@tcp:10:dd.0 Request processed in 427us (750us total) trans 4294969276 rc 0/0 00000100:00100000:0.0:1789429512.481498:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11519 00002000:00010000:0.0:1789429512.481503:0:20672:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:0.0:1789429512.481506:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073b80 with x1876351635090560 ext(0->18446744073709551615) 00002000:00010000:0.0:1789429512.481511:0:20672:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34073b80. 00000100:00100000:2.0:1789429512.534643:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429512.534722:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635090688 00000100:00100000:1.0:1789429512.534732:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635090688 00002000:00100000:1.0:1789429512.534786:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946f05473b80 x1876351635090688/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429512.534797:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05473b80 with x1876351635090688 ext(0->1048575) 00002000:00010000:1.0:1789429512.534803:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f05473b80 00000100:00100000:1.0:1789429512.534834:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11520 00000100:00100000:1.0:1789429512.534844:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351635090688:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429512.568956:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:2368:x1876351635090688:12345-192.168.203.39@tcp:4:dd.0 Request processed in 34103us (34312us total) trans 4294969277 rc 0/0 00000100:00100000:1.0:1789429512.568974:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11520 00002000:00100000:1.0:1789429512.568987:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946f05473b80 x1876351635090688/t4294969277(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429512.568997:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05473b80 with x1876351635090688 ext(0->1048575) 00002000:00010000:1.0:1789429512.569004:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f05473b80 00000100:00100000:2.0:1789429512.577460:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429512.579116:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635090816 00000100:00100000:1.0:1789429512.579129:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635090816 00002000:00100000:1.0:1789429512.579396:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946f05470380 x1876351635090816/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429512.579411:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05470380 with x1876351635090816 ext(1048576->2097151) 00002000:00010000:1.0:1789429512.579417:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f05470380 00000100:00100000:1.0:1789429512.579489:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11521 00000100:00100000:1.0:1789429512.579500:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351635090816:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429512.601997:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351635090816:12345-192.168.203.39@tcp:4:dd.0 Request processed in 22490us (24547us total) trans 4294969278 rc 0/0 00000100:00100000:1.0:1789429512.602011:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11521 00002000:00100000:1.0:1789429512.602024:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946f05470380 x1876351635090816/t4294969278(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429512.602034:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05470380 with x1876351635090816 ext(1048576->2097151) 00002000:00010000:1.0:1789429512.602054:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f05470380 00000100:00100000:3.0:1789429512.612015:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429512.612105:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635090944 00000100:00100000:0.0:1789429512.612116:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635090944 00002000:00100000:0.0:1789429512.612164:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946f34072300 x1876351635090944/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.612185:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072300 with x1876351635090944 ext(2097152->3145727) 00002000:00010000:0.0:1789429512.612190:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34072300 00000100:00100000:0.0:1789429512.612242:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11522 00000100:00100000:0.0:1789429512.612253:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+13:2369:x1876351635090944:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429512.623232:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+15:2369:x1876351635090944:12345-192.168.203.39@tcp:4:dd.0 Request processed in 10972us (11217us total) trans 4294969279 rc 0/0 00000100:00100000:0.0:1789429512.623247:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11522 00002000:00100000:0.0:1789429512.623260:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946f34072300 x1876351635090944/t4294969279(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.623271:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072300 with x1876351635090944 ext(2097152->3145727) 00002000:00010000:0.0:1789429512.623278:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34072300 00000100:00100000:3.0:1789429512.638684:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429512.640686:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635091072 00000100:00100000:0.0:1789429512.640702:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635091072 00002000:00100000:2.0:1789429512.640840:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f34070380 x1876351635091072/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429512.640862:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070380 with x1876351635091072 ext(3145728->4194303) 00002000:00010000:2.0:1789429512.640870:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34070380 00000100:00100000:2.0:1789429512.640951:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11523 00000100:00100000:2.0:1789429512.640961:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+15:2368:x1876351635091072:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429512.661806:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+17:2368:x1876351635091072:12345-192.168.203.39@tcp:4:dd.0 Request processed in 20836us (23120us total) trans 4294969280 rc 0/0 00000100:00100000:1.0:1789429512.661819:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11523 00002000:00100000:1.0:1789429512.661832:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f34070380 x1876351635091072/t4294969280(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429512.661844:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070380 with x1876351635091072 ext(3145728->4194303) 00002000:00010000:1.0:1789429512.661850:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34070380 00000100:00100000:1.0:1789429512.676438:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429512.676515:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635091200 00000100:00100000:0.0:1789429512.676526:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635091200 00002000:00100000:0.0:1789429512.676581:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946f415c6a00 x1876351635091200/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.676592:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6a00 with x1876351635091200 ext(4194304->5242879) 00002000:00010000:0.0:1789429512.676598:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f415c6a00 00000100:00100000:0.0:1789429512.676633:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11524 00000100:00100000:0.0:1789429512.676642:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351635091200:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429512.687302:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351635091200:12345-192.168.203.39@tcp:4:dd.0 Request processed in 10651us (10864us total) trans 4294969281 rc 0/0 00000100:00100000:0.0:1789429512.687320:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11524 00002000:00100000:0.0:1789429512.687332:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946f415c6a00 x1876351635091200/t4294969281(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.687342:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6a00 with x1876351635091200 ext(4194304->5242879) 00002000:00010000:0.0:1789429512.687347:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f415c6a00 00000100:00100000:3.0:1789429512.705555:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429512.705937:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635091328 00000100:00100000:2.0:1789429512.705948:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635091328 00002000:00100000:2.0:1789429512.705998:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946f34070000 x1876351635091328/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429512.706010:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070000 with x1876351635091328 ext(5242880->6291455) 00002000:00010000:2.0:1789429512.706016:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34070000 00000100:00100000:2.0:1789429512.706048:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11525 00000100:00100000:2.0:1789429512.706057:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351635091328:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429512.726354:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429512.726678:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635091456 00000100:00100000:2.0:1789429512.726690:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635091456 00002000:00100000:2.0:1789429512.726739:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946f34071c00 x1876351635091456/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429512.726750:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071c00 with x1876351635091456 ext(6291456->7340031) 00002000:00010000:2.0:1789429512.726756:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34071c00 00000100:00100000:2.0:1789429512.726797:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11526 00000100:00100000:2.0:1789429512.726807:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+21:2369:x1876351635091456:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429512.755978:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+23:2371:x1876351635091328:12345-192.168.203.39@tcp:4:dd.0 Request processed in 49912us (50421us total) trans 4294969282 rc 0/0 00000100:00100000:0.0:1789429512.755993:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11525 00002000:00100000:0.0:1789429512.756005:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946f34070000 x1876351635091328/t4294969282(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.756016:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070000 with x1876351635091328 ext(5242880->6291455) 00002000:00010000:0.0:1789429512.756022:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34070000 00000100:00100000:2.0:1789429512.757971:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429512.759512:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+23:2369:x1876351635091456:12345-192.168.203.39@tcp:4:dd.0 Request processed in 32701us (33161us total) trans 4294969283 rc 0/0 00000100:00100000:3.0:1789429512.759524:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11526 00002000:00100000:3.0:1789429512.759536:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946f34071c00 x1876351635091456/t4294969283(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429512.759548:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071c00 with x1876351635091456 ext(6291456->7340031) 00002000:00010000:3.0:1789429512.759554:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34071c00 00000100:00100000:3.0:1789429512.759846:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635091584 00000100:00100000:3.0:1789429512.759854:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635091584 00002000:00100000:3.0:1789429512.759930:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f05470700 x1876351635091584/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429512.759940:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05470700 with x1876351635091584 ext(7340032->8388607) 00002000:00010000:3.0:1789429512.759944:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f05470700 00000100:00100000:0.0:1789429512.760424:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11527 00000100:00100000:0.0:1789429512.760456:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+23:2370:x1876351635091584:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429512.772152:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429512.772500:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635091712 00000100:00100000:3.0:1789429512.772513:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635091712 00002000:00100000:3.0:1789429512.772633:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946f2f095180 x1876351635091712/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429512.772645:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095180 with x1876351635091712 ext(8388608->9437183) 00002000:00010000:3.0:1789429512.772651:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f095180 00000100:00100000:3.0:1789429512.772735:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11528 00000100:00100000:3.0:1789429512.772747:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+25:2370:x1876351635091712:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429512.779674:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05470700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351635091584:12345-192.168.203.39@tcp:4:dd.0 Request processed in 19229us (21698us total) trans 4294969284 rc 0/0 00000100:00100000:1.0:1789429512.779689:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11527 00002000:00100000:1.0:1789429512.779704:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f05470700 x1876351635091584/t4294969284(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429512.779716:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05470700 with x1876351635091584 ext(7340032->8388607) 00002000:00010000:1.0:1789429512.779723:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f05470700 00000100:00100000:2.0:1789429512.792552:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351635091712:12345-192.168.203.39@tcp:4:dd.0 Request processed in 19797us (20398us total) trans 4294969285 rc 0/0 00000100:00100000:2.0:1789429512.792633:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11528 00002000:00100000:2.0:1789429512.792646:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946f2f095180 x1876351635091712/t4294969285(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429512.792656:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095180 with x1876351635091712 ext(8388608->9437183) 00002000:00010000:2.0:1789429512.792663:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f095180 00000100:00100000:2.0:1789429512.799896:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429512.800031:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635091840 00000100:00100000:3.0:1789429512.800041:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635091840 00002000:00100000:3.0:1789429512.800089:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f2f095880 x1876351635091840/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429512.800100:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095880 with x1876351635091840 ext(9437184->10485759) 00002000:00010000:3.0:1789429512.800106:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f095880 00000100:00100000:3.0:1789429512.800131:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11529 00000100:00100000:3.0:1789429512.800140:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+27:2370:x1876351635091840:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429512.810096:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351635091840:12345-192.168.203.39@tcp:4:dd.0 Request processed in 9947us (10198us total) trans 4294969286 rc 0/0 00000100:00100000:3.0:1789429512.810112:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11529 00002000:00100000:3.0:1789429512.810124:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f2f095880 x1876351635091840/t4294969286(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429512.810135:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f095880 with x1876351635091840 ext(9437184->10485759) 00002000:00010000:3.0:1789429512.810142:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f095880 00000100:00100000:1.0:1789429512.819092:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429512.819298:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635091968 00000100:00100000:3.0:1789429512.819308:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635091968 00002000:00100000:2.0:1789429512.819571:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f415c4700 x1876351635091968/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429512.819583:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4700 with x1876351635091968 ext(10485760->11534335) 00002000:00010000:2.0:1789429512.819590:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f415c4700 00000100:00100000:2.0:1789429512.819662:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11530 00000100:00100000:2.0:1789429512.819672:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+29:2371:x1876351635091968:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429512.831717:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429512.831793:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635092096 00000100:00100000:2.0:1789429512.831808:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635092096 00002000:00100000:2.0:1789429512.831879:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946f340cc380 x1876351635092096/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429512.831893:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340cc380 with x1876351635092096 ext(11534336->12582911) 00002000:00010000:2.0:1789429512.831900:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f340cc380 00000100:00100000:2.0:1789429512.831944:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11531 00000100:00100000:2.0:1789429512.831956:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635092096:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429512.835409:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+33:2371:x1876351635091968:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15731us (16318us total) trans 4294969287 rc 0/0 00000100:00100000:2.0:1789429512.835423:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11530 00002000:00100000:2.0:1789429512.835434:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f415c4700 x1876351635091968/t4294969287(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429512.835441:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c4700 with x1876351635091968 ext(10485760->11534335) 00002000:00010000:2.0:1789429512.835457:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f415c4700 00000100:00100000:0.0:1789429512.846018:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429512.846438:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635092224 00000100:00100000:2.0:1789429512.846459:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635092224 00002000:00100000:2.0:1789429512.846842:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946f3f2e1f80 x1876351635092224/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429512.846863:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e1f80 with x1876351635092224 ext(12582912->13631487) 00002000:00010000:2.0:1789429512.846869:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e1f80 00000100:00100000:2.0:1789429512.846905:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11532 00000100:00100000:2.0:1789429512.846914:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+33:2369:x1876351635092224:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429512.847310:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+35:2368:x1876351635092096:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15303us (15556us total) trans 4294969288 rc 0/0 00000100:00100000:1.0:1789429512.847321:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11531 00002000:00100000:1.0:1789429512.847330:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946f340cc380 x1876351635092096/t4294969288(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429512.847340:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340cc380 with x1876351635092096 ext(11534336->12582911) 00002000:00010000:1.0:1789429512.847345:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f340cc380 00000100:00100000:3.0:1789429512.859391:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+35:2369:x1876351635092224:12345-192.168.203.39@tcp:4:dd.0 Request processed in 12461us (13367us total) trans 4294969289 rc 0/0 00000100:00100000:3.0:1789429512.859409:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11532 00002000:00100000:3.0:1789429512.859428:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946f3f2e1f80 x1876351635092224/t4294969289(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429512.859440:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e1f80 with x1876351635092224 ext(12582912->13631487) 00002000:00010000:3.0:1789429512.859461:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e1f80 00000100:00100000:2.0:1789429512.864502:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429512.865097:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635092352 00000100:00100000:3.0:1789429512.865112:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635092352 00002000:00100000:3.0:1789429512.865177:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946f054d4a80 x1876351635092352/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429512.865425:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4a80 with x1876351635092352 ext(13631488->14680063) 00002000:00010000:3.0:1789429512.865435:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d4a80 00000100:00100000:1.0:1789429512.865680:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11533 00000100:00100000:1.0:1789429512.865767:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+35:2370:x1876351635092352:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429512.884757:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429512.890086:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635092480 00000100:00100000:0.0:1789429512.890100:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635092480 00002000:00100000:0.0:1789429512.890146:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f340cdf80 x1876351635092480/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.890157:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340cdf80 with x1876351635092480 ext(14680064->15728639) 00002000:00010000:0.0:1789429512.890163:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f340cdf80 00000100:00100000:0.0:1789429512.890226:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11534 00000100:00100000:0.0:1789429512.890235:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+38:2371:x1876351635092480:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429512.890554:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+37:2370:x1876351635092352:12345-192.168.203.39@tcp:4:dd.0 Request processed in 20651us (21860us total) trans 4294969290 rc 0/0 00000100:00100000:1.0:1789429512.890570:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11533 00002000:00100000:1.0:1789429512.890580:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946f054d4a80 x1876351635092352/t4294969290(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429512.890589:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4a80 with x1876351635092352 ext(13631488->14680063) 00002000:00010000:1.0:1789429512.890594:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d4a80 00000100:00100000:1.0:1789429512.905158:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429512.907144:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+39:2371:x1876351635092480:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16898us (22391us total) trans 4294969291 rc 0/0 00000100:00100000:3.0:1789429512.907159:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11534 00002000:00100000:3.0:1789429512.907174:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f340cdf80 x1876351635092480/t4294969291(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429512.907184:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f340cdf80 with x1876351635092480 ext(14680064->15728639) 00002000:00010000:3.0:1789429512.907190:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f340cdf80 00000100:00100000:3.0:1789429512.907249:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635092608 00000100:00100000:3.0:1789429512.907257:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635092608 00002000:00100000:3.0:1789429512.907291:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f415c5500 x1876351635092608/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429512.907302:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c5500 with x1876351635092608 ext(15728640->16777215) 00002000:00010000:3.0:1789429512.907306:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f415c5500 00000100:00100000:3.0:1789429512.907333:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11535 00000100:00100000:3.0:1789429512.907344:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+39:2370:x1876351635092608:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429512.925487:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+41:2370:x1876351635092608:12345-192.168.203.39@tcp:4:dd.0 Request processed in 18136us (20336us total) trans 4294969292 rc 0/0 00000100:00100000:2.0:1789429512.925500:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11535 00002000:00100000:2.0:1789429512.925512:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f415c5500 x1876351635092608/t4294969292(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429512.925523:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c5500 with x1876351635092608 ext(15728640->16777215) 00002000:00010000:2.0:1789429512.925529:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f415c5500 00000100:00100000:1.0:1789429512.942319:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429512.942433:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635092736 00000100:00100000:2.0:1789429512.942454:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635092736 00002000:00100000:2.0:1789429512.942504:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946f415c6300 x1876351635092736/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429512.942514:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6300 with x1876351635092736 ext(16777216->17825791) 00002000:00010000:2.0:1789429512.942520:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f415c6300 00000100:00100000:2.0:1789429512.942548:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11536 00000100:00100000:2.0:1789429512.942557:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+41:2368:x1876351635092736:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429512.948521:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+43:2368:x1876351635092736:12345-192.168.203.39@tcp:4:dd.0 Request processed in 5954us (6200us total) trans 4294969293 rc 0/0 00000100:00100000:0.0:1789429512.948536:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11536 00002000:00100000:0.0:1789429512.948549:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946f415c6300 x1876351635092736/t4294969293(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.948561:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6300 with x1876351635092736 ext(16777216->17825791) 00002000:00010000:0.0:1789429512.948567:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f415c6300 00000001:00080000:1.0:1789429512.949924:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969282 is committed 00000001:00080000:1.0:1789429512.949950:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969288 is committed 00000001:00080000:1.0:1789429512.949981:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969289 is committed 00000100:00100000:0.0:1789429512.957500:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429512.959332:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635092864 00000100:00100000:1.0:1789429512.959347:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635092864 00002000:00100000:0.0:1789429512.959498:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946f3f2e0a80 x1876351635092864/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.959510:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e0a80 with x1876351635092864 ext(17825792->18874367) 00002000:00010000:0.0:1789429512.959516:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e0a80 00000100:00100000:0.0:1789429512.959546:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11537 00000100:00100000:0.0:1789429512.959555:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+16:2369:x1876351635092864:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429512.971541:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+18:2369:x1876351635092864:12345-192.168.203.39@tcp:4:dd.0 Request processed in 11969us (14030us total) trans 4294969294 rc 0/0 00000100:00100000:0.0:1789429512.971560:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11537 00002000:00100000:0.0:1789429512.971578:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946f3f2e0a80 x1876351635092864/t4294969294(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.971590:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e0a80 with x1876351635092864 ext(17825792->18874367) 00002000:00010000:0.0:1789429512.971598:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e0a80 00000100:00100000:1.0:1789429512.973904:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429512.974121:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635092992 00000100:00100000:0.0:1789429512.974137:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635092992 00002000:00100000:0.0:1789429512.974234:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946e15a52300 x1876351635092992/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.974249:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a52300 with x1876351635092992 ext(18874368->19922943) 00002000:00010000:0.0:1789429512.974256:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15a52300 00000100:00100000:0.0:1789429512.974301:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11538 00000100:00100000:0.0:1789429512.974312:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+18:2369:x1876351635092992:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429512.986475:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429512.986635:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635093120 00000100:00100000:1.0:1789429512.986647:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635093120 00002000:00100000:1.0:1789429512.986698:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f054d4e00 x1876351635093120/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429512.986710:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4e00 with x1876351635093120 ext(19922944->20971519) 00002000:00010000:1.0:1789429512.986716:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d4e00 00000100:00100000:1.0:1789429512.986758:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11539 00000100:00100000:1.0:1789429512.986769:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+20:2369:x1876351635093120:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429512.994245:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429512.994789:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+22:2369:x1876351635092992:12345-192.168.203.39@tcp:4:dd.0 Request processed in 20472us (20887us total) trans 4294969295 rc 0/0 00000100:00100000:0.0:1789429512.994804:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11538 00002000:00100000:0.0:1789429512.994821:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946e15a52300 x1876351635092992/t4294969295(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.994834:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a52300 with x1876351635092992 ext(18874368->19922943) 00002000:00010000:0.0:1789429512.994842:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15a52300 00000100:00100000:0.0:1789429512.994875:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635093248 00000100:00100000:0.0:1789429512.994884:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635093248 00002000:00100000:0.0:1789429512.994923:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946e0265d500 x1876351635093248/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/0 e 0 to 0 dl 1789429523 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429512.994932:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d500 with x1876351635093248 ext(20971520->22020095) 00002000:00010000:0.0:1789429512.994935:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265d500 00000100:00100000:1.0:1789429512.995512:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11540 00000100:00100000:1.0:1789429512.995531:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+22:2368:x1876351635093248:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429513.008054:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+24:2369:x1876351635093120:12345-192.168.203.39@tcp:4:dd.0 Request processed in 21276us (21598us total) trans 4294969296 rc 0/0 00000100:00100000:1.0:1789429513.008067:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11539 00002000:00100000:1.0:1789429513.008079:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f054d4e00 x1876351635093120/t4294969296(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429513.008088:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4e00 with x1876351635093120 ext(19922944->20971519) 00002000:00010000:1.0:1789429513.008095:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d4e00 00000100:00100000:3.0:1789429513.010341:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429513.010439:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635093376 00000100:00100000:0.0:1789429513.010460:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635093376 00002000:00100000:0.0:1789429513.010512:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946e0265d880 x1876351635093376/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.010522:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d880 with x1876351635093376 ext(22020096->23068671) 00002000:00010000:0.0:1789429513.010528:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265d880 00000100:00100000:0.0:1789429513.010566:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11541 00000100:00100000:0.0:1789429513.010576:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+24:2370:x1876351635093376:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429513.019717:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+26:2368:x1876351635093248:12345-192.168.203.39@tcp:4:dd.0 Request processed in 24177us (25470us total) trans 4294969297 rc 0/0 00000100:00100000:0.0:1789429513.019735:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11540 00002000:00100000:0.0:1789429513.019751:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946e0265d500 x1876351635093248/t4294969297(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:248/0 lens 488/448 e 0 to 0 dl 1789429523 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.019763:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d500 with x1876351635093248 ext(20971520->22020095) 00002000:00010000:0.0:1789429513.019771:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265d500 00000100:00100000:0.0:1789429513.024417:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+26:2370:x1876351635093376:12345-192.168.203.39@tcp:4:dd.0 Request processed in 13828us (14077us total) trans 4294969298 rc 0/0 00000100:00100000:0.0:1789429513.024434:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11541 00002000:00100000:0.0:1789429513.024459:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946e0265d880 x1876351635093376/t4294969298(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.024471:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265d880 with x1876351635093376 ext(22020096->23068671) 00002000:00010000:0.0:1789429513.024544:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265d880 00000100:00100000:1.0:1789429513.025905:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.026927:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635093504 00000100:00100000:2.0:1789429513.026941:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635093504 00002000:00100000:2.0:1789429513.027011:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946e15a53480 x1876351635093504/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.027024:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a53480 with x1876351635093504 ext(23068672->24117247) 00002000:00010000:2.0:1789429513.027030:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15a53480 00000100:00100000:3.0:1789429513.027161:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11542 00000100:00100000:3.0:1789429513.027177:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+26:2370:x1876351635093504:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429513.040928:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+28:2370:x1876351635093504:12345-192.168.203.39@tcp:4:dd.0 Request processed in 13740us (15013us total) trans 4294969299 rc 0/0 00000100:00100000:3.0:1789429513.040946:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11542 00002000:00100000:3.0:1789429513.040963:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946e15a53480 x1876351635093504/t4294969299(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.040975:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a53480 with x1876351635093504 ext(23068672->24117247) 00002000:00010000:3.0:1789429513.040983:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15a53480 00000100:00100000:0.0:1789429513.046187:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.046515:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635093632 00000100:00100000:2.0:1789429513.046530:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635093632 00002000:00100000:2.0:1789429513.046602:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946f3f2e3480 x1876351635093632/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.046616:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e3480 with x1876351635093632 ext(24117248->25165823) 00002000:00010000:2.0:1789429513.046624:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e3480 00000100:00100000:2.0:1789429513.046672:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11543 00000100:00100000:2.0:1789429513.046684:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:2371:x1876351635093632:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.061684:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429513.062253:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635093760 00000100:00100000:3.0:1789429513.062268:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635093760 00002000:00100000:3.0:1789429513.062345:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f054d6a00 x1876351635093760/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.062357:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d6a00 with x1876351635093760 ext(25165824->26214399) 00002000:00010000:3.0:1789429513.062364:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d6a00 00000100:00100000:3.0:1789429513.062408:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11544 00000100:00100000:3.0:1789429513.062420:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351635093760:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.063955:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351635093632:12345-192.168.203.39@tcp:4:dd.0 Request processed in 17259us (17769us total) trans 4294969300 rc 0/0 00000100:00100000:2.0:1789429513.063975:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11543 00002000:00100000:2.0:1789429513.063989:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946f3f2e3480 x1876351635093632/t4294969300(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.064001:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e3480 with x1876351635093632 ext(24117248->25165823) 00002000:00010000:2.0:1789429513.064008:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e3480 00000100:00100000:3.0:1789429513.077914:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:2370:x1876351635093760:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15479us (16228us total) trans 4294969301 rc 0/0 00000100:00100000:3.0:1789429513.077934:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11544 00002000:00100000:3.0:1789429513.077950:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f054d6a00 x1876351635093760/t4294969301(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.077961:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d6a00 with x1876351635093760 ext(25165824->26214399) 00002000:00010000:3.0:1789429513.077970:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d6a00 00000100:00100000:0.0:1789429513.090619:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429513.090738:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635093888 00000100:00100000:3.0:1789429513.090752:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635093888 00002000:00100000:3.0:1789429513.090822:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f3f2e3b80 x1876351635093888/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.090836:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e3b80 with x1876351635093888 ext(26214400->27262975) 00002000:00010000:3.0:1789429513.090844:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e3b80 00000100:00100000:3.0:1789429513.090918:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11545 00000100:00100000:3.0:1789429513.090930:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+32:2371:x1876351635093888:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.109563:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429513.110163:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635094016 00000100:00100000:3.0:1789429513.110179:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635094016 00002000:00100000:3.0:1789429513.110271:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946f054d4380 x1876351635094016/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.110284:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4380 with x1876351635094016 ext(27262976->28311551) 00002000:00010000:3.0:1789429513.110291:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d4380 00000100:00100000:0.0:1789429513.110422:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11546 00000100:00100000:0.0:1789429513.110437:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+34:2369:x1876351635094016:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429513.114297:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+36:2371:x1876351635093888:12345-192.168.203.39@tcp:4:dd.0 Request processed in 23353us (23677us total) trans 4294969302 rc 0/0 00000100:00100000:3.0:1789429513.114314:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11545 00002000:00100000:3.0:1789429513.114329:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f3f2e3b80 x1876351635093888/t4294969302(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.114340:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e3b80 with x1876351635093888 ext(26214400->27262975) 00002000:00010000:3.0:1789429513.114348:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e3b80 00000100:00100000:3.0:1789429513.123226:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+36:2369:x1876351635094016:12345-192.168.203.39@tcp:4:dd.0 Request processed in 12757us (13641us total) trans 4294969303 rc 0/0 00000100:00100000:3.0:1789429513.123246:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11546 00002000:00100000:3.0:1789429513.123262:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946f054d4380 x1876351635094016/t4294969303(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.123283:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4380 with x1876351635094016 ext(27262976->28311551) 00002000:00010000:3.0:1789429513.123291:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d4380 00000100:00100000:1.0:1789429513.126728:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429513.126804:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635094144 00000100:00100000:3.0:1789429513.126817:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635094144 00002000:00100000:3.0:1789429513.126895:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946e15a51500 x1876351635094144/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.126907:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51500 with x1876351635094144 ext(28311552->29360127) 00002000:00010000:3.0:1789429513.126914:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15a51500 00000100:00100000:3.0:1789429513.126951:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11547 00000100:00100000:3.0:1789429513.126963:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+36:2371:x1876351635094144:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.146191:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+38:2371:x1876351635094144:12345-192.168.203.39@tcp:4:dd.0 Request processed in 19213us (19462us total) trans 4294969304 rc 0/0 00000100:00100000:2.0:1789429513.146233:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11547 00002000:00100000:2.0:1789429513.146251:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946e15a51500 x1876351635094144/t4294969304(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.146263:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a51500 with x1876351635094144 ext(28311552->29360127) 00002000:00010000:2.0:1789429513.146283:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15a51500 00000100:00100000:1.0:1789429513.161930:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.164705:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635094272 00000100:00100000:2.0:1789429513.164726:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635094272 00002000:00100000:2.0:1789429513.164813:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e15a50380 x1876351635094272/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.164827:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a50380 with x1876351635094272 ext(29360128->30408703) 00002000:00010000:2.0:1789429513.164835:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15a50380 00000100:00100000:2.0:1789429513.164956:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11548 00000100:00100000:2.0:1789429513.164969:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+38:2370:x1876351635094272:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.174642:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+40:2370:x1876351635094272:12345-192.168.203.39@tcp:4:dd.0 Request processed in 9660us (12710us total) trans 4294969305 rc 0/0 00000100:00100000:2.0:1789429513.174666:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11548 00002000:00100000:2.0:1789429513.174683:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e15a50380 x1876351635094272/t4294969305(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.174695:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15a50380 with x1876351635094272 ext(29360128->30408703) 00002000:00010000:2.0:1789429513.174703:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15a50380 00000100:00100000:0.0:1789429513.178870:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.179423:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635094400 00000100:00100000:2.0:1789429513.179455:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635094400 00002000:00100000:2.0:1789429513.179518:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946f3f2e1c00 x1876351635094400/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.179530:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e1c00 with x1876351635094400 ext(30408704->31457279) 00002000:00010000:2.0:1789429513.179537:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e1c00 00000100:00100000:2.0:1789429513.179575:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11549 00000100:00100000:2.0:1789429513.179586:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+40:2370:x1876351635094400:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429513.191535:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.194251:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+42:2370:x1876351635094400:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14616us (15347us total) trans 4294969306 rc 0/0 00000100:00100000:2.0:1789429513.194268:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11549 00002000:00100000:2.0:1789429513.194287:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946f3f2e1c00 x1876351635094400/t4294969306(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.194300:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e1c00 with x1876351635094400 ext(30408704->31457279) 00002000:00010000:2.0:1789429513.194308:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e1c00 00000100:00100000:2.0:1789429513.194345:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635094528 00000100:00100000:2.0:1789429513.194353:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635094528 00002000:00100000:2.0:1789429513.194392:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946e0265ca80 x1876351635094528/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.194402:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265ca80 with x1876351635094528 ext(31457280->32505855) 00002000:00010000:2.0:1789429513.194405:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265ca80 00000100:00100000:0.0:1789429513.196139:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11550 00000100:00100000:0.0:1789429513.196169:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+42:2371:x1876351635094528:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429513.212692:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+44:2371:x1876351635094528:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16522us (21158us total) trans 4294969307 rc 0/0 00000100:00100000:0.0:1789429513.212709:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11550 00002000:00100000:0.0:1789429513.212726:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946e0265ca80 x1876351635094528/t4294969307(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.212738:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265ca80 with x1876351635094528 ext(31457280->32505855) 00002000:00010000:0.0:1789429513.212747:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265ca80 00000100:00100000:2.0:1789429513.219569:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429513.219871:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635094656 00000100:00100000:3.0:1789429513.219885:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635094656 00002000:00100000:3.0:1789429513.219967:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946f054d6300 x1876351635094656/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.219982:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d6300 with x1876351635094656 ext(32505856->33554431) 00002000:00010000:3.0:1789429513.219989:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d6300 00000100:00100000:3.0:1789429513.220031:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11551 00000100:00100000:3.0:1789429513.220043:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+44:2371:x1876351635094656:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.236038:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+46:2371:x1876351635094656:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15980us (16467us total) trans 4294969308 rc 0/0 00000100:00100000:2.0:1789429513.236056:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11551 00002000:00100000:2.0:1789429513.236072:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946f054d6300 x1876351635094656/t4294969308(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.236084:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d6300 with x1876351635094656 ext(32505856->33554431) 00002000:00010000:2.0:1789429513.236091:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d6300 00000100:00100000:0.0:1789429513.236271:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.236534:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635094784 00000100:00100000:2.0:1789429513.236545:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635094784 00002000:00100000:2.0:1789429513.236590:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946f3f2e3100 x1876351635094784/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.236600:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e3100 with x1876351635094784 ext(33554432->34603007) 00002000:00010000:2.0:1789429513.236603:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e3100 00000100:00100000:2.0:1789429513.236642:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11552 00000100:00100000:2.0:1789429513.236652:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+46:2370:x1876351635094784:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.247669:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+48:2370:x1876351635094784:12345-192.168.203.39@tcp:4:dd.0 Request processed in 11000us (11382us total) trans 4294969309 rc 0/0 00000100:00100000:2.0:1789429513.247689:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11552 00002000:00100000:2.0:1789429513.247705:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946f3f2e3100 x1876351635094784/t4294969309(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.247722:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f2e3100 with x1876351635094784 ext(33554432->34603007) 00002000:00010000:2.0:1789429513.247730:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f2e3100 00000100:00100000:3.0:1789429513.254654:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429513.254747:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635094912 00000100:00100000:0.0:1789429513.254760:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635094912 00002000:00100000:0.0:1789429513.254827:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946e0265df80 x1876351635094912/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.254839:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265df80 with x1876351635094912 ext(34603008->35651583) 00002000:00010000:0.0:1789429513.254847:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265df80 00000100:00100000:0.0:1789429513.254887:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11553 00000100:00100000:0.0:1789429513.254898:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+48:2370:x1876351635094912:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429513.267360:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+50:2370:x1876351635094912:12345-192.168.203.39@tcp:4:dd.0 Request processed in 12446us (12703us total) trans 4294969310 rc 0/0 00000100:00100000:0.0:1789429513.267379:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11553 00002000:00100000:0.0:1789429513.267396:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946e0265df80 x1876351635094912/t4294969310(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.267409:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265df80 with x1876351635094912 ext(34603008->35651583) 00002000:00010000:0.0:1789429513.267418:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265df80 00000100:00100000:1.0:1789429513.275010:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.275527:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635095040 00000100:00100000:2.0:1789429513.275542:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635095040 00002000:00100000:2.0:1789429513.275608:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e15186680 x1876351635095040/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.275622:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15186680 with x1876351635095040 ext(35651584->36700159) 00002000:00010000:2.0:1789429513.275630:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15186680 00000100:00100000:2.0:1789429513.275716:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11554 00000100:00100000:2.0:1789429513.275728:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+50:2371:x1876351635095040:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429513.285421:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+52:2371:x1876351635095040:12345-192.168.203.39@tcp:4:dd.0 Request processed in 9678us (10408us total) trans 4294969311 rc 0/0 00000100:00100000:0.0:1789429513.285517:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11554 00002000:00100000:0.0:1789429513.285535:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e15186680 x1876351635095040/t4294969311(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.285548:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15186680 with x1876351635095040 ext(35651584->36700159) 00002000:00010000:0.0:1789429513.285556:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15186680 00000100:00100000:2.0:1789429513.296356:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429513.296597:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635095168 00000100:00100000:0.0:1789429513.296610:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635095168 00002000:00100000:0.0:1789429513.296679:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946f054d7100 x1876351635095168/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.296692:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d7100 with x1876351635095168 ext(36700160->37748735) 00002000:00010000:0.0:1789429513.296700:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d7100 00000100:00100000:0.0:1789429513.296738:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11555 00000100:00100000:0.0:1789429513.296749:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+52:2370:x1876351635095168:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429513.311350:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+54:2370:x1876351635095168:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14588us (14994us total) trans 4294969312 rc 0/0 00000100:00100000:0.0:1789429513.311366:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11555 00002000:00100000:0.0:1789429513.311383:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946f054d7100 x1876351635095168/t4294969312(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.311394:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d7100 with x1876351635095168 ext(36700160->37748735) 00002000:00010000:0.0:1789429513.311402:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d7100 00000100:00100000:3.0:1789429513.312424:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429513.312591:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635095296 00000100:00100000:1.0:1789429513.312604:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635095296 00002000:00100000:1.0:1789429513.312667:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946e0265e680 x1876351635095296/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429513.312689:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265e680 with x1876351635095296 ext(37748736->38797311) 00002000:00010000:1.0:1789429513.312695:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265e680 00000100:00100000:1.0:1789429513.312731:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11556 00000100:00100000:1.0:1789429513.312742:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+54:2371:x1876351635095296:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429513.329281:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+56:2371:x1876351635095296:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16523us (16847us total) trans 4294969313 rc 0/0 00000100:00100000:1.0:1789429513.329300:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11556 00002000:00100000:1.0:1789429513.329315:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946e0265e680 x1876351635095296/t4294969313(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429513.329327:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265e680 with x1876351635095296 ext(37748736->38797311) 00002000:00010000:1.0:1789429513.329336:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265e680 00000100:00100000:0.0:1789429513.333580:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.333729:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635095424 00000100:00100000:2.0:1789429513.333755:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635095424 00002000:00100000:2.0:1789429513.333845:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946f02d65500 x1876351635095424/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.333858:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d65500 with x1876351635095424 ext(38797312->39845887) 00002000:00010000:2.0:1789429513.333866:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f02d65500 00000100:00100000:2.0:1789429513.333949:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11557 00000100:00100000:2.0:1789429513.333961:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+56:2370:x1876351635095424:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.352823:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+58:2370:x1876351635095424:12345-192.168.203.39@tcp:4:dd.0 Request processed in 18848us (19242us total) trans 4294969314 rc 0/0 00000100:00100000:2.0:1789429513.352842:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11557 00002000:00100000:2.0:1789429513.352860:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946f02d65500 x1876351635095424/t4294969314(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.352873:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d65500 with x1876351635095424 ext(38797312->39845887) 00002000:00010000:2.0:1789429513.352882:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f02d65500 00000100:00100000:3.0:1789429513.368859:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429513.369266:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635095552 00000100:00100000:0.0:1789429513.369281:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635095552 00002000:00100000:0.0:1789429513.369352:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946e0265fb80 x1876351635095552/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.369366:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265fb80 with x1876351635095552 ext(39845888->40894463) 00002000:00010000:0.0:1789429513.369375:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265fb80 00000100:00100000:0.0:1789429513.369421:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11558 00000100:00100000:0.0:1789429513.369434:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+58:2368:x1876351635095552:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429513.387071:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429513.387145:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635095680 00000100:00100000:0.0:1789429513.387158:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635095680 00002000:00100000:0.0:1789429513.387251:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946e15184000 x1876351635095680/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.387274:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184000 with x1876351635095680 ext(40894464->41943039) 00002000:00010000:0.0:1789429513.387283:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15184000 00000100:00100000:0.0:1789429513.387319:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11559 00000100:00100000:0.0:1789429513.387331:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+60:2371:x1876351635095680:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.405544:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429513.406074:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+62:2371:x1876351635095680:12345-192.168.203.39@tcp:4:dd.0 Request processed in 18742us (19013us total) trans 4294969315 rc 0/0 00000100:00100000:0.0:1789429513.406086:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11559 00002000:00100000:0.0:1789429513.406099:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946e15184000 x1876351635095680/t4294969315(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.406108:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184000 with x1876351635095680 ext(40894464->41943039) 00002000:00010000:0.0:1789429513.406115:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15184000 00000100:00100000:0.0:1789429513.406142:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635095808 00000100:00100000:0.0:1789429513.406149:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635095808 00002000:00100000:0.0:1789429513.406176:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946f3f1c7b80 x1876351635095808/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.406182:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7b80 with x1876351635095808 ext(41943040->42991615) 00002000:00010000:0.0:1789429513.406184:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c7b80 00000100:00100000:0.0:1789429513.406220:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11560 00000100:00100000:0.0:1789429513.406227:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+62:2370:x1876351635095808:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429513.407319:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+64:2368:x1876351635095552:12345-192.168.203.39@tcp:4:dd.0 Request processed in 37880us (38470us total) trans 4294969316 rc 0/0 00000100:00100000:0.0:1789429513.407332:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11558 00002000:00100000:0.0:1789429513.407342:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946e0265fb80 x1876351635095552/t4294969316(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.407352:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265fb80 with x1876351635095552 ext(39845888->40894463) 00002000:00010000:0.0:1789429513.407358:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265fb80 00000100:00100000:0.0:1789429513.423873:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429513.424034:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635095936 00000100:00100000:3.0:1789429513.424179:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635095936 00002000:00100000:3.0:1789429513.424290:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946f02d65180 x1876351635095936/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.424304:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d65180 with x1876351635095936 ext(42991616->44040191) 00002000:00010000:3.0:1789429513.424312:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f02d65180 00000100:00100000:3.0:1789429513.424411:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11561 00000100:00100000:3.0:1789429513.424423:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+64:2371:x1876351635095936:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.427509:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+66:2370:x1876351635095808:12345-192.168.203.39@tcp:4:dd.0 Request processed in 21263us (22481us total) trans 4294969317 rc 0/0 00000100:00100000:2.0:1789429513.427528:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11560 00002000:00100000:2.0:1789429513.427547:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946f3f1c7b80 x1876351635095808/t4294969317(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.427558:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c7b80 with x1876351635095808 ext(41943040->42991615) 00002000:00010000:2.0:1789429513.427566:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c7b80 00010000:00010000:0.0:1789429513.447939:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429513.449877:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429513.450048:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635096064 00000100:00100000:3.0:1789429513.450062:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635096064 00002000:00100000:3.0:1789429513.450138:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946f02d64000 x1876351635096064/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.450160:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d64000 with x1876351635096064 ext(44040192->45088767) 00002000:00010000:3.0:1789429513.450168:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f02d64000 00000100:00100000:3.0:1789429513.450283:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11562 00000100:00100000:3.0:1789429513.450296:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+66:2369:x1876351635096064:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429513.481431:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429513.482538:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+68:2369:x1876351635096064:12345-192.168.203.39@tcp:4:dd.0 Request processed in 32237us (32667us total) trans 4294969318 rc 0/0 00000100:00100000:1.0:1789429513.482554:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11562 00002000:00100000:1.0:1789429513.482572:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946f02d64000 x1876351635096064/t4294969318(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429513.482583:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d64000 with x1876351635096064 ext(44040192->45088767) 00002000:00010000:1.0:1789429513.482592:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f02d64000 00000100:00100000:2.0:1789429513.483130:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+68:2371:x1876351635095936:12345-192.168.203.39@tcp:4:dd.0 Request processed in 58706us (59268us total) trans 4294969319 rc 0/0 00000100:00100000:2.0:1789429513.483142:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11561 00002000:00100000:2.0:1789429513.483149:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946f02d65180 x1876351635095936/t4294969319(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.483157:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d65180 with x1876351635095936 ext(42991616->44040191) 00002000:00010000:2.0:1789429513.483162:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f02d65180 00000100:00100000:1.0:1789429513.485125:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635096192 00000100:00100000:1.0:1789429513.485145:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635096192 00002000:00100000:1.0:1789429513.485220:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946f02d66680 x1876351635096192/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429513.485232:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d66680 with x1876351635096192 ext(45088768->46137343) 00002000:00010000:1.0:1789429513.485239:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f02d66680 00000100:00100000:1.0:1789429513.485276:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11563 00000100:00100000:1.0:1789429513.485286:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f02d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+68:2370:x1876351635096192:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429513.499691:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.501401:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635096320 00000100:00100000:2.0:1789429513.501422:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635096320 00002000:00100000:2.0:1789429513.501511:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e0265f800 x1876351635096320/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.501527:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265f800 with x1876351635096320 ext(46137344->47185919) 00002000:00010000:2.0:1789429513.501534:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265f800 00000100:00100000:2.0:1789429513.501585:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11564 00000100:00100000:2.0:1789429513.501597:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+70:2368:x1876351635096320:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.510144:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f02d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+72:2370:x1876351635096192:12345-192.168.203.39@tcp:4:dd.0 Request processed in 24841us (28706us total) trans 4294969320 rc 0/0 00000100:00100000:2.0:1789429513.510166:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11563 00002000:00100000:2.0:1789429513.510186:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946f02d66680 x1876351635096192/t4294969320(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.510222:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f02d66680 with x1876351635096192 ext(45088768->46137343) 00002000:00010000:2.0:1789429513.510231:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f02d66680 00000100:00100000:0.0:1789429513.524813:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.525726:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635096448 00000100:00100000:2.0:1789429513.525744:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635096448 00002000:00100000:2.0:1789429513.525823:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f3462d880 x1876351635096448/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.525836:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462d880 with x1876351635096448 ext(47185920->48234495) 00002000:00010000:2.0:1789429513.525844:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462d880 00000100:00100000:2.0:1789429513.525893:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11565 00000100:00100000:2.0:1789429513.525904:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+72:2368:x1876351635096448:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429513.536872:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+74:2368:x1876351635096448:12345-192.168.203.39@tcp:4:dd.0 Request processed in 10951us (12058us total) trans 4294969321 rc 0/0 00000100:00100000:0.0:1789429513.536891:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11565 00002000:00100000:0.0:1789429513.536919:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f3462d880 x1876351635096448/t4294969321(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.536940:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462d880 with x1876351635096448 ext(47185920->48234495) 00002000:00010000:0.0:1789429513.536948:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462d880 00000100:00100000:2.0:1789429513.538768:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+74:2368:x1876351635096320:12345-192.168.203.39@tcp:4:dd.0 Request processed in 37157us (39075us total) trans 4294969322 rc 0/0 00000100:00100000:2.0:1789429513.538785:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11564 00002000:00100000:2.0:1789429513.538798:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e0265f800 x1876351635096320/t4294969322(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.539160:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265f800 with x1876351635096320 ext(46137344->47185919) 00002000:00010000:2.0:1789429513.539169:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265f800 00000100:00100000:3.0:1789429513.543543:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429513.543864:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635096576 00000100:00100000:1.0:1789429513.543879:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635096576 00002000:00100000:1.0:1789429513.543951:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946e0265f100 x1876351635096576/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429513.543966:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265f100 with x1876351635096576 ext(48234496->49283071) 00002000:00010000:1.0:1789429513.543974:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265f100 00000100:00100000:1.0:1789429513.544015:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11566 00000100:00100000:1.0:1789429513.544027:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+74:2371:x1876351635096576:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429513.565689:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.566889:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635096704 00000100:00100000:2.0:1789429513.566905:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635096704 00002000:00100000:2.0:1789429513.566989:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946e0265c700 x1876351635096704/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429513.567003:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265c700 with x1876351635096704 ext(49283072->50331647) 00002000:00010000:2.0:1789429513.567009:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265c700 00000100:00100000:2.0:1789429513.567052:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11567 00000100:00100000:2.0:1789429513.567064:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+76:2371:x1876351635096704:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429513.584309:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+78:2371:x1876351635096576:12345-192.168.203.39@tcp:4:dd.0 Request processed in 40270us (40776us total) trans 4294969323 rc 0/0 00000100:00100000:0.0:1789429513.584326:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11566 00002000:00100000:0.0:1789429513.584342:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946e0265f100 x1876351635096576/t4294969323(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.584459:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265f100 with x1876351635096576 ext(48234496->49283071) 00002000:00010000:0.0:1789429513.584467:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265f100 00000100:00100000:0.0:1789429513.597701:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429513.597891:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+78:2371:x1876351635096704:12345-192.168.203.39@tcp:4:dd.0 Request processed in 30827us (32353us total) trans 4294969324 rc 0/0 00000100:00100000:3.0:1789429513.597906:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11567 00002000:00100000:3.0:1789429513.597923:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946e0265c700 x1876351635096704/t4294969324(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429513.597935:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0265c700 with x1876351635096704 ext(49283072->50331647) 00002000:00010000:3.0:1789429513.597942:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0265c700 00000100:00100000:1.0:1789429513.598508:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635096832 00000100:00100000:1.0:1789429513.598520:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635096832 00002000:00100000:1.0:1789429513.598584:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f3462e680 x1876351635096832/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429513.598595:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462e680 with x1876351635096832 ext(50331648->51380223) 00002000:00010000:1.0:1789429513.598600:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462e680 00000100:00100000:1.0:1789429513.598629:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11568 00000100:00100000:1.0:1789429513.598639:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+79:2369:x1876351635096832:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429513.623139:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429513.623255:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635096960 00000100:00100000:0.0:1789429513.623279:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635096960 00002000:00100000:0.0:1789429513.623342:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f3f1c4000 x1876351635096960/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/0 e 0 to 0 dl 1789429524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429513.623356:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c4000 with x1876351635096960 ext(51380224->52428799) 00002000:00010000:0.0:1789429513.623364:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c4000 00000100:00100000:0.0:1789429513.623401:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11569 00000100:00100000:0.0:1789429513.623412:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+80:2369:x1876351635096960:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429513.636982:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+82:2369:x1876351635096832:12345-192.168.203.39@tcp:4:dd.0 Request processed in 38318us (39272us total) trans 4294969325 rc 0/0 00000100:00100000:1.0:1789429513.637002:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11568 00002000:00100000:1.0:1789429513.637019:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f3462e680 x1876351635096832/t4294969325(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429513.637032:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462e680 with x1876351635096832 ext(50331648->51380223) 00002000:00010000:1.0:1789429513.637040:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462e680 00000100:00100000:1.0:1789429513.638637:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+82:2369:x1876351635096960:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15212us (15500us total) trans 4294969326 rc 0/0 00000100:00100000:1.0:1789429513.638653:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11569 00002000:00100000:1.0:1789429513.638665:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f3f1c4000 x1876351635096960/t4294969326(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:249/0 lens 488/448 e 0 to 0 dl 1789429524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429513.638676:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c4000 with x1876351635096960 ext(51380224->52428799) 00002000:00010000:1.0:1789429513.638684:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c4000 00000100:00100000:3.0:1789429513.646835:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429513.647344:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635097088 00000100:00100000:1.0:1789429513.647360:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635097088 00000100:00100000:1.0:1789429513.647457:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21337 00000100:00100000:1.0:1789429513.647469:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+38:44663:x1876351635097088:12345-192.168.203.39@tcp:44:dd.0 00000001:00080000:2.0:1789429513.689699:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977224 is committed 00000001:00080000:2.0:1789429513.689738:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977226 is committed 00000100:00100000:1.0:1789429513.690118:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:44663:x1876351635097088:12345-192.168.203.39@tcp:44:dd.0 Request processed in 42642us (43290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429513.690134:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21337 00000100:00100000:0.0:1789429513.694330:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429513.694556:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635097216 00000100:00100000:1.0:1789429513.694581:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635097216 00000100:00100000:1.0:1789429513.694661:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5823 00000100:00100000:1.0:1789429513.694673:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+82:2369:x1876351635097216:12345-192.168.203.39@tcp:16:dd.0 00000001:00080000:0.0:1789429513.825866:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969323 is committed 00000001:00080000:0.0:1789429513.825924:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969326 is committed 00000100:00100000:3.0:1789429513.826182:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+8:2369:x1876351635097216:12345-192.168.203.39@tcp:16:dd.0 Request processed in 131506us (131863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429513.826193:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5823 00000100:00100000:2.0:1789429513.833385:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429513.833970:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635097472 00000100:00100000:1.0:1789429513.833985:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635097472 00000100:00100000:1.0:1789429513.834057:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 285 00000100:00100000:1.0:1789429513.834068:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:44663:x1876351635097472:12345-192.168.203.39@tcp:35:dd.0 00000001:00080000:1.0:1789429513.834484:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977227 00000100:00100000:1.0:1789429513.834616:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+33:44663:x1876351635097472:12345-192.168.203.39@tcp:35:dd.0 Request processed in 548us (1245us total) trans 4294977228 rc 0/0 00000100:00100000:1.0:1789429513.834634:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 285 00000020:00080000:1.0:1789429513.834639:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789429513.856097:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429513.856235:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635097600 00000100:00100000:0.0:1789429513.856250:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635097600 00000100:00080000:2.0:1789429513.856384:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429513.856558:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21338 00000100:00100000:0.0:1789429513.856572:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:44664:x1876351635097600:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429513.856600:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429513.856631:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361cfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c938 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.856719:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.856737:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.856752:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429513.856805:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429513.856809:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429513.856834:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.856868:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361cfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c938 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.856889:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c938 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.856899:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd900) 00010000:00010000:0.0:1789429513.856903:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429513.856907:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429513.857101:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:44664:x1876351635097600:12345-192.168.203.39@tcp:101:dd.0 Request processed in 530us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429513.857111:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21338 00000100:00100000:3.0:1789429513.862326:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.862664:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635097856 00000100:00100000:2.0:1789429513.862679:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635097856 00000100:00100000:2.0:1789429513.862757:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21339 00000100:00100000:2.0:1789429513.862769:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:44664:x1876351635097856:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429513.862797:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429513.862801:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789429513.862836:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c938 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.862860:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd900) 00010000:00010000:2.0:1789429513.862872:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429513.862892:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361d08 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c93f expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.865863:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361d0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.865893:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361d0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.865907:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361d0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.865926:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361d16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.865934:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361d16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.865941:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361d16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866561:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361d1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866574:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866639:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429513.866656:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8a:0x0]: returning size 52428800 00010000:00010000:2.0:1789429513.866789:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361d0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866803:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361d0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866811:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361d0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866818:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547c00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429513.866823:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361d0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866831:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361d0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866845:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef800) 00010000:00010000:2.0:1789429513.866848:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429513.866854:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361d0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866860:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547c00/0xb4c3dad726361d0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866875:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361d16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866881:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361d16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866887:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361d16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866892:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429513.866896:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361d16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866902:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361d16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.866909:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b086329 (ffff946f051efe00) 00010000:00010000:2.0:1789429513.866912:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429513.867289:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361d16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.867300:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361d16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.868791:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361d08 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c93f expref: 22 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.868827:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c93f expref: 21 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.868836:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429513.868839:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429513.868844:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:0.0:1789429513.868954:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:44664:x1876351635097856:12345-192.168.203.39@tcp:101:dd.0 Request processed in 6186us (6642us total) trans 4294977229 rc 0/0 00000100:00100000:0.0:1789429513.868965:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21339 00000100:00100000:0.0:1789429513.876237:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.876537:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635098112 00000100:00100000:2.0:1789429513.876551:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635098112 00000100:00100000:2.0:1789429513.876888:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21340 00000100:00100000:2.0:1789429513.876905:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:44664:x1876351635098112:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:2.0:1789429513.877007:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429513.877045:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546200/0xb4c3dad726361d1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c93f expref: 21 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.877073:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:2.0:1789429513.877079:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429513.877513:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.877532:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.877544:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789429513.877625:0:15700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977230 00000004:00010000:2.0:1789429513.877658:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003d98ca6d reply state 0000000021321058 transno 4294977231 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429513.877668:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789429513.877800:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:44664:x1876351635098112:12345-192.168.203.39@tcp:36:dd.0 Request processed in 898us (1577us total) trans 4294977231 rc 0/0 00000100:00100000:2.0:1789429513.877808:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21340 00000020:00080000:2.0:1789429513.877815:0:15700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789429513.880739:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1789429513.880740:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429513.880758:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429513.880766:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429513.880773:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f546400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429513.880779:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429513.880788:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429513.880810:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:3.0:1789429513.880814:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429513.880821:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429513.880909:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429513.890168:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635098240 00000100:00100000:0.0:1789429513.890191:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635098240 00000100:00100000:0.0:1789429513.890790:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21341 00000100:00100000:0.0:1789429513.890805:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:44664:x1876351635098240:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429513.890841:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429513.890874:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361d32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c946 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.891034:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c946 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.891056:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361d32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c946 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429513.891084:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429513.891088:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789429513.891093:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad200, rc 0) 00000100:00100000:0.0:1789429513.891182:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:44664:x1876351635098240:12345-192.168.203.39@tcp:101:dd.0 Request processed in 380us (10455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429513.891191:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21341 00000100:00100000:1.0:1789429513.897450:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429513.899316:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635098368 00000100:00100000:2.0:1789429513.899333:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635098368 00000100:00100000:2.0:1789429513.899498:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5824 00000100:00100000:2.0:1789429513.899510:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:44664:x1876351635098368:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429513.899640:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429513.899664:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c94d expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.899705:0:8085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361cf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c931 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.899715:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789429513.899720:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789429513.899725:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 6 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.899768:0:8085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361cf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c931 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.899785:0:8085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361cf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c931 expref: 7 pid: 20745 timeout: 1311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429513.899802:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8085:1876351648397312:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429513.899947:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e15865600 going to sleep for 11 seconds 00000100:00080000:3.0:1789429513.900116:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429513.903573:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8085:1876351648397312:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429513.903622:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 6 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429513.903649:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:2.0:1789429513.903765:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:44664:x1876351635098368:12345-192.168.203.39@tcp:101:dd.0 Request processed in 4256us (6410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429513.903776:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5824 00000100:00100000:0.0:1789429513.994889:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429513.995070:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635098496 00000100:00100000:3.0:1789429513.995084:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635098496 00010000:00010000:3.0:1789429513.995142:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361cf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c931 expref: 8 pid: 20745 timeout: 1311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429513.995192:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6228 00000100:00100000:3.0:1789429513.995247:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635098496:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429513.995266:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429513.995273:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361cf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c931 expref: 8 pid: 20745 timeout: 1311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429513.995288:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361cf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c931 expref: 8 pid: 20745 timeout: 1311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429513.995327:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361cf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c931 expref: 8 pid: 20745 timeout: 1311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429513.995473:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789429513.995478:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789429513.995488:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 5 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429513.995505:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 5 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429513.995563:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 5 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429513.995582:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01276a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648397440:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429513.997684:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f341a2780 going to sleep for 11 seconds 00000100:00100000:1.0:1789429514.005139:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429514.005416:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635098624 00000100:00100000:2.0:1789429514.005430:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01276a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648397440:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429514.005445:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635098624 00010000:00010000:2.0:1789429514.005474:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1789429514.005500:0:18945:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:3.0:1789429514.005507:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15186a00 with x1876351635098624 ext(0->18446744073709551615) 00002000:00010000:3.0:1789429514.005521:0:18945:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15186a00. 00000100:00100000:2.0:1789429514.005559:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635098496:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10355us (10684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429514.005571:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6228 00000100:00100000:3.0:1789429514.005576:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11570 00000100:00100000:3.0:1789429514.005589:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635098624:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:3.0:1789429514.015932:0:18945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789429514.015945:0:18945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 1789429512 -> 1789429514 00002000:00010000:3.0:1789429514.015950:0:18945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789429514.015952:0:18945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 1789429512 -> 1789429514 00002000:00010000:3.0:1789429514.015955:0:18945:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb blocks from disk: 1 -> 102407 00000100:00100000:3.0:1789429514.016151:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635098624:12345-192.168.203.39@tcp:10:dd.0 Request processed in 10558us (11032us total) trans 4294969327 rc 0/0 00000100:00100000:3.0:1789429514.016165:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11570 00002000:00010000:3.0:1789429514.016172:0:18945:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:3.0:1789429514.016177:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15186a00 with x1876351635098624 ext(0->18446744073709551615) 00002000:00010000:3.0:1789429514.016186:0:18945:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15186a00. 00000100:00100000:1.0:1789429514.037589:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429514.037710:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635098752 00000100:00100000:0.0:1789429514.037724:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635098752 00002000:00100000:0.0:1789429514.037794:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946e15184a80 x1876351635098752/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.037808:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184a80 with x1876351635098752 ext(0->1048575) 00002000:00010000:0.0:1789429514.037815:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15184a80 00000100:00100000:0.0:1789429514.037895:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11571 00000100:00100000:0.0:1789429514.037907:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635098752:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429514.103899:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2370:x1876351635098752:12345-192.168.203.39@tcp:4:dd.0 Request processed in 65976us (66308us total) trans 4294969328 rc 0/0 00000100:00100000:0.0:1789429514.103918:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11571 00002000:00100000:0.0:1789429514.103937:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946e15184a80 x1876351635098752/t4294969328(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.103949:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184a80 with x1876351635098752 ext(0->1048575) 00002000:00010000:0.0:1789429514.103957:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15184a80 00000001:00080000:1.0:1789429514.104039:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969328 is committed 00000100:00100000:1.0:1789429514.129797:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.129935:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635098880 00000100:00100000:2.0:1789429514.129951:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635098880 00002000:00100000:2.0:1789429514.130032:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946e15187100 x1876351635098880/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.130052:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15187100 with x1876351635098880 ext(1048576->2097151) 00002000:00010000:2.0:1789429514.130059:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15187100 00000100:00100000:2.0:1789429514.130105:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11572 00000100:00100000:2.0:1789429514.130118:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635098880:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.145426:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2369:x1876351635098880:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15294us (15633us total) trans 4294969329 rc 0/0 00000100:00100000:2.0:1789429514.145451:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11572 00002000:00100000:2.0:1789429514.145468:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946e15187100 x1876351635098880/t4294969329(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.145481:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15187100 with x1876351635098880 ext(1048576->2097151) 00002000:00010000:2.0:1789429514.145489:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15187100 00000100:00100000:1.0:1789429514.147476:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429514.147654:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635099008 00000100:00100000:0.0:1789429514.147667:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635099008 00002000:00100000:0.0:1789429514.147783:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946e15184700 x1876351635099008/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.147797:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184700 with x1876351635099008 ext(2097152->3145727) 00002000:00010000:0.0:1789429514.147804:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15184700 00000100:00100000:0.0:1789429514.147843:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11573 00000100:00100000:0.0:1789429514.147854:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351635099008:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.165843:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351635099008:12345-192.168.203.39@tcp:4:dd.0 Request processed in 17974us (18362us total) trans 4294969330 rc 0/0 00000100:00100000:2.0:1789429514.165861:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11573 00002000:00100000:2.0:1789429514.165878:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946e15184700 x1876351635099008/t4294969330(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.165889:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15184700 with x1876351635099008 ext(2097152->3145727) 00002000:00010000:2.0:1789429514.165898:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15184700 00000100:00100000:0.0:1789429514.178384:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.178624:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635099136 00000100:00100000:2.0:1789429514.179001:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635099136 00002000:00100000:2.0:1789429514.179069:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f3462e300 x1876351635099136/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.179088:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462e300 with x1876351635099136 ext(3145728->4194303) 00002000:00010000:2.0:1789429514.179095:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462e300 00000100:00100000:2.0:1789429514.179137:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11574 00000100:00100000:2.0:1789429514.179149:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351635099136:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.195647:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351635099136:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16484us (17264us total) trans 4294969331 rc 0/0 00000100:00100000:2.0:1789429514.195664:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11574 00002000:00100000:2.0:1789429514.195683:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f3462e300 x1876351635099136/t4294969331(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.195695:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462e300 with x1876351635099136 ext(3145728->4194303) 00002000:00010000:2.0:1789429514.195703:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462e300 00000100:00100000:1.0:1789429514.201175:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429514.201704:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635099264 00000100:00100000:0.0:1789429514.201718:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635099264 00002000:00100000:0.0:1789429514.201790:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946e15185500 x1876351635099264/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.201804:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185500 with x1876351635099264 ext(4194304->5242879) 00002000:00010000:0.0:1789429514.201812:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15185500 00000100:00100000:0.0:1789429514.201842:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11575 00000100:00100000:0.0:1789429514.201853:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351635099264:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429514.214726:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429514.217651:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351635099264:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15784us (16474us total) trans 4294969332 rc 0/0 00000100:00100000:1.0:1789429514.217671:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11575 00002000:00100000:1.0:1789429514.217691:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946e15185500 x1876351635099264/t4294969332(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429514.217704:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15185500 with x1876351635099264 ext(4194304->5242879) 00002000:00010000:1.0:1789429514.217712:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15185500 00000100:00100000:1.0:1789429514.217749:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635099392 00000100:00100000:1.0:1789429514.217758:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635099392 00002000:00100000:1.0:1789429514.217799:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946e15186300 x1876351635099392/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429514.217808:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15186300 with x1876351635099392 ext(5242880->6291455) 00002000:00010000:1.0:1789429514.217812:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15186300 00000100:00100000:2.0:1789429514.223015:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11576 00000100:00100000:2.0:1789429514.223061:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351635099392:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429514.250130:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.254867:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635099520 00000100:00100000:2.0:1789429514.254890:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635099520 00002000:00100000:2.0:1789429514.254961:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946e15fb9f80 x1876351635099520/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.254976:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb9f80 with x1876351635099520 ext(6291456->7340031) 00002000:00010000:2.0:1789429514.254984:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb9f80 00000100:00100000:2.0:1789429514.255036:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11577 00000100:00100000:2.0:1789429514.255048:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2369:x1876351635099520:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.257100:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351635099392:12345-192.168.203.39@tcp:4:dd.0 Request processed in 34046us (42377us total) trans 4294969333 rc 0/0 00000100:00100000:2.0:1789429514.257115:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11576 00002000:00100000:2.0:1789429514.257128:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946e15186300 x1876351635099392/t4294969333(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.257138:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15186300 with x1876351635099392 ext(5242880->6291455) 00002000:00010000:2.0:1789429514.257145:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15186300 00000100:00100000:3.0:1789429514.259688:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.259827:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635099648 00000100:00100000:2.0:1789429514.259841:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635099648 00002000:00100000:2.0:1789429514.259907:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946e01275c00 x1876351635099648/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.259919:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01275c00 with x1876351635099648 ext(7340032->8388607) 00002000:00010000:2.0:1789429514.259932:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01275c00 00000100:00100000:2.0:1789429514.259969:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11578 00000100:00100000:2.0:1789429514.259980:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2368:x1876351635099648:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.281622:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351635099520:12345-192.168.203.39@tcp:4:dd.0 Request processed in 26559us (31491us total) trans 4294969334 rc 0/0 00000100:00100000:2.0:1789429514.281640:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11577 00002000:00100000:2.0:1789429514.281657:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946e15fb9f80 x1876351635099520/t4294969334(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.281668:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb9f80 with x1876351635099520 ext(6291456->7340031) 00002000:00010000:2.0:1789429514.281676:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb9f80 00000100:00100000:1.0:1789429514.282866:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.283372:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635099776 00000100:00100000:2.0:1789429514.283384:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635099776 00002000:00100000:2.0:1789429514.283458:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946e15fb9500 x1876351635099776/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.283472:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb9500 with x1876351635099776 ext(8388608->9437183) 00002000:00010000:2.0:1789429514.283479:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb9500 00000100:00100000:2.0:1789429514.283520:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11579 00000100:00100000:2.0:1789429514.283533:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351635099776:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.286086:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635099648:12345-192.168.203.39@tcp:4:dd.0 Request processed in 26092us (26395us total) trans 4294969335 rc 0/0 00000100:00100000:2.0:1789429514.286101:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11578 00002000:00100000:2.0:1789429514.286116:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946e01275c00 x1876351635099648/t4294969335(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.286126:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01275c00 with x1876351635099648 ext(7340032->8388607) 00002000:00010000:2.0:1789429514.286133:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01275c00 00000100:00100000:1.0:1789429514.295859:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429514.296304:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635099904 00000100:00100000:0.0:1789429514.296317:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635099904 00002000:00100000:0.0:1789429514.296376:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946e15fb8380 x1876351635099904/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.296386:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb8380 with x1876351635099904 ext(9437184->10485759) 00002000:00010000:0.0:1789429514.296392:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb8380 00000100:00100000:0.0:1789429514.296423:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11580 00000100:00100000:0.0:1789429514.296442:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635099904:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.300987:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2369:x1876351635099776:12345-192.168.203.39@tcp:4:dd.0 Request processed in 17352us (18024us total) trans 4294969336 rc 0/0 00000100:00100000:2.0:1789429514.301006:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11579 00002000:00100000:2.0:1789429514.301024:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946e15fb9500 x1876351635099776/t4294969336(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.301036:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb9500 with x1876351635099776 ext(8388608->9437183) 00002000:00010000:2.0:1789429514.301046:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb9500 00000100:00100000:0.0:1789429514.306350:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2370:x1876351635099904:12345-192.168.203.39@tcp:4:dd.0 Request processed in 9902us (10491us total) trans 4294969337 rc 0/0 00000100:00100000:0.0:1789429514.306368:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11580 00002000:00100000:0.0:1789429514.306384:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946e15fb8380 x1876351635099904/t4294969337(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.306395:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb8380 with x1876351635099904 ext(9437184->10485759) 00002000:00010000:0.0:1789429514.306402:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb8380 00000100:00100000:1.0:1789429514.323469:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.324040:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635100032 00000100:00100000:2.0:1789429514.324053:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635100032 00002000:00100000:2.0:1789429514.324123:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946e15fbb100 x1876351635100032/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.324144:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbb100 with x1876351635100032 ext(10485760->11534335) 00002000:00010000:2.0:1789429514.324151:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbb100 00000100:00100000:2.0:1789429514.324194:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11581 00000100:00100000:2.0:1789429514.324247:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2371:x1876351635100032:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429514.337856:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351635100032:12345-192.168.203.39@tcp:4:dd.0 Request processed in 13594us (14383us total) trans 4294969338 rc 0/0 00000100:00100000:3.0:1789429514.337875:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11581 00002000:00100000:3.0:1789429514.337892:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946e15fbb100 x1876351635100032/t4294969338(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429514.337903:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbb100 with x1876351635100032 ext(10485760->11534335) 00002000:00010000:3.0:1789429514.337911:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbb100 00000100:00100000:0.0:1789429514.356586:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.357034:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635100160 00000100:00100000:2.0:1789429514.357048:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635100160 00002000:00100000:2.0:1789429514.357117:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946f3462c380 x1876351635100160/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.357131:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462c380 with x1876351635100160 ext(11534336->12582911) 00002000:00010000:2.0:1789429514.357139:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462c380 00000100:00100000:2.0:1789429514.357178:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11582 00000100:00100000:2.0:1789429514.357189:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:2371:x1876351635100160:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429514.368916:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2371:x1876351635100160:12345-192.168.203.39@tcp:4:dd.0 Request processed in 11710us (12327us total) trans 4294969339 rc 0/0 00000100:00100000:0.0:1789429514.369005:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11582 00002000:00100000:0.0:1789429514.369024:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946f3462c380 x1876351635100160/t4294969339(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.369037:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462c380 with x1876351635100160 ext(11534336->12582911) 00002000:00010000:0.0:1789429514.369046:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462c380 00000100:00100000:1.0:1789429514.385873:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.387290:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635100288 00000100:00100000:2.0:1789429514.387307:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635100288 00002000:00100000:2.0:1789429514.387377:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946e15fba300 x1876351635100288/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.387389:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fba300 with x1876351635100288 ext(12582912->13631487) 00002000:00010000:2.0:1789429514.387396:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fba300 00000100:00100000:2.0:1789429514.387447:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11583 00000100:00100000:2.0:1789429514.387457:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:2368:x1876351635100288:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.400282:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2368:x1876351635100288:12345-192.168.203.39@tcp:4:dd.0 Request processed in 12797us (14394us total) trans 4294969340 rc 0/0 00000100:00100000:2.0:1789429514.400307:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11583 00002000:00100000:2.0:1789429514.400325:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946e15fba300 x1876351635100288/t4294969340(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.400339:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fba300 with x1876351635100288 ext(12582912->13631487) 00002000:00010000:2.0:1789429514.400348:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fba300 00000100:00100000:1.0:1789429514.410742:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.410891:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635100416 00000100:00100000:2.0:1789429514.410907:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635100416 00002000:00100000:2.0:1789429514.410983:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946e15fb8e00 x1876351635100416/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.410995:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb8e00 with x1876351635100416 ext(13631488->14680063) 00002000:00010000:2.0:1789429514.411002:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb8e00 00000100:00100000:2.0:1789429514.411040:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11584 00000100:00100000:2.0:1789429514.411051:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:2370:x1876351635100416:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.433480:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+32:2370:x1876351635100416:12345-192.168.203.39@tcp:4:dd.0 Request processed in 22414us (22738us total) trans 4294969341 rc 0/0 00000100:00100000:2.0:1789429514.433497:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11584 00002000:00100000:2.0:1789429514.433514:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946e15fb8e00 x1876351635100416/t4294969341(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.433526:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb8e00 with x1876351635100416 ext(13631488->14680063) 00002000:00010000:2.0:1789429514.433533:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb8e00 00000100:00100000:2.0:1789429514.445393:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429514.448689:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635100544 00000100:00100000:3.0:1789429514.448710:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635100544 00002000:00100000:2.0:1789429514.451647:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f3f1c5880 x1876351635100544/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.451674:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5880 with x1876351635100544 ext(14680064->15728639) 00002000:00010000:2.0:1789429514.451683:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c5880 00000100:00100000:2.0:1789429514.451800:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11585 00000100:00100000:2.0:1789429514.451812:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+32:2371:x1876351635100544:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429514.463831:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.463942:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635100672 00000100:00100000:2.0:1789429514.463956:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635100672 00002000:00100000:2.0:1789429514.464025:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f3462ed80 x1876351635100672/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.464040:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462ed80 with x1876351635100672 ext(15728640->16777215) 00002000:00010000:2.0:1789429514.464047:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462ed80 00000100:00100000:2.0:1789429514.464122:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11586 00000100:00100000:2.0:1789429514.464134:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+34:2370:x1876351635100672:12345-192.168.203.39@tcp:4:dd.0 00010000:00010000:3.0:1789429514.468036:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429514.475695:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.475914:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635100800 00000100:00100000:2.0:1789429514.475927:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635100800 00002000:00100000:2.0:1789429514.476009:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946f3462ea00 x1876351635100800/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.476023:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462ea00 with x1876351635100800 ext(16777216->17825791) 00002000:00010000:2.0:1789429514.476030:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462ea00 00000100:00100000:2.0:1789429514.476063:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11587 00000100:00100000:2.0:1789429514.476075:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+36:2371:x1876351635100800:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.491659:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+38:2371:x1876351635100544:12345-192.168.203.39@tcp:4:dd.0 Request processed in 39831us (46265us total) trans 4294969342 rc 0/0 00000100:00100000:2.0:1789429514.491682:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11585 00002000:00100000:2.0:1789429514.491702:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f3f1c5880 x1876351635100544/t4294969342(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.491714:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c5880 with x1876351635100544 ext(14680064->15728639) 00002000:00010000:2.0:1789429514.491722:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c5880 00000100:00100000:2.0:1789429514.506154:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+38:2370:x1876351635100672:12345-192.168.203.39@tcp:4:dd.0 Request processed in 42005us (42320us total) trans 4294969343 rc 0/0 00000100:00100000:2.0:1789429514.506172:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11586 00002000:00100000:2.0:1789429514.506190:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f3462ed80 x1876351635100672/t4294969343(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.506239:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462ed80 with x1876351635100672 ext(15728640->16777215) 00002000:00010000:2.0:1789429514.506248:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462ed80 00000100:00100000:2.0:1789429514.519533:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+38:2371:x1876351635100800:12345-192.168.203.39@tcp:4:dd.0 Request processed in 43444us (43840us total) trans 4294969344 rc 0/0 00000100:00100000:2.0:1789429514.519551:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11587 00002000:00100000:2.0:1789429514.519569:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946f3462ea00 x1876351635100800/t4294969344(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.519580:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3462ea00 with x1876351635100800 ext(16777216->17825791) 00002000:00010000:2.0:1789429514.519587:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3462ea00 00000100:00100000:1.0:1789429514.525182:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.526516:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635100928 00000100:00100000:2.0:1789429514.526535:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635100928 00002000:00100000:2.0:1789429514.526611:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946e15fbaa00 x1876351635100928/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.526632:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbaa00 with x1876351635100928 ext(17825792->18874367) 00002000:00010000:2.0:1789429514.526640:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbaa00 00000100:00100000:2.0:1789429514.526688:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11588 00000100:00100000:2.0:1789429514.526699:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+38:2370:x1876351635100928:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.553734:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429514.556107:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635101056 00000100:00100000:2.0:1789429514.556314:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+40:2370:x1876351635100928:12345-192.168.203.39@tcp:4:dd.0 Request processed in 29601us (31130us total) trans 4294969345 rc 0/0 00000100:00100000:2.0:1789429514.556341:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11588 00002000:00100000:2.0:1789429514.556368:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946e15fbaa00 x1876351635100928/t4294969345(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.556379:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbaa00 with x1876351635100928 ext(17825792->18874367) 00002000:00010000:2.0:1789429514.556387:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbaa00 00000100:00100000:0.0:1789429514.556517:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635101056 00002000:00100000:2.0:1789429514.556665:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946f3f1c6d80 x1876351635101056/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.556675:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c6d80 with x1876351635101056 ext(18874368->19922943) 00002000:00010000:2.0:1789429514.556679:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c6d80 00000100:00100000:2.0:1789429514.556763:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11589 00000100:00100000:2.0:1789429514.556774:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+40:2371:x1876351635101056:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.570971:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+42:2371:x1876351635101056:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14182us (17238us total) trans 4294969346 rc 0/0 00000100:00100000:2.0:1789429514.570988:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11589 00002000:00100000:2.0:1789429514.571005:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946f3f1c6d80 x1876351635101056/t4294969346(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.571017:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c6d80 with x1876351635101056 ext(18874368->19922943) 00002000:00010000:2.0:1789429514.571026:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c6d80 00000100:00100000:1.0:1789429514.585134:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429514.585819:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635101184 00000100:00100000:0.0:1789429514.585835:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635101184 00002000:00100000:0.0:1789429514.585904:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946e15fb8700 x1876351635101184/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.585917:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb8700 with x1876351635101184 ext(19922944->20971519) 00002000:00010000:0.0:1789429514.585984:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb8700 00000100:00100000:0.0:1789429514.586027:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11590 00000100:00100000:0.0:1789429514.586038:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+42:2371:x1876351635101184:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429514.586518:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.586821:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635101312 00000100:00100000:2.0:1789429514.586828:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635101312 00002000:00100000:2.0:1789429514.586855:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946e01275500 x1876351635101312/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.586862:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01275500 with x1876351635101312 ext(20971520->22020095) 00002000:00010000:2.0:1789429514.586866:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01275500 00000100:00100000:2.0:1789429514.586888:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11591 00000100:00100000:2.0:1789429514.586896:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+44:2371:x1876351635101312:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.609337:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+47:2371:x1876351635101312:12345-192.168.203.39@tcp:4:dd.0 Request processed in 22428us (22808us total) trans 4294969347 rc 0/0 00000100:00100000:2.0:1789429514.609354:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11591 00002000:00100000:2.0:1789429514.609369:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946e01275500 x1876351635101312/t4294969347(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.609380:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01275500 with x1876351635101312 ext(20971520->22020095) 00002000:00010000:2.0:1789429514.609387:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01275500 00000100:00100000:0.0:1789429514.614997:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+46:2371:x1876351635101184:12345-192.168.203.39@tcp:4:dd.0 Request processed in 28937us (29857us total) trans 4294969348 rc 0/0 00000100:00100000:0.0:1789429514.615020:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11590 00002000:00100000:0.0:1789429514.615040:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946e15fb8700 x1876351635101184/t4294969348(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.615053:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb8700 with x1876351635101184 ext(19922944->20971519) 00002000:00010000:0.0:1789429514.615062:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb8700 00000100:00100000:1.0:1789429514.616133:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429514.616183:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635101440 00000100:00100000:1.0:1789429514.616194:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635101440 00002000:00100000:1.0:1789429514.616271:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946e15fbbb80 x1876351635101440/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429514.616308:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbbb80 with x1876351635101440 ext(22020096->23068671) 00002000:00010000:1.0:1789429514.616314:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbbb80 00000100:00100000:1.0:1789429514.616352:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11592 00000100:00100000:1.0:1789429514.616367:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+46:2369:x1876351635101440:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.642169:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429514.642277:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635101568 00000100:00100000:3.0:1789429514.642287:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635101568 00002000:00100000:3.0:1789429514.642338:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946f3f1c6300 x1876351635101568/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429514.642350:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c6300 with x1876351635101568 ext(23068672->24117247) 00002000:00010000:3.0:1789429514.642356:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c6300 00000100:00100000:3.0:1789429514.642386:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11593 00000100:00100000:3.0:1789429514.642396:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+48:2368:x1876351635101568:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.650663:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429514.650819:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635101696 00000100:00100000:1.0:1789429514.650830:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635101696 00002000:00100000:1.0:1789429514.650881:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946f34079880 x1876351635101696/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429514.650892:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34079880 with x1876351635101696 ext(24117248->25165823) 00002000:00010000:1.0:1789429514.650899:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34079880 00000100:00100000:1.0:1789429514.650932:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11594 00000100:00100000:1.0:1789429514.650942:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+50:2369:x1876351635101696:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.664389:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429514.664611:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635101824 00000100:00100000:1.0:1789429514.664626:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635101824 00002000:00100000:1.0:1789429514.664696:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f34079180 x1876351635101824/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429514.664710:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34079180 with x1876351635101824 ext(25165824->26214399) 00002000:00010000:1.0:1789429514.664718:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34079180 00000100:00100000:1.0:1789429514.664761:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11595 00000100:00100000:1.0:1789429514.664773:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+52:2370:x1876351635101824:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429514.686499:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429514.691607:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429514.705335:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635101952 00000100:00100000:0.0:1789429514.705357:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635101952 00002000:00100000:0.0:1789429514.705429:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946e15fb8000 x1876351635101952/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.705452:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb8000 with x1876351635101952 ext(26214400->27262975) 00002000:00010000:0.0:1789429514.705460:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb8000 00000100:00100000:0.0:1789429514.705616:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635102080 00000100:00100000:0.0:1789429514.705621:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635102080 00002000:00100000:0.0:1789429514.705640:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946e15fb8a80 x1876351635102080/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.705649:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb8a80 with x1876351635102080 ext(27262976->28311551) 00002000:00010000:0.0:1789429514.705652:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb8a80 00000100:00100000:3.0:1789429514.705665:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11596 00000100:00100000:0.0:1789429514.705678:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11597 00000100:00100000:3.0:1789429514.705685:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+55:2370:x1876351635101952:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429514.705692:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+55:2370:x1876351635102080:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429514.706969:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+57:2369:x1876351635101440:12345-192.168.203.39@tcp:4:dd.0 Request processed in 90598us (90833us total) trans 4294969349 rc 0/0 00000100:00100000:0.0:1789429514.706984:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11592 00002000:00100000:0.0:1789429514.706994:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946e15fbbb80 x1876351635101440/t4294969349(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.707005:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbbb80 with x1876351635101440 ext(22020096->23068671) 00002000:00010000:0.0:1789429514.707016:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbbb80 00000100:00100000:3.0:1789429514.717192:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+58:2368:x1876351635101568:12345-192.168.203.39@tcp:4:dd.0 Request processed in 74780us (75015us total) trans 4294969350 rc 0/0 00000100:00100000:3.0:1789429514.717242:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11593 00002000:00100000:3.0:1789429514.717259:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946f3f1c6300 x1876351635101568/t4294969350(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429514.717271:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c6300 with x1876351635101568 ext(23068672->24117247) 00002000:00010000:3.0:1789429514.717280:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c6300 00000100:00100000:3.0:1789429514.729232:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+58:2369:x1876351635101696:12345-192.168.203.39@tcp:4:dd.0 Request processed in 78245us (78531us total) trans 4294969351 rc 0/0 00000100:00100000:3.0:1789429514.729250:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11594 00002000:00100000:3.0:1789429514.729266:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946f34079880 x1876351635101696/t4294969351(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429514.729277:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34079880 with x1876351635101696 ext(24117248->25165823) 00002000:00010000:3.0:1789429514.729285:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34079880 00000100:00100000:3.0:1789429514.733350:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34079180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+58:2370:x1876351635101824:12345-192.168.203.39@tcp:4:dd.0 Request processed in 68560us (68955us total) trans 4294969352 rc 0/0 00000100:00100000:3.0:1789429514.733366:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11595 00002000:00100000:3.0:1789429514.733384:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f34079180 x1876351635101824/t4294969352(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429514.733396:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34079180 with x1876351635101824 ext(25165824->26214399) 00002000:00010000:3.0:1789429514.733403:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34079180 00000100:00100000:0.0:1789429514.736789:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+58:2370:x1876351635102080:12345-192.168.203.39@tcp:4:dd.0 Request processed in 31091us (45187us total) trans 4294969353 rc 0/0 00000100:00100000:0.0:1789429514.736810:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11597 00002000:00100000:0.0:1789429514.736831:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946e15fb8a80 x1876351635102080/t4294969353(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.737045:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb8a80 with x1876351635102080 ext(27262976->28311551) 00002000:00010000:0.0:1789429514.737056:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb8a80 00000100:00100000:2.0:1789429514.737463:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429514.737752:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635102208 00000100:00100000:1.0:1789429514.737764:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635102208 00002000:00100000:1.0:1789429514.737815:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946f1c34b480 x1876351635102208/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429514.737826:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c34b480 with x1876351635102208 ext(28311552->29360127) 00002000:00010000:1.0:1789429514.737830:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c34b480 00000100:00100000:1.0:1789429514.737905:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11598 00000100:00100000:1.0:1789429514.737916:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c34b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+58:2371:x1876351635102208:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429514.739372:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+60:2370:x1876351635101952:12345-192.168.203.39@tcp:4:dd.0 Request processed in 33684us (52878us total) trans 4294969354 rc 0/0 00000100:00100000:0.0:1789429514.739385:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11596 00002000:00100000:0.0:1789429514.739398:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946e15fb8000 x1876351635101952/t4294969354(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.739409:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb8000 with x1876351635101952 ext(26214400->27262975) 00002000:00010000:0.0:1789429514.739416:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb8000 00000100:00100000:3.0:1789429514.762642:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.762725:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635102336 00000100:00100000:2.0:1789429514.762738:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635102336 00002000:00100000:2.0:1789429514.762803:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e01276a00 x1876351635102336/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.762817:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01276a00 with x1876351635102336 ext(29360128->30408703) 00002000:00010000:2.0:1789429514.762824:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01276a00 00000100:00100000:2.0:1789429514.762863:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11599 00000100:00100000:2.0:1789429514.762874:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+60:2370:x1876351635102336:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429514.774855:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c34b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+62:2371:x1876351635102208:12345-192.168.203.39@tcp:4:dd.0 Request processed in 36927us (38912us total) trans 4294969355 rc 0/0 00000100:00100000:0.0:1789429514.774870:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11598 00002000:00100000:0.0:1789429514.774885:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946f1c34b480 x1876351635102208/t4294969355(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.774897:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c34b480 with x1876351635102208 ext(28311552->29360127) 00002000:00010000:0.0:1789429514.774905:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c34b480 00000100:00100000:2.0:1789429514.778619:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+62:2370:x1876351635102336:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15730us (15975us total) trans 4294969356 rc 0/0 00000100:00100000:2.0:1789429514.778638:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11599 00002000:00100000:2.0:1789429514.778655:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e01276a00 x1876351635102336/t4294969356(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.778667:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01276a00 with x1876351635102336 ext(29360128->30408703) 00002000:00010000:2.0:1789429514.778676:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01276a00 00000100:00100000:3.0:1789429514.785853:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429514.787042:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635102464 00000100:00100000:1.0:1789429514.787059:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635102464 00002000:00100000:0.0:1789429514.787272:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946f087bd500 x1876351635102464/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.787287:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bd500 with x1876351635102464 ext(30408704->31457279) 00002000:00010000:0.0:1789429514.787295:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bd500 00000100:00100000:0.0:1789429514.787329:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11600 00000100:00100000:0.0:1789429514.787341:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+62:2368:x1876351635102464:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.796453:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+64:2368:x1876351635102464:12345-192.168.203.39@tcp:4:dd.0 Request processed in 9088us (10591us total) trans 4294969357 rc 0/0 00000100:00100000:2.0:1789429514.796473:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11600 00002000:00100000:2.0:1789429514.796492:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946f087bd500 x1876351635102464/t4294969357(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.796504:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bd500 with x1876351635102464 ext(30408704->31457279) 00002000:00010000:2.0:1789429514.796512:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bd500 00000100:00100000:1.0:1789429514.809044:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.809137:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635102592 00000100:00100000:2.0:1789429514.809152:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635102592 00002000:00100000:2.0:1789429514.809227:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946e15fb9180 x1876351635102592/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.809243:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb9180 with x1876351635102592 ext(31457280->32505855) 00002000:00010000:2.0:1789429514.809249:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb9180 00000100:00100000:2.0:1789429514.809285:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11601 00000100:00100000:2.0:1789429514.809295:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+64:2371:x1876351635102592:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429514.829738:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429514.829790:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635102720 00000100:00100000:3.0:1789429514.829844:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635102720 00002000:00100000:3.0:1789429514.829910:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946f087bc380 x1876351635102720/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789429514.832706:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+67:2371:x1876351635102592:12345-192.168.203.39@tcp:4:dd.0 Request processed in 23396us (23660us total) trans 4294969358 rc 0/0 00000100:00100000:2.0:1789429514.832724:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11601 00002000:00100000:2.0:1789429514.832746:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946e15fb9180 x1876351635102592/t4294969358(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.832758:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb9180 with x1876351635102592 ext(31457280->32505855) 00002000:00010000:2.0:1789429514.832766:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb9180 00002000:00100000:3.0:1789429514.834291:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bc380 with x1876351635102720 ext(32505856->33554431) 00002000:00010000:3.0:1789429514.834302:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bc380 00000100:00100000:0.0:1789429514.835306:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11602 00000100:00100000:0.0:1789429514.835334:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+66:2370:x1876351635102720:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429514.850073:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.852295:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635102848 00000100:00100000:2.0:1789429514.852316:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635102848 00002000:00100000:2.0:1789429514.852531:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946e15fba680 x1876351635102848/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.852544:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fba680 with x1876351635102848 ext(33554432->34603007) 00002000:00010000:2.0:1789429514.852552:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fba680 00000100:00100000:2.0:1789429514.852586:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11603 00000100:00100000:2.0:1789429514.852598:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+68:2370:x1876351635102848:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429514.855047:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+70:2370:x1876351635102720:12345-192.168.203.39@tcp:4:dd.0 Request processed in 19715us (25310us total) trans 4294969359 rc 0/0 00000100:00100000:0.0:1789429514.855062:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11602 00002000:00100000:0.0:1789429514.855076:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946f087bc380 x1876351635102720/t4294969359(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.855087:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bc380 with x1876351635102720 ext(32505856->33554431) 00002000:00010000:0.0:1789429514.855096:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bc380 00000100:00100000:2.0:1789429514.862837:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+70:2370:x1876351635102848:12345-192.168.203.39@tcp:4:dd.0 Request processed in 10227us (12766us total) trans 4294969360 rc 0/0 00000100:00100000:2.0:1789429514.862852:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11603 00002000:00100000:2.0:1789429514.862869:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946e15fba680 x1876351635102848/t4294969360(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.862880:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fba680 with x1876351635102848 ext(33554432->34603007) 00002000:00010000:2.0:1789429514.862888:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fba680 00000100:00100000:1.0:1789429514.875752:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429514.876374:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635102976 00000100:00100000:3.0:1789429514.876388:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635102976 00002000:00100000:3.0:1789429514.876479:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946e15fb9c00 x1876351635102976/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429514.876493:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb9c00 with x1876351635102976 ext(34603008->35651583) 00002000:00010000:3.0:1789429514.876499:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb9c00 00000100:00100000:3.0:1789429514.876548:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11604 00000100:00100000:3.0:1789429514.876559:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+70:2369:x1876351635102976:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429514.950669:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429514.950714:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429514.950741:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429514.950776:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429514.950851:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635103104 00000100:00100000:2.0:1789429514.950865:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635103104 00002000:00100000:2.0:1789429514.950931:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e15fb9880 x1876351635103104/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.950946:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb9880 with x1876351635103104 ext(35651584->36700159) 00002000:00010000:2.0:1789429514.950953:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb9880 00000100:00100000:2.0:1789429514.950987:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635103360 00000100:00100000:2.0:1789429514.950991:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635103360 00002000:00100000:2.0:1789429514.951007:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946e15fbb800 x1876351635103360/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.951016:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbb800 with x1876351635103360 ext(37748736->38797311) 00002000:00010000:2.0:1789429514.951019:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbb800 00000100:00100000:2.0:1789429514.951033:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635103232 00000100:00100000:2.0:1789429514.951036:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635103232 00002000:00100000:2.0:1789429514.951049:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946e15fbad80 x1876351635103232/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.951058:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbad80 with x1876351635103232 ext(36700160->37748735) 00002000:00010000:2.0:1789429514.951061:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbad80 00000100:00100000:2.0:1789429514.951074:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635103488 00000100:00100000:2.0:1789429514.951077:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635103488 00002000:00100000:2.0:1789429514.951091:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946e15fbb480 x1876351635103488/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.951107:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbb480 with x1876351635103488 ext(38797312->39845887) 00002000:00010000:2.0:1789429514.951110:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbb480 00000100:00100000:2.0:1789429514.951128:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11605 00000100:00100000:2.0:1789429514.951139:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+75:2368:x1876351635103104:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429514.951363:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11606 00000100:00100000:3.0:1789429514.951374:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+76:2368:x1876351635103360:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.951415:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11607 00000100:00100000:2.0:1789429514.951423:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+76:2368:x1876351635103232:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.951537:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11608 00000100:00100000:2.0:1789429514.951634:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+78:2368:x1876351635103488:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.955404:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429514.955516:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635103616 00000100:00100000:1.0:1789429514.955530:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635103616 00002000:00100000:1.0:1789429514.955593:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946f0822b100 x1876351635103616/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429514.955605:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0822b100 with x1876351635103616 ext(39845888->40894463) 00002000:00010000:1.0:1789429514.955613:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0822b100 00000100:00100000:1.0:1789429514.955650:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11609 00000100:00100000:1.0:1789429514.955662:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+80:2371:x1876351635103616:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.971642:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429514.971771:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635103744 00000100:00100000:0.0:1789429514.971785:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635103744 00002000:00100000:0.0:1789429514.971849:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946f2f509880 x1876351635103744/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.971862:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f509880 with x1876351635103744 ext(40894464->41943039) 00002000:00010000:0.0:1789429514.971872:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f509880 00000100:00100000:0.0:1789429514.971914:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11610 00000100:00100000:0.0:1789429514.971927:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+82:2371:x1876351635103744:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429514.979049:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+84:2369:x1876351635102976:12345-192.168.203.39@tcp:4:dd.0 Request processed in 102470us (103290us total) trans 4294969361 rc 0/0 00000100:00100000:0.0:1789429514.979066:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11604 00002000:00100000:0.0:1789429514.979083:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946e15fb9c00 x1876351635102976/t4294969361(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.979096:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb9c00 with x1876351635102976 ext(34603008->35651583) 00002000:00010000:0.0:1789429514.979104:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb9c00 00000100:00100000:2.0:1789429514.983101:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+84:2368:x1876351635103104:12345-192.168.203.39@tcp:4:dd.0 Request processed in 31949us (32432us total) trans 4294969362 rc 0/0 00000100:00100000:2.0:1789429514.983118:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11605 00002000:00100000:2.0:1789429514.983133:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e15fb9880 x1876351635103104/t4294969362(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.983144:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fb9880 with x1876351635103104 ext(35651584->36700159) 00002000:00010000:2.0:1789429514.983152:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fb9880 00000100:00100000:1.0:1789429514.987516:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429514.987627:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635103872 00000100:00100000:0.0:1789429514.987639:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635103872 00002000:00100000:0.0:1789429514.987716:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946f09629880 x1876351635103872/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/0 e 0 to 0 dl 1789429525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429514.987731:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f09629880 with x1876351635103872 ext(41943040->42991615) 00002000:00010000:0.0:1789429514.987738:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f09629880 00000100:00100000:0.0:1789429514.987780:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11611 00000100:00100000:0.0:1789429514.987792:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+84:2371:x1876351635103872:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429514.999393:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+86:2368:x1876351635103360:12345-192.168.203.39@tcp:4:dd.0 Request processed in 48004us (48660us total) trans 4294969363 rc 0/0 00000100:00100000:2.0:1789429514.999411:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11606 00002000:00100000:2.0:1789429514.999437:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946e15fbb800 x1876351635103360/t4294969363(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429514.999455:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbb800 with x1876351635103360 ext(37748736->38797311) 00002000:00010000:2.0:1789429514.999463:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbb800 00000100:00100000:2.0:1789429515.007994:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+86:2368:x1876351635103232:12345-192.168.203.39@tcp:4:dd.0 Request processed in 56553us (57233us total) trans 4294969364 rc 0/0 00000100:00100000:2.0:1789429515.008012:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11607 00002000:00100000:2.0:1789429515.008029:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946e15fbad80 x1876351635103232/t4294969364(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429515.008042:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbad80 with x1876351635103232 ext(36700160->37748735) 00002000:00010000:2.0:1789429515.008051:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbad80 00000100:00100000:2.0:1789429515.012954:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15fbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+86:2368:x1876351635103488:12345-192.168.203.39@tcp:4:dd.0 Request processed in 61392us (62159us total) trans 4294969365 rc 0/0 00000100:00100000:2.0:1789429515.012973:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11608 00002000:00100000:2.0:1789429515.012990:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946e15fbb480 x1876351635103488/t4294969365(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429515.013003:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15fbb480 with x1876351635103488 ext(38797312->39845887) 00002000:00010000:2.0:1789429515.013012:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15fbb480 00000100:00100000:2.0:1789429515.020876:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0822b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+86:2371:x1876351635103616:12345-192.168.203.39@tcp:4:dd.0 Request processed in 65197us (65469us total) trans 4294969366 rc 0/0 00000100:00100000:2.0:1789429515.020896:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11609 00002000:00100000:2.0:1789429515.020913:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946f0822b100 x1876351635103616/t4294969366(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429515.020926:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0822b100 with x1876351635103616 ext(39845888->40894463) 00002000:00010000:2.0:1789429515.020936:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0822b100 00000100:00100000:1.0:1789429515.030038:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429515.031741:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+86:2371:x1876351635103744:12345-192.168.203.39@tcp:4:dd.0 Request processed in 59806us (60103us total) trans 4294969367 rc 0/0 00000100:00100000:0.0:1789429515.031758:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11610 00002000:00100000:0.0:1789429515.031776:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946f2f509880 x1876351635103744/t4294969367(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429515.031796:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f509880 with x1876351635103744 ext(40894464->41943039) 00002000:00010000:0.0:1789429515.031804:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f509880 00000100:00100000:0.0:1789429515.031838:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635104000 00000100:00100000:0.0:1789429515.031846:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635104000 00002000:00100000:0.0:1789429515.031894:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946f0962b800 x1876351635104000/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/0 e 0 to 0 dl 1789429526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429515.031903:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0962b800 with x1876351635104000 ext(42991616->44040191) 00002000:00010000:0.0:1789429515.031906:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0962b800 00000100:00100000:0.0:1789429515.031932:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11612 00000100:00100000:0.0:1789429515.031942:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+86:2369:x1876351635104000:12345-192.168.203.39@tcp:4:dd.0 00000100:00080000:3.0:1789429515.032695:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429515.056145:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+88:2371:x1876351635103872:12345-192.168.203.39@tcp:4:dd.0 Request processed in 68336us (68626us total) trans 4294969368 rc 0/0 00000100:00100000:0.0:1789429515.056165:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11611 00002000:00100000:0.0:1789429515.056183:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946f09629880 x1876351635103872/t4294969368(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:250/0 lens 488/448 e 0 to 0 dl 1789429525 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429515.056196:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f09629880 with x1876351635103872 ext(41943040->42991615) 00002000:00010000:0.0:1789429515.056240:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f09629880 00000100:00100000:2.0:1789429515.072878:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429515.073148:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429515.073234:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429515.073270:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635104512 00000100:00100000:2.0:1789429515.073283:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635104512 00000100:00100000:2.0:1789429515.073359:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 952 00000100:00100000:2.0:1789429515.073372:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635104512:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429515.073473:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635104512:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 103us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429515.073482:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 952 00000100:00100000:2.0:1789429515.073529:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429515.073612:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429515.073632:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429515.073655:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429515.073676:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429515.073709:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429515.073731:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635104128 00000100:00100000:2.0:1789429515.073736:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635104128 00002000:00100000:2.0:1789429515.073773:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946f2f50b480 x1876351635104128/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/0 e 0 to 0 dl 1789429526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429515.073785:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f50b480 with x1876351635104128 ext(44040192->45088767) 00002000:00010000:2.0:1789429515.073792:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f50b480 00000100:00100000:2.0:1789429515.073807:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635105024 00000100:00100000:2.0:1789429515.073810:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635105024 00002000:00100000:2.0:1789429515.073825:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946e0d981180 x1876351635105024/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/0 e 0 to 0 dl 1789429526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429515.073841:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d981180 with x1876351635105024 ext(45088768->46137343) 00002000:00010000:2.0:1789429515.073844:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d981180 00000100:00100000:2.0:1789429515.073857:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635105152 00000100:00100000:2.0:1789429515.073860:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635105152 00002000:00100000:2.0:1789429515.073874:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e0d982680 x1876351635105152/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/0 e 0 to 0 dl 1789429526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429515.073883:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d982680 with x1876351635105152 ext(46137344->47185919) 00002000:00010000:2.0:1789429515.073887:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d982680 00000100:00100000:2.0:1789429515.073900:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11613 00000100:00100000:2.0:1789429515.073907:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+90:2371:x1876351635104128:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429515.074262:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11614 00000100:00100000:0.0:1789429515.074273:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+91:2370:x1876351635105024:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429515.074387:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635104768 00000100:00100000:0.0:1789429515.074392:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635104768 00000100:00100000:0.0:1789429515.074445:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635104384 00000100:00100000:0.0:1789429515.074449:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635104384 00000100:00100000:0.0:1789429515.074478:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 905 00000100:00100000:0.0:1789429515.074484:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2369:x1876351635104768:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429515.074538:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2369:x1876351635104768:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 53us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429515.074546:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 905 00000100:00100000:0.0:1789429515.074563:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 906 00000100:00100000:0.0:1789429515.074570:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+33:2369:x1876351635104384:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429515.074603:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+33:2369:x1876351635104384:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 34us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429515.074608:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 906 00000100:00100000:0.0:1789429515.074626:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635104640 00000100:00100000:0.0:1789429515.074630:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635104640 00000100:00100000:0.0:1789429515.074652:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635104896 00000100:00100000:0.0:1789429515.074654:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635104896 00000100:00100000:0.0:1789429515.074675:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 953 00000100:00100000:0.0:1789429515.074681:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+8:2369:x1876351635104640:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429515.074708:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+8:2369:x1876351635104640:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429515.074713:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 953 00000100:00100000:0.0:1789429515.074724:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 954 00000100:00100000:0.0:1789429515.074730:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c08fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635104896:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429515.074752:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c08fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635104896:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429515.074758:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 954 00000100:00100000:0.0:1789429515.074983:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11615 00000100:00100000:0.0:1789429515.074999:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+92:2370:x1876351635105152:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429515.075469:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635104256 00000100:00100000:3.0:1789429515.075476:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635104256 00000100:00100000:3.0:1789429515.075522:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 611 00000100:00100000:3.0:1789429515.075529:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635104256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429515.075570:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635104256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 42us (2423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429515.075577:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 611 00000100:00080000:3.0:1789429515.075601:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429515.075608:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429515.075611:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429515.090129:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+94:2369:x1876351635104000:12345-192.168.203.39@tcp:4:dd.0 Request processed in 58171us (60088us total) trans 4294969369 rc 0/0 00000100:00100000:0.0:1789429515.090146:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11612 00002000:00100000:0.0:1789429515.090162:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946f0962b800 x1876351635104000/t4294969369(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/448 e 0 to 0 dl 1789429526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429515.090174:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0962b800 with x1876351635104000 ext(42991616->44040191) 00002000:00010000:0.0:1789429515.090182:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0962b800 00000100:00100000:2.0:1789429515.092456:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+94:2371:x1876351635104128:12345-192.168.203.39@tcp:4:dd.0 Request processed in 18533us (19577us total) trans 4294969370 rc 0/0 00000100:00100000:2.0:1789429515.092472:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11613 00002000:00100000:2.0:1789429515.092486:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946f2f50b480 x1876351635104128/t4294969370(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/448 e 0 to 0 dl 1789429526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429515.092498:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f50b480 with x1876351635104128 ext(44040192->45088767) 00002000:00010000:2.0:1789429515.092505:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f50b480 00000100:00100000:3.0:1789429515.101633:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429515.102932:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+94:2370:x1876351635105024:12345-192.168.203.39@tcp:4:dd.0 Request processed in 28649us (29241us total) trans 4294969371 rc 0/0 00000100:00100000:0.0:1789429515.102951:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11614 00002000:00100000:0.0:1789429515.102970:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946e0d981180 x1876351635105024/t4294969371(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/448 e 0 to 0 dl 1789429526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429515.102983:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d981180 with x1876351635105024 ext(45088768->46137343) 00002000:00010000:0.0:1789429515.102992:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d981180 00000100:00100000:0.0:1789429515.103037:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635105280 00000100:00100000:0.0:1789429515.103047:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635105280 00002000:00100000:0.0:1789429515.103085:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f087bf100 x1876351635105280/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/0 e 0 to 0 dl 1789429526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429515.103094:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bf100 with x1876351635105280 ext(47185920->48234495) 00002000:00010000:0.0:1789429515.103097:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bf100 00000100:00100000:0.0:1789429515.103126:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11616 00000100:00100000:0.0:1789429515.103136:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+94:2370:x1876351635105280:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429515.110999:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+96:2370:x1876351635105152:12345-192.168.203.39@tcp:4:dd.0 Request processed in 35990us (37272us total) trans 4294969372 rc 0/0 00000100:00100000:0.0:1789429515.111018:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11615 00002000:00100000:0.0:1789429515.111036:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e0d982680 x1876351635105152/t4294969372(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/448 e 0 to 0 dl 1789429526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429515.111049:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d982680 with x1876351635105152 ext(46137344->47185919) 00002000:00010000:0.0:1789429515.111057:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d982680 00000100:00100000:1.0:1789429515.147342:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429515.147632:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635105408 00000100:00100000:3.0:1789429515.147645:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635105408 00002000:00100000:3.0:1789429515.147711:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f0962ad80 x1876351635105408/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/0 e 0 to 0 dl 1789429526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429515.147725:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0962ad80 with x1876351635105408 ext(48234496->49283071) 00002000:00010000:3.0:1789429515.147733:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0962ad80 00000100:00100000:3.0:1789429515.147779:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11617 00000100:00100000:3.0:1789429515.147791:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+96:2371:x1876351635105408:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429515.163938:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429515.164009:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635105536 00000100:00100000:3.0:1789429515.164024:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635105536 00002000:00100000:3.0:1789429515.164088:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946f087be300 x1876351635105536/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/0 e 0 to 0 dl 1789429526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429515.164101:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087be300 with x1876351635105536 ext(49283072->50331647) 00002000:00010000:3.0:1789429515.164109:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087be300 00000100:00100000:3.0:1789429515.164156:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11618 00000100:00100000:3.0:1789429515.164168:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+97:2370:x1876351635105536:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429515.181811:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+99:2370:x1876351635105280:12345-192.168.203.39@tcp:4:dd.0 Request processed in 78660us (80178us total) trans 4294969373 rc 0/0 00000100:00100000:0.0:1789429515.181829:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11616 00002000:00100000:0.0:1789429515.181844:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f087bf100 x1876351635105280/t4294969373(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/448 e 0 to 0 dl 1789429526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429515.181856:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bf100 with x1876351635105280 ext(47185920->48234495) 00002000:00010000:0.0:1789429515.181864:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bf100 00000100:00100000:2.0:1789429515.198688:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429515.198814:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635105664 00000100:00100000:0.0:1789429515.198831:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635105664 00002000:00100000:0.0:1789429515.198899:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946e0d981c00 x1876351635105664/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/0 e 0 to 0 dl 1789429526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429515.198923:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d981c00 with x1876351635105664 ext(50331648->51380223) 00002000:00010000:0.0:1789429515.198932:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d981c00 00000100:00100000:0.0:1789429515.198970:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11619 00000100:00100000:0.0:1789429515.198982:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+100:2368:x1876351635105664:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429515.206592:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+102:2370:x1876351635105536:12345-192.168.203.39@tcp:4:dd.0 Request processed in 42407us (42649us total) trans 4294969374 rc 0/0 00000100:00100000:0.0:1789429515.206612:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11618 00002000:00100000:0.0:1789429515.206631:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946f087be300 x1876351635105536/t4294969374(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/448 e 0 to 0 dl 1789429526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429515.206643:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087be300 with x1876351635105536 ext(49283072->50331647) 00002000:00010000:0.0:1789429515.206652:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087be300 00000100:00100000:2.0:1789429515.221250:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+102:2371:x1876351635105408:12345-192.168.203.39@tcp:4:dd.0 Request processed in 73450us (73914us total) trans 4294969375 rc 0/0 00000100:00100000:2.0:1789429515.221508:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11617 00002000:00100000:2.0:1789429515.221521:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f0962ad80 x1876351635105408/t4294969375(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/448 e 0 to 0 dl 1789429526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429515.221536:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0962ad80 with x1876351635105408 ext(48234496->49283071) 00002000:00010000:2.0:1789429515.221542:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0962ad80 00000100:00100000:3.0:1789429515.224143:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429515.224183:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429515.224287:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635106048 00000100:00100000:1.0:1789429515.224297:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635106048 00002000:00100000:1.0:1789429515.224343:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f087bea00 x1876351635106048/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/0 e 0 to 0 dl 1789429526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429515.224354:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bea00 with x1876351635106048 ext(51380224->52428799) 00002000:00010000:1.0:1789429515.224360:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bea00 00000100:00100000:1.0:1789429515.224396:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11620 00000100:00100000:1.0:1789429515.224405:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+102:2368:x1876351635106048:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429515.224826:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635105920 00000100:00100000:2.0:1789429515.224831:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635105920 00000100:00100000:2.0:1789429515.224873:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 286 00000100:00100000:2.0:1789429515.224881:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:44664:x1876351635105920:12345-192.168.203.39@tcp:35:dd.0 00000001:00080000:2.0:1789429515.225785:0:21208:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977232 00000100:00100000:2.0:1789429515.225952:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:44664:x1876351635105920:12345-192.168.203.39@tcp:35:dd.0 Request processed in 1069us (1813us total) trans 4294977233 rc 0/0 00000100:00100000:2.0:1789429515.225961:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 286 00000020:00080000:2.0:1789429515.225966:0:21208:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789429515.228064:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+104:2368:x1876351635105664:12345-192.168.203.39@tcp:4:dd.0 Request processed in 29077us (29377us total) trans 4294969376 rc 0/0 00000100:00100000:2.0:1789429515.228078:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11619 00002000:00100000:2.0:1789429515.228090:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946e0d981c00 x1876351635105664/t4294969376(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/448 e 0 to 0 dl 1789429526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429515.228100:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d981c00 with x1876351635105664 ext(50331648->51380223) 00002000:00010000:2.0:1789429515.228107:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d981c00 00000100:00100000:2.0:1789429515.240159:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+104:2368:x1876351635106048:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15743us (15963us total) trans 4294969377 rc 0/0 00000100:00100000:2.0:1789429515.240172:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11620 00002000:00100000:2.0:1789429515.240186:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f087bea00 x1876351635106048/t4294969377(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:251/0 lens 488/448 e 0 to 0 dl 1789429526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429515.240232:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bea00 with x1876351635106048 ext(51380224->52428799) 00002000:00010000:2.0:1789429515.240239:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bea00 00000100:00100000:1.0:1789429515.427881:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f09628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648397952:0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.427952:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429515.428007:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789429515.428013:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0962b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648397568:0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428042:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429515.428064:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0962b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648398080:0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428087:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429515.428111:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f09629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648397824:0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428132:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429515.428148:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789429515.428154:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f09629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648397696:0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428171:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429515.428184:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0962a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648398208:0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428225:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429515.428253:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648397952 00000100:00100000:1.0:1789429515.428261:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648397952 00000100:00100000:1.0:1789429515.428309:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1789429515.428317:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648397952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428363:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648397952:12345-0@lo:400:kworker.0 Request processed in 47us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429515.428370:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1789429515.428385:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648398208 00000100:00100000:1.0:1789429515.428389:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648398208 00000100:00100000:1.0:1789429515.428408:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1789429515.428413:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648398208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428457:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648398208:12345-0@lo:400:kworker.0 Request processed in 43us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429515.428463:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1789429515.428480:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648397568 00000100:00100000:1.0:1789429515.428483:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648397568 00000100:00100000:1.0:1789429515.428507:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:1.0:1789429515.428513:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648397568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428541:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648397568:12345-0@lo:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429515.428547:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:1.0:1789429515.428585:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648398080 00000100:00100000:1.0:1789429515.428589:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648398080 00000100:00100000:1.0:1789429515.428610:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648397824 00000100:00100000:1.0:1789429515.428613:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648397824 00000100:00100000:1.0:1789429515.428627:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648397696 00000100:00100000:1.0:1789429515.428629:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648397696 00000100:00100000:1.0:1789429515.428648:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:1.0:1789429515.428654:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648398080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428684:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648398080:12345-0@lo:400:kworker.0 Request processed in 31us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429515.428690:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:1.0:1789429515.428702:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1789429515.428707:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648397824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428732:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648397824:12345-0@lo:400:kworker.0 Request processed in 25us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429515.428738:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1789429515.428750:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:1.0:1789429515.428755:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648397696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428779:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648397696:12345-0@lo:400:kworker.0 Request processed in 24us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429515.428785:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00080000:1.0:1789429515.428807:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429515.428811:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429515.428813:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429515.428844:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f09629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648397696:0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428854:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0962a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648398208:0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428862:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f09629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648397824:0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428889:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0962b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648397568:0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428898:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0962b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648398080:0@lo:400:kworker.0 00000100:00100000:1.0:1789429515.428907:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f09628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648397952:0@lo:400:kworker.0 00010000:00010000:0.0:1789429515.496126:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429515.941113:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429515.941137:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0d981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648398336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429515.941238:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429515.941319:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648398336 00000100:00100000:3.0:1789429515.941327:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648398336 00000100:00100000:3.0:1789429515.941375:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1789429515.941384:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648398336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429515.941418:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429515.941479:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648398336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429515.941486:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1789429515.941509:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648398464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429515.941543:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429515.941593:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648398464 00000100:00100000:3.0:1789429515.941597:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648398464 00000100:00100000:3.0:1789429515.941620:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789429515.941626:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648398464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429515.941636:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 303366144 pending 83492864 free 3803185152 avail 3800039424 00000100:00100000:3.0:1789429515.941660:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648398464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429515.941664:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789429515.941717:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648398464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429515.941766:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0d981880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648398336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429516.033058:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.033605:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635106176 00000100:00100000:2.0:1789429516.033615:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635106176 00000100:00100000:2.0:1789429516.036140:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21342 00000100:00100000:2.0:1789429516.036159:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:44675:x1876351635106176:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429516.036185:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429516.036225:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c954 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.036303:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361d47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.036318:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.036333:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429516.036368:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429516.036372:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429516.036391:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361d47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.036416:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546400/0xb4c3dad726361d40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c954 expref: 27 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.036446:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361d47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c954 expref: 26 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.036455:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051efe00) 00010000:00010000:2.0:1789429516.036458:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429516.036461:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546e00, rc 0) 00000100:00100000:2.0:1789429516.036523:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:44675:x1876351635106176:12345-192.168.203.39@tcp:101:dd.0 Request processed in 372us (3472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429516.036531:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21342 00000100:00100000:1.0:1789429516.045102:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429516.045130:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429516.045266:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635106304 00000100:00100000:0.0:1789429516.045276:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635106304 00000100:00100000:0.0:1789429516.045325:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635106560 00000100:00100000:0.0:1789429516.045328:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635106560 00000100:00100000:0.0:1789429516.045348:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21343 00000100:00100000:0.0:1789429516.045357:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+33:44674:x1876351635106304:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429516.045377:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429516.045397:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726361d4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c95b expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.045561:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.045575:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.045586:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429516.045623:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429516.045627:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429516.045649:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.045672:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad726361d4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c95b expref: 35 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.045687:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c95b expref: 34 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.045695:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051efe00) 00010000:00010000:0.0:1789429516.045698:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429516.045701:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc 0) 00000100:00100000:0.0:1789429516.045814:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+34:44674:x1876351635106304:12345-192.168.203.39@tcp:101:dd.0 Request processed in 457us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429516.045822:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21343 00000100:00100000:0.0:1789429516.045947:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21344 00000100:00100000:0.0:1789429516.045956:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+26:44675:x1876351635106560:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429516.045966:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429516.045968:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789429516.045984:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361d47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c954 expref: 26 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.045994:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051efe00) 00010000:00010000:0.0:1789429516.045998:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429516.046005:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361d5c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c962 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046404:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726361d63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046415:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726361d63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046513:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726361d63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046529:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361d6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046537:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361d6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046543:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361d6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046716:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726361d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046725:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726361d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046733:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726361d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429516.046742:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8a:0x0]: returning size 52428800 00010000:00010000:0.0:1789429516.046951:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726361d63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046959:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726361d63 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046967:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726361d63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046974:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429516.046979:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726361d63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046987:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726361d63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.046997:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051efe00) 00010000:00010000:0.0:1789429516.047000:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429516.047004:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726361d63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.047010:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad726361d63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.047020:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361d6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.047026:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361d6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.047033:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361d6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.047038:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2adc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429516.047041:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361d6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.047047:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361d6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.047056:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b086329 (ffff946f120fd900) 00010000:00010000:0.0:1789429516.047059:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429516.047061:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361d6a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.047067:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726361d6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.047103:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad400/0xb4c3dad726361d5c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c962 expref: 28 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.047117:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726361d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c962 expref: 27 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.047124:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429516.047127:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429516.047129:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad600, rc 0) 00000100:00100000:0.0:1789429516.048516:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:44675:x1876351635106560:12345-192.168.203.39@tcp:101:dd.0 Request processed in 2553us (3375us total) trans 4294977234 rc 0/0 00000100:00100000:0.0:1789429516.048528:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21344 00000100:00100000:0.0:1789429516.061830:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429516.061867:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429516.062285:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635106816 00000100:00100000:0.0:1789429516.062296:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635106816 00000100:00100000:0.0:1789429516.062344:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635107072 00000100:00100000:0.0:1789429516.062347:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635107072 00000100:00100000:0.0:1789429516.062367:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21345 00000100:00100000:0.0:1789429516.062378:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+34:44674:x1876351635106816:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429516.062399:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429516.062402:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789429516.062438:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2acc00/0xb4c3dad726361d55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c95b expref: 34 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.062456:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051efe00) 00010000:00010000:0.0:1789429516.062468:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429516.062485:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726361d7f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c969 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.062845:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361d86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.062859:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361d86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.062870:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361d86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.062883:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361d8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.062890:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.062896:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063089:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361d94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063103:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063111:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361d94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429516.063121:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8a:0x0]: returning size 52428800 00010000:00010000:0.0:1789429516.063241:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361d86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063249:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361d86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063255:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361d86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063260:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01653a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429516.063264:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361d86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063272:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361d86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063280:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd800) 00010000:00010000:0.0:1789429516.063283:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429516.063287:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361d86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063294:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653a00/0xb4c3dad726361d86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063309:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361d8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063316:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361d8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063322:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361d8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063327:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01653800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429516.063330:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361d8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063336:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361d8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063343:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b086329 (ffff946f120fdd00) 00010000:00010000:0.0:1789429516.063345:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429516.063348:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361d8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063355:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361d8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063399:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad726361d7f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c969 expref: 36 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063415:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c969 expref: 35 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063439:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429516.063441:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429516.063444:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01652a00, rc 0) 00000100:00100000:0.0:1789429516.063511:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+35:44674:x1876351635106816:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1135us (1691us total) trans 4294977235 rc 0/0 00000100:00100000:0.0:1789429516.063520:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21345 00000100:00100000:0.0:1789429516.063549:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21346 00000100:00100000:0.0:1789429516.063561:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:44675:x1876351635107072:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:0.0:1789429516.063594:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429516.063607:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726361d71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c962 expref: 27 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063618:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429516.063621:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429516.063801:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063813:0:15700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361d94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c969 expref: 34 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063823:0:15700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063857:0:15700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c969 expref: 34 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.063877:0:15700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c969 expref: 34 pid: 15700 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429516.063891:0:15700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f05473800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648398592:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429516.063958:0:15700:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789429516.070344:0:15700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f05473800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648398592:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429516.070377:0:15700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429516.079829:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429516.079866:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.080183:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635107456 00000100:00100000:3.0:1789429516.080194:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635107456 00010000:00010000:3.0:1789429516.080292:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c969 expref: 35 pid: 15700 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429516.080324:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6229 00000100:00100000:3.0:1789429516.080334:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+35:2371:x1876351635107456:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429516.080349:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429516.080356:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361d94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c969 expref: 35 pid: 15700 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.080370:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361d94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c969 expref: 35 pid: 15700 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.080392:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361d94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c969 expref: 35 pid: 15700 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.080407:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:3.0:1789429516.080413:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.080433:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.080441:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.080466:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429516.080514:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05470e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+34:2371:x1876351635107456:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 181us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429516.080522:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6229 00010000:00010000:3.0:1789429516.080547:0:15700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.080554:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789429516.081107:0:15700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977236 00000100:00100000:1.0:1789429516.081142:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635107328 00000100:00100000:1.0:1789429516.081148:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635107328 00000004:00010000:3.0:1789429516.081381:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009495e0fd reply state 0000000033a0784a transno 4294977237 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429516.081392:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789429516.081478:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3462ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:44675:x1876351635107072:12345-192.168.203.39@tcp:36:dd.0 Request processed in 17919us (19609us total) trans 4294977237 rc 0/0 00000100:00100000:3.0:1789429516.081485:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21346 00000020:00080000:3.0:1789429516.081489:0:15700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789429516.081506:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21347 00000100:00100000:3.0:1789429516.081513:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+34:44674:x1876351635107328:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:3.0:1789429516.081853:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.081865:0:15700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.081873:0:15700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.081901:0:15700:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.081911:0:15700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.084597:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.084613:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.084622:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.084628:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f93ba00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429516.084644:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.084653:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.084668:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:3.0:1789429516.084671:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429516.084675:0:3285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.084685:0:3285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.084693:0:3285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.084729:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.084738:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361da2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.085224:0:15700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.085236:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789429516.085345:0:15700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977238 00000004:00010000:0.0:1789429516.085405:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e2d11067 reply state 00000000eb4041a1 transno 4294977239 ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429516.085415:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429516.085546:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+37:44674:x1876351635107328:12345-192.168.203.39@tcp:36:dd.0 Request processed in 4029us (5725us total) trans 4294977239 rc 0/0 00000100:00100000:0.0:1789429516.085555:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21347 00000020:00080000:0.0:1789429516.085560:0:15700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789429516.086311:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429516.086365:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635107584 00000100:00100000:1.0:1789429516.086373:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635107584 00002000:00010000:1.0:1789429516.086407:0:18633:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:1.0:1789429516.086412:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05473800 with x1876351635107584 ext(0->18446744073709551615) 00002000:00010000:1.0:1789429516.086429:0:18633:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f05473800. 00000100:00100000:1.0:1789429516.086461:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11621 00000100:00100000:1.0:1789429516.086508:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+104:2370:x1876351635107584:12345-192.168.203.39@tcp:10:dd.0 00010000:00010000:3.0:1789429516.087019:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.087028:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.087035:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.087040:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429516.087044:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.087050:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.087062:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:3.0:1789429516.087065:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429516.087070:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.087075:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361da9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429516.087940:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429516.088191:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635107712 00000100:00100000:0.0:1789429516.088214:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635107712 00000100:00100000:0.0:1789429516.088256:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5825 00000100:00100000:0.0:1789429516.088264:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:44674:x1876351635107712:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429516.088280:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429516.088296:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c970 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.088326:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 104 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.088336:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=3s v=(1 0) 00010000:00010000:0.0:1789429516.088341:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(1 1) 00010000:00010000:0.0:1789429516.088346:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.088573:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 104 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.088587:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 104 pid: 8085 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429516.088602:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648398720:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429516.088688:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538900 going to sleep for 11 seconds 00000100:00100000:0.0:1789429516.091044:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648398720:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429516.091080:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 8 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.091101:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93a600, rc 0) 00000100:00100000:0.0:1789429516.091222:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:44674:x1876351635107712:12345-192.168.203.39@tcp:101:dd.0 Request processed in 2935us (3261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429516.091232:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5825 00002000:00010000:1.0:1789429516.175660:0:18633:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789429516.175666:0:18633:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 1789429514 -> 1789429516 00002000:00010000:1.0:1789429516.175776:0:18633:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789429516.175778:0:18633:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 1789429514 -> 1789429516 00002000:00010000:1.0:1789429516.175780:0:18633:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb blocks from disk: 102407 -> 2055 00000100:00100000:1.0:1789429516.175891:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+105:2370:x1876351635107584:12345-192.168.203.39@tcp:10:dd.0 Request processed in 89380us (89578us total) trans 4294969378 rc 0/0 00000100:00100000:1.0:1789429516.175901:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11621 00002000:00010000:1.0:1789429516.175906:0:18633:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:1.0:1789429516.175909:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05473800 with x1876351635107584 ext(0->18446744073709551615) 00010000:00010000:1.0:1789429516.175920:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 105 pid: 8085 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.175936:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 105 pid: 8085 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429516.175948:0:18633:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f05473800. 00000100:00100000:3.0:1789429516.266937:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.266988:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429516.267110:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635107968 00000100:00100000:1.0:1789429516.267120:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635107968 00000100:00100000:1.0:1789429516.267181:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5826 00000100:00100000:1.0:1789429516.267191:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+105:44675:x1876351635107968:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429516.267240:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429516.267258:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c977 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.267288:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(1 1) 00010000:00010000:1.0:1789429516.267297:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.267304:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 1) 00010000:00010000:1.0:1789429516.267310:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 106 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.267433:0:20986:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.267457:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 106 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429516.267463:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635107840 00000100:00100000:0.0:1789429516.267469:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635107840 00010000:00010000:3.0:1789429516.267470:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01507400, rc 0) 00010000:00010000:0.0:1789429516.267496:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 107 pid: 8085 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429516.267532:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6230 00000100:00100000:3.0:1789429516.267533:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+107:44675:x1876351635107968:12345-192.168.203.39@tcp:101:dd.0 Request processed in 341us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429516.267542:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+107:2371:x1876351635107840:12345-192.168.203.39@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789429516.267545:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5826 00010000:00010000:0.0:1789429516.267556:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429516.267564:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 106 pid: 8085 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.267578:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 106 pid: 8085 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.267610:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361d39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c94d expref: 106 pid: 8085 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.267623:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(3 1) 00010000:00010000:0.0:1789429516.267627:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(3 1) 00010000:00010000:0.0:1789429516.267633:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.267642:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.267666:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.267677:0:11354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 7 pid: 13238 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429516.267690:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648398976:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429516.267765:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538900 going to sleep for 11 seconds 00000100:00100000:3.0:1789429516.275322:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429516.275530:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635108096 00000100:00100000:1.0:1789429516.275540:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635108096 00002000:00010000:1.0:1789429516.275578:0:20672:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:1.0:1789429516.275583:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087be680 with x1876351635108096 ext(0->18446744073709551615) 00010000:00010000:1.0:1789429516.275609:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 8 pid: 13238 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.275627:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 8 pid: 13238 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429516.275636:0:20672:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f087be680. 00000100:00100000:1.0:1789429516.275669:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1406 00000100:00100000:1.0:1789429516.275678:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635108096:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:1.0:1789429516.275901:0:20672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789429516.275905:0:20672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 1789429516 -> 1789429516 00002000:00010000:1.0:1789429516.275907:0:20672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789429516.275910:0:20672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 1789429516 -> 1789429516 00002000:00010000:1.0:1789429516.275912:0:20672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb blocks from disk: 2055 -> 2055 00000100:00100000:1.0:1789429516.275971:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351635108096:12345-192.168.203.39@tcp:10:dd.0 Request processed in 293us (656us total) trans 4294969379 rc 0/0 00000100:00100000:1.0:1789429516.275978:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1406 00002000:00010000:1.0:1789429516.275982:0:20672:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:1.0:1789429516.275985:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087be680 with x1876351635108096 ext(0->18446744073709551615) 00010000:00010000:1.0:1789429516.275992:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 9 pid: 13238 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.276004:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 9 pid: 13238 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429516.276012:0:20672:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f087be680. 00000100:00100000:0.0:1789429516.276311:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b321880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648398976:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429516.276332:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429516.276357:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+105:2371:x1876351635107840:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8818us (9429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429516.276366:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6230 00000100:00100000:1.0:1789429516.282654:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.282756:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635108224 00000100:00100000:2.0:1789429516.282766:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635108224 00000100:00100000:2.0:1789429516.282823:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5827 00000100:00100000:2.0:1789429516.282833:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+9:44674:x1876351635108224:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429516.282851:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429516.282869:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c97e expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.282900:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(3 1) 00010000:00010000:2.0:1789429516.282916:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 104 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.282927:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(4 1) 00010000:00010000:2.0:1789429516.282932:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.282974:0:6681:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 104 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.282994:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.283008:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546400, rc 0) 00000100:00100000:2.0:1789429516.283067:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+10:44674:x1876351635108224:12345-192.168.203.39@tcp:101:dd.0 Request processed in 235us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429516.283073:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5827 00000100:00100000:3.0:1789429516.283771:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.283892:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635108352 00000100:00100000:2.0:1789429516.283899:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635108352 00010000:00010000:2.0:1789429516.283925:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 10 pid: 13238 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429516.283958:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6231 00000100:00100000:2.0:1789429516.283966:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+10:2369:x1876351635108352:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429516.283978:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429516.283998:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 10 pid: 13238 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.284011:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 10 pid: 13238 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.284033:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361db0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c970 expref: 10 pid: 13238 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.284055:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(5 1) 00010000:00010000:2.0:1789429516.284059:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(5 1) 00010000:00010000:2.0:1789429516.284067:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 104 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.284077:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 104 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.284108:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 104 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.284121:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 104 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429516.284135:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0d983800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648399232:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429516.284856:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e15865f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789429516.286126:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0d983800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648399232:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429516.286148:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429516.286228:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351635108352:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2231us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429516.286241:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6231 00000100:00100000:3.0:1789429516.319877:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.319923:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.320068:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635108480 00000100:00100000:2.0:1789429516.320078:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635108480 00002000:00100000:2.0:1789429516.320128:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946f087bf800 x1876351635108480/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.320139:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bf800 with x1876351635108480 ext(0->1048575) 00010000:00010000:2.0:1789429516.320149:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 105 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.320166:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 105 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429516.320174:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f087bf800 00000100:00100000:2.0:1789429516.320245:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1407 00000100:00100000:2.0:1789429516.320265:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+105:2369:x1876351635108480:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429516.321228:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635108608 00000100:00100000:0.0:1789429516.321236:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635108608 00000100:00100000:0.0:1789429516.321293:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5828 00000100:00100000:0.0:1789429516.321303:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+107:44675:x1876351635108608:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429516.321314:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429516.321332:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c985 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.321358:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(5 1) 00010000:00010000:0.0:1789429516.321365:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(6 1) 00010000:00010000:0.0:1789429516.321370:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 108 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.321385:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 108 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.321398:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93bc00, rc 0) 00000100:00100000:0.0:1789429516.321475:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+108:44675:x1876351635108608:12345-192.168.203.39@tcp:101:dd.0 Request processed in 173us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429516.321483:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5828 00000100:00100000:2.0:1789429516.340563:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+108:2369:x1876351635108480:12345-192.168.203.39@tcp:4:dd.0 Request processed in 20288us (20627us total) trans 4294969380 rc 0/0 00000100:00100000:2.0:1789429516.340579:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1407 00002000:00100000:2.0:1789429516.340605:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946f087bf800 x1876351635108480/t4294969380(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.340617:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bf800 with x1876351635108480 ext(0->1048575) 00010000:00010000:2.0:1789429516.340630:0:19375:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 108 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.340651:0:19375:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 108 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429516.340660:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f087bf800 00000100:00100000:1.0:1789429516.349997:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.350089:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635108736 00000100:00100000:2.0:1789429516.350099:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635108736 00010000:00010000:2.0:1789429516.350238:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 108 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429516.350281:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6232 00000100:00100000:2.0:1789429516.350291:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+108:2371:x1876351635108736:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429516.350306:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789429516.350325:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 0 -> 1048576 00010000:00010000:2.0:1789429516.350332:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 108 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.350346:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 108 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.350367:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361db7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c977 expref: 108 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.350384:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(6 1) 00010000:00010000:2.0:1789429516.350389:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(6 1) 00010000:00010000:2.0:1789429516.350397:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.350827:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.350841:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(6 1) 00010000:00010000:2.0:1789429516.350845:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(6 1) 00010000:00010000:2.0:1789429516.350851:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 107 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.350859:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 107 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.350898:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 107 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429516.350913:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0d983800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648399360:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429516.351026:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429516.351037:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0d982d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648399488:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429516.351059:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e15865f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789429516.356814:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0d983800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648399360:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429516.356833:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0d982d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648399488:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429516.356859:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429516.356927:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+107:2371:x1876351635108736:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6636us (6939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429516.356938:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6232 00000100:00100000:3.0:1789429516.405855:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.405892:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635108864 00000100:00100000:3.0:1789429516.405902:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635108864 00002000:00100000:3.0:1789429516.405954:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946f087bed80 x1876351635108864/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.405965:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bed80 with x1876351635108864 ext(1048576->2097151) 00002000:00010000:3.0:1789429516.405971:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bed80 00000100:00100000:3.0:1789429516.406000:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11622 00000100:00100000:3.0:1789429516.406009:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+107:2369:x1876351635108864:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429516.412841:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429516.412877:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.413703:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635108992 00000100:00100000:2.0:1789429516.413725:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635108992 00002000:00100000:2.0:1789429516.413774:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946f09629f80 x1876351635108992/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.413786:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f09629f80 with x1876351635108992 ext(0->1048575) 00002000:00010000:2.0:1789429516.413791:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f09629f80 00000100:00100000:2.0:1789429516.413832:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11623 00000100:00100000:2.0:1789429516.413842:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351635108992:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429516.414170:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635109120 00000100:00100000:0.0:1789429516.414176:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635109120 00000100:00100000:0.0:1789429516.414224:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5829 00000100:00100000:0.0:1789429516.414232:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+11:44674:x1876351635109120:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429516.414252:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429516.414273:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c98c expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.414303:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 108 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.414313:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(6 1) 00010000:00010000:0.0:1789429516.414317:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(7 1) 00010000:00010000:0.0:1789429516.414323:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 12 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.414356:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 108 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.414371:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 108 pid: 6682 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429516.414385:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3b321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648399616:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429516.414457:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538900 going to sleep for 11 seconds 00000100:00100000:0.0:1789429516.443594:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3b321880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648399616:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429516.443635:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 12 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.443659:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93a600, rc 0) 00000100:00100000:0.0:1789429516.443723:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+12:44674:x1876351635109120:12345-192.168.203.39@tcp:101:dd.0 Request processed in 29492us (30892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429516.443732:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5829 00000100:00100000:3.0:1789429516.458528:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+109:2369:x1876351635108864:12345-192.168.203.39@tcp:4:dd.0 Request processed in 52509us (52673us total) trans 4294969381 rc 0/0 00000100:00100000:3.0:1789429516.458541:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11622 00002000:00100000:3.0:1789429516.458555:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946f087bed80 x1876351635108864/t4294969381(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.458565:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bed80 with x1876351635108864 ext(1048576->2097151) 00010000:00010000:3.0:1789429516.458576:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 109 pid: 6682 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.458614:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 109 pid: 6682 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429516.458622:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f087bed80 00000100:00100000:3.0:1789429516.473302:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.473327:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.473352:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635109376 00000100:00100000:3.0:1789429516.473362:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635109376 00000100:00100000:1.0:1789429516.473554:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635109248 00000100:00100000:1.0:1789429516.473559:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635109248 00002000:00100000:1.0:1789429516.473603:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946f087bf480 x1876351635109248/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429516.473616:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bf480 with x1876351635109248 ext(2097152->3145727) 00010000:00010000:1.0:1789429516.473625:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 109 pid: 6682 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.473643:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 109 pid: 6682 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429516.473652:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f087bf480 00000100:00100000:1.0:1789429516.473672:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1408 00000100:00100000:1.0:1789429516.473680:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+109:2371:x1876351635109248:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429516.474146:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5830 00000100:00100000:3.0:1789429516.474153:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+111:44675:x1876351635109376:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429516.474163:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429516.474178:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c993 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.474218:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(7 1) 00010000:00010000:3.0:1789429516.474224:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(8 1) 00010000:00010000:3.0:1789429516.474229:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 112 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.474250:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 112 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.474262:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0800, rc 0) 00000100:00100000:3.0:1789429516.474293:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+112:44675:x1876351635109376:12345-192.168.203.39@tcp:101:dd.0 Request processed in 140us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429516.474300:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5830 00000100:00100000:2.0:1789429516.479735:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351635108992:12345-192.168.203.39@tcp:4:dd.0 Request processed in 65871us (66834us total) trans 4294969382 rc 0/0 00000100:00100000:2.0:1789429516.479750:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11623 00002000:00100000:2.0:1789429516.479766:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946f09629f80 x1876351635108992/t4294969382(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.479777:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f09629f80 with x1876351635108992 ext(0->1048575) 00002000:00010000:2.0:1789429516.479785:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f09629f80 00000100:00100000:0.0:1789429516.499868:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+112:2371:x1876351635109248:12345-192.168.203.39@tcp:4:dd.0 Request processed in 26178us (26565us total) trans 4294969383 rc 0/0 00000100:00100000:0.0:1789429516.499882:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1408 00002000:00100000:0.0:1789429516.499895:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946f087bf480 x1876351635109248/t4294969383(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429516.499904:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bf480 with x1876351635109248 ext(2097152->3145727) 00010000:00010000:0.0:1789429516.499914:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 112 pid: 6682 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.499941:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 112 pid: 6682 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429516.499961:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f087bf480 00000100:00100000:3.0:1789429516.509755:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429516.510143:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635109504 00000100:00100000:1.0:1789429516.510154:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635109504 00010000:00010000:1.0:1789429516.510195:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 112 pid: 6682 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429516.510288:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6233 00000100:00100000:1.0:1789429516.510299:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+112:2369:x1876351635109504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429516.510313:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429516.510332:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 1048576 -> 3145728 00010000:00010000:1.0:1789429516.510339:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 112 pid: 6682 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.510372:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 112 pid: 6682 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.510395:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361dc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c985 expref: 112 pid: 6682 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.510410:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(8 1) 00010000:00010000:1.0:1789429516.510414:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(8 1) 00010000:00010000:1.0:1789429516.510438:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 11 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.510448:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 11 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.510457:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(8 1) 00010000:00010000:1.0:1789429516.510460:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(8 1) 00010000:00010000:1.0:1789429516.510464:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 111 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.510472:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 111 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429516.510507:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 111 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429516.510526:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f09628a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648399744:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429516.510820:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 11 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429516.510836:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f09629180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648399872:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429516.510862:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865000 going to sleep for 11 seconds 00010000:00010000:1.0:1789429516.515889:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429516.517082:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f09628a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648399744:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429516.517098:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f09629180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648399872:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429516.517120:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429516.517258:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+111:2369:x1876351635109504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6959us (7511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429516.517269:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6233 00000100:00100000:0.0:1789429516.550751:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.550876:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635109632 00000100:00100000:2.0:1789429516.550887:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635109632 00002000:00100000:2.0:1789429516.551003:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f3b321880 x1876351635109632/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.551015:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b321880 with x1876351635109632 ext(3145728->4194303) 00002000:00010000:2.0:1789429516.551022:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3b321880 00000100:00100000:2.0:1789429516.551058:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11624 00000100:00100000:2.0:1789429516.551069:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3b321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+111:2370:x1876351635109632:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429516.569577:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429516.569762:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635109760 00000100:00100000:0.0:1789429516.569771:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635109760 00002000:00100000:0.0:1789429516.569812:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946e1030a680 x1876351635109760/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429516.569823:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1030a680 with x1876351635109760 ext(1048576->2097151) 00002000:00010000:0.0:1789429516.569828:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1030a680 00000100:00100000:0.0:1789429516.569853:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11625 00000100:00100000:0.0:1789429516.569862:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1030a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+12:2368:x1876351635109760:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429516.571321:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3b321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+113:2370:x1876351635109632:12345-192.168.203.39@tcp:4:dd.0 Request processed in 20246us (20572us total) trans 4294969384 rc 0/0 00000100:00100000:3.0:1789429516.571335:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11624 00002000:00100000:3.0:1789429516.571345:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f3b321880 x1876351635109632/t4294969384(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.571354:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3b321880 with x1876351635109632 ext(3145728->4194303) 00002000:00010000:3.0:1789429516.571360:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3b321880 00000100:00100000:1.0:1789429516.582816:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1030a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+14:2368:x1876351635109760:12345-192.168.203.39@tcp:4:dd.0 Request processed in 12942us (13235us total) trans 4294969385 rc 0/0 00000100:00100000:1.0:1789429516.582830:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11625 00002000:00100000:1.0:1789429516.582845:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946e1030a680 x1876351635109760/t4294969385(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429516.582856:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1030a680 with x1876351635109760 ext(1048576->2097151) 00002000:00010000:1.0:1789429516.582863:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1030a680 00000100:00100000:2.0:1789429516.586317:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.586424:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635109888 00000100:00100000:3.0:1789429516.586435:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635109888 00002000:00100000:3.0:1789429516.586485:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946e0d982d80 x1876351635109888/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.586496:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d982d80 with x1876351635109888 ext(4194304->5242879) 00002000:00010000:3.0:1789429516.586502:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d982d80 00000100:00100000:3.0:1789429516.586537:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11626 00000100:00100000:3.0:1789429516.586548:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+113:2371:x1876351635109888:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429516.603897:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.604185:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635110016 00000100:00100000:2.0:1789429516.604195:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635110016 00002000:00100000:2.0:1789429516.604281:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946f09629180 x1876351635110016/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.604295:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f09629180 with x1876351635110016 ext(2097152->3145727) 00002000:00010000:2.0:1789429516.604301:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f09629180 00000100:00100000:2.0:1789429516.604332:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11627 00000100:00100000:2.0:1789429516.604341:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+14:2368:x1876351635110016:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429516.608648:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+115:2371:x1876351635109888:12345-192.168.203.39@tcp:4:dd.0 Request processed in 22095us (22333us total) trans 4294969386 rc 0/0 00000100:00100000:3.0:1789429516.608665:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11626 00002000:00100000:3.0:1789429516.608678:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946e0d982d80 x1876351635109888/t4294969386(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.608688:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d982d80 with x1876351635109888 ext(4194304->5242879) 00002000:00010000:3.0:1789429516.608695:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d982d80 00000100:00100000:1.0:1789429516.609239:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.613081:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635110144 00000100:00100000:3.0:1789429516.613098:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635110144 00000100:00100000:3.0:1789429516.613166:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5831 00000100:00100000:3.0:1789429516.613176:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+16:44674:x1876351635110144:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429516.613194:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429516.613251:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c99a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.613284:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 114 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.613294:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(8 1) 00010000:00010000:3.0:1789429516.613299:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(9 1) 00010000:00010000:3.0:1789429516.613304:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.613341:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 114 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.613355:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 114 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429516.613368:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648400000:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429516.613467:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c272e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429516.621052:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+18:2368:x1876351635110016:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16701us (17155us total) trans 4294969387 rc 0/0 00000100:00100000:3.0:1789429516.621067:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11627 00002000:00100000:3.0:1789429516.621081:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946f09629180 x1876351635110016/t4294969387(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.621091:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f09629180 with x1876351635110016 ext(2097152->3145727) 00002000:00010000:3.0:1789429516.621098:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f09629180 00000100:00100000:3.0:1789429516.624846:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648400000:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429516.624883:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 17 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.624905:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c1800, rc 0) 00000100:00100000:3.0:1789429516.625014:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+17:44674:x1876351635110144:12345-192.168.203.39@tcp:101:dd.0 Request processed in 11838us (17308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429516.625023:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5831 00000100:00100000:2.0:1789429516.639130:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.642624:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635110272 00000100:00100000:3.0:1789429516.642639:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635110272 00002000:00100000:2.0:1789429516.642908:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946e0d983800 x1876351635110272/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.642919:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d983800 with x1876351635110272 ext(5242880->6291455) 00010000:00010000:2.0:1789429516.642929:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 115 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.642946:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 115 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429516.642955:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0d983800 00000100:00100000:2.0:1789429516.642984:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1409 00000100:00100000:2.0:1789429516.642993:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+115:2370:x1876351635110272:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429516.643424:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.644043:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635110400 00000100:00100000:3.0:1789429516.644050:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635110400 00000100:00100000:3.0:1789429516.644096:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5832 00000100:00100000:3.0:1789429516.644105:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+117:44675:x1876351635110400:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429516.644116:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429516.644134:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9a1 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.644159:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(9 1) 00010000:00010000:3.0:1789429516.644164:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(10 1) 00010000:00010000:3.0:1789429516.644170:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 118 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.644182:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 118 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.644194:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0a00, rc 0) 00000100:00100000:3.0:1789429516.644279:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+118:44675:x1876351635110400:12345-192.168.203.39@tcp:101:dd.0 Request processed in 175us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429516.644286:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5832 00000100:00100000:2.0:1789429516.675286:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+118:2370:x1876351635110272:12345-192.168.203.39@tcp:4:dd.0 Request processed in 32283us (36155us total) trans 4294969388 rc 0/0 00000100:00100000:2.0:1789429516.675300:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1409 00002000:00100000:2.0:1789429516.675315:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946e0d983800 x1876351635110272/t4294969388(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.675330:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d983800 with x1876351635110272 ext(5242880->6291455) 00010000:00010000:2.0:1789429516.675341:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 118 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.675362:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 118 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429516.675371:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0d983800 00000100:00100000:0.0:1789429516.689459:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.691842:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635110528 00000100:00100000:2.0:1789429516.691857:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635110528 00010000:00010000:2.0:1789429516.691912:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 118 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429516.691963:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6234 00000100:00100000:2.0:1789429516.691973:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+118:2371:x1876351635110528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429516.691988:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789429516.692008:0:11354:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:2.0:1789429516.692011:0:11354:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 1789429516 -> 1789429517 00002000:00010000:2.0:1789429516.692013:0:11354:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 1789429516 -> 1789429517 00010000:00010000:2.0:1789429516.692019:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 118 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.692035:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 118 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.692063:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3303a0d/0xb4c3dad726361dd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c993 expref: 118 pid: 20986 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.692082:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(10 1) 00010000:00010000:2.0:1789429516.692087:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(10 1) 00010000:00010000:2.0:1789429516.692097:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.692108:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.692118:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(10 1) 00010000:00010000:2.0:1789429516.692120:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(10 1) 00010000:00010000:2.0:1789429516.692124:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 117 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.692133:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 117 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.692172:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 117 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429516.692186:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0d981f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648400128:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429516.692350:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429516.692361:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0d981500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648400256:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429516.692385:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e15865f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789429516.698466:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0d981f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648400128:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429516.698483:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0d981500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648400256:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429516.698511:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429516.698560:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+117:2371:x1876351635110528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6588us (9109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429516.698572:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6234 00000100:00100000:3.0:1789429516.731168:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429516.731244:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635110656 00000100:00100000:1.0:1789429516.731255:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635110656 00002000:00100000:1.0:1789429516.731303:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f29deb480 x1876351635110656/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429516.731315:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29deb480 with x1876351635110656 ext(3145728->4194303) 00002000:00010000:1.0:1789429516.731321:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29deb480 00000100:00100000:1.0:1789429516.731344:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11628 00000100:00100000:1.0:1789429516.731353:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351635110656:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429516.738748:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.739261:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635110784 00000100:00100000:3.0:1789429516.739272:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635110784 00002000:00100000:3.0:1789429516.739317:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946e0d981500 x1876351635110784/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.739329:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d981500 with x1876351635110784 ext(6291456->7340031) 00002000:00010000:3.0:1789429516.739337:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d981500 00000100:00100000:3.0:1789429516.739374:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11629 00000100:00100000:3.0:1789429516.739382:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+117:2371:x1876351635110784:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429516.750496:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351635110656:12345-192.168.203.39@tcp:4:dd.0 Request processed in 19133us (19329us total) trans 4294969389 rc 0/0 00000100:00100000:1.0:1789429516.750510:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11628 00002000:00100000:1.0:1789429516.750522:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f29deb480 x1876351635110656/t4294969389(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429516.750533:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29deb480 with x1876351635110656 ext(3145728->4194303) 00002000:00010000:1.0:1789429516.750540:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29deb480 00000100:00100000:2.0:1789429516.767931:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.769318:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635110912 00000100:00100000:3.0:1789429516.769331:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635110912 00002000:00100000:2.0:1789429516.770340:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946e0d981f80 x1876351635110912/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.770353:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d981f80 with x1876351635110912 ext(4194304->5242879) 00002000:00010000:2.0:1789429516.770360:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d981f80 00000100:00100000:2.0:1789429516.770497:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11630 00000100:00100000:2.0:1789429516.770509:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351635110912:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429516.774333:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+119:2371:x1876351635110784:12345-192.168.203.39@tcp:4:dd.0 Request processed in 34941us (35584us total) trans 4294969390 rc 0/0 00000100:00100000:1.0:1789429516.774346:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11629 00002000:00100000:1.0:1789429516.774357:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946e0d981500 x1876351635110784/t4294969390(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429516.774367:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d981500 with x1876351635110784 ext(6291456->7340031) 00002000:00010000:1.0:1789429516.774373:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d981500 00000100:00100000:3.0:1789429516.786831:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.786863:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635111040 00000100:00100000:3.0:1789429516.786873:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635111040 00002000:00100000:3.0:1789429516.786921:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f29de8a80 x1876351635111040/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.786933:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de8a80 with x1876351635111040 ext(7340032->8388607) 00002000:00010000:3.0:1789429516.786938:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29de8a80 00000100:00100000:3.0:1789429516.786966:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11631 00000100:00100000:3.0:1789429516.786976:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+119:2369:x1876351635111040:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429516.797140:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351635110912:12345-192.168.203.39@tcp:4:dd.0 Request processed in 26622us (29208us total) trans 4294969391 rc 0/0 00000100:00100000:1.0:1789429516.797159:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11630 00002000:00100000:1.0:1789429516.797176:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946e0d981f80 x1876351635110912/t4294969391(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429516.797187:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d981f80 with x1876351635110912 ext(4194304->5242879) 00002000:00010000:1.0:1789429516.797196:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d981f80 00000100:00100000:1.0:1789429516.799947:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429516.800026:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.800673:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635111168 00000100:00100000:3.0:1789429516.800684:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635111168 00000100:00100000:3.0:1789429516.800784:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5833 00000100:00100000:3.0:1789429516.800795:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+21:44674:x1876351635111168:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429516.800812:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429516.800829:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9a8 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.800861:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 120 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.800871:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(10 1) 00010000:00010000:3.0:1789429516.800876:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(11 1) 00010000:00010000:3.0:1789429516.800881:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 22 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.800920:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 120 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.800934:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 120 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429516.800947:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648400384:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429516.801018:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c272e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789429516.801036:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635111296 00000100:00100000:3.0:1789429516.801039:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635111296 00002000:00100000:3.0:1789429516.801065:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946f09629c00 x1876351635111296/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.801075:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f09629c00 with x1876351635111296 ext(5242880->6291455) 00002000:00010000:3.0:1789429516.801080:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f09629c00 00000100:00100000:3.0:1789429516.803194:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11632 00000100:00100000:3.0:1789429516.803227:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+23:2368:x1876351635111296:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429516.811040:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648400384:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429516.811083:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 24 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.811106:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0c00, rc 0) 00000100:00100000:3.0:1789429516.811176:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+24:44674:x1876351635111168:12345-192.168.203.39@tcp:101:dd.0 Request processed in 10382us (11237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429516.811185:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5833 00000100:00100000:3.0:1789429516.812801:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.812887:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635111424 00000100:00100000:2.0:1789429516.812896:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635111424 00002000:00100000:2.0:1789429516.812941:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946f29de9f80 x1876351635111424/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.812954:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9f80 with x1876351635111424 ext(8388608->9437183) 00010000:00010000:2.0:1789429516.812962:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 121 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.812980:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 121 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429516.812989:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f29de9f80 00000100:00100000:2.0:1789429516.813020:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1410 00000100:00100000:2.0:1789429516.813029:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+121:2369:x1876351635111424:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429516.824854:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+24:2368:x1876351635111296:12345-192.168.203.39@tcp:4:dd.0 Request processed in 21623us (24817us total) trans 4294969392 rc 0/0 00000100:00100000:3.0:1789429516.824869:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11632 00002000:00100000:3.0:1789429516.824883:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946f09629c00 x1876351635111296/t4294969392(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.824892:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f09629c00 with x1876351635111296 ext(5242880->6291455) 00002000:00010000:3.0:1789429516.824898:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f09629c00 00000100:00100000:0.0:1789429516.826884:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+123:2369:x1876351635111040:12345-192.168.203.39@tcp:4:dd.0 Request processed in 39901us (40054us total) trans 4294969393 rc 0/0 00000100:00100000:0.0:1789429516.826898:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11631 00002000:00100000:0.0:1789429516.826908:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f29de8a80 x1876351635111040/t4294969393(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429516.826919:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de8a80 with x1876351635111040 ext(7340032->8388607) 00010000:00010000:0.0:1789429516.826929:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 123 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429516.826957:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 123 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429516.826965:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f29de8a80 00000100:00100000:3.0:1789429516.829709:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+123:2369:x1876351635111424:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16673us (16905us total) trans 4294969394 rc 0/0 00000100:00100000:3.0:1789429516.829722:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1410 00002000:00100000:3.0:1789429516.829732:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946f29de9f80 x1876351635111424/t4294969394(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.829743:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9f80 with x1876351635111424 ext(8388608->9437183) 00010000:00010000:3.0:1789429516.829752:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 123 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.829768:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 123 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429516.829776:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f29de9f80 00000100:00100000:1.0:1789429516.837616:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429516.837666:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.838169:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635111552 00000100:00100000:2.0:1789429516.838180:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635111552 00000100:00100000:2.0:1789429516.838262:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5834 00000100:00100000:2.0:1789429516.838272:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+123:44675:x1876351635111552:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429516.838291:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429516.838307:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9af expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.838337:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(11 1) 00010000:00010000:2.0:1789429516.838343:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(12 1) 00010000:00010000:2.0:1789429516.838349:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 124 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.838362:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 124 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.838377:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546600, rc 0) 00000100:00100000:2.0:1789429516.838448:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+124:44675:x1876351635111552:12345-192.168.203.39@tcp:101:dd.0 Request processed in 176us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429516.838456:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5834 00000100:00100000:3.0:1789429516.839286:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635111680 00000100:00100000:3.0:1789429516.839294:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635111680 00002000:00100000:3.0:1789429516.839333:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f1c1a3480 x1876351635111680/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.840826:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a3480 with x1876351635111680 ext(9437184->10485759) 00010000:00010000:3.0:1789429516.840849:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 124 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429516.840869:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 124 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429516.840878:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f1c1a3480 00000100:00100000:2.0:1789429516.843899:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1411 00000100:00100000:2.0:1789429516.843924:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+124:2370:x1876351635111680:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429516.871613:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+126:2370:x1876351635111680:12345-192.168.203.39@tcp:4:dd.0 Request processed in 27692us (33937us total) trans 4294969395 rc 0/0 00000100:00100000:2.0:1789429516.871628:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1411 00002000:00100000:2.0:1789429516.871640:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f1c1a3480 x1876351635111680/t4294969395(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.871651:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a3480 with x1876351635111680 ext(9437184->10485759) 00010000:00010000:2.0:1789429516.871663:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 126 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.871681:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 126 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429516.871690:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f1c1a3480 00000100:00100000:1.0:1789429516.876872:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429516.876934:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635111808 00000100:00100000:2.0:1789429516.876945:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635111808 00010000:00010000:2.0:1789429516.876985:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 126 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429516.877077:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6235 00000100:00100000:2.0:1789429516.877088:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+126:2368:x1876351635111808:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429516.877106:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789429516.877125:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 6291456 -> 10485760 00010000:00010000:2.0:1789429516.877132:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 126 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.877146:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 126 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.877181:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b412cfa6/0xb4c3dad726361de1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [6291456->18446744073709551615] (req 6291456->7340031) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a1 expref: 126 pid: 20745 timeout: 1314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.877234:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(12 1) 00010000:00010000:2.0:1789429516.877240:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(12 1) 00010000:00010000:2.0:1789429516.877258:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [6291456->10485759] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 23 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.877269:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [6291456->10485759] (req 6291456->7340031) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 23 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.877279:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(12 1) 00010000:00010000:2.0:1789429516.877282:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(12 1) 00010000:00010000:2.0:1789429516.877287:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 125 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.877297:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 125 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429516.877332:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 125 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429516.877347:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0d980380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648400512:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429516.877457:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [6291456->10485759] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 23 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429516.877468:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0d983100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648400640:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429516.877490:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e15865f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789429516.889116:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0d980380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648400512:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429516.889133:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0d983100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648400640:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429516.889158:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429516.889251:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+125:2368:x1876351635111808:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12163us (12385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429516.889261:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6235 00000100:00100000:3.0:1789429516.917928:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.917966:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429516.918048:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635111936 00000100:00100000:0.0:1789429516.918058:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635111936 00002000:00100000:0.0:1789429516.918109:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946f29de9500 x1876351635111936/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429516.918121:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9500 with x1876351635111936 ext(6291456->7340031) 00002000:00010000:0.0:1789429516.918127:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29de9500 00000100:00100000:0.0:1789429516.918158:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635112064 00000100:00100000:0.0:1789429516.918162:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635112064 00002000:00100000:0.0:1789429516.918178:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f29debb80 x1876351635112064/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429516.918186:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29debb80 with x1876351635112064 ext(10485760->11534335) 00002000:00010000:0.0:1789429516.918190:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29debb80 00000100:00100000:0.0:1789429516.918242:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11633 00000100:00100000:0.0:1789429516.918252:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+24:2369:x1876351635111936:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429516.918454:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11634 00000100:00100000:2.0:1789429516.918465:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+125:2370:x1876351635112064:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429516.947965:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+127:2370:x1876351635112064:12345-192.168.203.39@tcp:4:dd.0 Request processed in 29492us (29987us total) trans 4294969396 rc 0/0 00000100:00100000:2.0:1789429516.947979:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11634 00002000:00100000:2.0:1789429516.947991:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f29debb80 x1876351635112064/t4294969396(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429516.948009:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29debb80 with x1876351635112064 ext(10485760->11534335) 00002000:00010000:2.0:1789429516.948015:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29debb80 00000100:00100000:0.0:1789429516.954244:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+26:2369:x1876351635111936:12345-192.168.203.39@tcp:4:dd.0 Request processed in 35949us (36282us total) trans 4294969397 rc 0/0 00000100:00100000:0.0:1789429516.954257:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11633 00002000:00100000:0.0:1789429516.954270:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946f29de9500 x1876351635111936/t4294969397(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429516.954286:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9500 with x1876351635111936 ext(6291456->7340031) 00002000:00010000:0.0:1789429516.954292:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29de9500 00000100:00100000:0.0:1789429516.965110:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429516.965710:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635112192 00000100:00100000:1.0:1789429516.965722:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635112192 00000100:00100000:3.0:1789429516.965756:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00002000:00100000:1.0:1789429516.965772:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946e10309500 x1876351635112192/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429516.965784:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10309500 with x1876351635112192 ext(11534336->12582911) 00002000:00010000:1.0:1789429516.965790:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10309500 00000100:00100000:1.0:1789429516.965823:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635112320 00000100:00100000:1.0:1789429516.965826:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635112320 00002000:00100000:1.0:1789429516.965843:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f29dea680 x1876351635112320/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1789429516.965854:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11635 00002000:00100000:1.0:1789429516.965856:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29dea680 with x1876351635112320 ext(7340032->8388607) 00002000:00010000:1.0:1789429516.965862:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29dea680 00000100:00100000:0.0:1789429516.965871:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+127:2371:x1876351635112192:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429516.965884:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11636 00000100:00100000:1.0:1789429516.965895:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+26:2368:x1876351635112320:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429516.983683:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+129:2371:x1876351635112192:12345-192.168.203.39@tcp:4:dd.0 Request processed in 17809us (18572us total) trans 4294969398 rc 0/0 00000100:00100000:0.0:1789429516.983698:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11635 00002000:00100000:0.0:1789429516.983710:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946e10309500 x1876351635112192/t4294969398(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429516.983720:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10309500 with x1876351635112192 ext(11534336->12582911) 00002000:00010000:0.0:1789429516.983726:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10309500 00000100:00100000:1.0:1789429516.993357:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+28:2368:x1876351635112320:12345-192.168.203.39@tcp:4:dd.0 Request processed in 27455us (27593us total) trans 4294969399 rc 0/0 00000100:00100000:1.0:1789429516.993371:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11636 00002000:00100000:1.0:1789429516.993384:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f29dea680 x1876351635112320/t4294969399(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429516.993394:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29dea680 with x1876351635112320 ext(7340032->8388607) 00002000:00010000:1.0:1789429516.993400:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29dea680 00000100:00100000:2.0:1789429516.994936:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429516.995023:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635112576 00000100:00100000:1.0:1789429516.995033:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635112576 00002000:00100000:1.0:1789429516.995076:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946e0d983100 x1876351635112576/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429516.995086:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d983100 with x1876351635112576 ext(8388608->9437183) 00002000:00010000:1.0:1789429516.995092:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d983100 00000100:00100000:1.0:1789429516.995125:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11637 00000100:00100000:1.0:1789429516.995135:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+28:2369:x1876351635112576:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429516.998904:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429516.998985:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635112448 00000100:00100000:3.0:1789429516.998995:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635112448 00002000:00100000:3.0:1789429516.999042:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946f054d5f80 x1876351635112448/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/0 e 0 to 0 dl 1789429527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429516.999054:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d5f80 with x1876351635112448 ext(12582912->13631487) 00002000:00010000:3.0:1789429516.999060:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d5f80 00000100:00100000:3.0:1789429516.999094:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11638 00000100:00100000:3.0:1789429516.999104:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+129:2370:x1876351635112448:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429517.023125:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.023173:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429517.023558:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635112960 00000100:00100000:1.0:1789429517.023568:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635112960 00000100:00100000:1.0:1789429517.023635:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5835 00000100:00100000:1.0:1789429517.023645:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:44674:x1876351635112960:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429517.023663:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429517.023682:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9b6 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.023715:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 130 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.023725:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=1s v=(12 1) 00010000:00010000:1.0:1789429517.023729:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(13 1) 00010000:00010000:1.0:1789429517.023734:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 31 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.023768:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 130 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.023782:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 130 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429517.023796:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c00b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648400768:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429517.023880:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865000 going to sleep for 11 seconds 00000100:00080000:3.0:1789429517.023974:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429517.024140:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635112832 00000100:00100000:0.0:1789429517.024145:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635112832 00002000:00100000:0.0:1789429517.024176:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f29deb800 x1876351635112832/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.024186:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29deb800 with x1876351635112832 ext(9437184->10485759) 00002000:00010000:0.0:1789429517.024191:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29deb800 00000100:00100000:0.0:1789429517.024248:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11639 00000100:00100000:0.0:1789429517.024256:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+32:2368:x1876351635112832:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.034665:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.034700:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635112704 00000100:00100000:2.0:1789429517.034710:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635112704 00002000:00100000:2.0:1789429517.034763:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946e0d980380 x1876351635112704/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.034775:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d980380 with x1876351635112704 ext(13631488->14680063) 00010000:00010000:2.0:1789429517.034784:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 131 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.034801:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 131 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429517.034810:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0d980380 00000100:00100000:2.0:1789429517.034838:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1412 00000100:00100000:2.0:1789429517.034848:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+131:2371:x1876351635112704:12345-192.168.203.39@tcp:4:dd.0 00000100:00080000:3.0:1789429517.035607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429517.036377:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+34:2369:x1876351635112576:12345-192.168.203.39@tcp:4:dd.0 Request processed in 41238us (41443us total) trans 4294969400 rc 0/0 00000100:00100000:3.0:1789429517.036390:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11637 00002000:00100000:3.0:1789429517.036399:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946e0d983100 x1876351635112576/t4294969400(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429517.036410:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d983100 with x1876351635112576 ext(8388608->9437183) 00002000:00010000:3.0:1789429517.036424:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d983100 00000100:00100000:1.0:1789429517.040652:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c00b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648400768:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429517.040695:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 33 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.040719:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01507e00, rc 0) 00000100:00100000:1.0:1789429517.040788:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+33:44674:x1876351635112960:12345-192.168.203.39@tcp:101:dd.0 Request processed in 17143us (17613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429517.040797:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5835 00000100:00100000:1.0:1789429517.052870:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.052931:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635113088 00000100:00100000:0.0:1789429517.052942:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635113088 00002000:00100000:0.0:1789429517.052998:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f1c00b800 x1876351635113088/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.053015:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00b800 with x1876351635113088 ext(14680064->15728639) 00010000:00010000:0.0:1789429517.053026:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 133 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.053047:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 133 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429517.053057:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f1c00b800 00000100:00100000:3.0:1789429517.053359:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+134:2370:x1876351635112448:12345-192.168.203.39@tcp:4:dd.0 Request processed in 54253us (54462us total) trans 4294969401 rc 0/0 00000100:00100000:3.0:1789429517.053370:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11638 00002000:00100000:3.0:1789429517.053379:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946f054d5f80 x1876351635112448/t4294969401(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:252/0 lens 488/448 e 0 to 0 dl 1789429527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429517.053387:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d5f80 with x1876351635112448 ext(12582912->13631487) 00010000:00010000:3.0:1789429517.053394:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 134 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.053406:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 134 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429517.053425:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f054d5f80 00000100:00100000:3.0:1789429517.053448:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1413 00000100:00100000:3.0:1789429517.053457:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+133:2369:x1876351635113088:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429517.059144:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+33:2368:x1876351635112832:12345-192.168.203.39@tcp:4:dd.0 Request processed in 34878us (36018us total) trans 4294969402 rc 0/0 00000100:00100000:0.0:1789429517.059158:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11639 00002000:00100000:0.0:1789429517.059171:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f29deb800 x1876351635112832/t4294969402(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.059181:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29deb800 with x1876351635112832 ext(9437184->10485759) 00002000:00010000:0.0:1789429517.059187:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29deb800 00000100:00100000:1.0:1789429517.062371:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.062476:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635113216 00000100:00100000:3.0:1789429517.062486:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635113216 00000100:00100000:3.0:1789429517.062538:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5836 00000100:00100000:3.0:1789429517.062548:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+135:44675:x1876351635113216:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429517.062566:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429517.062586:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9bd expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.062619:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(13 1) 00010000:00010000:3.0:1789429517.062625:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(14 1) 00010000:00010000:3.0:1789429517.062630:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 136 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.062644:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 136 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.062656:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f119c0e00, rc 0) 00000100:00100000:3.0:1789429517.062715:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+136:44675:x1876351635113216:12345-192.168.203.39@tcp:101:dd.0 Request processed in 168us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429517.062722:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5836 00000100:00100000:2.0:1789429517.074948:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+136:2371:x1876351635112704:12345-192.168.203.39@tcp:4:dd.0 Request processed in 40090us (40283us total) trans 4294969403 rc 0/0 00000100:00100000:2.0:1789429517.074963:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1412 00002000:00100000:2.0:1789429517.074975:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946e0d980380 x1876351635112704/t4294969403(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.074993:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d980380 with x1876351635112704 ext(13631488->14680063) 00010000:00010000:2.0:1789429517.075004:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 136 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.075023:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 136 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429517.075030:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0d980380 00000100:00100000:2.0:1789429517.090913:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+136:2369:x1876351635113088:12345-192.168.203.39@tcp:4:dd.0 Request processed in 37447us (38046us total) trans 4294969404 rc 0/0 00000100:00100000:2.0:1789429517.090927:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1413 00002000:00100000:2.0:1789429517.090940:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f1c00b800 x1876351635113088/t4294969404(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.090952:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00b800 with x1876351635113088 ext(14680064->15728639) 00010000:00010000:2.0:1789429517.090961:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 136 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.090982:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 136 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429517.090990:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f1c00b800 00000100:00100000:3.0:1789429517.102339:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429517.102718:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635113344 00000100:00100000:1.0:1789429517.102729:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635113344 00010000:00010000:1.0:1789429517.102775:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 136 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429517.102829:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6236 00000100:00100000:1.0:1789429517.102840:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+136:2371:x1876351635113344:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429517.102855:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429517.102873:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 10485760 -> 15728640 00010000:00010000:1.0:1789429517.102880:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 136 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.102894:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 136 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.102920:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025801196/0xb4c3dad726361def lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [10485760->18446744073709551615] (req 10485760->11534335) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9af expref: 136 pid: 6681 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.102936:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(14 1) 00010000:00010000:1.0:1789429517.102942:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(14 1) 00010000:00010000:1.0:1789429517.102950:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [10485760->15728639] (req 10485760->11534335) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 32 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.102962:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [10485760->15728639] (req 10485760->11534335) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 32 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.102977:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(14 1) 00010000:00010000:1.0:1789429517.102980:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(14 1) 00010000:00010000:1.0:1789429517.102985:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 135 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.102994:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 135 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.103030:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 135 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429517.103043:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c00b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648400896:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429517.103142:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [10485760->15728639] (req 10485760->11534335) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 32 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429517.103152:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c00a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648401024:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429517.103173:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865000 going to sleep for 11 seconds 00000100:00100000:2.0:1789429517.106050:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c00b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648400896:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429517.106066:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c00a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648401024:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429517.106091:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429517.106146:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+135:2371:x1876351635113344:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3308us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429517.106157:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6236 00000100:00100000:0.0:1789429517.170289:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.170329:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.170425:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635113472 00000100:00100000:2.0:1789429517.170435:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635113472 00002000:00100000:2.0:1789429517.170485:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f054d5500 x1876351635113472/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.170496:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d5500 with x1876351635113472 ext(15728640->16777215) 00002000:00010000:2.0:1789429517.170502:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d5500 00000100:00100000:2.0:1789429517.170528:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635113600 00000100:00100000:2.0:1789429517.170531:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635113600 00002000:00100000:2.0:1789429517.170551:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f054d4700 x1876351635113600/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.170559:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4700 with x1876351635113600 ext(10485760->11534335) 00002000:00010000:2.0:1789429517.170564:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d4700 00000100:00100000:2.0:1789429517.170592:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11640 00000100:00100000:2.0:1789429517.170600:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+135:2371:x1876351635113472:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429517.170875:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11641 00000100:00100000:0.0:1789429517.170886:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+33:2368:x1876351635113600:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429517.194741:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.196418:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635113728 00000100:00100000:0.0:1789429517.196433:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635113728 00002000:00100000:0.0:1789429517.196489:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946f1c00ad80 x1876351635113728/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.196499:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00ad80 with x1876351635113728 ext(16777216->17825791) 00002000:00010000:0.0:1789429517.196505:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00ad80 00000100:00100000:0.0:1789429517.196538:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11642 00000100:00100000:0.0:1789429517.196556:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+137:2371:x1876351635113728:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.209634:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+139:2371:x1876351635113472:12345-192.168.203.39@tcp:4:dd.0 Request processed in 39016us (39336us total) trans 4294969405 rc 0/0 00000100:00100000:2.0:1789429517.209650:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11640 00002000:00100000:2.0:1789429517.209665:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f054d5500 x1876351635113472/t4294969405(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.209676:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d5500 with x1876351635113472 ext(15728640->16777215) 00002000:00010000:2.0:1789429517.209683:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d5500 00000100:00100000:0.0:1789429517.220960:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.220995:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635113856 00000100:00100000:0.0:1789429517.221004:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635113856 00002000:00100000:0.0:1789429517.221056:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946f3fbc9880 x1876351635113856/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.221068:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbc9880 with x1876351635113856 ext(11534336->12582911) 00002000:00010000:0.0:1789429517.221075:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3fbc9880 00000100:00100000:0.0:1789429517.221104:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11643 00000100:00100000:0.0:1789429517.221127:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+35:2371:x1876351635113856:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429517.222094:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+37:2368:x1876351635113600:12345-192.168.203.39@tcp:4:dd.0 Request processed in 51206us (51758us total) trans 4294969406 rc 0/0 00000100:00100000:3.0:1789429517.222103:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11641 00002000:00100000:3.0:1789429517.222112:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f054d4700 x1876351635113600/t4294969406(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429517.222120:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4700 with x1876351635113600 ext(10485760->11534335) 00002000:00010000:3.0:1789429517.222124:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f054d4700 00000100:00100000:2.0:1789429517.224891:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+139:2371:x1876351635113728:12345-192.168.203.39@tcp:4:dd.0 Request processed in 28334us (30149us total) trans 4294969407 rc 0/0 00000100:00100000:2.0:1789429517.224915:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11642 00002000:00100000:2.0:1789429517.224927:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946f1c00ad80 x1876351635113728/t4294969407(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.224937:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00ad80 with x1876351635113728 ext(16777216->17825791) 00002000:00010000:2.0:1789429517.224944:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00ad80 00000100:00100000:3.0:1789429517.248464:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.250642:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.250933:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635113984 00000100:00100000:2.0:1789429517.250944:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635113984 00002000:00100000:2.0:1789429517.250991:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946f29d56300 x1876351635113984/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.251002:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56300 with x1876351635113984 ext(17825792->18874367) 00002000:00010000:2.0:1789429517.251008:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29d56300 00000100:00100000:2.0:1789429517.251037:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635114112 00000100:00100000:2.0:1789429517.251040:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635114112 00002000:00100000:2.0:1789429517.251056:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946f1c1a9f80 x1876351635114112/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.251063:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a9f80 with x1876351635114112 ext(12582912->13631487) 00002000:00010000:2.0:1789429517.251067:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1a9f80 00000100:00100000:2.0:1789429517.251089:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11644 00000100:00100000:2.0:1789429517.251098:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+139:2370:x1876351635113984:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.251278:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11645 00000100:00100000:2.0:1789429517.251285:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+37:2369:x1876351635114112:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.274424:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+39:2371:x1876351635113856:12345-192.168.203.39@tcp:4:dd.0 Request processed in 53292us (53501us total) trans 4294969408 rc 0/0 00000100:00100000:2.0:1789429517.274439:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11643 00002000:00100000:2.0:1789429517.274452:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946f3fbc9880 x1876351635113856/t4294969408(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.274462:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbc9880 with x1876351635113856 ext(11534336->12582911) 00002000:00010000:2.0:1789429517.274468:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3fbc9880 00000100:00100000:2.0:1789429517.282525:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+141:2370:x1876351635113984:12345-192.168.203.39@tcp:4:dd.0 Request processed in 31416us (34058us total) trans 4294969409 rc 0/0 00000100:00100000:2.0:1789429517.282539:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11644 00002000:00100000:2.0:1789429517.282564:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946f29d56300 x1876351635113984/t4294969409(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.282582:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d56300 with x1876351635113984 ext(17825792->18874367) 00002000:00010000:2.0:1789429517.282588:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29d56300 00000100:00100000:2.0:1789429517.294042:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+39:2369:x1876351635114112:12345-192.168.203.39@tcp:4:dd.0 Request processed in 42745us (43397us total) trans 4294969410 rc 0/0 00000100:00100000:2.0:1789429517.294059:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11645 00002000:00100000:2.0:1789429517.294073:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946f1c1a9f80 x1876351635114112/t4294969410(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.294083:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a9f80 with x1876351635114112 ext(12582912->13631487) 00002000:00010000:2.0:1789429517.294090:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1a9f80 00000100:00100000:0.0:1789429517.300864:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429517.301047:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635114240 00000100:00100000:1.0:1789429517.301056:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635114240 00002000:00100000:1.0:1789429517.301104:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946f1c1ab480 x1876351635114240/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.301115:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1ab480 with x1876351635114240 ext(18874368->19922943) 00002000:00010000:1.0:1789429517.301121:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1ab480 00000100:00100000:1.0:1789429517.301161:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11646 00000100:00100000:1.0:1789429517.301171:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+141:2371:x1876351635114240:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429517.305733:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.305825:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635114368 00000100:00100000:2.0:1789429517.305837:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635114368 00002000:00100000:2.0:1789429517.305883:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946f1c00a680 x1876351635114368/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.305895:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00a680 with x1876351635114368 ext(13631488->14680063) 00002000:00010000:2.0:1789429517.305909:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00a680 00000100:00100000:2.0:1789429517.305943:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11647 00000100:00100000:2.0:1789429517.305952:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+39:2368:x1876351635114368:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429517.320077:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429517.320265:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635114496 00000100:00100000:1.0:1789429517.320276:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635114496 00002000:00100000:1.0:1789429517.320326:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f415c6680 x1876351635114496/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.320337:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6680 with x1876351635114496 ext(19922944->20971519) 00002000:00010000:1.0:1789429517.320342:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f415c6680 00000100:00100000:2.0:1789429517.320459:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11648 00000100:00100000:2.0:1789429517.320472:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+143:2370:x1876351635114496:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.343475:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+145:2371:x1876351635114240:12345-192.168.203.39@tcp:4:dd.0 Request processed in 42295us (42610us total) trans 4294969411 rc 0/0 00000100:00100000:2.0:1789429517.343488:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11646 00002000:00100000:2.0:1789429517.343503:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946f1c1ab480 x1876351635114240/t4294969411(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.343513:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1ab480 with x1876351635114240 ext(18874368->19922943) 00002000:00010000:2.0:1789429517.343519:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1ab480 00000100:00100000:3.0:1789429517.359846:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.359885:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.359917:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.360002:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635114752 00000100:00100000:2.0:1789429517.360012:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635114752 00000100:00100000:2.0:1789429517.360069:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5837 00000100:00100000:2.0:1789429517.360079:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+41:44674:x1876351635114752:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429517.360096:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429517.360114:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9c4 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429517.360129:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635114624 00000100:00100000:3.0:1789429517.360135:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635114624 00010000:00010000:2.0:1789429517.360145:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 144 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.360156:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(14 1) 00010000:00010000:2.0:1789429517.360161:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(15 1) 00002000:00100000:3.0:1789429517.360165:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f29da8e00 x1876351635114624/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1789429517.360170:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 43 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789429517.360187:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8e00 with x1876351635114624 ext(14680064->15728639) 00002000:00010000:3.0:1789429517.360193:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da8e00 00000100:00100000:3.0:1789429517.360234:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635114880 00000100:00100000:3.0:1789429517.360239:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635114880 00010000:00010000:2.0:1789429517.360240:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 144 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789429517.360257:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946f2f50b800 x1876351635114880/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1789429517.360258:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 145 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789429517.360281:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f50b800 with x1876351635114880 ext(20971520->22020095) 00000100:00100000:2.0:1789429517.360287:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0d982300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648401152:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429517.360289:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 145 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429517.360304:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11649 00010000:00010000:3.0:1789429517.360305:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 145 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429517.360313:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f2f50b800 00000100:00100000:1.0:1789429517.360314:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+43:2368:x1876351635114624:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429517.360328:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1414 00000100:00100000:3.0:1789429517.360336:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+145:2370:x1876351635114880:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.360372:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e15865000 going to sleep for 11 seconds 00000100:00100000:3.0:1789429517.369719:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0d982300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648401152:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429517.369756:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 44 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.369778:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546800, rc 0) 00000100:00100000:3.0:1789429517.369842:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+44:44674:x1876351635114752:12345-192.168.203.39@tcp:101:dd.0 Request processed in 9764us (9956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429517.369851:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5837 00000100:00100000:2.0:1789429517.373651:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+44:2368:x1876351635114368:12345-192.168.203.39@tcp:4:dd.0 Request processed in 67689us (67914us total) trans 4294969412 rc 0/0 00000100:00100000:2.0:1789429517.373665:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11647 00002000:00100000:2.0:1789429517.373678:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946f1c00a680 x1876351635114368/t4294969412(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.373689:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00a680 with x1876351635114368 ext(13631488->14680063) 00002000:00010000:2.0:1789429517.373694:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00a680 00000100:00100000:2.0:1789429517.375163:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+147:2370:x1876351635114496:12345-192.168.203.39@tcp:4:dd.0 Request processed in 54688us (55088us total) trans 4294969413 rc 0/0 00000100:00100000:2.0:1789429517.375174:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11648 00002000:00100000:2.0:1789429517.375186:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f415c6680 x1876351635114496/t4294969413(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.375195:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f415c6680 with x1876351635114496 ext(19922944->20971519) 00010000:00010000:2.0:1789429517.375231:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 147 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.375250:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 147 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429517.375311:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f415c6680 00000100:00100000:0.0:1789429517.379270:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+44:2368:x1876351635114624:12345-192.168.203.39@tcp:4:dd.0 Request processed in 18947us (19423us total) trans 4294969414 rc 0/0 00000100:00100000:0.0:1789429517.379284:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11649 00002000:00100000:0.0:1789429517.379298:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f29da8e00 x1876351635114624/t4294969414(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.379308:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8e00 with x1876351635114624 ext(14680064->15728639) 00002000:00010000:0.0:1789429517.379314:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da8e00 00000100:00100000:0.0:1789429517.381114:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+147:2370:x1876351635114880:12345-192.168.203.39@tcp:4:dd.0 Request processed in 20770us (21188us total) trans 4294969415 rc 0/0 00000100:00100000:0.0:1789429517.381127:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1414 00002000:00100000:0.0:1789429517.381138:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946f2f50b800 x1876351635114880/t4294969415(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.381249:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f50b800 with x1876351635114880 ext(20971520->22020095) 00010000:00010000:0.0:1789429517.381259:0:18636:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 147 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.381278:0:18636:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 147 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429517.381286:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f2f50b800 00000100:00100000:1.0:1789429517.383058:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429517.383102:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.383403:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635115136 00000100:00100000:0.0:1789429517.383422:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635115136 00000100:00100000:2.0:1789429517.383534:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635115008 00000100:00100000:2.0:1789429517.383539:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635115008 00002000:00100000:2.0:1789429517.383570:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946f1c00b100 x1876351635115008/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.383591:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00b100 with x1876351635115008 ext(22020096->23068671) 00010000:00010000:2.0:1789429517.383600:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 148 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.383615:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 148 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429517.383622:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f1c00b100 00000100:00100000:2.0:1789429517.383646:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1415 00000100:00100000:2.0:1789429517.383655:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+148:2368:x1876351635115008:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429517.384097:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5838 00000100:00100000:0.0:1789429517.384108:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+149:44675:x1876351635115136:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429517.384116:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429517.384131:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9cb expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.384155:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(15 1) 00010000:00010000:0.0:1789429517.384162:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(16 1) 00010000:00010000:0.0:1789429517.384167:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 150 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.384179:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 150 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.384191:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93ac00, rc 0) 00000100:00100000:0.0:1789429517.384245:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+150:44675:x1876351635115136:12345-192.168.203.39@tcp:101:dd.0 Request processed in 140us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429517.384252:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5838 00000100:00100000:2.0:1789429517.397027:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+150:2368:x1876351635115008:12345-192.168.203.39@tcp:4:dd.0 Request processed in 13363us (13967us total) trans 4294969416 rc 0/0 00000100:00100000:2.0:1789429517.397040:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1415 00002000:00100000:2.0:1789429517.397052:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946f1c00b100 x1876351635115008/t4294969416(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.397062:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00b100 with x1876351635115008 ext(22020096->23068671) 00010000:00010000:2.0:1789429517.397074:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 150 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.397092:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 150 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429517.397100:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f1c00b100 00000100:00100000:2.0:1789429517.424348:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429517.424521:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635115264 00000100:00100000:1.0:1789429517.424532:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635115264 00010000:00010000:1.0:1789429517.424586:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 150 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429517.424629:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6237 00000100:00100000:1.0:1789429517.424639:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+150:2371:x1876351635115264:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429517.424655:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429517.424673:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 15728640 -> 23068672 00010000:00010000:1.0:1789429517.424680:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 150 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.424700:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 150 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.424723:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000650b91fb/0xb4c3dad726361dfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [15728640->18446744073709551615] (req 15728640->16777215) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9bd expref: 150 pid: 8085 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.424740:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(16 1) 00010000:00010000:1.0:1789429517.424746:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(16 1) 00010000:00010000:1.0:1789429517.424754:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [15728640->23068671] (req 15728640->16777215) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 43 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.424768:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [15728640->23068671] (req 15728640->16777215) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 43 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.424777:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(16 1) 00010000:00010000:1.0:1789429517.424780:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(16 1) 00010000:00010000:1.0:1789429517.424785:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 149 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.424793:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 149 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.424831:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 149 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429517.424850:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3449a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648401280:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429517.424980:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [15728640->23068671] (req 15728640->16777215) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 43 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429517.424991:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8daa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648401408:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429517.425015:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429517.438976:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3449a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648401280:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429517.438994:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8daa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648401408:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429517.439020:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429517.439130:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+149:2371:x1876351635115264:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 14492us (14789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429517.439141:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6237 00000100:00100000:2.0:1789429517.484732:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.484813:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635115392 00000100:00100000:3.0:1789429517.484824:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635115392 00002000:00100000:3.0:1789429517.484871:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946e0d982a00 x1876351635115392/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429517.484880:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d982a00 with x1876351635115392 ext(15728640->16777215) 00002000:00010000:3.0:1789429517.484885:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d982a00 00000100:00100000:3.0:1789429517.484914:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11650 00000100:00100000:3.0:1789429517.484923:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+44:2371:x1876351635115392:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429517.485370:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429517.485628:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635115520 00000100:00100000:1.0:1789429517.485634:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635115520 00002000:00100000:1.0:1789429517.485660:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946e15187b80 x1876351635115520/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.485668:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15187b80 with x1876351635115520 ext(23068672->24117247) 00002000:00010000:1.0:1789429517.485672:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15187b80 00000100:00100000:1.0:1789429517.485694:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11651 00000100:00100000:1.0:1789429517.485701:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e15187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+149:2369:x1876351635115520:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.520915:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.520959:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635115648 00000100:00100000:3.0:1789429517.520968:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635115648 00000100:00100000:1.0:1789429517.521280:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+47:2371:x1876351635115392:12345-192.168.203.39@tcp:4:dd.0 Request processed in 36356us (36554us total) trans 4294969417 rc 0/0 00000100:00100000:1.0:1789429517.521295:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11650 00002000:00100000:1.0:1789429517.521307:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946e0d982a00 x1876351635115392/t4294969417(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.521318:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d982a00 with x1876351635115392 ext(15728640->16777215) 00002000:00010000:1.0:1789429517.521324:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d982a00 00002000:00100000:3.0:1789429517.523771:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946e0d982300 x1876351635115648/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429517.523786:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d982300 with x1876351635115648 ext(16777216->17825791) 00002000:00010000:3.0:1789429517.523792:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d982300 00000100:00100000:3.0:1789429517.523823:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11652 00000100:00100000:3.0:1789429517.523835:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+46:2370:x1876351635115648:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429517.526761:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e15187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+151:2369:x1876351635115520:12345-192.168.203.39@tcp:4:dd.0 Request processed in 40271us (40602us total) trans 4294969418 rc 0/0 00000100:00100000:1.0:1789429517.526778:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11651 00002000:00100000:1.0:1789429517.526790:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946e15187b80 x1876351635115520/t4294969418(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.526800:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e15187b80 with x1876351635115520 ext(23068672->24117247) 00002000:00010000:1.0:1789429517.526806:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e15187b80 00000100:00100000:2.0:1789429517.534522:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.534665:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635115776 00000100:00100000:0.0:1789429517.534675:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635115776 00002000:00100000:0.0:1789429517.534723:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946e0d981880 x1876351635115776/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.534735:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d981880 with x1876351635115776 ext(24117248->25165823) 00002000:00010000:0.0:1789429517.534740:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d981880 00000100:00100000:0.0:1789429517.534772:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11653 00000100:00100000:0.0:1789429517.534781:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+151:2368:x1876351635115776:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429517.538119:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+48:2370:x1876351635115648:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14278us (17204us total) trans 4294969419 rc 0/0 00000100:00100000:0.0:1789429517.538132:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11652 00002000:00100000:0.0:1789429517.538143:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946e0d982300 x1876351635115648/t4294969419(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.538152:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d982300 with x1876351635115648 ext(16777216->17825791) 00002000:00010000:0.0:1789429517.538159:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d982300 00010000:00010000:0.0:1789429517.540106:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429517.545968:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+153:2368:x1876351635115776:12345-192.168.203.39@tcp:4:dd.0 Request processed in 11177us (11444us total) trans 4294969420 rc 0/0 00000100:00100000:0.0:1789429517.545981:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11653 00002000:00100000:0.0:1789429517.545995:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946e0d981880 x1876351635115776/t4294969420(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.546005:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d981880 with x1876351635115776 ext(24117248->25165823) 00002000:00010000:0.0:1789429517.546011:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d981880 00000100:00100000:3.0:1789429517.550330:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.550461:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635115904 00000100:00100000:2.0:1789429517.550471:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635115904 00002000:00100000:2.0:1789429517.550519:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946e1523e680 x1876351635115904/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.550530:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523e680 with x1876351635115904 ext(17825792->18874367) 00002000:00010000:2.0:1789429517.550536:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523e680 00000100:00100000:2.0:1789429517.550567:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11654 00000100:00100000:2.0:1789429517.550576:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+48:2371:x1876351635115904:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429517.561557:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+50:2371:x1876351635115904:12345-192.168.203.39@tcp:4:dd.0 Request processed in 10972us (11225us total) trans 4294969421 rc 0/0 00000100:00100000:0.0:1789429517.561571:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11654 00002000:00100000:0.0:1789429517.561584:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946e1523e680 x1876351635115904/t4294969421(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.561594:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523e680 with x1876351635115904 ext(17825792->18874367) 00002000:00010000:0.0:1789429517.561600:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523e680 00000100:00100000:1.0:1789429517.573724:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.573808:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635116032 00000100:00100000:2.0:1789429517.573818:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635116032 00002000:00100000:2.0:1789429517.573865:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f3f8daa00 x1876351635116032/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.573875:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8daa00 with x1876351635116032 ext(25165824->26214399) 00002000:00010000:2.0:1789429517.573882:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8daa00 00000100:00100000:2.0:1789429517.573918:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11655 00000100:00100000:2.0:1789429517.573927:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+153:2369:x1876351635116032:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.588190:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+155:2369:x1876351635116032:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14253us (14464us total) trans 4294969422 rc 0/0 00000100:00100000:2.0:1789429517.588242:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11655 00002000:00100000:2.0:1789429517.588256:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f3f8daa00 x1876351635116032/t4294969422(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.588266:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8daa00 with x1876351635116032 ext(25165824->26214399) 00002000:00010000:2.0:1789429517.588272:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8daa00 00000100:00100000:3.0:1789429517.596065:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.596466:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635116160 00000100:00100000:0.0:1789429517.596486:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635116160 00002000:00100000:0.0:1789429517.596536:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946e1523dc00 x1876351635116160/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.596547:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523dc00 with x1876351635116160 ext(18874368->19922943) 00002000:00010000:0.0:1789429517.596553:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523dc00 00000100:00100000:0.0:1789429517.596587:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11656 00000100:00100000:0.0:1789429517.596597:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+50:2370:x1876351635116160:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.618367:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.619404:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635116288 00000100:00100000:3.0:1789429517.619428:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635116288 00000100:00100000:2.0:1789429517.621070:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+52:2370:x1876351635116160:12345-192.168.203.39@tcp:4:dd.0 Request processed in 24465us (25006us total) trans 4294969423 rc 0/0 00000100:00100000:2.0:1789429517.621083:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11656 00002000:00100000:2.0:1789429517.621096:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946e1523dc00 x1876351635116160/t4294969423(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.621106:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523dc00 with x1876351635116160 ext(18874368->19922943) 00002000:00010000:2.0:1789429517.621112:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523dc00 00002000:00100000:0.0:1789429517.621995:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946e0d980700 x1876351635116288/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.622006:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d980700 with x1876351635116288 ext(26214400->27262975) 00002000:00010000:0.0:1789429517.622012:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d980700 00000100:00100000:0.0:1789429517.622049:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11657 00000100:00100000:0.0:1789429517.622060:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+155:2368:x1876351635116288:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429517.640919:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.641019:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635116416 00000100:00100000:2.0:1789429517.641030:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635116416 00002000:00100000:2.0:1789429517.641077:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f3f8d8e00 x1876351635116416/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.641089:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8e00 with x1876351635116416 ext(19922944->20971519) 00002000:00010000:2.0:1789429517.641095:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8d8e00 00000100:00100000:2.0:1789429517.641130:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11658 00000100:00100000:2.0:1789429517.641139:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+52:2371:x1876351635116416:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429517.660247:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.660277:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.661130:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+157:2368:x1876351635116288:12345-192.168.203.39@tcp:4:dd.0 Request processed in 39068us (42767us total) trans 4294969424 rc 0/0 00000100:00100000:0.0:1789429517.661143:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11657 00002000:00100000:0.0:1789429517.661155:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946e0d980700 x1876351635116288/t4294969424(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.661165:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d980700 with x1876351635116288 ext(26214400->27262975) 00002000:00010000:0.0:1789429517.661172:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d980700 00000100:00100000:0.0:1789429517.662034:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635116544 00000100:00100000:0.0:1789429517.662043:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635116544 00002000:00100000:0.0:1789429517.662079:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946e1523d880 x1876351635116544/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.662091:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523d880 with x1876351635116544 ext(20971520->22020095) 00002000:00010000:0.0:1789429517.662095:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523d880 00000100:00100000:2.0:1789429517.662384:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635116672 00000100:00100000:2.0:1789429517.662389:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635116672 00002000:00100000:2.0:1789429517.664700:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946e1523f800 x1876351635116672/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.664714:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523f800 with x1876351635116672 ext(27262976->28311551) 00002000:00010000:2.0:1789429517.664720:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523f800 00000100:00100000:2.0:1789429517.664752:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11659 00000100:00100000:2.0:1789429517.664763:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+54:2371:x1876351635116544:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429517.665347:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11660 00000100:00100000:3.0:1789429517.665359:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+157:2369:x1876351635116672:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.667915:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+56:2371:x1876351635116416:12345-192.168.203.39@tcp:4:dd.0 Request processed in 26410us (26637us total) trans 4294969425 rc 0/0 00000100:00100000:2.0:1789429517.667930:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11658 00002000:00100000:2.0:1789429517.667942:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f3f8d8e00 x1876351635116416/t4294969425(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.667954:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8e00 with x1876351635116416 ext(19922944->20971519) 00002000:00010000:2.0:1789429517.667960:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8d8e00 00000100:00100000:2.0:1789429517.690442:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+56:2371:x1876351635116544:12345-192.168.203.39@tcp:4:dd.0 Request processed in 25669us (30230us total) trans 4294969426 rc 0/0 00000100:00100000:2.0:1789429517.690457:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11659 00002000:00100000:2.0:1789429517.690473:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946e1523d880 x1876351635116544/t4294969426(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.690482:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523d880 with x1876351635116544 ext(20971520->22020095) 00002000:00010000:2.0:1789429517.690489:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523d880 00000100:00100000:1.0:1789429517.693379:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.693633:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635116928 00000100:00100000:3.0:1789429517.693643:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635116928 00000100:00100000:3.0:1789429517.693703:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5839 00000100:00100000:3.0:1789429517.693712:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+56:44674:x1876351635116928:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429517.693729:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429517.693749:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9d2 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.693781:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 158 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.693791:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(16 1) 00010000:00010000:3.0:1789429517.693796:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(17 1) 00010000:00010000:3.0:1789429517.693801:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 57 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.693833:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 158 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.693852:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 158 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429517.693866:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e1523ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648401536:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429517.694053:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c272e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429517.696254:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.696306:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.697468:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+159:2369:x1876351635116672:12345-192.168.203.39@tcp:4:dd.0 Request processed in 32106us (37184us total) trans 4294969427 rc 0/0 00000100:00100000:0.0:1789429517.697480:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11660 00002000:00100000:0.0:1789429517.697491:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946e1523f800 x1876351635116672/t4294969427(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.697500:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523f800 with x1876351635116672 ext(27262976->28311551) 00010000:00010000:0.0:1789429517.697510:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 159 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.697533:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 159 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429517.697542:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e1523f800 00000100:00100000:0.0:1789429517.697775:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635116800 00000100:00100000:0.0:1789429517.697783:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635116800 00002000:00100000:0.0:1789429517.697815:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946e0d980a80 x1876351635116800/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.697824:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d980a80 with x1876351635116800 ext(22020096->23068671) 00002000:00010000:0.0:1789429517.697827:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d980a80 00000100:00100000:0.0:1789429517.697843:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635117056 00000100:00100000:0.0:1789429517.697846:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635117056 00002000:00100000:0.0:1789429517.697861:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946f05470e00 x1876351635117056/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.697869:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05470e00 with x1876351635117056 ext(28311552->29360127) 00010000:00010000:0.0:1789429517.697874:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 159 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.697884:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 159 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429517.697891:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f05470e00 00000100:00100000:0.0:1789429517.697913:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1416 00000100:00100000:0.0:1789429517.697922:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+159:2369:x1876351635117056:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.698984:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11661 00000100:00100000:2.0:1789429517.699002:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+58:2370:x1876351635116800:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429517.710347:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e1523ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648401536:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429517.710383:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 59 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.710423:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6600, rc 0) 00000100:00100000:1.0:1789429517.710469:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+59:44674:x1876351635116928:12345-192.168.203.39@tcp:101:dd.0 Request processed in 16758us (17099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429517.710478:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5839 00000100:00100000:0.0:1789429517.719149:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+59:2370:x1876351635116800:12345-192.168.203.39@tcp:4:dd.0 Request processed in 20144us (22897us total) trans 4294969428 rc 0/0 00000100:00100000:0.0:1789429517.719164:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11661 00002000:00100000:0.0:1789429517.719177:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946e0d980a80 x1876351635116800/t4294969428(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.719188:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d980a80 with x1876351635116800 ext(22020096->23068671) 00002000:00010000:0.0:1789429517.719194:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d980a80 00000100:00100000:3.0:1789429517.719810:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.719927:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.719950:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635117184 00000100:00100000:3.0:1789429517.719958:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635117184 00002000:00100000:3.0:1789429517.719995:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e1523df80 x1876351635117184/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429517.720004:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523df80 with x1876351635117184 ext(29360128->30408703) 00010000:00010000:3.0:1789429517.720012:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 161 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.720028:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 161 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429517.720035:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e1523df80 00000100:00100000:3.0:1789429517.720056:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1417 00000100:00100000:3.0:1789429517.720065:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+161:2370:x1876351635117184:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429517.720551:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635117312 00000100:00100000:0.0:1789429517.720631:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635117312 00000100:00100000:0.0:1789429517.720666:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5840 00000100:00100000:0.0:1789429517.720674:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+163:44675:x1876351635117312:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429517.720683:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429517.720699:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9d9 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.720723:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(17 1) 00010000:00010000:0.0:1789429517.720728:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(18 1) 00010000:00010000:0.0:1789429517.720733:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 164 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.720745:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 164 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.720757:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93bc00, rc 0) 00000100:00100000:0.0:1789429517.720795:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+164:44675:x1876351635117312:12345-192.168.203.39@tcp:101:dd.0 Request processed in 121us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429517.720801:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5840 00000100:00100000:1.0:1789429517.722024:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05470e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+164:2369:x1876351635117056:12345-192.168.203.39@tcp:4:dd.0 Request processed in 24097us (25712us total) trans 4294969429 rc 0/0 00000100:00100000:1.0:1789429517.722036:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1416 00002000:00100000:1.0:1789429517.722046:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946f05470e00 x1876351635117056/t4294969429(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.722055:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f05470e00 with x1876351635117056 ext(28311552->29360127) 00010000:00010000:1.0:1789429517.722064:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 164 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.722082:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 164 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429517.722090:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f05470e00 00000100:00100000:2.0:1789429517.732804:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+164:2370:x1876351635117184:12345-192.168.203.39@tcp:4:dd.0 Request processed in 12731us (12866us total) trans 4294969430 rc 0/0 00000100:00100000:2.0:1789429517.732817:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1417 00002000:00100000:2.0:1789429517.732829:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e1523df80 x1876351635117184/t4294969430(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.732841:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523df80 with x1876351635117184 ext(29360128->30408703) 00010000:00010000:2.0:1789429517.732851:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 164 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.732871:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 164 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429517.732880:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e1523df80 00000100:00100000:2.0:1789429517.741856:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.741949:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635117440 00000100:00100000:0.0:1789429517.741958:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635117440 00010000:00010000:0.0:1789429517.741998:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 164 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429517.742038:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6238 00000100:00100000:0.0:1789429517.742047:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+164:2369:x1876351635117440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429517.742061:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789429517.742080:0:11354:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 23068672 -> 30408704 00002000:00010000:0.0:1789429517.742083:0:11354:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 1789429517 -> 1789429518 00002000:00010000:0.0:1789429517.742085:0:11354:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 1789429517 -> 1789429518 00010000:00010000:0.0:1789429517.742092:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 164 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.742106:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 164 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.742128:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a674ce45/0xb4c3dad726361e0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [23068672->18446744073709551615] (req 23068672->24117247) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9cb expref: 164 pid: 6682 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.742146:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(18 1) 00010000:00010000:0.0:1789429517.742151:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(18 1) 00010000:00010000:0.0:1789429517.742159:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [23068672->30408703] (req 23068672->24117247) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 58 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.742175:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [23068672->30408703] (req 23068672->24117247) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 58 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.742184:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(18 1) 00010000:00010000:0.0:1789429517.742187:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(18 1) 00010000:00010000:0.0:1789429517.742192:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 163 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.742626:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 163 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.742666:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 163 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429517.742680:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648401664:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429517.742769:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [23068672->30408703] (req 23068672->24117247) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 58 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429517.742779:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648401792:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429517.742800:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789429517.750692:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648401664:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429517.750706:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648401792:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429517.750730:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429517.750830:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+163:2369:x1876351635117440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8782us (8980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429517.750842:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6238 00000100:00100000:1.0:1789429517.764494:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.765136:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635117568 00000100:00100000:3.0:1789429517.765148:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635117568 00002000:00100000:3.0:1789429517.765235:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946f3f8d8000 x1876351635117568/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429517.765247:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8000 with x1876351635117568 ext(30408704->31457279) 00002000:00010000:3.0:1789429517.765253:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8d8000 00000100:00100000:3.0:1789429517.765285:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11662 00000100:00100000:3.0:1789429517.765294:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+163:2368:x1876351635117568:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429517.767333:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.769696:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635117696 00000100:00100000:2.0:1789429517.769710:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635117696 00002000:00100000:2.0:1789429517.769763:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946f3449a300 x1876351635117696/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.769774:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449a300 with x1876351635117696 ext(23068672->24117247) 00002000:00010000:2.0:1789429517.769781:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3449a300 00000100:00100000:2.0:1789429517.769806:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11663 00000100:00100000:2.0:1789429517.769816:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3449a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+59:2370:x1876351635117696:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429517.782328:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.782365:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429517.782392:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635117952 00000100:00100000:1.0:1789429517.782401:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635117952 00002000:00100000:1.0:1789429517.782456:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946e1523d500 x1876351635117952/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.782468:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523d500 with x1876351635117952 ext(24117248->25165823) 00002000:00010000:1.0:1789429517.782473:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523d500 00000100:00100000:1.0:1789429517.782503:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635117824 00000100:00100000:1.0:1789429517.782507:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635117824 00002000:00100000:1.0:1789429517.782522:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946e1523c380 x1876351635117824/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.782536:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523c380 with x1876351635117824 ext(31457280->32505855) 00002000:00010000:1.0:1789429517.782540:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523c380 00000100:00100000:1.0:1789429517.782667:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11664 00000100:00100000:1.0:1789429517.782677:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+61:2370:x1876351635117952:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429517.783520:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11665 00000100:00100000:3.0:1789429517.783534:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+165:2369:x1876351635117824:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429517.799599:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.799638:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.799666:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635118208 00000100:00100000:2.0:1789429517.799677:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635118208 00002000:00100000:2.0:1789429517.799723:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946e1523f100 x1876351635118208/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.799734:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523f100 with x1876351635118208 ext(25165824->26214399) 00002000:00010000:2.0:1789429517.799740:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523f100 00000100:00100000:2.0:1789429517.799770:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635118080 00000100:00100000:2.0:1789429517.799773:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635118080 00002000:00100000:2.0:1789429517.799790:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946e1523e300 x1876351635118080/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.799799:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523e300 with x1876351635118080 ext(32505856->33554431) 00002000:00010000:2.0:1789429517.799802:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523e300 00000100:00100000:2.0:1789429517.799829:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11666 00000100:00100000:2.0:1789429517.799838:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+63:2370:x1876351635118208:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429517.800051:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11667 00000100:00100000:1.0:1789429517.800061:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+167:2368:x1876351635118080:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429517.811922:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+169:2368:x1876351635117568:12345-192.168.203.39@tcp:4:dd.0 Request processed in 46618us (47504us total) trans 4294969431 rc 0/0 00000100:00100000:0.0:1789429517.811937:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11662 00002000:00100000:0.0:1789429517.811950:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946f3f8d8000 x1876351635117568/t4294969431(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.811961:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8d8000 with x1876351635117568 ext(30408704->31457279) 00002000:00010000:0.0:1789429517.811967:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8d8000 00000100:00100000:0.0:1789429517.823079:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3449a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+65:2370:x1876351635117696:12345-192.168.203.39@tcp:4:dd.0 Request processed in 53256us (55744us total) trans 4294969432 rc 0/0 00000100:00100000:0.0:1789429517.823100:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11663 00002000:00100000:0.0:1789429517.823112:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946f3449a300 x1876351635117696/t4294969432(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.823122:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3449a300 with x1876351635117696 ext(23068672->24117247) 00002000:00010000:0.0:1789429517.823128:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3449a300 00000100:00100000:1.0:1789429517.828157:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.828285:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635118336 00000100:00100000:0.0:1789429517.828296:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635118336 00002000:00100000:0.0:1789429517.828344:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946f3221f800 x1876351635118336/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.828356:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221f800 with x1876351635118336 ext(33554432->34603007) 00002000:00010000:0.0:1789429517.828362:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3221f800 00000100:00100000:0.0:1789429517.828415:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11668 00000100:00100000:0.0:1789429517.828426:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+169:2369:x1876351635118336:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429517.832137:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.833226:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635118464 00000100:00100000:2.0:1789429517.833239:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635118464 00002000:00100000:2.0:1789429517.833291:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f3221df80 x1876351635118464/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.833304:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221df80 with x1876351635118464 ext(26214400->27262975) 00002000:00010000:2.0:1789429517.833309:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3221df80 00000100:00100000:2.0:1789429517.833347:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11669 00000100:00100000:2.0:1789429517.833357:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+65:2370:x1876351635118464:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429517.846514:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+171:2369:x1876351635117824:12345-192.168.203.39@tcp:4:dd.0 Request processed in 62971us (64134us total) trans 4294969433 rc 0/0 00000100:00100000:1.0:1789429517.846514:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+67:2370:x1876351635117952:12345-192.168.203.39@tcp:4:dd.0 Request processed in 63825us (64181us total) trans 4294969434 rc 0/0 00000100:00100000:1.0:1789429517.846535:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11664 00000100:00100000:0.0:1789429517.846541:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11665 00002000:00100000:0.0:1789429517.846563:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946e1523c380 x1876351635117824/t4294969433(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.846580:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523c380 with x1876351635117824 ext(31457280->32505855) 00002000:00010000:0.0:1789429517.846587:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523c380 00002000:00100000:1.0:1789429517.846650:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946e1523d500 x1876351635117952/t4294969434(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.846659:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523d500 with x1876351635117952 ext(24117248->25165823) 00002000:00010000:1.0:1789429517.846664:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523d500 00000100:00100000:1.0:1789429517.851501:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429517.851612:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.852957:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635118592 00000100:00100000:2.0:1789429517.852969:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635118592 00002000:00100000:2.0:1789429517.853018:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946f119c5c00 x1876351635118592/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.853030:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c5c00 with x1876351635118592 ext(34603008->35651583) 00002000:00010000:2.0:1789429517.853036:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f119c5c00 00000100:00100000:2.0:1789429517.853055:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635118720 00000100:00100000:2.0:1789429517.853059:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635118720 00002000:00100000:2.0:1789429517.853075:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946e0de0ed80 x1876351635118720/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.853083:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ed80 with x1876351635118720 ext(27262976->28311551) 00002000:00010000:2.0:1789429517.853087:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ed80 00000100:00100000:2.0:1789429517.853109:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11670 00000100:00100000:2.0:1789429517.853118:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+171:2368:x1876351635118592:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429517.854688:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11671 00000100:00100000:1.0:1789429517.854705:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+67:2371:x1876351635118720:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429517.861504:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+69:2370:x1876351635118208:12345-192.168.203.39@tcp:4:dd.0 Request processed in 61654us (61901us total) trans 4294969435 rc 0/0 00000100:00100000:0.0:1789429517.861520:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11666 00002000:00100000:0.0:1789429517.861535:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946e1523f100 x1876351635118208/t4294969435(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.861547:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523f100 with x1876351635118208 ext(25165824->26214399) 00002000:00010000:0.0:1789429517.861553:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523f100 00000100:00100000:0.0:1789429517.870090:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+173:2368:x1876351635118080:12345-192.168.203.39@tcp:4:dd.0 Request processed in 70021us (70440us total) trans 4294969436 rc 0/0 00000100:00100000:0.0:1789429517.870106:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11667 00002000:00100000:0.0:1789429517.870119:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946e1523e300 x1876351635118080/t4294969436(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.870130:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523e300 with x1876351635118080 ext(32505856->33554431) 00002000:00010000:0.0:1789429517.870136:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523e300 00000100:00100000:3.0:1789429517.873339:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.873367:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.873502:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635118848 00000100:00100000:2.0:1789429517.873513:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635118848 00002000:00100000:2.0:1789429517.873632:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e1523ce00 x1876351635118848/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.873645:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523ce00 with x1876351635118848 ext(35651584->36700159) 00002000:00010000:2.0:1789429517.873653:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523ce00 00000100:00100000:2.0:1789429517.873684:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635118976 00000100:00100000:2.0:1789429517.873687:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635118976 00002000:00100000:2.0:1789429517.873703:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946e1523ea00 x1876351635118976/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.873712:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523ea00 with x1876351635118976 ext(28311552->29360127) 00002000:00010000:2.0:1789429517.873716:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523ea00 00000100:00100000:2.0:1789429517.873834:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11672 00000100:00100000:2.0:1789429517.873844:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+173:2368:x1876351635118848:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.877700:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+70:2370:x1876351635118464:12345-192.168.203.39@tcp:4:dd.0 Request processed in 44332us (45558us total) trans 4294969437 rc 0/0 00000100:00100000:2.0:1789429517.877714:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11669 00002000:00100000:2.0:1789429517.877726:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f3221df80 x1876351635118464/t4294969437(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.877737:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221df80 with x1876351635118464 ext(26214400->27262975) 00002000:00010000:2.0:1789429517.877744:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3221df80 00000100:00100000:2.0:1789429517.877777:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11673 00000100:00100000:2.0:1789429517.877790:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+69:2371:x1876351635118976:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.894781:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f119c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+175:2368:x1876351635118592:12345-192.168.203.39@tcp:4:dd.0 Request processed in 41654us (43278us total) trans 4294969438 rc 0/0 00000100:00100000:2.0:1789429517.894799:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11670 00002000:00100000:2.0:1789429517.894811:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946f119c5c00 x1876351635118592/t4294969438(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.894821:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f119c5c00 with x1876351635118592 ext(34603008->35651583) 00002000:00010000:2.0:1789429517.894828:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f119c5c00 00000100:00100000:1.0:1789429517.900337:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+175:2369:x1876351635118336:12345-192.168.203.39@tcp:4:dd.0 Request processed in 71900us (72177us total) trans 4294969439 rc 0/0 00000100:00100000:1.0:1789429517.900352:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11668 00002000:00100000:1.0:1789429517.900367:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946f3221f800 x1876351635118336/t4294969439(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.900377:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221f800 with x1876351635118336 ext(33554432->34603007) 00002000:00010000:1.0:1789429517.900384:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3221f800 00000100:00100000:1.0:1789429517.903295:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+71:2371:x1876351635118720:12345-192.168.203.39@tcp:4:dd.0 Request processed in 48587us (51673us total) trans 4294969440 rc 0/0 00000100:00100000:1.0:1789429517.903308:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11671 00002000:00100000:1.0:1789429517.903320:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946e0de0ed80 x1876351635118720/t4294969440(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.903331:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ed80 with x1876351635118720 ext(27262976->28311551) 00002000:00010000:1.0:1789429517.903336:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ed80 00000100:00100000:2.0:1789429517.912632:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.912714:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429517.912772:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.912813:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635119360 00000100:00100000:0.0:1789429517.912824:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635119360 00000100:00100000:0.0:1789429517.912875:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5841 00000100:00100000:0.0:1789429517.912885:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+71:44674:x1876351635119360:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429517.912902:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429517.912921:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9e0 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.912957:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 174 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.912967:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(18 1) 00010000:00010000:0.0:1789429517.912972:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(19 1) 00010000:00010000:0.0:1789429517.912978:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 72 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.913013:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 174 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.913027:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 174 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429517.913042:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648401920:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429517.913132:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429517.913732:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635119104 00000100:00100000:3.0:1789429517.913739:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635119104 00002000:00100000:3.0:1789429517.913776:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946f087bdc00 x1876351635119104/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429517.913787:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bdc00 with x1876351635119104 ext(36700160->37748735) 00010000:00010000:3.0:1789429517.913794:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 175 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.913808:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 175 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429517.913822:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f087bdc00 00000100:00100000:0.0:1789429517.913851:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635119232 00000100:00100000:0.0:1789429517.913855:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635119232 00002000:00100000:0.0:1789429517.913875:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e05044380 x1876351635119232/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.913884:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044380 with x1876351635119232 ext(29360128->30408703) 00002000:00010000:0.0:1789429517.913888:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05044380 00000100:00100000:0.0:1789429517.913914:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1418 00000100:00100000:0.0:1789429517.913922:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+175:2369:x1876351635119104:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.914134:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11674 00000100:00100000:2.0:1789429517.914144:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+73:2371:x1876351635119232:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429517.921008:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648401920:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429517.921042:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 73 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.921063:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93ba00, rc 0) 00000100:00100000:0.0:1789429517.921120:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+73:44674:x1876351635119360:12345-192.168.203.39@tcp:101:dd.0 Request processed in 8237us (8406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429517.921128:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5841 00000100:00100000:3.0:1789429517.929572:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+177:2368:x1876351635118848:12345-192.168.203.39@tcp:4:dd.0 Request processed in 55721us (56233us total) trans 4294969441 rc 0/0 00000100:00100000:3.0:1789429517.929585:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11672 00002000:00100000:3.0:1789429517.929598:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e1523ce00 x1876351635118848/t4294969441(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429517.929608:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523ce00 with x1876351635118848 ext(35651584->36700159) 00010000:00010000:3.0:1789429517.929619:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 177 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.929635:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 177 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429517.929644:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e1523ce00 00000100:00100000:1.0:1789429517.929904:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+177:2369:x1876351635119104:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15981us (17279us total) trans 4294969442 rc 0/0 00000100:00100000:1.0:1789429517.929912:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1418 00002000:00100000:1.0:1789429517.929919:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946f087bdc00 x1876351635119104/t4294969442(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.929926:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bdc00 with x1876351635119104 ext(36700160->37748735) 00010000:00010000:1.0:1789429517.929932:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 177 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.929943:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 177 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429517.929943:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+74:2371:x1876351635118976:12345-192.168.203.39@tcp:4:dd.0 Request processed in 52157us (56574us total) trans 4294969443 rc 0/0 00002000:00010000:1.0:1789429517.929951:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f087bdc00 00000100:00100000:2.0:1789429517.929951:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11673 00002000:00100000:2.0:1789429517.929956:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946e1523ea00 x1876351635118976/t4294969443(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.929963:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523ea00 with x1876351635118976 ext(28311552->29360127) 00002000:00010000:2.0:1789429517.929967:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523ea00 00000100:00100000:3.0:1789429517.930378:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.930430:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.930511:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635119616 00000100:00100000:0.0:1789429517.930520:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635119616 00000100:00100000:0.0:1789429517.930624:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5842 00000100:00100000:0.0:1789429517.930635:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+177:44675:x1876351635119616:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429517.930648:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429517.930665:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9e7 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.930689:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(19 1) 00010000:00010000:0.0:1789429517.930695:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(20 1) 00010000:00010000:0.0:1789429517.930700:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 178 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.930711:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 178 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429517.930722:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93be00, rc 0) 00000100:00100000:0.0:1789429517.931402:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+178:44675:x1876351635119616:12345-192.168.203.39@tcp:101:dd.0 Request processed in 767us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429517.931421:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5842 00000100:00100000:1.0:1789429517.931500:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635119488 00000100:00100000:1.0:1789429517.931506:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635119488 00002000:00100000:1.0:1789429517.931537:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946e1523fb80 x1876351635119488/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429517.931547:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523fb80 with x1876351635119488 ext(37748736->38797311) 00010000:00010000:1.0:1789429517.931564:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 178 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429517.931577:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 178 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429517.931584:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e1523fb80 00000100:00100000:1.0:1789429517.931608:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1419 00000100:00100000:1.0:1789429517.931616:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+178:2370:x1876351635119488:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429517.939431:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+74:2371:x1876351635119232:12345-192.168.203.39@tcp:4:dd.0 Request processed in 25279us (26649us total) trans 4294969444 rc 0/0 00000100:00100000:0.0:1789429517.939444:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11674 00002000:00100000:0.0:1789429517.939455:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e05044380 x1876351635119232/t4294969444(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.939466:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044380 with x1876351635119232 ext(29360128->30408703) 00002000:00010000:0.0:1789429517.939471:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05044380 00000100:00100000:3.0:1789429517.944800:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+180:2370:x1876351635119488:12345-192.168.203.39@tcp:4:dd.0 Request processed in 13174us (14359us total) trans 4294969445 rc 0/0 00000100:00100000:3.0:1789429517.944816:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1419 00002000:00100000:3.0:1789429517.944829:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946e1523fb80 x1876351635119488/t4294969445(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429517.944839:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523fb80 with x1876351635119488 ext(37748736->38797311) 00010000:00010000:3.0:1789429517.944851:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 180 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429517.944869:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 180 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429517.944876:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e1523fb80 00000100:00100000:2.0:1789429517.952102:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429517.952172:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635119744 00000100:00100000:3.0:1789429517.952182:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635119744 00010000:00010000:3.0:1789429517.952248:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 180 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429517.952354:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6239 00000100:00100000:2.0:1789429517.952365:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+180:2369:x1876351635119744:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429517.952380:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789429517.952403:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 30408704 -> 38797312 00010000:00010000:2.0:1789429517.952419:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 180 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.952434:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 180 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.952467:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361e19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d9 expref: 180 pid: 20986 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.952486:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(20 1) 00010000:00010000:2.0:1789429517.952491:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(20 1) 00010000:00010000:2.0:1789429517.952499:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->38797311] (req 30408704->31457279) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 73 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.952509:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->38797311] (req 30408704->31457279) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 73 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.952518:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(20 1) 00010000:00010000:2.0:1789429517.952521:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(20 1) 00010000:00010000:2.0:1789429517.952526:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 179 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.952535:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 179 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429517.952569:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 179 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429517.952588:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05046300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648402048:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429517.952718:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->38797311] (req 30408704->31457279) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 73 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429517.952729:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05044e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648402176:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429517.952751:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e15865300 going to sleep for 11 seconds 00000100:00100000:2.0:1789429517.958188:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05046300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648402048:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429517.958240:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05044e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648402176:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429517.958265:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429517.958318:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+179:2369:x1876351635119744:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5954us (6221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429517.958329:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6239 00000100:00100000:3.0:1789429517.973288:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429517.973416:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635119872 00000100:00100000:0.0:1789429517.973426:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635119872 00002000:00100000:0.0:1789429517.973472:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946e1523c000 x1876351635119872/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/0 e 0 to 0 dl 1789429528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429517.973483:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523c000 with x1876351635119872 ext(30408704->31457279) 00002000:00010000:0.0:1789429517.973489:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523c000 00000100:00100000:0.0:1789429517.973521:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11675 00000100:00100000:0.0:1789429517.973531:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+74:2368:x1876351635119872:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429517.984941:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+76:2368:x1876351635119872:12345-192.168.203.39@tcp:4:dd.0 Request processed in 11400us (11651us total) trans 4294969446 rc 0/0 00000100:00100000:2.0:1789429517.984955:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11675 00002000:00100000:2.0:1789429517.984968:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946e1523c000 x1876351635119872/t4294969446(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:253/0 lens 488/448 e 0 to 0 dl 1789429528 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429517.984980:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523c000 with x1876351635119872 ext(30408704->31457279) 00002000:00010000:2.0:1789429517.984987:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523c000 00000100:00100000:0.0:1789429518.002019:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429518.002132:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635120000 00000100:00100000:1.0:1789429518.002142:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635120000 00002000:00100000:1.0:1789429518.002192:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946f1c1aaa00 x1876351635120000/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.002234:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1aaa00 with x1876351635120000 ext(38797312->39845887) 00002000:00010000:1.0:1789429518.002249:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1aaa00 00000100:00100000:1.0:1789429518.002272:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11676 00000100:00100000:1.0:1789429518.002282:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+179:2369:x1876351635120000:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429518.004149:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429518.004216:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635120128 00000100:00100000:1.0:1789429518.004222:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635120128 00002000:00100000:1.0:1789429518.004260:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946f1c1a8700 x1876351635120128/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.004272:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a8700 with x1876351635120128 ext(31457280->32505855) 00002000:00010000:1.0:1789429518.004277:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1a8700 00000100:00100000:1.0:1789429518.004307:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11677 00000100:00100000:1.0:1789429518.004316:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+76:2369:x1876351635120128:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429518.014686:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+181:2369:x1876351635120000:12345-192.168.203.39@tcp:4:dd.0 Request processed in 12396us (12666us total) trans 4294969447 rc 0/0 00000100:00100000:1.0:1789429518.014699:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11676 00002000:00100000:1.0:1789429518.014712:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946f1c1aaa00 x1876351635120000/t4294969447(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.014722:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1aaa00 with x1876351635120000 ext(38797312->39845887) 00002000:00010000:1.0:1789429518.014728:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1aaa00 00000100:00100000:1.0:1789429518.020796:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+78:2369:x1876351635120128:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16471us (16645us total) trans 4294969448 rc 0/0 00000100:00100000:1.0:1789429518.020810:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11677 00002000:00100000:1.0:1789429518.020822:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946f1c1a8700 x1876351635120128/t4294969448(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.020833:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a8700 with x1876351635120128 ext(31457280->32505855) 00002000:00010000:1.0:1789429518.020840:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1a8700 00000100:00100000:2.0:1789429518.027775:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429518.027922:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635120256 00000100:00100000:1.0:1789429518.027932:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635120256 00002000:00100000:1.0:1789429518.027978:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946e05044e00 x1876351635120256/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.027997:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044e00 with x1876351635120256 ext(39845888->40894463) 00002000:00010000:1.0:1789429518.028003:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05044e00 00000100:00100000:1.0:1789429518.028102:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11678 00000100:00100000:1.0:1789429518.028112:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+181:2369:x1876351635120256:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429518.035335:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429518.036655:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635120384 00000100:00100000:2.0:1789429518.036667:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635120384 00002000:00100000:2.0:1789429518.036721:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946e1523ca80 x1876351635120384/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.036733:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523ca80 with x1876351635120384 ext(32505856->33554431) 00002000:00010000:2.0:1789429518.036739:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523ca80 00000100:00100000:2.0:1789429518.036771:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11679 00000100:00100000:2.0:1789429518.036780:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+78:2368:x1876351635120384:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429518.053378:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+183:2369:x1876351635120256:12345-192.168.203.39@tcp:4:dd.0 Request processed in 25259us (25603us total) trans 4294969449 rc 0/0 00000100:00100000:0.0:1789429518.053393:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11678 00002000:00100000:0.0:1789429518.053415:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946e05044e00 x1876351635120256/t4294969449(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.053431:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044e00 with x1876351635120256 ext(39845888->40894463) 00002000:00010000:0.0:1789429518.053437:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05044e00 00000100:00100000:3.0:1789429518.058185:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.058753:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635120512 00000100:00100000:0.0:1789429518.058762:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635120512 00002000:00100000:0.0:1789429518.058809:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946e1523d180 x1876351635120512/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.058821:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523d180 with x1876351635120512 ext(40894464->41943039) 00002000:00010000:0.0:1789429518.058827:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523d180 00000100:00100000:0.0:1789429518.058894:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11680 00000100:00100000:0.0:1789429518.058904:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+183:2368:x1876351635120512:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429518.060300:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429518.061361:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635120640 00000100:00100000:3.0:1789429518.061372:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635120640 00002000:00100000:3.0:1789429518.061433:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946e0de0f480 x1876351635120640/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.061443:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0f480 with x1876351635120640 ext(33554432->34603007) 00002000:00010000:3.0:1789429518.061448:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0f480 00000100:00100000:3.0:1789429518.061469:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11681 00000100:00100000:3.0:1789429518.061478:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+80:2371:x1876351635120640:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429518.065300:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+82:2368:x1876351635120384:12345-192.168.203.39@tcp:4:dd.0 Request processed in 28510us (29963us total) trans 4294969450 rc 0/0 00000100:00100000:2.0:1789429518.065315:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11679 00002000:00100000:2.0:1789429518.065327:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946e1523ca80 x1876351635120384/t4294969450(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.065338:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523ca80 with x1876351635120384 ext(32505856->33554431) 00002000:00010000:2.0:1789429518.065345:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523ca80 00000100:00100000:2.0:1789429518.080756:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+185:2368:x1876351635120512:12345-192.168.203.39@tcp:4:dd.0 Request processed in 21842us (22566us total) trans 4294969451 rc 0/0 00000100:00100000:2.0:1789429518.080772:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11680 00002000:00100000:2.0:1789429518.080787:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946e1523d180 x1876351635120512/t4294969451(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.080799:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523d180 with x1876351635120512 ext(40894464->41943039) 00002000:00010000:2.0:1789429518.080816:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523d180 00000100:00100000:2.0:1789429518.081729:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.082150:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635120768 00000100:00100000:0.0:1789429518.082159:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635120768 00002000:00100000:0.0:1789429518.082217:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946e05046300 x1876351635120768/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.082238:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05046300 with x1876351635120768 ext(34603008->35651583) 00002000:00010000:0.0:1789429518.082243:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05046300 00000100:00100000:0.0:1789429518.082267:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11682 00000100:00100000:0.0:1789429518.082275:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+83:2370:x1876351635120768:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429518.082305:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+83:2371:x1876351635120640:12345-192.168.203.39@tcp:4:dd.0 Request processed in 20828us (22009us total) trans 4294969452 rc 0/0 00000100:00100000:3.0:1789429518.082313:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11681 00002000:00100000:3.0:1789429518.082320:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946e0de0f480 x1876351635120640/t4294969452(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.082328:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0f480 with x1876351635120640 ext(33554432->34603007) 00002000:00010000:3.0:1789429518.082332:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0f480 00000100:00100000:1.0:1789429518.086932:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.087192:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635120896 00000100:00100000:0.0:1789429518.087243:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635120896 00002000:00100000:0.0:1789429518.087299:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946e0de0df80 x1876351635120896/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.087311:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0df80 with x1876351635120896 ext(41943040->42991615) 00002000:00010000:0.0:1789429518.087317:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0df80 00000100:00100000:0.0:1789429518.087344:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11683 00000100:00100000:0.0:1789429518.087355:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+185:2369:x1876351635120896:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429518.105184:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+84:2370:x1876351635120768:12345-192.168.203.39@tcp:4:dd.0 Request processed in 22899us (23448us total) trans 4294969453 rc 0/0 00000100:00100000:0.0:1789429518.105380:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11682 00002000:00100000:0.0:1789429518.105395:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946e05046300 x1876351635120768/t4294969453(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.105414:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05046300 with x1876351635120768 ext(34603008->35651583) 00002000:00010000:0.0:1789429518.105421:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05046300 00000100:00100000:0.0:1789429518.111647:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+187:2369:x1876351635120896:12345-192.168.203.39@tcp:4:dd.0 Request processed in 24282us (24715us total) trans 4294969454 rc 0/0 00000100:00100000:0.0:1789429518.111662:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11683 00002000:00100000:0.0:1789429518.111676:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946e0de0df80 x1876351635120896/t4294969454(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.111687:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0df80 with x1876351635120896 ext(41943040->42991615) 00002000:00010000:0.0:1789429518.111694:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0df80 00000100:00100000:3.0:1789429518.120837:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.123553:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635121024 00000100:00100000:0.0:1789429518.123568:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635121024 00002000:00100000:0.0:1789429518.123627:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946e1523ed80 x1876351635121024/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.123732:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523ed80 with x1876351635121024 ext(42991616->44040191) 00002000:00010000:0.0:1789429518.123739:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523ed80 00000100:00100000:0.0:1789429518.123835:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11684 00000100:00100000:0.0:1789429518.123846:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1523ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+187:2369:x1876351635121024:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429518.132009:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.132117:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635121152 00000100:00100000:0.0:1789429518.132127:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635121152 00002000:00100000:0.0:1789429518.132172:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e05046a00 x1876351635121152/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.132184:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05046a00 with x1876351635121152 ext(35651584->36700159) 00002000:00010000:0.0:1789429518.132190:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05046a00 00000100:00100000:0.0:1789429518.132381:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11685 00000100:00100000:0.0:1789429518.132401:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+84:2368:x1876351635121152:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429518.140194:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1523ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+189:2369:x1876351635121024:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16339us (19354us total) trans 4294969455 rc 0/0 00000100:00100000:2.0:1789429518.140307:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11684 00002000:00100000:2.0:1789429518.140321:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946e1523ed80 x1876351635121024/t4294969455(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.140332:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1523ed80 with x1876351635121024 ext(42991616->44040191) 00002000:00010000:2.0:1789429518.140339:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1523ed80 00000100:00100000:3.0:1789429518.157045:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.159954:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635121280 00000100:00100000:0.0:1789429518.159968:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635121280 00002000:00100000:0.0:1789429518.160020:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946e0eb42300 x1876351635121280/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.160030:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb42300 with x1876351635121280 ext(44040192->45088767) 00002000:00010000:0.0:1789429518.160036:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eb42300 00000100:00100000:0.0:1789429518.160071:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11686 00000100:00100000:0.0:1789429518.160081:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+189:2368:x1876351635121280:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429518.161430:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429518.161947:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+86:2368:x1876351635121152:12345-192.168.203.39@tcp:4:dd.0 Request processed in 29554us (29943us total) trans 4294969456 rc 0/0 00000100:00100000:1.0:1789429518.161958:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11685 00002000:00100000:1.0:1789429518.161969:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e05046a00 x1876351635121152/t4294969456(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.161977:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05046a00 with x1876351635121152 ext(35651584->36700159) 00002000:00010000:1.0:1789429518.161982:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05046a00 00000100:00100000:1.0:1789429518.162006:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635121408 00000100:00100000:1.0:1789429518.162012:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635121408 00002000:00100000:1.0:1789429518.162038:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946e05044700 x1876351635121408/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.162046:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044700 with x1876351635121408 ext(36700160->37748735) 00002000:00010000:1.0:1789429518.162049:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05044700 00000100:00100000:1.0:1789429518.162064:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11687 00000100:00100000:1.0:1789429518.162073:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+86:2371:x1876351635121408:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429518.179993:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.180154:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635121536 00000100:00100000:0.0:1789429518.180164:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635121536 00002000:00100000:0.0:1789429518.180226:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946e0eb40e00 x1876351635121536/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.180238:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb40e00 with x1876351635121536 ext(45088768->46137343) 00002000:00010000:0.0:1789429518.180243:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eb40e00 00000100:00100000:0.0:1789429518.180268:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11688 00000100:00100000:0.0:1789429518.180278:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+191:2369:x1876351635121536:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429518.181582:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+88:2371:x1876351635121408:12345-192.168.203.39@tcp:4:dd.0 Request processed in 19505us (20152us total) trans 4294969457 rc 0/0 00000100:00100000:1.0:1789429518.181593:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11687 00002000:00100000:1.0:1789429518.181601:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946e05044700 x1876351635121408/t4294969457(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.181611:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044700 with x1876351635121408 ext(36700160->37748735) 00002000:00010000:1.0:1789429518.181617:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05044700 00000100:00100000:0.0:1789429518.184581:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+193:2368:x1876351635121280:12345-192.168.203.39@tcp:4:dd.0 Request processed in 24492us (27534us total) trans 4294969458 rc 0/0 00000100:00100000:0.0:1789429518.184594:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11686 00002000:00100000:0.0:1789429518.184605:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946e0eb42300 x1876351635121280/t4294969458(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.184615:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb42300 with x1876351635121280 ext(44040192->45088767) 00002000:00010000:0.0:1789429518.184622:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eb42300 00000100:00100000:0.0:1789429518.193871:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+193:2369:x1876351635121536:12345-192.168.203.39@tcp:4:dd.0 Request processed in 13584us (13877us total) trans 4294969459 rc 0/0 00000100:00100000:0.0:1789429518.193886:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11688 00002000:00100000:0.0:1789429518.193898:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946e0eb40e00 x1876351635121536/t4294969459(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.193909:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb40e00 with x1876351635121536 ext(45088768->46137343) 00002000:00010000:0.0:1789429518.193916:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eb40e00 00000100:00100000:3.0:1789429518.221610:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429518.221899:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635121664 00000100:00100000:2.0:1789429518.221910:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635121664 00002000:00100000:2.0:1789429518.221964:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e0eb42a00 x1876351635121664/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.221976:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb42a00 with x1876351635121664 ext(46137344->47185919) 00002000:00010000:2.0:1789429518.221981:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eb42a00 00000100:00100000:2.0:1789429518.222016:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11689 00000100:00100000:2.0:1789429518.222026:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+193:2368:x1876351635121664:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429518.228024:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429518.228066:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429518.228147:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635121920 00000100:00100000:3.0:1789429518.228160:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635121920 00000100:00100000:3.0:1789429518.228254:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5843 00000100:00100000:3.0:1789429518.228264:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+88:44674:x1876351635121920:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429518.228281:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429518.228299:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9ee expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429518.228334:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 194 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429518.228343:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=1s v=(20 1) 00010000:00010000:3.0:1789429518.228348:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(1 20) 00010000:00010000:3.0:1789429518.228353:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 89 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429518.228385:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 194 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429518.228417:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 194 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429518.228432:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648402304:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429518.228520:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1c272e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789429518.236419:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635121792 00000100:00100000:2.0:1789429518.236436:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635121792 00002000:00100000:2.0:1789429518.236896:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946e0de0d500 x1876351635121792/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.236921:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0d500 with x1876351635121792 ext(37748736->38797311) 00002000:00010000:2.0:1789429518.236928:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0d500 00000100:00100000:2.0:1789429518.236963:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11690 00000100:00100000:2.0:1789429518.236973:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+90:2368:x1876351635121792:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429518.254646:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429518.254666:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648402304:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429518.254701:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->39845887] (req 38797312->39845887) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 91 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429518.254725:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6000, rc 0) 00000100:00100000:1.0:1789429518.254779:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+91:44674:x1876351635121920:12345-192.168.203.39@tcp:101:dd.0 Request processed in 26516us (26712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429518.254789:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5843 00000100:00100000:2.0:1789429518.259472:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635122048 00000100:00100000:2.0:1789429518.259488:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635122048 00002000:00100000:2.0:1789429518.259545:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f1c1abb80 x1876351635122048/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.259558:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1abb80 with x1876351635122048 ext(47185920->48234495) 00010000:00010000:2.0:1789429518.259568:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 195 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429518.259588:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 195 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429518.259597:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f1c1abb80 00000100:00100000:2.0:1789429518.259716:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1420 00000100:00100000:2.0:1789429518.259727:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+195:2369:x1876351635122048:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429518.273611:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+197:2368:x1876351635121664:12345-192.168.203.39@tcp:4:dd.0 Request processed in 51578us (52017us total) trans 4294969460 rc 0/0 00000100:00100000:0.0:1789429518.273623:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11689 00002000:00100000:0.0:1789429518.273635:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e0eb42a00 x1876351635121664/t4294969460(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.273644:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb42a00 with x1876351635121664 ext(46137344->47185919) 00010000:00010000:0.0:1789429518.273657:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 197 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429518.273676:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 197 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429518.273683:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eb42a00 00000100:00100000:3.0:1789429518.276079:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429518.276113:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635122176 00000100:00100000:3.0:1789429518.276123:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635122176 00000100:00100000:3.0:1789429518.276183:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5844 00000100:00100000:3.0:1789429518.276194:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+197:44675:x1876351635122176:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429518.276227:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429518.276253:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9f5 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429518.276284:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(1 20) 00010000:00010000:3.0:1789429518.276290:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 20) 00010000:00010000:3.0:1789429518.276296:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 198 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429518.276308:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 198 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429518.276321:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6800, rc 0) 00000100:00100000:3.0:1789429518.276373:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+198:44675:x1876351635122176:12345-192.168.203.39@tcp:101:dd.0 Request processed in 181us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429518.276380:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5844 00000100:00100000:3.0:1789429518.276443:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429518.276533:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635122304 00000100:00100000:3.0:1789429518.276537:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635122304 00002000:00100000:3.0:1789429518.276561:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946e0eb40000 x1876351635122304/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.276571:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb40000 with x1876351635122304 ext(48234496->49283071) 00010000:00010000:3.0:1789429518.276577:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 198 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429518.276592:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 198 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429518.276600:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eb40000 00000100:00100000:3.0:1789429518.276615:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1421 00000100:00100000:3.0:1789429518.276624:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+198:2368:x1876351635122304:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429518.276804:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+91:2368:x1876351635121792:12345-192.168.203.39@tcp:4:dd.0 Request processed in 39829us (48786us total) trans 4294969461 rc 0/0 00000100:00100000:1.0:1789429518.276815:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11690 00002000:00100000:1.0:1789429518.276823:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946e0de0d500 x1876351635121792/t4294969461(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.276831:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0d500 with x1876351635121792 ext(37748736->38797311) 00002000:00010000:1.0:1789429518.276837:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0d500 00000100:00100000:1.0:1789429518.299981:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+200:2369:x1876351635122048:12345-192.168.203.39@tcp:4:dd.0 Request processed in 40246us (45333us total) trans 4294969462 rc 0/0 00000100:00100000:1.0:1789429518.299994:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1420 00002000:00100000:1.0:1789429518.300008:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f1c1abb80 x1876351635122048/t4294969462(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.300017:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1abb80 with x1876351635122048 ext(47185920->48234495) 00010000:00010000:1.0:1789429518.300027:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 200 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429518.300047:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 200 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429518.300055:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f1c1abb80 00000100:00100000:2.0:1789429518.302068:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+200:2368:x1876351635122304:12345-192.168.203.39@tcp:4:dd.0 Request processed in 25439us (25617us total) trans 4294969463 rc 0/0 00000100:00100000:2.0:1789429518.302080:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1421 00002000:00100000:2.0:1789429518.302089:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946e0eb40000 x1876351635122304/t4294969463(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.302099:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb40000 with x1876351635122304 ext(48234496->49283071) 00010000:00010000:2.0:1789429518.302108:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 200 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429518.302124:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 200 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429518.302139:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eb40000 00000100:00100000:3.0:1789429518.342033:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429518.342138:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635122432 00000100:00100000:2.0:1789429518.342149:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635122432 00010000:00010000:2.0:1789429518.342192:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 200 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429518.342276:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6240 00000100:00100000:2.0:1789429518.342286:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+200:2370:x1876351635122432:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429518.342311:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789429518.342331:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 38797312 -> 49283072 00010000:00010000:2.0:1789429518.342338:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 200 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429518.342363:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 200 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429518.342389:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361e27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [38797312->18446744073709551615] (req 38797312->39845887) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e7 expref: 200 pid: 6682 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429518.342619:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 20) 00010000:00010000:2.0:1789429518.342624:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 20) 00010000:00010000:2.0:1789429518.342635:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->49283071] (req 38797312->39845887) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 90 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429518.342653:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->49283071] (req 38797312->39845887) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 90 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429518.342663:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 20) 00010000:00010000:2.0:1789429518.342665:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 20) 00010000:00010000:2.0:1789429518.342670:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 199 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429518.342679:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 199 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429518.342716:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 199 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429518.342729:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05047b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648402432:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429518.342832:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->49283071] (req 38797312->39845887) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 90 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429518.342842:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05044000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648402560:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429518.342865:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e15865300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429518.345696:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05047b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648402432:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429518.345712:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05044000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648402560:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429518.345733:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429518.345791:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+199:2370:x1876351635122432:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3505us (3767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429518.345802:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6240 00000100:00100000:1.0:1789429518.372799:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429518.372891:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635122560 00000100:00100000:2.0:1789429518.372902:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635122560 00002000:00100000:2.0:1789429518.372951:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946e0de0f100 x1876351635122560/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.372970:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0f100 with x1876351635122560 ext(38797312->39845887) 00002000:00010000:2.0:1789429518.372977:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0f100 00000100:00100000:2.0:1789429518.373012:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11691 00000100:00100000:2.0:1789429518.373022:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+91:2369:x1876351635122560:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429518.408713:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429518.408764:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429518.408808:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.408968:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635122944 00000100:00100000:0.0:1789429518.408980:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635122944 00002000:00100000:0.0:1789429518.409028:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946e05044a80 x1876351635122944/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.409039:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044a80 with x1876351635122944 ext(50331648->51380223) 00002000:00010000:0.0:1789429518.409045:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05044a80 00000100:00100000:0.0:1789429518.409072:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635122688 00000100:00100000:0.0:1789429518.409076:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635122688 00002000:00100000:0.0:1789429518.409091:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946e05045180 x1876351635122688/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.409100:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05045180 with x1876351635122688 ext(49283072->50331647) 00002000:00010000:0.0:1789429518.409103:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05045180 00000100:00100000:0.0:1789429518.409117:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635122816 00000100:00100000:0.0:1789429518.409120:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635122816 00002000:00100000:0.0:1789429518.409134:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946e05046680 x1876351635122816/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.409142:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05046680 with x1876351635122816 ext(39845888->40894463) 00002000:00010000:0.0:1789429518.409145:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05046680 00000100:00100000:0.0:1789429518.409164:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11692 00000100:00100000:0.0:1789429518.409174:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+200:2371:x1876351635122944:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429518.409379:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11693 00000100:00100000:0.0:1789429518.409387:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+201:2368:x1876351635122688:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429518.409497:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11694 00000100:00100000:0.0:1789429518.409504:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+93:2368:x1876351635122816:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429518.416523:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+95:2369:x1876351635122560:12345-192.168.203.39@tcp:4:dd.0 Request processed in 43482us (43713us total) trans 4294969464 rc 0/0 00000100:00100000:3.0:1789429518.416545:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11691 00002000:00100000:3.0:1789429518.421121:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946e0de0f100 x1876351635122560/t4294969464(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.421137:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0f100 with x1876351635122560 ext(38797312->39845887) 00002000:00010000:3.0:1789429518.421145:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0f100 00000100:00100000:2.0:1789429518.430516:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429518.442263:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+203:2371:x1876351635122944:12345-192.168.203.39@tcp:4:dd.0 Request processed in 33080us (33549us total) trans 4294969465 rc 0/0 00000100:00100000:2.0:1789429518.442283:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11692 00002000:00100000:2.0:1789429518.442298:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946e05044a80 x1876351635122944/t4294969465(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.442308:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044a80 with x1876351635122944 ext(50331648->51380223) 00002000:00010000:2.0:1789429518.442314:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05044a80 00000100:00100000:2.0:1789429518.442342:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635123072 00000100:00100000:2.0:1789429518.442349:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635123072 00002000:00100000:2.0:1789429518.442378:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946e05045c00 x1876351635123072/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.442385:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05045c00 with x1876351635123072 ext(40894464->41943039) 00002000:00010000:2.0:1789429518.442387:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05045c00 00000100:00100000:2.0:1789429518.442420:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11695 00000100:00100000:2.0:1789429518.442428:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+95:2368:x1876351635123072:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429518.454353:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+203:2368:x1876351635122688:12345-192.168.203.39@tcp:4:dd.0 Request processed in 44956us (45577us total) trans 4294969466 rc 0/0 00000100:00100000:2.0:1789429518.454367:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11693 00002000:00100000:2.0:1789429518.454380:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946e05045180 x1876351635122688/t4294969466(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.454392:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05045180 with x1876351635122688 ext(49283072->50331647) 00002000:00010000:2.0:1789429518.454398:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05045180 00000100:00100000:1.0:1789429518.460958:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429518.461013:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.461099:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635123456 00000100:00100000:0.0:1789429518.461109:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635123456 00000100:00100000:0.0:1789429518.461179:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 287 00000100:00100000:0.0:1789429518.461190:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+28:44675:x1876351635123456:12345-192.168.203.39@tcp:35:dd.0 00000100:00080000:1.0:1789429518.461733:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429518.461761:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635123200 00000100:00100000:1.0:1789429518.461765:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635123200 00002000:00100000:1.0:1789429518.461799:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946e0de0ce00 x1876351635123200/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.461810:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ce00 with x1876351635123200 ext(51380224->52428799) 00002000:00010000:1.0:1789429518.461816:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ce00 00000100:00100000:1.0:1789429518.461836:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11696 00000100:00100000:1.0:1789429518.461844:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+203:2371:x1876351635123200:12345-192.168.203.39@tcp:4:dd.0 00000001:00080000:0.0:1789429518.464736:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977240 00000100:00100000:0.0:1789429518.464894:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+30:44675:x1876351635123456:12345-192.168.203.39@tcp:35:dd.0 Request processed in 3700us (3939us total) trans 4294977241 rc 0/0 00000100:00100000:0.0:1789429518.464905:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 287 00000020:00080000:0.0:1789429518.464910:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789429518.469935:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+97:2368:x1876351635122816:12345-192.168.203.39@tcp:4:dd.0 Request processed in 60419us (61114us total) trans 4294969467 rc 0/0 00000100:00100000:0.0:1789429518.469950:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11694 00002000:00100000:0.0:1789429518.469963:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946e05046680 x1876351635122816/t4294969467(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.469974:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05046680 with x1876351635122816 ext(39845888->40894463) 00002000:00010000:0.0:1789429518.469981:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05046680 00000100:00100000:0.0:1789429518.473774:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+97:2368:x1876351635123072:12345-192.168.203.39@tcp:4:dd.0 Request processed in 31335us (43260us total) trans 4294969468 rc 0/0 00000100:00100000:0.0:1789429518.473788:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11695 00002000:00100000:0.0:1789429518.473803:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946e05045c00 x1876351635123072/t4294969468(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.473813:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05045c00 with x1876351635123072 ext(40894464->41943039) 00002000:00010000:0.0:1789429518.473819:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05045c00 00000100:00100000:1.0:1789429518.476383:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429518.476489:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635123584 00000100:00100000:3.0:1789429518.476499:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635123584 00002000:00100000:3.0:1789429518.476558:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946e0de0ea00 x1876351635123584/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.476569:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ea00 with x1876351635123584 ext(41943040->42991615) 00002000:00010000:3.0:1789429518.476575:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ea00 00000100:00100000:3.0:1789429518.476602:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11697 00000100:00100000:3.0:1789429518.476610:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+97:2368:x1876351635123584:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429518.484371:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+205:2371:x1876351635123200:12345-192.168.203.39@tcp:4:dd.0 Request processed in 22517us (23347us total) trans 4294969469 rc 0/0 00000100:00100000:3.0:1789429518.484393:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11696 00002000:00100000:3.0:1789429518.484415:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946e0de0ce00 x1876351635123200/t4294969469(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.484426:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ce00 with x1876351635123200 ext(51380224->52428799) 00002000:00010000:3.0:1789429518.484432:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ce00 00000100:00100000:2.0:1789429518.496814:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429518.496936:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635123712 00000100:00100000:1.0:1789429518.496945:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635123712 00002000:00100000:1.0:1789429518.496986:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946e05045880 x1876351635123712/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.496997:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05045880 with x1876351635123712 ext(42991616->44040191) 00002000:00010000:1.0:1789429518.497003:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05045880 00000100:00100000:1.0:1789429518.497031:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11698 00000100:00100000:1.0:1789429518.497040:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+100:2370:x1876351635123712:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429518.497855:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+101:2368:x1876351635123584:12345-192.168.203.39@tcp:4:dd.0 Request processed in 21240us (21475us total) trans 4294969470 rc 0/0 00000100:00100000:0.0:1789429518.497864:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11697 00002000:00100000:0.0:1789429518.497871:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946e0de0ea00 x1876351635123584/t4294969470(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.497880:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ea00 with x1876351635123584 ext(41943040->42991615) 00002000:00010000:0.0:1789429518.497885:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ea00 00000100:00100000:2.0:1789429518.510123:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+101:2370:x1876351635123712:12345-192.168.203.39@tcp:4:dd.0 Request processed in 13074us (13307us total) trans 4294969471 rc 0/0 00000100:00100000:2.0:1789429518.510137:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11698 00002000:00100000:2.0:1789429518.510150:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946e05045880 x1876351635123712/t4294969471(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.510160:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05045880 with x1876351635123712 ext(42991616->44040191) 00002000:00010000:2.0:1789429518.510167:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05045880 00000100:00100000:1.0:1789429518.524457:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429518.524667:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635123840 00000100:00100000:3.0:1789429518.524678:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635123840 00002000:00100000:3.0:1789429518.524727:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946e0de0c700 x1876351635123840/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.524739:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0c700 with x1876351635123840 ext(44040192->45088767) 00002000:00010000:3.0:1789429518.524746:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0c700 00000100:00100000:3.0:1789429518.524778:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11699 00000100:00100000:3.0:1789429518.524787:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+101:2371:x1876351635123840:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429518.538956:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+103:2371:x1876351635123840:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14160us (14506us total) trans 4294969472 rc 0/0 00000100:00100000:3.0:1789429518.538970:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11699 00002000:00100000:3.0:1789429518.538984:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946e0de0c700 x1876351635123840/t4294969472(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.538995:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0c700 with x1876351635123840 ext(44040192->45088767) 00002000:00010000:3.0:1789429518.539001:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0c700 00000100:00100000:0.0:1789429518.557539:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429518.557689:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635123968 00000100:00100000:2.0:1789429518.557699:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635123968 00002000:00100000:2.0:1789429518.557751:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946f3fbcc380 x1876351635123968/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.557761:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcc380 with x1876351635123968 ext(45088768->46137343) 00002000:00010000:2.0:1789429518.557767:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3fbcc380 00000100:00100000:2.0:1789429518.557801:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11700 00000100:00100000:2.0:1789429518.557810:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+103:2370:x1876351635123968:12345-192.168.203.39@tcp:4:dd.0 00010000:00010000:1.0:1789429518.565860:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429518.573894:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3fbcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+105:2370:x1876351635123968:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16076us (16355us total) trans 4294969473 rc 0/0 00000100:00100000:2.0:1789429518.573908:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11700 00002000:00100000:2.0:1789429518.573921:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946f3fbcc380 x1876351635123968/t4294969473(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.573931:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3fbcc380 with x1876351635123968 ext(45088768->46137343) 00002000:00010000:2.0:1789429518.573938:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3fbcc380 00000100:00100000:1.0:1789429518.594811:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429518.594965:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635124096 00000100:00100000:3.0:1789429518.594976:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635124096 00002000:00100000:3.0:1789429518.595029:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e0de0fb80 x1876351635124096/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.595042:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0fb80 with x1876351635124096 ext(46137344->47185919) 00002000:00010000:3.0:1789429518.595049:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0fb80 00000100:00100000:3.0:1789429518.595138:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11701 00000100:00100000:3.0:1789429518.595150:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+105:2370:x1876351635124096:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429518.612038:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+107:2370:x1876351635124096:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16881us (17227us total) trans 4294969474 rc 0/0 00000100:00100000:2.0:1789429518.612051:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11701 00002000:00100000:2.0:1789429518.612065:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e0de0fb80 x1876351635124096/t4294969474(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.612076:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0fb80 with x1876351635124096 ext(46137344->47185919) 00002000:00010000:2.0:1789429518.612083:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0fb80 00000100:00100000:0.0:1789429518.622897:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.623011:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.623053:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429518.623274:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635124480 00000100:00100000:1.0:1789429518.623289:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635124480 00000100:00100000:1.0:1789429518.623352:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5845 00000100:00100000:1.0:1789429518.623362:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+107:44674:x1876351635124480:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429518.623380:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429518.623399:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1c9fc expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429518.623442:0:13238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 204 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429518.623453:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 20) 00010000:00010000:1.0:1789429518.623457:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(3 20) 00010000:00010000:1.0:1789429518.623463:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->50331647] (req 49283072->50331647) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 108 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429518.623504:0:13238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 204 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429518.623518:0:13238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 204 pid: 6681 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429518.623531:0:13238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648402688:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429518.623842:0:13238:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789429518.629259:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429518.629446:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635124608 00000100:00100000:1.0:1789429518.629469:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635124608 00010000:00010000:1.0:1789429518.629527:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 205 pid: 6681 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429518.629583:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6241 00000100:00100000:1.0:1789429518.629595:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+205:2371:x1876351635124608:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429518.629616:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429518.629646:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 49283072 -> 52428800 00010000:00010000:1.0:1789429518.629657:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 205 pid: 6681 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429518.629676:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 205 pid: 6681 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429518.629719:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(3 20) 00010000:00010000:1.0:1789429518.629724:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(3 20) 00010000:00010000:1.0:1789429518.629734:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 108 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429518.629746:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 108 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429518.629793:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 108 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429518.629811:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648402816:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429518.629920:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865780 going to sleep for 11 seconds 00010000:00010000:1.0:1789429518.629969:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008601d168/0xb4c3dad726361e35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9f5 expref: 205 pid: 6681 timeout: 1316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429518.629985:0:13238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13238:1876351648402688:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429518.630013:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 108 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429518.630025:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01507200, rc 0) 00000100:00100000:1.0:1789429518.630059:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+108:44674:x1876351635124480:12345-192.168.203.39@tcp:101:dd.0 Request processed in 6698us (7048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429518.630071:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5845 00000100:00100000:2.0:1789429518.635977:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635124224 00000100:00100000:2.0:1789429518.636000:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635124224 00002000:00100000:2.0:1789429518.636093:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f2f65f100 x1876351635124224/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.636106:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65f100 with x1876351635124224 ext(47185920->48234495) 00002000:00010000:2.0:1789429518.636112:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f65f100 00000100:00100000:2.0:1789429518.636161:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635124352 00000100:00100000:2.0:1789429518.636166:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635124352 00002000:00100000:2.0:1789429518.636182:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f1c0a8380 x1876351635124352/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429518.636219:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a8380 with x1876351635124352 ext(48234496->49283071) 00002000:00010000:2.0:1789429518.636224:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0a8380 00000100:00100000:2.0:1789429518.636243:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11702 00000100:00100000:2.0:1789429518.636254:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+109:2371:x1876351635124224:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429518.636589:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11703 00000100:00100000:0.0:1789429518.636603:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+110:2370:x1876351635124352:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429518.643118:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648402816:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429518.643157:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429518.643286:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+204:2371:x1876351635124608:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 13691us (14041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429518.643300:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6241 00000100:00100000:3.0:1789429518.662816:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+112:2371:x1876351635124224:12345-192.168.203.39@tcp:4:dd.0 Request processed in 26547us (39913us total) trans 4294969475 rc 0/0 00000100:00100000:3.0:1789429518.662835:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11702 00002000:00100000:3.0:1789429518.662853:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f2f65f100 x1876351635124224/t4294969475(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.662866:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f65f100 with x1876351635124224 ext(47185920->48234495) 00002000:00010000:3.0:1789429518.662875:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f65f100 00000100:00100000:0.0:1789429518.664124:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+112:2370:x1876351635124352:12345-192.168.203.39@tcp:4:dd.0 Request processed in 27513us (41057us total) trans 4294969476 rc 0/0 00000100:00100000:0.0:1789429518.664139:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11703 00002000:00100000:0.0:1789429518.664153:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f1c0a8380 x1876351635124352/t4294969476(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.664163:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a8380 with x1876351635124352 ext(48234496->49283071) 00002000:00010000:0.0:1789429518.664171:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0a8380 00000100:00100000:0.0:1789429518.665174:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429518.665787:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635124736 00000100:00100000:3.0:1789429518.665801:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635124736 00002000:00100000:3.0:1789429518.665865:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946f1c0ab480 x1876351635124736/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.665878:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0ab480 with x1876351635124736 ext(49283072->50331647) 00002000:00010000:3.0:1789429518.665885:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0ab480 00000100:00100000:3.0:1789429518.665922:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11704 00000100:00100000:3.0:1789429518.665933:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+112:2370:x1876351635124736:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429518.682330:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+114:2370:x1876351635124736:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16379us (17146us total) trans 4294969477 rc 0/0 00000100:00100000:3.0:1789429518.682349:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11704 00002000:00100000:3.0:1789429518.682366:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946f1c0ab480 x1876351635124736/t4294969477(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.682379:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0ab480 with x1876351635124736 ext(49283072->50331647) 00002000:00010000:3.0:1789429518.682386:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0ab480 00000100:00100000:0.0:1789429518.695824:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429518.698425:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635124864 00000100:00100000:3.0:1789429518.698448:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635124864 00002000:00100000:3.0:1789429518.698536:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f1c0a9180 x1876351635124864/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429518.698551:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a9180 with x1876351635124864 ext(50331648->51380223) 00002000:00010000:3.0:1789429518.698560:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0a9180 00000100:00100000:3.0:1789429518.698613:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11705 00000100:00100000:3.0:1789429518.698626:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+114:2368:x1876351635124864:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429518.721682:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+116:2368:x1876351635124864:12345-192.168.203.39@tcp:4:dd.0 Request processed in 23040us (25856us total) trans 4294969478 rc 0/0 00000100:00100000:1.0:1789429518.721701:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11705 00002000:00100000:1.0:1789429518.721717:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f1c0a9180 x1876351635124864/t4294969478(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429518.721727:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c0a9180 with x1876351635124864 ext(50331648->51380223) 00002000:00010000:1.0:1789429518.721735:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c0a9180 00000100:00100000:2.0:1789429518.722854:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429518.722902:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429518.722988:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635124992 00000100:00100000:0.0:1789429518.723000:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635124992 00002000:00100000:0.0:1789429518.723057:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946e05047800 x1876351635124992/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/0 e 0 to 0 dl 1789429529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.723067:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05047800 with x1876351635124992 ext(51380224->52428799) 00002000:00010000:0.0:1789429518.723073:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05047800 00000100:00100000:0.0:1789429518.723105:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11706 00000100:00100000:0.0:1789429518.723117:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+116:2369:x1876351635124992:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429518.723651:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635125248 00000100:00100000:3.0:1789429518.723658:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635125248 00000100:00100000:3.0:1789429518.723768:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 288 00000100:00100000:3.0:1789429518.723776:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05acc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+36:44674:x1876351635125248:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:3.0:1789429518.724102:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05acc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12e09781-3d24-4c67-9972-bb781900e20d+37:44674:x1876351635125248:12345-192.168.203.39@tcp:35:dd.0 Request processed in 325us (1253us total) trans 4294977242 rc 0/0 00000100:00100000:3.0:1789429518.724110:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 288 00000100:00080000:0.0:1789429518.729026:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429518.741026:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+118:2369:x1876351635124992:12345-192.168.203.39@tcp:4:dd.0 Request processed in 17896us (18107us total) trans 4294969479 rc 0/0 00000100:00100000:0.0:1789429518.741043:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11706 00002000:00100000:0.0:1789429518.741059:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946e05047800 x1876351635124992/t4294969479(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:254/0 lens 488/448 e 0 to 0 dl 1789429529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429518.741071:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05047800 with x1876351635124992 ext(51380224->52428799) 00002000:00010000:0.0:1789429518.741080:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05047800 00000001:00080000:2.0:1789429519.085898:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977241 is committed 00000001:00080000:2.0:1789429519.085934:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977239 is committed 00000001:00080000:2.0:1789429519.085969:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977242 is committed 00010000:00010000:1.0:1789429519.596447:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429519.684531:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969479 is committed 00000001:00080000:2.0:1789429519.684779:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969460 is committed 00000001:00080000:2.0:1789429519.684941:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969462 is committed 00000001:00080000:2.0:1789429519.685027:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969466 is committed 00000001:00080000:2.0:1789429519.685242:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969469 is committed 00000100:00100000:3.0:1789429520.151693:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.151783:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635125376 00000100:00100000:3.0:1789429520.151784:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.151796:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635125376 00000100:00100000:3.0:1789429520.151816:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429520.151841:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.151851:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 613 00000100:00100000:1.0:1789429520.151863:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635125376:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429520.151868:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429520.151892:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429520.151913:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.151944:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635125376:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.151953:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 613 00000100:00100000:3.0:1789429520.151959:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635125760 00000100:00100000:3.0:1789429520.151964:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635125760 00000100:00100000:1.0:1789429520.151989:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635126016 00000100:00100000:1.0:1789429520.151994:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635126016 00000100:00100000:3.0:1789429520.152008:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635125632 00000100:00100000:3.0:1789429520.152013:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635125632 00000100:00100000:1.0:1789429520.152025:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635126144 00000100:00100000:1.0:1789429520.152030:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635126144 00000100:00100000:3.0:1789429520.152045:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 957 00000100:00100000:3.0:1789429520.152056:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635125760:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429520.152061:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 958 00000100:00100000:1.0:1789429520.152071:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635126016:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429520.152095:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635125760:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 41us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.152105:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635126016:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 34us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429520.152105:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 957 00000100:00100000:1.0:1789429520.152117:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 958 00000100:00100000:3.0:1789429520.152129:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 959 00000100:00100000:3.0:1789429520.152139:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351635125632:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429520.152167:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351635125632:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429520.152173:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 959 00000100:00100000:0.0:1789429520.152243:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 960 00000100:00100000:0.0:1789429520.152253:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635126144:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429520.152282:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635126144:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.152289:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 960 00000100:00100000:1.0:1789429520.152343:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635125504 00000100:00100000:1.0:1789429520.152348:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635125504 00000100:00100000:1.0:1789429520.152374:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635125888 00000100:00100000:1.0:1789429520.152377:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635125888 00000100:00100000:1.0:1789429520.152410:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 910 00000100:00100000:1.0:1789429520.152417:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635125504:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429520.152452:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635125504:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 36us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.152458:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 910 00000100:00100000:1.0:1789429520.152470:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 911 00000100:00100000:1.0:1789429520.152477:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351635125888:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429520.152507:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351635125888:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.152514:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 911 00000100:00080000:3.0:1789429520.152526:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429520.152532:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429520.152535:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429520.481497:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.481865:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635126272 00000100:00100000:2.0:1789429520.481876:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635126272 00000100:00100000:2.0:1789429520.481949:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21348 00000100:00100000:2.0:1789429520.481959:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:44696:x1876351635126272:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429520.481978:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429520.482000:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361e43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca03 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.482066:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361e4a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.482081:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361e4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.482094:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361e4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429520.482131:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429520.482135:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429520.482155:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361e4a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.482181:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546600/0xb4c3dad726361e43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca03 expref: 22 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.482194:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361e4a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca03 expref: 21 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.482456:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef600) 00010000:00010000:2.0:1789429520.482459:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429520.482463:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546e00, rc 0) 00000100:00100000:2.0:1789429520.482562:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:44696:x1876351635126272:12345-192.168.203.39@tcp:101:dd.0 Request processed in 604us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429520.482569:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21348 00000100:00100000:1.0:1789429520.486983:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429520.487422:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635126400 00000100:00100000:0.0:1789429520.487434:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635126400 00000100:00100000:0.0:1789429520.487485:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21349 00000100:00100000:0.0:1789429520.487495:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:44695:x1876351635126400:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429520.487516:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429520.487537:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ac00/0xb4c3dad726361e51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca0a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.487598:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361e58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.487624:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.487636:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429520.487669:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429520.487672:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429520.487692:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.487715:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ac00/0xb4c3dad726361e51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca0a expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.487734:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361e58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca0a expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.487741:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef600) 00010000:00010000:0.0:1789429520.487745:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429520.487748:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93a000, rc 0) 00000100:00100000:0.0:1789429520.487811:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:44695:x1876351635126400:12345-192.168.203.39@tcp:101:dd.0 Request processed in 317us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.487818:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21349 00000100:00100000:3.0:1789429520.490404:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429520.490438:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635126656 00000100:00100000:3.0:1789429520.490447:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635126656 00000100:00100000:3.0:1789429520.490493:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21350 00000100:00100000:3.0:1789429520.490504:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:44696:x1876351635126656:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429520.490525:0:15669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429520.490528:0:15669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789429520.490551:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546e00/0xb4c3dad726361e4a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca03 expref: 21 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.490569:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef600) 00010000:00010000:3.0:1789429520.490573:0:15669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429520.490586:0:15669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361e5f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca11 expref: -99 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.491700:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361e66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.491716:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361e66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.491731:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361e66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.491745:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361e6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.491751:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361e6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.491757:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361e6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.491940:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361e74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.491949:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.491956:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429520.491965:0:15669:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8a:0x0]: returning size 52428800 00010000:00010000:3.0:1789429520.492090:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361e66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492099:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361e66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492105:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361e66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492111:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0e00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429520.492115:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361e66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492123:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361e66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492133:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef600) 00010000:00010000:3.0:1789429520.492136:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429520.492140:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361e66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492147:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0e00/0xb4c3dad726361e66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492159:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361e6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492166:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361e6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492172:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361e6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492177:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f119c0a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429520.492179:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361e6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492185:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361e6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492192:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b086329 (ffff946f04fb8400) 00010000:00010000:3.0:1789429520.492194:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429520.492217:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361e6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492224:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0a00/0xb4c3dad726361e6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492268:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0800/0xb4c3dad726361e5f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca11 expref: 23 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492282:0:15669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca11 expref: 22 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.492289:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:3.0:1789429520.492292:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429520.492294:0:15669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c6800, rc 0) 00000100:00100000:3.0:1789429520.492357:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:44696:x1876351635126656:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1854us (1970us total) trans 4294977243 rc 0/0 00000100:00100000:3.0:1789429520.492365:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21350 00000100:00100000:3.0:1789429520.493428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429520.494143:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635126912 00000100:00100000:3.0:1789429520.494152:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635126912 00000100:00100000:3.0:1789429520.494273:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21351 00000100:00100000:3.0:1789429520.494284:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+32:44695:x1876351635126912:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429520.494303:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429520.494306:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789429520.494328:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361e58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca0a expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.494345:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051ef600) 00010000:00010000:3.0:1789429520.494355:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429520.494369:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad726361e82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca18 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495134:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726361e89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495148:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726361e89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495158:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726361e89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495170:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5600/0xb4c3dad726361e90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495177:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5600/0xb4c3dad726361e90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495184:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5600/0xb4c3dad726361e90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495400:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad726361e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495411:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad726361e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495420:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad726361e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429520.495430:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8a:0x0]: returning size 52428800 00010000:00010000:3.0:1789429520.495516:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726361e89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495526:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726361e89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495533:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726361e89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495540:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c4800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429520.495544:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726361e89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495552:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726361e89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495563:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8c00) 00010000:00010000:3.0:1789429520.495566:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429520.495570:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726361e89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495577:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726361e89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495587:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5600/0xb4c3dad726361e90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495594:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5600/0xb4c3dad726361e90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495600:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5600/0xb4c3dad726361e90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495605:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429520.495608:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5600/0xb4c3dad726361e90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495614:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5600/0xb4c3dad726361e90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495632:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b086329 (ffff946f04fb8e00) 00010000:00010000:3.0:1789429520.495635:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429520.495638:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5600/0xb4c3dad726361e90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495644:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5600/0xb4c3dad726361e90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495683:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad726361e82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca18 expref: 34 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495699:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad726361e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca18 expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.495707:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:3.0:1789429520.495709:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789429520.495711:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5400, rc 0) 00000100:00100000:3.0:1789429520.495794:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+33:44695:x1876351635126912:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1512us (2369us total) trans 4294977244 rc 0/0 00000100:00100000:3.0:1789429520.495803:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21351 00000100:00100000:3.0:1789429520.498604:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429520.498675:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635127168 00000100:00100000:0.0:1789429520.498683:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635127168 00000100:00100000:0.0:1789429520.498730:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21352 00000100:00100000:0.0:1789429520.498740:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+33:44695:x1876351635127168:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:0.0:1789429520.498789:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429520.498813:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5400/0xb4c3dad726361e97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca18 expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.498830:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429520.498834:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429520.499132:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.499145:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361e74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca11 expref: 21 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.499151:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.499190:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca11 expref: 21 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.499234:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361e74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca11 expref: 21 pid: 15669 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429520.499255:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648402944:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429520.499336:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538300 going to sleep for 11 seconds 00000100:00100000:1.0:1789429520.499544:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.499683:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635127424 00000100:00100000:2.0:1789429520.499690:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635127424 00000100:00100000:2.0:1789429520.499725:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21353 00000100:00100000:2.0:1789429520.499733:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:44696:x1876351635127424:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:2.0:1789429520.499763:0:15669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429520.499773:0:15669:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361e74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca11 expref: 22 pid: 15669 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.499788:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:2.0:1789429520.499793:0:15669:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.499801:0:15669:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.499809:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.499823:0:15669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789429520.500091:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.500101:0:15669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.500108:0:15669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 4/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.500119:0:15669:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.500128:0:15669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.504002:0:5841:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.39@tcp) returned -22 from blocking AST (req@00000000c6d2c200 x1876351648402944) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361e74 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca11 expref: 23 pid: 15669 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.504026:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6800/0xb4c3dad726361e74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca11 expref: 23 pid: 15669 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.504040:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648402944:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429520.504059:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:2.0:1789429520.504065:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.504078:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.504086:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.504092:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789429520.504223:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977245 00000004:00010000:2.0:1789429520.504275:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000fa56610 reply state 00000000ad538228 transno 4294977247 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.504284:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789429520.504399:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+35:44695:x1876351635127168:12345-192.168.203.39@tcp:36:dd.0 Request processed in 5649us (5789us total) trans 4294977247 rc 0/0 00000100:00100000:2.0:1789429520.504408:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21352 00000020:00080000:2.0:1789429520.504414:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789429520.507124:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.507146:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.507154:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.507160:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f93be00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429520.507166:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.507173:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.507191:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:3.0:1789429520.507194:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429520.507223:0:3285:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.507234:0:3285:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.507243:0:3285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.507274:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.507281:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361ea5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.507402:0:15669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.507410:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789429520.507519:0:15669:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977246 00000004:00010000:0.0:1789429520.507568:0:15669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000473f2286 reply state 00000000c96431e6 transno 4294977248 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429520.507578:0:15669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429520.507682:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:44696:x1876351635127424:12345-192.168.203.39@tcp:36:dd.0 Request processed in 7946us (8135us total) trans 4294977248 rc 0/0 00000100:00100000:0.0:1789429520.507691:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21353 00000020:00080000:0.0:1789429520.507697:0:15669:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789429520.511316:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.511333:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.511342:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.511348:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f547400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429520.511353:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.511364:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.511381:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429520.511384:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429520.511399:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.511406:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547400/0xb4c3dad726361eac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429520.513096:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.513188:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635127680 00000100:00100000:1.0:1789429520.513224:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635127680 00000100:00100000:1.0:1789429520.513284:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5846 00000100:00100000:1.0:1789429520.513295:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:44696:x1876351635127680:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429520.513312:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429520.513329:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca26 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513361:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513376:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513385:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513402:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [6291456->10485759] (req 6291456->7340031) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513410:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [10485760->15728639] (req 10485760->11534335) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513418:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [15728640->23068671] (req 15728640->16777215) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513426:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [23068672->30408703] (req 23068672->24117247) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513434:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [30408704->38797311] (req 30408704->31457279) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513442:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->49283071] (req 38797312->39845887) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513456:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513464:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 10 to [0x240000400:0x39:0x0].0x0 since=2s v=(3 20) 00010000:00010000:1.0:1789429520.513468:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(13 20) 00010000:00010000:1.0:1789429520.513473:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 13/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513507:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513520:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 16 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.513533:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403072:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.513760:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->49283071] (req 38797312->39845887) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513772:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [38797312->49283071] (req 38797312->39845887) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 16 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.513782:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403200:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.513830:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [30408704->38797311] (req 30408704->31457279) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513840:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [30408704->38797311] (req 30408704->31457279) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 16 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.513850:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403328:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.513878:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [23068672->30408703] (req 23068672->24117247) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.513963:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [23068672->30408703] (req 23068672->24117247) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 16 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.513975:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403456:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.514008:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [15728640->23068671] (req 15728640->16777215) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.514018:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [15728640->23068671] (req 15728640->16777215) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 16 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.514027:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403584:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.514056:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [10485760->15728639] (req 10485760->11534335) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.514065:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [10485760->15728639] (req 10485760->11534335) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 16 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.514075:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403712:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.514117:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [6291456->10485759] (req 6291456->7340031) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.514127:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [6291456->10485759] (req 6291456->7340031) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 16 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.514137:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403840:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.514166:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 16 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.514176:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 16 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.514185:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403968:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.514301:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 16 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.514311:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 16 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.514320:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648404096:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.514352:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 16 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.514361:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 16 pid: 6681 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.514370:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648404224:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.514403:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e038653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429520.517018:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403072:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429520.518492:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.518706:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635127552 00000100:00100000:1.0:1789429520.518714:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635127552 00000100:00100000:1.0:1789429520.518785:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5847 00000100:00100000:1.0:1789429520.518796:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+17:44695:x1876351635127552:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429520.518814:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429520.518835:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca1f expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.518872:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 10 to [0x240000400:0x39:0x0].0x0 since=0s v=(13 20) 00010000:00010000:1.0:1789429520.518881:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.518901:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(23 20) 00010000:00010000:1.0:1789429520.518907:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.518956:0:20745:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.518970:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 18 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.518983:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01506000, rc 0) 00000100:00100000:1.0:1789429520.519047:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+18:44695:x1876351635127552:12345-192.168.203.39@tcp:101:dd.0 Request processed in 252us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.519054:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5847 00000100:00100000:1.0:1789429520.531437:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403200:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.531453:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403328:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.531460:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403456:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.531468:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403584:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.531476:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403712:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.531484:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403840:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.531492:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648403968:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.531500:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648404096:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.536273:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648404224:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.536340:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.536364:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01507400, rc 0) 00000100:00100000:1.0:1789429520.536439:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:44696:x1876351635127680:12345-192.168.203.39@tcp:101:dd.0 Request processed in 23146us (23349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.536449:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5846 00000100:00100000:0.0:1789429520.550154:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648404864:0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.550512:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429520.550549:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789429520.550555:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648404480:0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.550582:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429520.550604:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648404992:0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.550625:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429520.550714:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648404608:0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.550736:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429520.550751:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648405120:0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.550766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429520.550780:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429520.550784:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648404736:0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.550799:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429520.550824:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648404864 00000100:00100000:0.0:1789429520.550832:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648404864 00000100:00100000:0.0:1789429520.550878:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648405120 00000100:00100000:0.0:1789429520.550881:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648405120 00000100:00100000:0.0:1789429520.550900:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:0.0:1789429520.550907:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648404864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.550950:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648404864:12345-0@lo:400:kworker.0 Request processed in 43us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.550957:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:0.0:1789429520.550970:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1789429520.550975:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648405120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.551012:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648405120:12345-0@lo:400:kworker.0 Request processed in 36us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.551017:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1789429520.551035:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648404480 00000100:00100000:0.0:1789429520.551038:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648404480 00000100:00100000:0.0:1789429520.551057:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1789429520.551062:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648404480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.551084:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648404480:12345-0@lo:400:kworker.0 Request processed in 23us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.551089:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1789429520.551113:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648404992 00000100:00100000:0.0:1789429520.551116:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648404992 00000100:00100000:0.0:1789429520.551136:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648404608 00000100:00100000:0.0:1789429520.551138:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648404608 00000100:00100000:0.0:1789429520.551149:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648404736 00000100:00100000:0.0:1789429520.551151:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648404736 00000100:00100000:0.0:1789429520.551165:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1789429520.551170:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648404992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.551194:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648404992:12345-0@lo:400:kworker.0 Request processed in 24us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.551217:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1789429520.551227:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1789429520.551232:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648404608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.551254:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648404608:12345-0@lo:400:kworker.0 Request processed in 22us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.551259:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1789429520.551267:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:0.0:1789429520.551271:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648404736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.551289:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648404736:12345-0@lo:400:kworker.0 Request processed in 18us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.551294:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00080000:0.0:1789429520.551315:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429520.551318:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429520.551320:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429520.551357:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648404736:0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.551366:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648404608:0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.551373:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648405120:0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.551410:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648404480:0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.551419:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648404992:0@lo:400:kworker.0 00000100:00100000:0.0:1789429520.551427:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648404864:0@lo:400:kworker.0 00000100:00100000:3.0:1789429520.555127:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.560361:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635127808 00000100:00100000:2.0:1789429520.560376:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635127808 00010000:00010000:2.0:1789429520.560434:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [6291456->10485759] (req 6291456->7340031) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 18 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.560480:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6242 00000100:00100000:2.0:1789429520.560489:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2368:x1876351635127808:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429520.560504:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429520.560510:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 14 type: EXT [6291456->10485759] (req 6291456->7340031) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 18 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.560523:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 14 type: EXT [6291456->10485759] (req 6291456->7340031) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 18 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.560549:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abe31dd/0xb4c3dad726361de8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 14 type: EXT [6291456->10485759] (req 6291456->7340031) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9a8 expref: 18 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.560566:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429520.560630:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2368:x1876351635127808:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 142us (5512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429520.560639:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6242 00000100:00100000:2.0:1789429520.565734:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429520.565838:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635127936 00000100:00100000:0.0:1789429520.565848:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635127936 00010000:00010000:0.0:1789429520.565886:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 17 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429520.565959:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6243 00000100:00100000:0.0:1789429520.565968:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+17:2369:x1876351635127936:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429520.565984:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429520.565990:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 17 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.566014:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 17 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.566037:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002808f649/0xb4c3dad726361dda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [3145728->6291455] (req 3145728->4194303) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c99a expref: 17 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.566052:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429520.566107:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+16:2369:x1876351635127936:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 140us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.566115:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6243 00000100:00100000:2.0:1789429520.583030:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.583071:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.583099:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.583123:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.583151:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635128064 00000100:00100000:2.0:1789429520.583161:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635128064 00010000:00010000:2.0:1789429520.583224:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 16 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.583252:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635128320 00000100:00100000:2.0:1789429520.583255:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635128320 00010000:00010000:2.0:1789429520.583274:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 17 pid: 6681 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.583288:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635128192 00000100:00100000:2.0:1789429520.583291:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635128192 00010000:00010000:2.0:1789429520.583304:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [10485760->15728639] (req 10485760->11534335) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 18 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.583316:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635128448 00000100:00100000:2.0:1789429520.583319:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635128448 00010000:00010000:2.0:1789429520.583332:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [15728640->23068671] (req 15728640->16777215) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 19 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.583349:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6244 00000100:00100000:2.0:1789429520.583359:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351635128064:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429520.583374:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429520.583380:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 19 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583403:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 19 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583433:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361e3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [49283072->18446744073709551615] (req 49283072->50331647) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9fc expref: 19 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583447:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429520.583497:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635128064:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 140us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429520.583504:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6244 00000100:00100000:2.0:1789429520.583521:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6245 00000100:00100000:2.0:1789429520.583528:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351635128320:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429520.583536:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429520.583540:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 17 pid: 6681 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583550:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 17 pid: 6681 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583563:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ea183cf/0xb4c3dad726361dbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c97e expref: 17 pid: 6681 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583572:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429520.583593:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+16:2370:x1876351635128320:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 66us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429520.583612:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6245 00000100:00100000:2.0:1789429520.583629:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6246 00000100:00100000:2.0:1789429520.583639:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+15:2370:x1876351635128192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429520.583647:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429520.583651:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [10485760->15728639] (req 10485760->11534335) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 15 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583661:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [10485760->15728639] (req 10485760->11534335) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 15 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583673:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361df6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [10485760->15728639] (req 10485760->11534335) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9b6 expref: 15 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583683:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429520.583703:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:2370:x1876351635128192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 67us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429520.583710:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6246 00000100:00100000:2.0:1789429520.583723:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6247 00000100:00100000:2.0:1789429520.583730:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351635128448:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429520.583739:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429520.583744:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [15728640->23068671] (req 15728640->16777215) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 13 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583753:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [15728640->23068671] (req 15728640->16777215) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 13 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583765:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7b86653/0xb4c3dad726361e04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [15728640->23068671] (req 15728640->16777215) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9c4 expref: 13 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.583776:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429520.583797:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351635128448:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 67us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429520.583803:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6247 00000100:00100000:3.0:1789429520.612129:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429520.613677:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.614040:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635128576 00000100:00100000:2.0:1789429520.614049:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635128576 00010000:00010000:2.0:1789429520.614086:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 12 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.614160:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635128704 00000100:00100000:2.0:1789429520.614163:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635128704 00010000:00010000:2.0:1789429520.614176:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [30408704->38797311] (req 30408704->31457279) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 13 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429520.614284:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6248 00000100:00100000:3.0:1789429520.614294:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+13:2368:x1876351635128576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429520.614308:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429520.614314:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 13 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.614327:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 13 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.614349:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361dcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [1048576->3145727] (req 1048576->2097151) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c98c expref: 13 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.614363:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429520.614495:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:2368:x1876351635128576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 202us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429520.614503:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6248 00000100:00100000:3.0:1789429520.614524:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6249 00000100:00100000:3.0:1789429520.614533:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351635128704:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429520.614541:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429520.614545:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [30408704->38797311] (req 30408704->31457279) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 11 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.614560:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [30408704->38797311] (req 30408704->31457279) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 11 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.614573:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361e20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [30408704->38797311] (req 30408704->31457279) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9e0 expref: 11 pid: 13238 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.614582:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429520.614599:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+10:2370:x1876351635128704:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 69us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429520.614605:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6249 00010000:00010000:3.0:1789429520.617898:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429520.618136:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429520.623749:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635128832 00000100:00100000:3.0:1789429520.623765:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635128832 00010000:00010000:3.0:1789429520.623806:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [38797312->49283071] (req 38797312->39845887) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 10 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429520.625028:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6250 00000100:00100000:3.0:1789429520.625044:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+10:2369:x1876351635128832:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429520.625065:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429520.625074:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [38797312->49283071] (req 38797312->39845887) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 10 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.625091:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [38797312->49283071] (req 38797312->39845887) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 10 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.625122:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f27046d/0xb4c3dad726361e2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [38797312->49283071] (req 38797312->39845887) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9ee expref: 10 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.625139:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429520.625286:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+9:2369:x1876351635128832:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 245us (7153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429520.625295:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6250 00000100:00100000:0.0:1789429520.633813:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.633896:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635128960 00000100:00100000:1.0:1789429520.633907:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635128960 00010000:00010000:1.0:1789429520.633956:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [23068672->30408703] (req 23068672->24117247) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 9 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.634007:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6251 00000100:00100000:1.0:1789429520.634017:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+9:2370:x1876351635128960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429520.634032:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429520.634038:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [23068672->30408703] (req 23068672->24117247) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 9 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.634052:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [23068672->30408703] (req 23068672->24117247) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 9 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.634076:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095a0deb0/0xb4c3dad726361e12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [23068672->30408703] (req 23068672->24117247) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c9d2 expref: 9 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.634090:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(24 20) 00010000:00010000:1.0:1789429520.634095:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(24 20) 00010000:00010000:1.0:1789429520.634102:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 5 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.634112:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 5 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.634151:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 5 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.634165:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 5 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.634180:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648405248:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429520.634401:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e038653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789429520.641343:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648405248:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429520.641372:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429520.641442:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635128960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7425us (7637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.641453:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6251 00000100:00100000:0.0:1789429520.647328:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.647493:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635129088 00000100:00100000:2.0:1789429520.647504:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635129088 00002000:00010000:2.0:1789429520.647551:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:2.0:1789429520.647557:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac1500 with x1876351635129088 ext(0->18446744073709551615) 00010000:00010000:2.0:1789429520.647573:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 6 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.647591:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 6 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429520.647600:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eac1500. 00000100:00100000:2.0:1789429520.647664:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1422 00000100:00100000:2.0:1789429520.647674:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635129088:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:2.0:1789429520.648062:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 52428800 -> 0 00002000:00010000:2.0:1789429520.648067:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 1789429518 -> 1789429520 00002000:00010000:2.0:1789429520.648070:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789429520.648072:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 1789429518 -> 1789429520 00002000:00010000:2.0:1789429520.648074:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb blocks from disk: 2055 -> 102407 00000100:00100000:2.0:1789429520.648158:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635129088:12345-192.168.203.39@tcp:10:dd.0 Request processed in 484us (840us total) trans 4294969480 rc 0/0 00000100:00100000:2.0:1789429520.648166:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1422 00002000:00010000:2.0:1789429520.648171:0:6685:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:2.0:1789429520.648174:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac1500 with x1876351635129088 ext(0->18446744073709551615) 00010000:00010000:2.0:1789429520.648182:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 7 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.648196:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 7 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429520.648232:0:6685:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eac1500. 00000100:00100000:0.0:1789429520.661079:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429520.661412:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635129216 00000100:00100000:3.0:1789429520.661422:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635129216 00010000:00010000:3.0:1789429520.661465:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 7 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429520.661510:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6252 00000100:00100000:3.0:1789429520.661520:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635129216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429520.661535:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429520.661542:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 7 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.661556:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 7 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.661580:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361eb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca26 expref: 7 pid: 6680 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.661602:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(24 20) 00010000:00010000:3.0:1789429520.661608:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(24 20) 00010000:00010000:3.0:1789429520.661616:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.661626:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.661666:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429520.661680:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb43100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648405376:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429520.661767:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f32232840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429520.679570:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429520.679703:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.679815:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635129344 00000100:00100000:1.0:1789429520.679825:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635129344 00000100:00100000:1.0:1789429520.679882:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5848 00000100:00100000:1.0:1789429520.679892:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:44696:x1876351635129344:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429520.679909:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429520.679938:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca2d expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.679978:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.679989:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(24 20) 00010000:00010000:1.0:1789429520.679994:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(25 20) 00010000:00010000:1.0:1789429520.680000:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 8 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.680034:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.680048:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 7 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.680063:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:20745:1876351648405504:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.680135:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e038653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429520.680257:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb43100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648405376:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429520.680277:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429520.680308:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2369:x1876351635129216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 18789us (19238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429520.680311:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635129472 00000100:00100000:2.0:1789429520.680318:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635129472 00000100:00100000:3.0:1789429520.680319:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6252 00002000:00010000:2.0:1789429520.680344:0:20673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:2.0:1789429520.680350:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac2d80 with x1876351635129472 ext(0->18446744073709551615) 00010000:00010000:2.0:1789429520.680360:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 8 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.680379:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 8 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429520.680462:0:20673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eac2d80. 00000100:00100000:2.0:1789429520.680491:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1423 00000100:00100000:2.0:1789429520.680500:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+8:2368:x1876351635129472:12345-192.168.203.39@tcp:10:dd.0 00002000:00010000:2.0:1789429520.680724:0:20673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789429520.680727:0:20673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 1789429520 -> 1789429520 00002000:00010000:2.0:1789429520.680730:0:20673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789429520.680732:0:20673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 1789429520 -> 1789429520 00002000:00010000:2.0:1789429520.680734:0:20673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb blocks from disk: 102407 -> 102407 00000100:00100000:2.0:1789429520.680762:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351635129472:12345-192.168.203.39@tcp:10:dd.0 Request processed in 264us (1059us total) trans 4294969481 rc 0/0 00000100:00100000:2.0:1789429520.680769:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1423 00002000:00010000:2.0:1789429520.680772:0:20673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/57 (0->18446744073709551615) 00002000:00100000:2.0:1789429520.680775:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac2d80 with x1876351635129472 ext(0->18446744073709551615) 00010000:00010000:2.0:1789429520.680781:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 9 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.680792:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 9 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429520.680800:0:20673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eac2d80. 00000100:00100000:2.0:1789429520.686138:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:20745:1876351648405504:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429520.686178:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.686233:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01506200, rc 0) 00000100:00100000:2.0:1789429520.686287:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:44696:x1876351635129344:12345-192.168.203.39@tcp:101:dd.0 Request processed in 6395us (6726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429520.686297:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5848 00000100:00100000:0.0:1789429520.690071:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429520.691782:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635129600 00000100:00100000:3.0:1789429520.691796:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635129600 00010000:00010000:3.0:1789429520.691846:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 9 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429520.692021:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6253 00000100:00100000:3.0:1789429520.692032:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:2368:x1876351635129600:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429520.692049:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789429520.692073:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 9 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.692098:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 9 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.692120:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089f47d21/0xb4c3dad726361eba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca1f expref: 9 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.692138:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(25 20) 00010000:00010000:3.0:1789429520.692143:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(25 20) 00010000:00010000:3.0:1789429520.692152:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 6 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.692162:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 6 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.692246:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 6 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429520.692260:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb43100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648405632:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429520.692336:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f32232840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429520.697028:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.697166:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635129728 00000100:00100000:1.0:1789429520.697178:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635129728 00000100:00100000:1.0:1789429520.697359:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5849 00000100:00100000:1.0:1789429520.697369:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:44695:x1876351635129728:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429520.697396:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429520.697415:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361ec8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca34 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.697452:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 6 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.697461:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(25 20) 00010000:00010000:1.0:1789429520.697466:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(26 20) 00010000:00010000:1.0:1789429520.697471:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361ec8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca34 expref: 10 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.697505:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 6 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.697519:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 6 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.697533:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648405760:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.697631:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429520.700986:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb43100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648405632:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429520.701025:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429520.701086:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+10:2368:x1876351635129600:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9055us (11021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.701097:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6253 00000100:00100000:1.0:1789429520.720500:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648405760:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.720539:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361ec8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca34 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.720566:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01507400, rc 0) 00000100:00100000:1.0:1789429520.720681:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:44695:x1876351635129728:12345-192.168.203.39@tcp:101:dd.0 Request processed in 23312us (23661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.720691:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5849 00000100:00100000:3.0:1789429520.737103:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429520.737250:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635129984 00000100:00100000:0.0:1789429520.737260:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635129984 00000100:00100000:0.0:1789429520.737323:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5850 00000100:00100000:0.0:1789429520.737333:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:44696:x1876351635129984:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429520.737352:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429520.737370:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca3b expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.737411:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(26 20) 00010000:00010000:0.0:1789429520.737417:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(27 20) 00010000:00010000:0.0:1789429520.737423:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 8 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.737445:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 8 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.737458:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93a000, rc 0) 00000100:00100000:0.0:1789429520.737521:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:44696:x1876351635129984:12345-192.168.203.39@tcp:101:dd.0 Request processed in 189us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.737528:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5850 00000100:00100000:3.0:1789429520.740785:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.740891:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635129856 00000100:00100000:2.0:1789429520.740900:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635129856 00002000:00100000:2.0:1789429520.740949:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946e0eb40a80 x1876351635129856/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:256/0 lens 488/0 e 0 to 0 dl 1789429531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429520.740961:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb40a80 with x1876351635129856 ext(0->1048575) 00010000:00010000:2.0:1789429520.740970:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 8 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.740987:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 8 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429520.740995:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eb40a80 00000100:00100000:2.0:1789429520.741033:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1424 00000100:00100000:2.0:1789429520.741043:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635129856:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429520.753276:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351635129856:12345-192.168.203.39@tcp:4:dd.0 Request processed in 12224us (12491us total) trans 4294969482 rc 0/0 00000100:00100000:3.0:1789429520.753289:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1424 00002000:00100000:3.0:1789429520.753302:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946e0eb40a80 x1876351635129856/t4294969482(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:256/0 lens 488/448 e 0 to 0 dl 1789429531 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429520.753312:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb40a80 with x1876351635129856 ext(0->1048575) 00010000:00010000:3.0:1789429520.753322:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 10 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.753340:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 10 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429520.753348:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eb40a80 00000100:00100000:2.0:1789429520.764907:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429520.769523:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635130112 00000100:00100000:3.0:1789429520.769537:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635130112 00010000:00010000:2.0:1789429520.772071:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 10 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.772134:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6254 00000100:00100000:2.0:1789429520.772146:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351635130112:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429520.772161:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789429520.772181:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1789429520.772184:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 1789429520 -> 1789429521 00002000:00010000:2.0:1789429520.772187:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 1789429520 -> 1789429521 00010000:00010000:2.0:1789429520.772192:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 10 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.772235:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 10 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.772256:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f00d937/0xb4c3dad726361ec1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca2d expref: 10 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.772272:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(27 20) 00010000:00010000:2.0:1789429520.772277:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(27 20) 00010000:00010000:2.0:1789429520.772285:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361ec8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca34 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.772294:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361ec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca34 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.772303:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(27 20) 00010000:00010000:2.0:1789429520.772306:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(27 20) 00010000:00010000:2.0:1789429520.772311:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 9 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.772320:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 9 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.772354:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 9 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.772368:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05047480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648405888:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429520.772595:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361ec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca34 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.772606:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05045f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648406016:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429520.772629:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1962f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789429520.782864:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05047480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648405888:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429520.782887:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05045f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648406016:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429520.782912:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429520.782974:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2368:x1876351635130112:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10830us (18076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.782988:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6254 00000100:00100000:0.0:1789429520.805392:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.805529:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635130368 00000100:00100000:2.0:1789429520.805541:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635130368 00000100:00100000:2.0:1789429520.805602:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5851 00000100:00100000:2.0:1789429520.805612:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+9:44695:x1876351635130368:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429520.805630:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429520.805648:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361ed6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca42 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.805682:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 8 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.805699:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(27 20) 00010000:00010000:2.0:1789429520.805704:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(28 20) 00010000:00010000:2.0:1789429520.805709:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361ed6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca42 expref: 10 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.805742:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 8 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.805770:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 8 pid: 8085 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429520.805785:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05045500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648406144:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429520.805872:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1962f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789429520.806107:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429520.808974:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05045500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648406144:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429520.809011:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361ed6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca42 expref: 10 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429520.809033:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546200, rc 0) 00000100:00100000:0.0:1789429520.809096:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+10:44695:x1876351635130368:12345-192.168.203.39@tcp:101:dd.0 Request processed in 3485us (3728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429520.809105:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5851 00000100:00100000:2.0:1789429520.810251:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635130240 00000100:00100000:2.0:1789429520.810262:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635130240 00002000:00100000:2.0:1789429520.810320:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946e0eac0a80 x1876351635130240/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:256/0 lens 488/0 e 0 to 0 dl 1789429531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429520.810331:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac0a80 with x1876351635130240 ext(0->1048575) 00002000:00010000:2.0:1789429520.810338:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eac0a80 00000100:00100000:2.0:1789429520.810440:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11707 00000100:00100000:2.0:1789429520.810451:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+10:2370:x1876351635130240:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429520.819154:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429520.819254:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.819776:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635130496 00000100:00100000:2.0:1789429520.819787:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635130496 00002000:00100000:2.0:1789429520.819837:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946e0eac1180 x1876351635130496/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:256/0 lens 488/0 e 0 to 0 dl 1789429531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429520.819850:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac1180 with x1876351635130496 ext(1048576->2097151) 00010000:00010000:2.0:1789429520.819860:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 9 pid: 8085 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.819879:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 9 pid: 8085 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429520.819887:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eac1180 00000100:00100000:2.0:1789429520.819918:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1425 00000100:00100000:2.0:1789429520.819928:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2368:x1876351635130496:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429520.820225:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635130624 00000100:00100000:1.0:1789429520.820230:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635130624 00000100:00100000:1.0:1789429520.820267:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5852 00000100:00100000:1.0:1789429520.820274:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:44696:x1876351635130624:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429520.820284:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429520.820300:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca49 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.820325:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(28 20) 00010000:00010000:1.0:1789429520.820329:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(29 20) 00010000:00010000:1.0:1789429520.820334:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 12 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.820343:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 12 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.820353:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01507200, rc 0) 00000100:00100000:1.0:1789429520.820381:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:44696:x1876351635130624:12345-192.168.203.39@tcp:101:dd.0 Request processed in 107us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.820396:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5852 00000100:00100000:2.0:1789429520.826272:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351635130240:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15813us (20155us total) trans 4294969483 rc 0/0 00000100:00100000:2.0:1789429520.826286:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11707 00002000:00100000:2.0:1789429520.826299:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946e0eac0a80 x1876351635130240/t4294969483(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:256/0 lens 488/448 e 0 to 0 dl 1789429531 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429520.826309:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac0a80 with x1876351635130240 ext(0->1048575) 00002000:00010000:2.0:1789429520.826315:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eac0a80 00000100:00100000:2.0:1789429520.832068:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2368:x1876351635130496:12345-192.168.203.39@tcp:4:dd.0 Request processed in 12129us (12912us total) trans 4294969484 rc 0/0 00000100:00100000:2.0:1789429520.834338:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1425 00002000:00100000:2.0:1789429520.834359:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946e0eac1180 x1876351635130496/t4294969484(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:256/0 lens 488/448 e 0 to 0 dl 1789429531 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429520.834379:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac1180 with x1876351635130496 ext(1048576->2097151) 00010000:00010000:2.0:1789429520.834404:0:18945:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 12 pid: 8085 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.834425:0:18945:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 12 pid: 8085 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429520.834434:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eac1180 00000100:00100000:2.0:1789429520.838185:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.838749:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635130752 00000100:00100000:1.0:1789429520.838760:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635130752 00010000:00010000:1.0:1789429520.838798:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 12 pid: 8085 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.840264:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6255 00000100:00100000:1.0:1789429520.840282:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351635130752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429520.840300:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429520.840320:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 1048576 -> 2097152 00010000:00010000:1.0:1789429520.840328:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 12 pid: 8085 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.840343:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 12 pid: 8085 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.840365:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361ecf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [1048576->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca3b expref: 12 pid: 8085 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.840391:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(29 20) 00010000:00010000:1.0:1789429520.840396:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(29 20) 00010000:00010000:1.0:1789429520.840405:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361ed6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca42 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.840415:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361ed6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca42 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.840429:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(29 20) 00010000:00010000:1.0:1789429520.840432:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(29 20) 00010000:00010000:1.0:1789429520.840437:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.840445:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.840483:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 11 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.840497:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648406272:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429520.840597:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361ed6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca42 expref: 11 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.840607:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648406400:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429520.840631:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429520.848624:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648406272:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429520.848640:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648406400:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429520.848665:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429520.848723:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2371:x1876351635130752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 8448us (10546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.848734:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6255 00000100:00100000:0.0:1789429520.896301:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429520.896416:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.896443:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635131008 00000100:00100000:1.0:1789429520.896454:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635131008 00000100:00100000:1.0:1789429520.896517:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5853 00000100:00100000:1.0:1789429520.896529:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:44695:x1876351635131008:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429520.896547:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429520.896565:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361ee4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca50 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.896598:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.896608:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(29 20) 00010000:00010000:1.0:1789429520.896613:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(30 20) 00010000:00010000:1.0:1789429520.896618:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361ee4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca50 expref: 13 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.896654:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 10 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.896669:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 10 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429520.896684:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648406528:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429520.896789:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865600 going to sleep for 11 seconds 00000100:00100000:2.0:1789429520.896859:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635130880 00000100:00100000:2.0:1789429520.896864:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635130880 00002000:00100000:2.0:1789429520.896896:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946f2035fb80 x1876351635130880/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:256/0 lens 488/0 e 0 to 0 dl 1789429531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429520.896906:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035fb80 with x1876351635130880 ext(1048576->2097151) 00002000:00010000:2.0:1789429520.896911:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035fb80 00000100:00100000:2.0:1789429520.896941:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11708 00000100:00100000:2.0:1789429520.896950:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+14:2368:x1876351635130880:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429520.905558:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429520.905803:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635131136 00000100:00100000:3.0:1789429520.905814:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635131136 00002000:00100000:3.0:1789429520.905860:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946e0eb40700 x1876351635131136/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:256/0 lens 488/0 e 0 to 0 dl 1789429531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429520.905871:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb40700 with x1876351635131136 ext(2097152->3145727) 00010000:00010000:3.0:1789429520.905881:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 11 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.905899:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 11 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429520.905908:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eb40700 00000100:00100000:3.0:1789429520.905932:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1426 00000100:00100000:3.0:1789429520.905942:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2370:x1876351635131136:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429520.912414:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648406528:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429520.912451:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361ee4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca50 expref: 15 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429520.912472:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01507e00, rc 0) 00000100:00100000:1.0:1789429520.912553:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+15:44695:x1876351635131008:12345-192.168.203.39@tcp:101:dd.0 Request processed in 16025us (16260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429520.912563:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5853 00000100:00100000:3.0:1789429520.935518:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:2370:x1876351635131136:12345-192.168.203.39@tcp:4:dd.0 Request processed in 29567us (29961us total) trans 4294969486 rc 0/0 00000100:00100000:3.0:1789429520.935690:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1426 00002000:00100000:3.0:1789429520.935704:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946e0eb40700 x1876351635131136/t4294969486(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:256/0 lens 488/448 e 0 to 0 dl 1789429531 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429520.935715:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eb40700 with x1876351635131136 ext(2097152->3145727) 00010000:00010000:3.0:1789429520.935726:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 13 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429520.935745:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 13 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429520.935753:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eb40700 00000100:00100000:2.0:1789429520.938706:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+15:2368:x1876351635130880:12345-192.168.203.39@tcp:4:dd.0 Request processed in 41742us (42274us total) trans 4294969485 rc 0/0 00000100:00100000:2.0:1789429520.938725:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11708 00002000:00100000:2.0:1789429520.938741:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946f2035fb80 x1876351635130880/t4294969485(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:256/0 lens 488/448 e 0 to 0 dl 1789429531 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429520.938751:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035fb80 with x1876351635130880 ext(1048576->2097151) 00002000:00010000:2.0:1789429520.938758:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035fb80 00000100:00100000:1.0:1789429520.961767:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429520.961827:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429520.962124:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635131392 00000100:00100000:2.0:1789429520.962134:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635131392 00000100:00100000:2.0:1789429520.962227:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5854 00000100:00100000:2.0:1789429520.962238:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:44696:x1876351635131392:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429520.962256:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429520.962275:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca57 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.962305:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(30 20) 00010000:00010000:2.0:1789429520.962310:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(31 20) 00010000:00010000:2.0:1789429520.962315:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.962328:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 14 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.962341:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f547400, rc 0) 00000100:00100000:2.0:1789429520.962403:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:44696:x1876351635131392:12345-192.168.203.39@tcp:101:dd.0 Request processed in 166us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429520.962410:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5854 00000100:00100000:3.0:1789429520.967947:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635131264 00000100:00100000:3.0:1789429520.967962:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635131264 00002000:00100000:2.0:1789429520.968266:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f0879e300 x1876351635131264/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:256/0 lens 488/0 e 0 to 0 dl 1789429531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429520.968278:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879e300 with x1876351635131264 ext(3145728->4194303) 00010000:00010000:2.0:1789429520.968288:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 14 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.968309:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 14 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429520.968317:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f0879e300 00000100:00100000:2.0:1789429520.968343:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1427 00000100:00100000:2.0:1789429520.968352:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2368:x1876351635131264:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429520.984320:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351635131264:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15957us (22481us total) trans 4294969487 rc 0/0 00000100:00100000:2.0:1789429520.984334:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1427 00002000:00100000:2.0:1789429520.984347:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f0879e300 x1876351635131264/t4294969487(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:256/0 lens 488/448 e 0 to 0 dl 1789429531 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429520.984357:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879e300 with x1876351635131264 ext(3145728->4194303) 00010000:00010000:2.0:1789429520.984368:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 16 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429520.984398:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 16 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429520.984408:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f0879e300 00000100:00100000:3.0:1789429521.004029:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.004767:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635131520 00000100:00100000:0.0:1789429521.004778:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635131520 00010000:00010000:0.0:1789429521.004819:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 16 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429521.004861:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6256 00000100:00100000:0.0:1789429521.004869:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351635131520:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429521.004883:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789429521.004900:0:11354:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 2097152 -> 4194304 00010000:00010000:0.0:1789429521.004906:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 16 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.004926:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 16 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.004949:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf3331c7/0xb4c3dad726361edd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [2097152->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca49 expref: 16 pid: 20745 timeout: 1318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.004973:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(31 20) 00010000:00010000:0.0:1789429521.004979:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(31 20) 00010000:00010000:0.0:1789429521.004996:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361ee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca50 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.005006:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca50 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.005014:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(31 20) 00010000:00010000:0.0:1789429521.005017:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(31 20) 00010000:00010000:0.0:1789429521.005021:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.005028:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.005061:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 15 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429521.005078:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2035c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648406656:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429521.005185:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca50 expref: 14 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429521.005195:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2035ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648406784:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429521.005269:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538300 going to sleep for 11 seconds 00000100:00100000:0.0:1789429521.011566:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2035c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648406656:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429521.011580:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2035ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648406784:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429521.011600:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429521.011658:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2368:x1876351635131520:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6788us (7638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429521.011668:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6256 00000100:00100000:1.0:1789429521.045262:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.046008:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635131776 00000100:00100000:3.0:1789429521.046019:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635131776 00002000:00100000:3.0:1789429521.046070:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946f0879c380 x1876351635131776/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.046088:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879c380 with x1876351635131776 ext(4194304->5242879) 00002000:00010000:3.0:1789429521.046094:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879c380 00000100:00100000:3.0:1789429521.046130:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11709 00000100:00100000:3.0:1789429521.046140:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2371:x1876351635131776:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.051366:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.051657:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635131648 00000100:00100000:2.0:1789429521.051667:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635131648 00002000:00100000:2.0:1789429521.051717:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946f2f508700 x1876351635131648/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.051735:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f508700 with x1876351635131648 ext(2097152->3145727) 00002000:00010000:2.0:1789429521.051741:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f508700 00000100:00100000:2.0:1789429521.051767:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11710 00000100:00100000:2.0:1789429521.051777:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+15:2368:x1876351635131648:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.060070:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2371:x1876351635131776:12345-192.168.203.39@tcp:4:dd.0 Request processed in 13920us (14807us total) trans 4294969488 rc 0/0 00000100:00100000:0.0:1789429521.060083:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11709 00002000:00100000:0.0:1789429521.060096:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946f0879c380 x1876351635131776/t4294969488(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.060107:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879c380 with x1876351635131776 ext(4194304->5242879) 00002000:00010000:0.0:1789429521.060112:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879c380 00000100:00100000:2.0:1789429521.061301:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2035ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648407040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429521.061372:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429521.061502:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429521.061517:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648406912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429521.061559:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429521.061596:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648407040 00000100:00100000:1.0:1789429521.061604:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648407040 00000100:00100000:1.0:1789429521.061641:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648406912 00000100:00100000:1.0:1789429521.061645:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648406912 00000100:00100000:1.0:1789429521.061661:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1789429521.061668:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648407040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429521.061689:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 417529856 pending 13631488 free 3803185152 avail 3801088000 00000100:00100000:3.0:1789429521.061769:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1789429521.061779:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648406912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429521.061804:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429521.061843:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648406912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429521.061850:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789429521.061958:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648406912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429521.065028:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f508700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+17:2368:x1876351635131648:12345-192.168.203.39@tcp:4:dd.0 Request processed in 13243us (13661us total) trans 4294969489 rc 0/0 00000100:00100000:3.0:1789429521.065042:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11710 00002000:00100000:3.0:1789429521.065055:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946f2f508700 x1876351635131648/t4294969489(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.065064:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f508700 with x1876351635131648 ext(2097152->3145727) 00002000:00010000:3.0:1789429521.065070:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f508700 00000100:00100000:3.0:1789429521.072257:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.072333:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635131904 00000100:00100000:0.0:1789429521.072342:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635131904 00002000:00100000:0.0:1789429521.072409:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946f3f8db100 x1876351635131904/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.072420:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8db100 with x1876351635131904 ext(5242880->6291455) 00002000:00010000:0.0:1789429521.072427:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8db100 00000100:00100000:0.0:1789429521.072468:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11711 00000100:00100000:0.0:1789429521.072478:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2371:x1876351635131904:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429521.073180:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648407040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11508us (11805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429521.073192:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1789429521.080014:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2035ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648407040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429521.081783:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351635131904:12345-192.168.203.39@tcp:4:dd.0 Request processed in 9298us (9525us total) trans 4294969490 rc 0/0 00000100:00100000:2.0:1789429521.081798:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11711 00002000:00100000:2.0:1789429521.081810:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946f3f8db100 x1876351635131904/t4294969490(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.081820:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f8db100 with x1876351635131904 ext(5242880->6291455) 00002000:00010000:2.0:1789429521.081827:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f8db100 00000100:00100000:0.0:1789429521.094815:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.094861:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.094911:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.094999:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635132160 00000100:00100000:2.0:1789429521.095010:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635132160 00000100:00100000:2.0:1789429521.095060:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5855 00000100:00100000:2.0:1789429521.095071:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:44695:x1876351635132160:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429521.095089:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429521.095108:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad726361ef2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca5e expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.095140:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.095150:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=1s v=(31 20) 00010000:00010000:2.0:1789429521.095155:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(32 20) 00010000:00010000:2.0:1789429521.095160:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad726361ef2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca5e expref: 18 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.095195:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 18 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.095236:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 18 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429521.095250:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05046d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648407168:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429521.095332:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1962f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429521.098875:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635132288 00000100:00100000:3.0:1789429521.098890:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635132288 00002000:00100000:0.0:1789429521.100252:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946f2035d180 x1876351635132288/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.100264:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035d180 with x1876351635132288 ext(6291456->7340031) 00010000:00010000:0.0:1789429521.100275:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 19 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.100292:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 19 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429521.100299:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f2035d180 00000100:00100000:0.0:1789429521.100324:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635132032 00000100:00100000:0.0:1789429521.100329:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635132032 00002000:00100000:0.0:1789429521.100345:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f2035e680 x1876351635132032/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.100366:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035e680 with x1876351635132032 ext(3145728->4194303) 00002000:00010000:0.0:1789429521.100370:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035e680 00000100:00100000:0.0:1789429521.100403:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1428 00000100:00100000:0.0:1789429521.100413:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351635132288:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.100688:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11712 00000100:00100000:3.0:1789429521.100699:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+19:2369:x1876351635132032:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429521.107564:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05046d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648407168:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429521.107603:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad726361ef2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca5e expref: 20 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.107624:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546e00, rc 0) 00000100:00100000:2.0:1789429521.107682:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+20:44695:x1876351635132160:12345-192.168.203.39@tcp:101:dd.0 Request processed in 12612us (12874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429521.107691:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5855 00000100:00100000:0.0:1789429521.109998:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429521.110081:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635132416 00000100:00100000:1.0:1789429521.110089:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635132416 00002000:00100000:1.0:1789429521.110136:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f2035dc00 x1876351635132416/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.110147:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035dc00 with x1876351635132416 ext(7340032->8388607) 00010000:00010000:1.0:1789429521.110157:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 21 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.110174:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 21 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429521.110182:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f2035dc00 00000100:00100000:1.0:1789429521.110239:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1429 00000100:00100000:1.0:1789429521.110249:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351635132416:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.110737:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.111259:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635132544 00000100:00100000:3.0:1789429521.111266:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635132544 00000100:00100000:3.0:1789429521.111310:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5856 00000100:00100000:3.0:1789429521.111317:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:44696:x1876351635132544:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429521.111329:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429521.111345:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca65 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.111394:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(32 20) 00010000:00010000:3.0:1789429521.111399:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(33 20) 00010000:00010000:3.0:1789429521.111405:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 23 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.111417:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 23 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.115935:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5600, rc 0) 00000100:00100000:1.0:1789429521.116168:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:44696:x1876351635132544:12345-192.168.203.39@tcp:101:dd.0 Request processed in 4845us (5426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429521.116177:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5856 00000100:00100000:2.0:1789429521.126267:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2371:x1876351635132288:12345-192.168.203.39@tcp:4:dd.0 Request processed in 25845us (31395us total) trans 4294969491 rc 0/0 00000100:00100000:2.0:1789429521.126284:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1428 00002000:00100000:2.0:1789429521.126296:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946f2035d180 x1876351635132288/t4294969491(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.126307:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035d180 with x1876351635132288 ext(6291456->7340031) 00010000:00010000:2.0:1789429521.126318:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 24 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.126338:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 24 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429521.126346:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f2035d180 00000100:00100000:3.0:1789429521.133913:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+20:2369:x1876351635132032:12345-192.168.203.39@tcp:4:dd.0 Request processed in 33207us (38991us total) trans 4294969492 rc 0/0 00000100:00100000:3.0:1789429521.133931:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11712 00002000:00100000:3.0:1789429521.133942:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f2035e680 x1876351635132032/t4294969492(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.133952:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035e680 with x1876351635132032 ext(3145728->4194303) 00002000:00010000:3.0:1789429521.133958:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035e680 00000100:00100000:3.0:1789429521.142814:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2371:x1876351635132416:12345-192.168.203.39@tcp:4:dd.0 Request processed in 32557us (32815us total) trans 4294969493 rc 0/0 00000100:00100000:3.0:1789429521.142828:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1429 00002000:00100000:3.0:1789429521.142840:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f2035dc00 x1876351635132416/t4294969493(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.142851:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035dc00 with x1876351635132416 ext(7340032->8388607) 00010000:00010000:3.0:1789429521.142861:0:20973:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 24 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.142880:0:20973:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 24 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429521.142888:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f2035dc00 00000100:00100000:0.0:1789429521.152469:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.152572:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635132672 00000100:00100000:3.0:1789429521.152582:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635132672 00010000:00010000:3.0:1789429521.152621:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 24 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429521.152667:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6257 00000100:00100000:3.0:1789429521.152676:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:2368:x1876351635132672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429521.152692:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789429521.152709:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 4194304 -> 8388608 00010000:00010000:3.0:1789429521.152716:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 24 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.152729:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 24 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.152755:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfb45d7d/0xb4c3dad726361eeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca57 expref: 24 pid: 6682 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.152772:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(33 20) 00010000:00010000:3.0:1789429521.152778:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(33 20) 00010000:00010000:3.0:1789429521.152787:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad726361ef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [4194304->8388607] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca5e expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.152796:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad726361ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [4194304->8388607] (req 4194304->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca5e expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.152805:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(33 20) 00010000:00010000:3.0:1789429521.152807:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(33 20) 00010000:00010000:3.0:1789429521.152812:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 23 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.152821:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 23 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.152860:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 23 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429521.152875:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648407296:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429521.153186:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad726361ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [4194304->8388607] (req 4194304->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca5e expref: 19 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429521.153990:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648407424:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429521.154068:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f32232840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429521.161879:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648407296:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429521.161897:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648407424:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429521.161926:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429521.162018:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2368:x1876351635132672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 9341us (9556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429521.162030:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6257 00000100:00100000:2.0:1789429521.195052:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.195140:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635132928 00000100:00100000:3.0:1789429521.195151:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635132928 00002000:00100000:3.0:1789429521.195197:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946e05046d80 x1876351635132928/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.195249:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05046d80 with x1876351635132928 ext(8388608->9437183) 00002000:00010000:3.0:1789429521.195256:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05046d80 00000100:00100000:3.0:1789429521.195282:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11713 00000100:00100000:3.0:1789429521.195292:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2371:x1876351635132928:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429521.200096:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.201688:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635132800 00000100:00100000:3.0:1789429521.201700:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635132800 00002000:00100000:3.0:1789429521.201753:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946e05044000 x1876351635132800/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.201764:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044000 with x1876351635132800 ext(4194304->5242879) 00002000:00010000:3.0:1789429521.201770:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05044000 00000100:00100000:3.0:1789429521.204499:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11714 00000100:00100000:3.0:1789429521.204521:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+20:2369:x1876351635132800:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.210141:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2371:x1876351635132928:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14840us (15088us total) trans 4294969494 rc 0/0 00000100:00100000:3.0:1789429521.210155:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11713 00002000:00100000:3.0:1789429521.210168:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946e05046d80 x1876351635132928/t4294969494(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.210178:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05046d80 with x1876351635132928 ext(8388608->9437183) 00002000:00010000:3.0:1789429521.210183:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05046d80 00000100:00100000:0.0:1789429521.232036:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.232124:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635133056 00000100:00100000:3.0:1789429521.232134:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635133056 00002000:00100000:3.0:1789429521.232184:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946f2035ed80 x1876351635133056/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.232195:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035ed80 with x1876351635133056 ext(5242880->6291455) 00002000:00010000:3.0:1789429521.232239:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035ed80 00000100:00100000:3.0:1789429521.232262:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11715 00000100:00100000:3.0:1789429521.232272:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+22:2370:x1876351635133056:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429521.233235:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+24:2369:x1876351635132800:12345-192.168.203.39@tcp:4:dd.0 Request processed in 28718us (33143us total) trans 4294969495 rc 0/0 00000100:00100000:2.0:1789429521.233245:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11714 00002000:00100000:2.0:1789429521.233253:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946e05044000 x1876351635132800/t4294969495(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.233261:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044000 with x1876351635132800 ext(4194304->5242879) 00002000:00010000:2.0:1789429521.233265:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05044000 00000100:00100000:2.0:1789429521.238863:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+24:2370:x1876351635133056:12345-192.168.203.39@tcp:4:dd.0 Request processed in 6583us (6827us total) trans 4294969496 rc 0/0 00000100:00100000:2.0:1789429521.238879:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11715 00002000:00100000:2.0:1789429521.238891:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946f2035ed80 x1876351635133056/t4294969496(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.238903:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035ed80 with x1876351635133056 ext(5242880->6291455) 00002000:00010000:2.0:1789429521.238909:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035ed80 00000100:00100000:3.0:1789429521.239700:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429521.239787:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635133184 00000100:00100000:1.0:1789429521.239795:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635133184 00002000:00100000:1.0:1789429521.239847:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f087bca80 x1876351635133184/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.239857:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bca80 with x1876351635133184 ext(9437184->10485759) 00002000:00010000:1.0:1789429521.239861:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bca80 00000100:00100000:1.0:1789429521.239887:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11716 00000100:00100000:1.0:1789429521.239896:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:2368:x1876351635133184:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429521.247842:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2368:x1876351635133184:12345-192.168.203.39@tcp:4:dd.0 Request processed in 7935us (8134us total) trans 4294969497 rc 0/0 00000100:00100000:1.0:1789429521.247856:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11716 00002000:00100000:1.0:1789429521.247869:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f087bca80 x1876351635133184/t4294969497(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.247884:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bca80 with x1876351635133184 ext(9437184->10485759) 00002000:00010000:1.0:1789429521.247891:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bca80 00000100:00100000:3.0:1789429521.265121:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.265316:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635133312 00000100:00100000:2.0:1789429521.265327:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635133312 00002000:00100000:2.0:1789429521.265509:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946f087bce00 x1876351635133312/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.265521:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bce00 with x1876351635133312 ext(6291456->7340031) 00002000:00010000:2.0:1789429521.265528:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bce00 00000100:00100000:2.0:1789429521.265563:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11717 00000100:00100000:2.0:1789429521.265573:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+24:2369:x1876351635133312:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.269359:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.269605:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635133440 00000100:00100000:2.0:1789429521.269616:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635133440 00002000:00100000:2.0:1789429521.269664:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f3f1c4380 x1876351635133440/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.269676:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c4380 with x1876351635133440 ext(10485760->11534335) 00002000:00010000:2.0:1789429521.269681:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c4380 00000100:00100000:2.0:1789429521.269712:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11718 00000100:00100000:2.0:1789429521.269722:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+27:2368:x1876351635133440:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429521.294484:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+26:2369:x1876351635133312:12345-192.168.203.39@tcp:4:dd.0 Request processed in 28904us (29365us total) trans 4294969498 rc 0/0 00000100:00100000:1.0:1789429521.294498:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11717 00002000:00100000:1.0:1789429521.294509:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946f087bce00 x1876351635133312/t4294969498(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.294519:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bce00 with x1876351635133312 ext(6291456->7340031) 00002000:00010000:1.0:1789429521.294525:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bce00 00000100:00100000:1.0:1789429521.299498:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2368:x1876351635133440:12345-192.168.203.39@tcp:4:dd.0 Request processed in 29768us (30137us total) trans 4294969499 rc 0/0 00000100:00100000:1.0:1789429521.299511:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11718 00002000:00100000:1.0:1789429521.299523:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f3f1c4380 x1876351635133440/t4294969499(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.299533:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3f1c4380 with x1876351635133440 ext(10485760->11534335) 00002000:00010000:1.0:1789429521.299539:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3f1c4380 00000100:00100000:2.0:1789429521.317967:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.318011:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.318052:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.318138:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635133568 00000100:00100000:0.0:1789429521.318148:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635133568 00002000:00100000:0.0:1789429521.318252:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946e05045500 x1876351635133568/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.318265:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05045500 with x1876351635133568 ext(7340032->8388607) 00002000:00010000:0.0:1789429521.318272:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05045500 00000100:00100000:0.0:1789429521.318293:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635133696 00000100:00100000:0.0:1789429521.318297:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635133696 00002000:00100000:0.0:1789429521.318315:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946e05047480 x1876351635133696/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.318323:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05047480 with x1876351635133696 ext(11534336->12582911) 00002000:00010000:0.0:1789429521.318327:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05047480 00000100:00100000:0.0:1789429521.318344:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11719 00000100:00100000:0.0:1789429521.318661:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+26:2369:x1876351635133568:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.318883:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11720 00000100:00100000:0.0:1789429521.318893:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+29:2371:x1876351635133696:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.320463:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635133824 00000100:00100000:3.0:1789429521.320474:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635133824 00000100:00100000:3.0:1789429521.320540:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5857 00000100:00100000:3.0:1789429521.320550:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+28:44695:x1876351635133824:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429521.320566:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429521.320586:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcf7108e/0xb4c3dad726361f00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca6c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.320617:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.320627:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(33 20) 00010000:00010000:3.0:1789429521.320631:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(34 20) 00010000:00010000:3.0:1789429521.320637:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf7108e/0xb4c3dad726361f00 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca6c expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.320694:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 30 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.320708:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 30 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429521.320722:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08741f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648407552:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429521.320801:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f32232840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429521.333898:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2369:x1876351635133568:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15535us (15930us total) trans 4294969500 rc 0/0 00000100:00100000:0.0:1789429521.333913:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11719 00002000:00100000:0.0:1789429521.333926:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946e05045500 x1876351635133568/t4294969500(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.333935:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05045500 with x1876351635133568 ext(7340032->8388607) 00002000:00010000:0.0:1789429521.333940:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e05045500 00000100:00100000:1.0:1789429521.334348:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08741f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648407552:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429521.334401:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fcf7108e/0xb4c3dad726361f00 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca6c expref: 29 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.334421:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4800, rc 0) 00000100:00100000:1.0:1789429521.334456:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+29:44695:x1876351635133824:12345-192.168.203.39@tcp:101:dd.0 Request processed in 13908us (16445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429521.334463:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5857 00000100:00100000:2.0:1789429521.340559:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429521.341171:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635133952 00000100:00100000:1.0:1789429521.341182:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635133952 00002000:00100000:1.0:1789429521.341254:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946e05047b80 x1876351635133952/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.341266:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05047b80 with x1876351635133952 ext(12582912->13631487) 00010000:00010000:1.0:1789429521.341276:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 31 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.341292:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 31 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429521.341301:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e05047b80 00000100:00100000:1.0:1789429521.341333:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1430 00000100:00100000:1.0:1789429521.341342:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+31:2371:x1876351635133952:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.342011:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+33:2371:x1876351635133696:12345-192.168.203.39@tcp:4:dd.0 Request processed in 23117us (23955us total) trans 4294969501 rc 0/0 00000100:00100000:0.0:1789429521.342020:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11720 00002000:00100000:0.0:1789429521.342028:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946e05047480 x1876351635133696/t4294969501(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.342037:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05047480 with x1876351635133696 ext(11534336->12582911) 00010000:00010000:0.0:1789429521.342043:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 33 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.342056:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 33 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429521.342063:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e05047480 00000100:00100000:3.0:1789429521.364594:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.364643:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.364752:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635134080 00000100:00100000:0.0:1789429521.364762:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635134080 00002000:00100000:0.0:1789429521.364808:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946f08741500 x1876351635134080/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.364820:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08741500 with x1876351635134080 ext(13631488->14680063) 00010000:00010000:0.0:1789429521.364828:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 33 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.364845:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 33 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429521.364854:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f08741500 00000100:00100000:0.0:1789429521.364886:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1431 00000100:00100000:0.0:1789429521.364894:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+33:2371:x1876351635134080:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.365050:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635134208 00000100:00100000:0.0:1789429521.365054:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635134208 00000100:00100000:0.0:1789429521.365084:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5858 00000100:00100000:0.0:1789429521.365091:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:44696:x1876351635134208:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429521.365099:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429521.365115:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca73 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.365138:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(34 20) 00010000:00010000:0.0:1789429521.365143:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(35 20) 00010000:00010000:0.0:1789429521.365148:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 36 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.365161:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 36 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.365172:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93ba00, rc 0) 00000100:00100000:0.0:1789429521.365230:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+36:44696:x1876351635134208:12345-192.168.203.39@tcp:101:dd.0 Request processed in 110us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429521.365237:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5858 00000100:00100000:1.0:1789429521.379708:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+36:2371:x1876351635133952:12345-192.168.203.39@tcp:4:dd.0 Request processed in 38357us (39149us total) trans 4294969502 rc 0/0 00000100:00100000:1.0:1789429521.379722:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1430 00002000:00100000:1.0:1789429521.379734:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946e05047b80 x1876351635133952/t4294969502(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.379745:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05047b80 with x1876351635133952 ext(12582912->13631487) 00010000:00010000:1.0:1789429521.379755:0:18633:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 36 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.379780:0:18633:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 36 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429521.379789:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e05047b80 00000100:00100000:0.0:1789429521.380491:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+36:2371:x1876351635134080:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15593us (15901us total) trans 4294969503 rc 0/0 00000100:00100000:0.0:1789429521.380501:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1431 00002000:00100000:0.0:1789429521.380509:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946f08741500 x1876351635134080/t4294969503(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.380518:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08741500 with x1876351635134080 ext(13631488->14680063) 00010000:00010000:0.0:1789429521.380525:0:19374:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 36 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.380536:0:19374:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 36 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429521.380544:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f08741500 00000100:00100000:3.0:1789429521.395709:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.395902:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635134336 00000100:00100000:2.0:1789429521.395912:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635134336 00010000:00010000:2.0:1789429521.395955:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 36 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429521.396001:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6258 00000100:00100000:2.0:1789429521.396011:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+36:2371:x1876351635134336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429521.396025:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789429521.396045:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 8388608 -> 14680064 00010000:00010000:2.0:1789429521.396052:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 36 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.396066:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 36 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.396088:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a36b2c5/0xb4c3dad726361ef9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [8388608->18446744073709551615] (req 8388608->9437183) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca65 expref: 36 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.396104:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(35 20) 00010000:00010000:2.0:1789429521.396109:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(35 20) 00010000:00010000:2.0:1789429521.396117:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcf7108e/0xb4c3dad726361f00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [8388608->14680063] (req 8388608->9437183) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca6c expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.396126:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf7108e/0xb4c3dad726361f00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [8388608->14680063] (req 8388608->9437183) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca6c expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.396134:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(35 20) 00010000:00010000:2.0:1789429521.396137:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(35 20) 00010000:00010000:2.0:1789429521.396141:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 35 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.396148:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 35 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.396183:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 35 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429521.396197:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d55c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648407680:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429521.396340:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fcf7108e/0xb4c3dad726361f00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [8388608->14680063] (req 8388608->9437183) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca6c expref: 28 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429521.396350:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0d980e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648407808:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429521.396373:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1962f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789429521.402982:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d55c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648407680:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429521.403000:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0d980e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648407808:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429521.403024:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429521.403080:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+35:2371:x1876351635134336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7070us (7380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429521.403090:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6258 00000100:00100000:1.0:1789429521.427544:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.430415:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635134464 00000100:00100000:2.0:1789429521.430431:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635134464 00002000:00100000:2.0:1789429521.430492:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946f0879c700 x1876351635134464/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.430503:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879c700 with x1876351635134464 ext(8388608->9437183) 00002000:00010000:2.0:1789429521.430509:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879c700 00000100:00100000:2.0:1789429521.430552:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11721 00000100:00100000:2.0:1789429521.430561:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+29:2370:x1876351635134464:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.468083:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.468147:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.468195:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429521.468246:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635134720 00000100:00100000:1.0:1789429521.468256:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635134720 00002000:00100000:1.0:1789429521.468303:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f08742300 x1876351635134720/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.468313:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08742300 with x1876351635134720 ext(9437184->10485759) 00002000:00010000:1.0:1789429521.468319:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08742300 00000100:00100000:1.0:1789429521.468337:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635134592 00000100:00100000:1.0:1789429521.468340:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635134592 00002000:00100000:1.0:1789429521.468368:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f08740e00 x1876351635134592/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.468376:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08740e00 with x1876351635134592 ext(14680064->15728639) 00002000:00010000:1.0:1789429521.468388:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08740e00 00000100:00100000:1.0:1789429521.468452:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11722 00000100:00100000:1.0:1789429521.468462:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351635134720:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.482998:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.483102:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635134848 00000100:00100000:2.0:1789429521.483114:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635134848 00002000:00100000:2.0:1789429521.483166:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f08742a00 x1876351635134848/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.483179:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08742a00 with x1876351635134848 ext(15728640->16777215) 00002000:00010000:2.0:1789429521.483186:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08742a00 00000100:00100000:2.0:1789429521.483315:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11723 00000100:00100000:2.0:1789429521.483326:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+36:2368:x1876351635134592:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429521.483660:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11724 00000100:00100000:2.0:1789429521.483668:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+37:2368:x1876351635134848:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.485703:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635134976 00000100:00100000:0.0:1789429521.485714:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635134976 00002000:00100000:0.0:1789429521.485755:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f08740700 x1876351635134976/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.485774:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08740700 with x1876351635134976 ext(10485760->11534335) 00002000:00010000:0.0:1789429521.485780:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08740700 00000100:00100000:0.0:1789429521.485811:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11725 00000100:00100000:0.0:1789429521.485821:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+33:2371:x1876351635134976:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429521.487683:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+35:2370:x1876351635134464:12345-192.168.203.39@tcp:4:dd.0 Request processed in 57114us (60140us total) trans 4294969504 rc 0/0 00000100:00100000:2.0:1789429521.487698:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11721 00002000:00100000:2.0:1789429521.487708:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946f0879c700 x1876351635134464/t4294969504(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.487719:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879c700 with x1876351635134464 ext(8388608->9437183) 00002000:00010000:2.0:1789429521.487725:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879c700 00000100:00100000:2.0:1789429521.496034:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+35:2371:x1876351635134720:12345-192.168.203.39@tcp:4:dd.0 Request processed in 27562us (27960us total) trans 4294969505 rc 0/0 00000100:00100000:2.0:1789429521.496048:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11722 00002000:00100000:2.0:1789429521.496060:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f08742300 x1876351635134720/t4294969505(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.496069:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08742300 with x1876351635134720 ext(9437184->10485759) 00002000:00010000:2.0:1789429521.496075:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08742300 00000100:00100000:0.0:1789429521.503629:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.503883:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635135104 00000100:00100000:2.0:1789429521.503894:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635135104 00002000:00100000:2.0:1789429521.503946:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946f2035f480 x1876351635135104/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.503958:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035f480 with x1876351635135104 ext(16777216->17825791) 00002000:00010000:2.0:1789429521.503964:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035f480 00000100:00100000:2.0:1789429521.503993:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11726 00000100:00100000:2.0:1789429521.504001:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+39:2368:x1876351635135104:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429521.505961:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.506236:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635135232 00000100:00100000:2.0:1789429521.506245:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635135232 00002000:00100000:2.0:1789429521.506288:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946f0879fb80 x1876351635135232/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.506298:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879fb80 with x1876351635135232 ext(11534336->12582911) 00002000:00010000:2.0:1789429521.506304:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879fb80 00000100:00100000:2.0:1789429521.506334:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11727 00000100:00100000:2.0:1789429521.506343:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+35:2371:x1876351635135232:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429521.509662:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+41:2368:x1876351635134592:12345-192.168.203.39@tcp:4:dd.0 Request processed in 26328us (41508us total) trans 4294969506 rc 0/0 00000100:00100000:2.0:1789429521.509676:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11723 00002000:00100000:2.0:1789429521.509688:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f08740e00 x1876351635134592/t4294969506(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.509698:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08740e00 with x1876351635134592 ext(14680064->15728639) 00002000:00010000:2.0:1789429521.509704:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08740e00 00000100:00100000:3.0:1789429521.524014:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08742a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+41:2368:x1876351635134848:12345-192.168.203.39@tcp:4:dd.0 Request processed in 40334us (55807us total) trans 4294969507 rc 0/0 00000100:00100000:3.0:1789429521.524027:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11724 00002000:00100000:3.0:1789429521.524039:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f08742a00 x1876351635134848/t4294969507(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.524049:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08742a00 with x1876351635134848 ext(15728640->16777215) 00002000:00010000:3.0:1789429521.524057:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08742a00 00000100:00100000:2.0:1789429521.538439:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.539148:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635135360 00000100:00100000:0.0:1789429521.539159:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635135360 00002000:00100000:0.0:1789429521.539234:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946e0d980e00 x1876351635135360/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.539246:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d980e00 with x1876351635135360 ext(17825792->18874367) 00002000:00010000:0.0:1789429521.539252:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d980e00 00000100:00100000:0.0:1789429521.539280:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11728 00000100:00100000:0.0:1789429521.539289:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+41:2369:x1876351635135360:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429521.540625:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+43:2368:x1876351635135104:12345-192.168.203.39@tcp:4:dd.0 Request processed in 36619us (36998us total) trans 4294969508 rc 0/0 00000100:00100000:2.0:1789429521.540637:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11726 00002000:00100000:2.0:1789429521.540647:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946f2035f480 x1876351635135104/t4294969508(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.540656:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035f480 with x1876351635135104 ext(16777216->17825791) 00002000:00010000:2.0:1789429521.540661:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035f480 00000100:00100000:0.0:1789429521.544835:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+37:2371:x1876351635135232:12345-192.168.203.39@tcp:4:dd.0 Request processed in 38483us (38872us total) trans 4294969509 rc 0/0 00000100:00100000:0.0:1789429521.544849:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11727 00002000:00100000:0.0:1789429521.544861:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946f0879fb80 x1876351635135232/t4294969509(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.544871:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879fb80 with x1876351635135232 ext(11534336->12582911) 00002000:00010000:0.0:1789429521.544877:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879fb80 00000100:00100000:0.0:1789429521.545002:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.545730:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+37:2371:x1876351635134976:12345-192.168.203.39@tcp:4:dd.0 Request processed in 59907us (62738us total) trans 4294969510 rc 0/0 00000100:00100000:3.0:1789429521.545740:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11725 00002000:00100000:3.0:1789429521.545748:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f08740700 x1876351635134976/t4294969510(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.545758:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08740700 with x1876351635134976 ext(10485760->11534335) 00002000:00010000:3.0:1789429521.545762:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08740700 00000100:00100000:3.0:1789429521.545780:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635135488 00000100:00100000:3.0:1789429521.545787:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635135488 00002000:00100000:3.0:1789429521.545815:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946f2035df80 x1876351635135488/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.545823:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035df80 with x1876351635135488 ext(12582912->13631487) 00002000:00010000:3.0:1789429521.545826:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035df80 00000100:00100000:3.0:1789429521.545850:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11729 00000100:00100000:3.0:1789429521.545859:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+37:2371:x1876351635135488:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429521.569309:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.569677:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635135616 00000100:00100000:2.0:1789429521.569687:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635135616 00002000:00100000:2.0:1789429521.569738:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946f0879c000 x1876351635135616/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.569749:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879c000 with x1876351635135616 ext(18874368->19922943) 00002000:00010000:2.0:1789429521.569755:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879c000 00000100:00100000:2.0:1789429521.569787:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11730 00000100:00100000:2.0:1789429521.569797:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+43:2368:x1876351635135616:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.583340:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+45:2369:x1876351635135360:12345-192.168.203.39@tcp:4:dd.0 Request processed in 44041us (44910us total) trans 4294969511 rc 0/0 00000100:00100000:3.0:1789429521.583353:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11728 00002000:00100000:3.0:1789429521.583366:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946e0d980e00 x1876351635135360/t4294969511(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.583377:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d980e00 with x1876351635135360 ext(17825792->18874367) 00002000:00010000:3.0:1789429521.583393:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d980e00 00000100:00100000:0.0:1789429521.584356:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.584411:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429521.584556:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635135744 00000100:00100000:1.0:1789429521.584565:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635135744 00002000:00100000:1.0:1789429521.584604:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946f2035d500 x1876351635135744/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.584615:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035d500 with x1876351635135744 ext(13631488->14680063) 00002000:00010000:1.0:1789429521.584619:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035d500 00000100:00100000:1.0:1789429521.584652:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11731 00000100:00100000:1.0:1789429521.584661:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+39:2370:x1876351635135744:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.585375:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635135872 00000100:00100000:3.0:1789429521.585398:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635135872 00000100:00100000:3.0:1789429521.585541:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5859 00000100:00100000:3.0:1789429521.585550:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+41:44695:x1876351635135872:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429521.585560:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429521.585579:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002464966/0xb4c3dad726361f0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca7a expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.585607:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 44 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.585616:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(35 20) 00010000:00010000:3.0:1789429521.585620:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(36 20) 00010000:00010000:3.0:1789429521.585625:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002464966/0xb4c3dad726361f0e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca7a expref: 42 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.585656:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 44 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.585670:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 44 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429521.585685:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08743b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648407936:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429521.592032:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f32232840 going to sleep for 11 seconds 00000100:00100000:3.0:1789429521.595583:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+43:2371:x1876351635135488:12345-192.168.203.39@tcp:4:dd.0 Request processed in 49716us (50572us total) trans 4294969512 rc 0/0 00000100:00100000:3.0:1789429521.595598:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11729 00002000:00100000:3.0:1789429521.595611:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946f2035df80 x1876351635135488/t4294969512(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.595623:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035df80 with x1876351635135488 ext(12582912->13631487) 00002000:00010000:3.0:1789429521.595629:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035df80 00000100:00100000:1.0:1789429521.597949:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.598685:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635136000 00000100:00100000:2.0:1789429521.598697:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635136000 00002000:00100000:2.0:1789429521.598746:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f0879ca80 x1876351635136000/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.598770:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879ca80 with x1876351635136000 ext(19922944->20971519) 00010000:00010000:2.0:1789429521.598781:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 45 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.598801:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 45 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429521.598811:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f0879ca80 00000100:00100000:2.0:1789429521.598843:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1432 00000100:00100000:2.0:1789429521.598854:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+45:2369:x1876351635136000:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429521.601521:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+47:2368:x1876351635135616:12345-192.168.203.39@tcp:4:dd.0 Request processed in 31715us (32213us total) trans 4294969513 rc 0/0 00000100:00100000:2.0:1789429521.601534:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11730 00002000:00100000:2.0:1789429521.601546:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946f0879c000 x1876351635135616/t4294969513(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.601557:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879c000 with x1876351635135616 ext(18874368->19922943) 00010000:00010000:2.0:1789429521.601567:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 47 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.601586:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 47 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429521.601594:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f0879c000 00000100:00100000:3.0:1789429521.602017:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08743b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648407936:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429521.602050:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002464966/0xb4c3dad726361f0e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca7a expref: 42 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429521.602067:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4600, rc 0) 00000100:00100000:3.0:1789429521.602402:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429521.602474:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635136128 00000100:00100000:1.0:1789429521.602481:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635136128 00000100:00100000:0.0:1789429521.602511:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+42:44695:x1876351635135872:12345-192.168.203.39@tcp:101:dd.0 Request processed in 16959us (18096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429521.602523:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5859 00002000:00100000:1.0:1789429521.602525:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946f08743b80 x1876351635136128/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.602535:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08743b80 with x1876351635136128 ext(20971520->22020095) 00010000:00010000:1.0:1789429521.602543:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 47 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.602558:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 47 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429521.602567:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f08743b80 00000100:00100000:1.0:1789429521.602599:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1433 00000100:00100000:1.0:1789429521.602610:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+47:2371:x1876351635136128:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429521.605849:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429521.607067:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+42:2370:x1876351635135744:12345-192.168.203.39@tcp:4:dd.0 Request processed in 22401us (22710us total) trans 4294969514 rc 0/0 00000100:00100000:1.0:1789429521.607081:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11731 00002000:00100000:1.0:1789429521.607094:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946f2035d500 x1876351635135744/t4294969514(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.607102:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035d500 with x1876351635135744 ext(13631488->14680063) 00002000:00010000:1.0:1789429521.607108:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035d500 00000100:00100000:0.0:1789429521.607312:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635136256 00000100:00100000:0.0:1789429521.607321:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635136256 00000100:00100000:0.0:1789429521.607372:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5860 00000100:00100000:0.0:1789429521.607393:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+49:44696:x1876351635136256:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429521.607408:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429521.607427:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca81 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.607458:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(36 20) 00010000:00010000:0.0:1789429521.607463:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(37 20) 00010000:00010000:0.0:1789429521.607469:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 50 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.607482:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 50 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.607496:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93be00, rc 0) 00000100:00100000:0.0:1789429521.607533:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+50:44696:x1876351635136256:12345-192.168.203.39@tcp:101:dd.0 Request processed in 152us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429521.607539:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5860 00000100:00100000:1.0:1789429521.622118:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+50:2369:x1876351635136000:12345-192.168.203.39@tcp:4:dd.0 Request processed in 23255us (24167us total) trans 4294969515 rc 0/0 00000100:00100000:1.0:1789429521.622133:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1432 00002000:00100000:1.0:1789429521.622147:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f0879ca80 x1876351635136000/t4294969515(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.622158:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879ca80 with x1876351635136000 ext(19922944->20971519) 00010000:00010000:1.0:1789429521.622171:0:20672:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 50 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.622976:0:20672:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 50 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429521.622989:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f0879ca80 00000100:00100000:1.0:1789429521.627033:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+50:2371:x1876351635136128:12345-192.168.203.39@tcp:4:dd.0 Request processed in 24415us (24622us total) trans 4294969516 rc 0/0 00000100:00100000:1.0:1789429521.627048:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1433 00002000:00100000:1.0:1789429521.627060:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946f08743b80 x1876351635136128/t4294969516(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.627071:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08743b80 with x1876351635136128 ext(20971520->22020095) 00010000:00010000:1.0:1789429521.627081:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 50 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.627101:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 50 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429521.627110:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f08743b80 00010000:00010000:1.0:1789429521.635591:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429521.638876:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429521.638988:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635136384 00000100:00100000:1.0:1789429521.638999:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635136384 00010000:00010000:1.0:1789429521.639040:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 50 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429521.639089:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6259 00000100:00100000:1.0:1789429521.639100:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+50:2369:x1876351635136384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429521.639115:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429521.639133:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 14680064 -> 22020096 00010000:00010000:1.0:1789429521.639140:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 50 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.639153:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 50 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.639176:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003dc3d2c/0xb4c3dad726361f07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [14680064->18446744073709551615] (req 14680064->15728639) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca73 expref: 50 pid: 6681 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.639663:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(37 20) 00010000:00010000:1.0:1789429521.639670:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(37 20) 00010000:00010000:1.0:1789429521.639681:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002464966/0xb4c3dad726361f0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [14680064->22020095] (req 14680064->15728639) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca7a expref: 41 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.639693:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002464966/0xb4c3dad726361f0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [14680064->22020095] (req 14680064->15728639) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca7a expref: 41 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.639703:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(37 20) 00010000:00010000:1.0:1789429521.639706:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(37 20) 00010000:00010000:1.0:1789429521.639711:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 49 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.639719:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 49 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.639761:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 49 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429521.639777:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648408064:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429521.640099:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000002464966/0xb4c3dad726361f0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [14680064->22020095] (req 14680064->15728639) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca7a expref: 41 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429521.640111:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648408192:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429521.640142:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865600 going to sleep for 11 seconds 00000100:00100000:1.0:1789429521.645301:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648408064:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429521.645319:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648408192:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429521.645352:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429521.645420:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+49:2369:x1876351635136384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6320us (6553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429521.645431:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6259 00000100:00100000:2.0:1789429521.677680:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.677774:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635136512 00000100:00100000:3.0:1789429521.677785:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635136512 00002000:00100000:3.0:1789429521.677835:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946e01bfd500 x1876351635136512/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.677847:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfd500 with x1876351635136512 ext(22020096->23068671) 00002000:00010000:3.0:1789429521.677854:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfd500 00000100:00100000:3.0:1789429521.677888:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11732 00000100:00100000:3.0:1789429521.677898:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+49:2370:x1876351635136512:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.680556:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.680639:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635136640 00000100:00100000:2.0:1789429521.680648:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635136640 00002000:00100000:2.0:1789429521.680695:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f08740a80 x1876351635136640/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.680706:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08740a80 with x1876351635136640 ext(14680064->15728639) 00002000:00010000:2.0:1789429521.680712:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08740a80 00000100:00100000:2.0:1789429521.680746:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11733 00000100:00100000:2.0:1789429521.680756:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+42:2368:x1876351635136640:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429521.698052:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.699249:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+51:2370:x1876351635136512:12345-192.168.203.39@tcp:4:dd.0 Request processed in 21346us (21572us total) trans 4294969517 rc 0/0 00000100:00100000:0.0:1789429521.699261:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11732 00002000:00100000:0.0:1789429521.699273:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946e01bfd500 x1876351635136512/t4294969517(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.699282:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfd500 with x1876351635136512 ext(22020096->23068671) 00002000:00010000:0.0:1789429521.699289:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfd500 00000100:00100000:0.0:1789429521.699314:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635136768 00000100:00100000:0.0:1789429521.699320:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635136768 00002000:00100000:0.0:1789429521.699349:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946e01bfc380 x1876351635136768/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.699358:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfc380 with x1876351635136768 ext(23068672->24117247) 00002000:00010000:0.0:1789429521.699361:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfc380 00000100:00100000:0.0:1789429521.699398:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11734 00000100:00100000:0.0:1789429521.699406:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+51:2368:x1876351635136768:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.701108:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+44:2368:x1876351635136640:12345-192.168.203.39@tcp:4:dd.0 Request processed in 20345us (20553us total) trans 4294969518 rc 0/0 00000100:00100000:0.0:1789429521.701119:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11733 00002000:00100000:0.0:1789429521.701131:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f08740a80 x1876351635136640/t4294969518(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.701141:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08740a80 with x1876351635136640 ext(14680064->15728639) 00002000:00010000:0.0:1789429521.701146:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08740a80 00000100:00100000:3.0:1789429521.725274:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429521.725875:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635136896 00000100:00100000:1.0:1789429521.725885:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635136896 00002000:00100000:1.0:1789429521.725930:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f08741180 x1876351635136896/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.725941:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08741180 with x1876351635136896 ext(15728640->16777215) 00002000:00010000:1.0:1789429521.725947:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08741180 00000100:00100000:1.0:1789429521.725969:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11735 00000100:00100000:1.0:1789429521.725979:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+44:2370:x1876351635136896:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.726371:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+53:2368:x1876351635136768:12345-192.168.203.39@tcp:4:dd.0 Request processed in 26963us (28327us total) trans 4294969519 rc 0/0 00000100:00100000:0.0:1789429521.726390:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11734 00002000:00100000:0.0:1789429521.726400:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946e01bfc380 x1876351635136768/t4294969519(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.726420:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfc380 with x1876351635136768 ext(23068672->24117247) 00002000:00010000:0.0:1789429521.726432:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfc380 00000100:00100000:1.0:1789429521.733971:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.734518:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635137024 00000100:00100000:3.0:1789429521.734529:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635137024 00002000:00100000:3.0:1789429521.734688:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946f0879e680 x1876351635137024/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.734701:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879e680 with x1876351635137024 ext(24117248->25165823) 00002000:00010000:3.0:1789429521.734707:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879e680 00000100:00100000:3.0:1789429521.734778:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11736 00000100:00100000:3.0:1789429521.734789:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+53:2370:x1876351635137024:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429521.737830:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08741180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+46:2370:x1876351635136896:12345-192.168.203.39@tcp:4:dd.0 Request processed in 11842us (12554us total) trans 4294969520 rc 0/0 00000100:00100000:1.0:1789429521.737843:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11735 00002000:00100000:1.0:1789429521.737854:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f08741180 x1876351635136896/t4294969520(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.737864:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08741180 with x1876351635136896 ext(15728640->16777215) 00002000:00010000:1.0:1789429521.737870:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08741180 00000100:00100000:0.0:1789429521.749895:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+55:2370:x1876351635137024:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15097us (15921us total) trans 4294969521 rc 0/0 00000100:00100000:0.0:1789429521.749910:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11736 00002000:00100000:0.0:1789429521.749923:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946f0879e680 x1876351635137024/t4294969521(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.749934:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879e680 with x1876351635137024 ext(24117248->25165823) 00002000:00010000:0.0:1789429521.749940:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879e680 00000100:00100000:2.0:1789429521.760098:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.760191:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635137152 00000100:00100000:0.0:1789429521.760245:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635137152 00002000:00100000:0.0:1789429521.760296:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946e01bff100 x1876351635137152/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.760307:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bff100 with x1876351635137152 ext(16777216->17825791) 00002000:00010000:0.0:1789429521.760314:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bff100 00000100:00100000:0.0:1789429521.760534:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11737 00000100:00100000:0.0:1789429521.760546:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+46:2369:x1876351635137152:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.772347:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.772552:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635137280 00000100:00100000:0.0:1789429521.772564:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635137280 00002000:00100000:0.0:1789429521.772609:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f08742680 x1876351635137280/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.772622:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08742680 with x1876351635137280 ext(25165824->26214399) 00002000:00010000:0.0:1789429521.772628:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08742680 00000100:00100000:0.0:1789429521.772662:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11738 00000100:00100000:0.0:1789429521.772672:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+55:2371:x1876351635137280:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.794026:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+48:2369:x1876351635137152:12345-192.168.203.39@tcp:4:dd.0 Request processed in 33470us (33924us total) trans 4294969522 rc 0/0 00000100:00100000:0.0:1789429521.794041:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11737 00002000:00100000:0.0:1789429521.794055:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946e01bff100 x1876351635137152/t4294969522(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.794065:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bff100 with x1876351635137152 ext(16777216->17825791) 00002000:00010000:0.0:1789429521.794072:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bff100 00000100:00100000:3.0:1789429521.800726:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.800792:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.800901:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635137408 00000100:00100000:0.0:1789429521.800912:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635137408 00002000:00100000:0.0:1789429521.800963:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946f08741c00 x1876351635137408/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.800976:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08741c00 with x1876351635137408 ext(17825792->18874367) 00002000:00010000:0.0:1789429521.800984:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08741c00 00000100:00100000:0.0:1789429521.801008:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635137536 00000100:00100000:0.0:1789429521.801012:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635137536 00000100:00100000:2.0:1789429521.801026:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11739 00002000:00100000:0.0:1789429521.801031:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f08741880 x1876351635137536/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789429521.801044:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+48:2368:x1876351635137408:12345-192.168.203.39@tcp:4:dd.0 00002000:00100000:0.0:1789429521.801045:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08741880 with x1876351635137536 ext(26214400->27262975) 00002000:00010000:0.0:1789429521.801053:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08741880 00000100:00100000:0.0:1789429521.801074:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11740 00000100:00100000:0.0:1789429521.801083:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+57:2370:x1876351635137536:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.802173:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08742680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+59:2371:x1876351635137280:12345-192.168.203.39@tcp:4:dd.0 Request processed in 29496us (29830us total) trans 4294969523 rc 0/0 00000100:00100000:0.0:1789429521.802185:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11738 00002000:00100000:0.0:1789429521.802195:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f08742680 x1876351635137280/t4294969523(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.803971:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08742680 with x1876351635137280 ext(25165824->26214399) 00002000:00010000:0.0:1789429521.803979:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08742680 00000100:00100000:1.0:1789429521.811536:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+59:2370:x1876351635137536:12345-192.168.203.39@tcp:4:dd.0 Request processed in 10443us (10734us total) trans 4294969524 rc 0/0 00000100:00100000:1.0:1789429521.811549:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11740 00002000:00100000:1.0:1789429521.811563:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f08741880 x1876351635137536/t4294969524(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.811574:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08741880 with x1876351635137536 ext(26214400->27262975) 00002000:00010000:1.0:1789429521.811581:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08741880 00000100:00100000:3.0:1789429521.825933:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.826248:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635137664 00000100:00100000:0.0:1789429521.826259:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635137664 00002000:00100000:0.0:1789429521.826308:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946f08743800 x1876351635137664/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.826319:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08743800 with x1876351635137664 ext(27262976->28311551) 00002000:00010000:0.0:1789429521.826326:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08743800 00000100:00100000:0.0:1789429521.826359:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11741 00000100:00100000:0.0:1789429521.826385:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+59:2369:x1876351635137664:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.828764:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.829705:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+50:2368:x1876351635137408:12345-192.168.203.39@tcp:4:dd.0 Request processed in 28663us (28986us total) trans 4294969525 rc 0/0 00000100:00100000:0.0:1789429521.829718:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11739 00002000:00100000:0.0:1789429521.829731:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946f08741c00 x1876351635137408/t4294969525(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.829742:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08741c00 with x1876351635137408 ext(17825792->18874367) 00002000:00010000:0.0:1789429521.829749:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08741c00 00000100:00100000:0.0:1789429521.829773:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635137792 00000100:00100000:0.0:1789429521.829780:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635137792 00002000:00100000:0.0:1789429521.829806:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946f08742d80 x1876351635137792/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.829815:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08742d80 with x1876351635137792 ext(18874368->19922943) 00002000:00010000:0.0:1789429521.829817:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08742d80 00000100:00100000:0.0:1789429521.829849:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11742 00000100:00100000:0.0:1789429521.829858:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+50:2370:x1876351635137792:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.844584:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+61:2369:x1876351635137664:12345-192.168.203.39@tcp:4:dd.0 Request processed in 18202us (18646us total) trans 4294969526 rc 0/0 00000100:00100000:0.0:1789429521.844601:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11741 00002000:00100000:0.0:1789429521.844615:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946f08743800 x1876351635137664/t4294969526(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.844625:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08743800 with x1876351635137664 ext(27262976->28311551) 00002000:00010000:0.0:1789429521.844632:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08743800 00000100:00100000:0.0:1789429521.856062:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.856105:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.856188:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635137920 00000100:00100000:2.0:1789429521.856222:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635137920 00002000:00100000:2.0:1789429521.856269:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946f2035f100 x1876351635137920/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.856281:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035f100 with x1876351635137920 ext(28311552->29360127) 00002000:00010000:2.0:1789429521.856287:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035f100 00000100:00100000:2.0:1789429521.856316:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635138048 00000100:00100000:2.0:1789429521.856319:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635138048 00002000:00100000:2.0:1789429521.856334:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f2035e300 x1876351635138048/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.856343:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035e300 with x1876351635138048 ext(19922944->20971519) 00002000:00010000:2.0:1789429521.856347:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035e300 00000100:00100000:2.0:1789429521.856371:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11743 00000100:00100000:2.0:1789429521.856388:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+61:2368:x1876351635137920:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.856638:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11744 00000100:00100000:0.0:1789429521.856648:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+52:2371:x1876351635138048:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429521.865418:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+54:2370:x1876351635137792:12345-192.168.203.39@tcp:4:dd.0 Request processed in 35549us (36701us total) trans 4294969527 rc 0/0 00000100:00100000:2.0:1789429521.865433:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11742 00002000:00100000:2.0:1789429521.865448:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946f08742d80 x1876351635137792/t4294969527(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.865458:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08742d80 with x1876351635137792 ext(18874368->19922943) 00002000:00010000:2.0:1789429521.865465:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08742d80 00000100:00100000:3.0:1789429521.869576:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+63:2368:x1876351635137920:12345-192.168.203.39@tcp:4:dd.0 Request processed in 13186us (13513us total) trans 4294969528 rc 0/0 00000100:00100000:3.0:1789429521.869590:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11743 00002000:00100000:3.0:1789429521.869604:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946f2035f100 x1876351635137920/t4294969528(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.869615:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035f100 with x1876351635137920 ext(28311552->29360127) 00002000:00010000:3.0:1789429521.869622:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035f100 00000100:00100000:2.0:1789429521.869866:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.869972:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635138176 00000100:00100000:3.0:1789429521.869980:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635138176 00002000:00100000:3.0:1789429521.870014:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946e01bfe300 x1876351635138176/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429521.870023:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfe300 with x1876351635138176 ext(20971520->22020095) 00002000:00010000:3.0:1789429521.870027:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfe300 00000100:00100000:3.0:1789429521.870060:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11745 00000100:00100000:3.0:1789429521.870070:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+54:2371:x1876351635138176:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429521.872915:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429521.872993:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635138304 00000100:00100000:1.0:1789429521.873004:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635138304 00000100:00100000:1.0:1789429521.873062:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5861 00000100:00100000:1.0:1789429521.873072:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+56:44695:x1876351635138304:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429521.873089:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429521.873105:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f81fdbd2/0xb4c3dad726361f1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca88 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.873137:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 62 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.873148:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(37 20) 00010000:00010000:1.0:1789429521.873153:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(38 20) 00010000:00010000:1.0:1789429521.873159:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f81fdbd2/0xb4c3dad726361f1c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca88 expref: 57 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.873192:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 62 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.873228:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 62 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429521.873248:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648408320:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429521.873335:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865600 going to sleep for 11 seconds 00000100:00100000:0.0:1789429521.881236:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+58:2371:x1876351635138048:12345-192.168.203.39@tcp:4:dd.0 Request processed in 24578us (25119us total) trans 4294969529 rc 0/0 00000100:00100000:0.0:1789429521.881250:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11744 00002000:00100000:0.0:1789429521.881262:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f2035e300 x1876351635138048/t4294969529(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.881272:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035e300 with x1876351635138048 ext(19922944->20971519) 00002000:00010000:0.0:1789429521.881279:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035e300 00000100:00100000:1.0:1789429521.881392:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648408320:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429521.881422:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f81fdbd2/0xb4c3dad726361f1c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca88 expref: 57 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429521.881442:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f072d9e00, rc 0) 00000100:00100000:1.0:1789429521.881479:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+57:44695:x1876351635138304:12345-192.168.203.39@tcp:101:dd.0 Request processed in 8409us (8571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429521.881486:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5861 00000100:00100000:0.0:1789429521.884527:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+57:2371:x1876351635138176:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14450us (14652us total) trans 4294969530 rc 0/0 00000100:00100000:0.0:1789429521.884541:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11745 00002000:00100000:0.0:1789429521.884552:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946e01bfe300 x1876351635138176/t4294969530(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.884562:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfe300 with x1876351635138176 ext(20971520->22020095) 00002000:00010000:0.0:1789429521.884569:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfe300 00000100:00100000:3.0:1789429521.886391:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429521.886457:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.886581:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635138432 00000100:00100000:2.0:1789429521.886590:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635138432 00002000:00100000:2.0:1789429521.886630:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e10159180 x1876351635138432/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.886641:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10159180 with x1876351635138432 ext(29360128->30408703) 00010000:00010000:2.0:1789429521.886650:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 63 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.886667:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 63 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429521.886676:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e10159180 00000100:00100000:2.0:1789429521.886707:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1434 00000100:00100000:2.0:1789429521.886716:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+63:2371:x1876351635138432:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429521.887045:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635138560 00000100:00100000:0.0:1789429521.887050:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635138560 00000100:00100000:0.0:1789429521.887084:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5862 00000100:00100000:0.0:1789429521.887091:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+65:44696:x1876351635138560:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429521.887100:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429521.887116:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca8f expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.887139:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(38 20) 00010000:00010000:0.0:1789429521.887145:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(39 20) 00010000:00010000:0.0:1789429521.887151:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 66 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.887164:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 66 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.887176:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93a000, rc 0) 00000100:00100000:0.0:1789429521.887239:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+66:44696:x1876351635138560:12345-192.168.203.39@tcp:101:dd.0 Request processed in 148us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429521.887250:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5862 00000100:00100000:2.0:1789429521.906488:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10159180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+66:2371:x1876351635138432:12345-192.168.203.39@tcp:4:dd.0 Request processed in 19762us (20020us total) trans 4294969531 rc 0/0 00000100:00100000:2.0:1789429521.906501:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1434 00002000:00100000:2.0:1789429521.906514:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e10159180 x1876351635138432/t4294969531(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429521.906530:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10159180 with x1876351635138432 ext(29360128->30408703) 00010000:00010000:2.0:1789429521.906540:0:19372:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 66 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429521.906559:0:19372:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 66 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429521.906568:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e10159180 00000100:00100000:3.0:1789429521.915303:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.915471:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635138688 00000100:00100000:0.0:1789429521.915481:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635138688 00010000:00010000:0.0:1789429521.915523:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 66 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429521.915599:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6260 00000100:00100000:0.0:1789429521.915608:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1015a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+66:2369:x1876351635138688:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429521.915625:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789429521.915644:0:11354:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 22020096 -> 30408704 00002000:00010000:0.0:1789429521.915648:0:11354:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 1789429521 -> 1789429522 00002000:00010000:0.0:1789429521.915651:0:11354:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 1789429521 -> 1789429522 00010000:00010000:0.0:1789429521.915657:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 66 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.915671:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 66 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.915695:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ca5cb28/0xb4c3dad726361f15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [22020096->18446744073709551615] (req 22020096->23068671) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca81 expref: 66 pid: 13238 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.915713:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(39 20) 00010000:00010000:0.0:1789429521.915717:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(39 20) 00010000:00010000:0.0:1789429521.915726:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f81fdbd2/0xb4c3dad726361f1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [22020096->30408703] (req 22020096->23068671) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca88 expref: 56 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.915743:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f81fdbd2/0xb4c3dad726361f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [22020096->30408703] (req 22020096->23068671) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca88 expref: 56 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.915752:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(39 20) 00010000:00010000:0.0:1789429521.915755:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(39 20) 00010000:00010000:0.0:1789429521.915759:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 65 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.915768:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 65 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429521.915875:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 65 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429521.915890:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2035ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648408448:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429521.916009:0:11354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f81fdbd2/0xb4c3dad726361f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [22020096->30408703] (req 22020096->23068671) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca88 expref: 56 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429521.916020:0:11354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2035ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648408576:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429521.916040:0:11354:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538900 going to sleep for 11 seconds 00000100:00100000:0.0:1789429521.922097:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2035ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648408576:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429521.922116:0:11354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2035ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11354:1876351648408448:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429521.922141:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429521.922673:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1015a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+65:2369:x1876351635138688:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7062us (7479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429521.922685:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6260 00000100:00100000:3.0:1789429521.950777:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429521.953393:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429521.957641:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635138944 00000100:00100000:0.0:1789429521.957657:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635138944 00002000:00100000:0.0:1789429521.957714:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946e10159c00 x1876351635138944/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429521.957728:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10159c00 with x1876351635138944 ext(22020096->23068671) 00002000:00010000:0.0:1789429521.957733:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10159c00 00000100:00100000:0.0:1789429521.957755:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635138816 00000100:00100000:0.0:1789429521.957759:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635138816 00002000:00100000:0.0:1789429521.957773:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946e01bfce00 x1876351635138816/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/0 e 0 to 0 dl 1789429532 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789429521.959328:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11746 00000100:00100000:2.0:1789429521.959348:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+57:2371:x1876351635138944:12345-192.168.203.39@tcp:4:dd.0 00002000:00100000:0.0:1789429521.960469:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfce00 with x1876351635138816 ext(30408704->31457279) 00002000:00010000:0.0:1789429521.960481:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfce00 00000100:00100000:0.0:1789429521.960520:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11747 00000100:00100000:0.0:1789429521.960533:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+65:2368:x1876351635138816:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429521.997874:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10159c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+59:2371:x1876351635138944:12345-192.168.203.39@tcp:4:dd.0 Request processed in 38519us (47091us total) trans 4294969532 rc 0/0 00000100:00100000:1.0:1789429521.997892:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11746 00002000:00100000:1.0:1789429521.997906:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946e10159c00 x1876351635138944/t4294969532(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429521.997916:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10159c00 with x1876351635138944 ext(22020096->23068671) 00002000:00010000:1.0:1789429521.997924:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10159c00 00000100:00100000:1.0:1789429522.002169:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+67:2368:x1876351635138816:12345-192.168.203.39@tcp:4:dd.0 Request processed in 41633us (48783us total) trans 4294969533 rc 0/0 00000100:00100000:1.0:1789429522.002182:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11747 00002000:00100000:1.0:1789429522.002196:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946e01bfce00 x1876351635138816/t4294969533(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:257/0 lens 488/448 e 0 to 0 dl 1789429532 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.002236:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfce00 with x1876351635138816 ext(30408704->31457279) 00002000:00010000:1.0:1789429522.002242:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfce00 00000100:00100000:1.0:1789429522.017587:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.017639:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.018256:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635139200 00000100:00100000:0.0:1789429522.018267:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635139200 00002000:00100000:0.0:1789429522.018325:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946f0879d180 x1876351635139200/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.018338:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879d180 with x1876351635139200 ext(31457280->32505855) 00002000:00010000:0.0:1789429522.018344:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879d180 00000100:00100000:0.0:1789429522.018389:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635139072 00000100:00100000:0.0:1789429522.018393:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635139072 00002000:00100000:0.0:1789429522.018412:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946f0879dc00 x1876351635139072/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.018421:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879dc00 with x1876351635139072 ext(23068672->24117247) 00002000:00010000:0.0:1789429522.018425:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879dc00 00000100:00100000:0.0:1789429522.018442:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11748 00000100:00100000:0.0:1789429522.018451:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+67:2369:x1876351635139200:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.018617:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11749 00000100:00100000:0.0:1789429522.018625:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+59:2370:x1876351635139072:12345-192.168.203.39@tcp:4:dd.0 00000100:00080000:1.0:1789429522.018781:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429522.029260:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.029314:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429522.029613:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635139328 00000100:00100000:2.0:1789429522.029623:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635139328 00002000:00100000:2.0:1789429522.029670:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946f2035ce00 x1876351635139328/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.029680:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035ce00 with x1876351635139328 ext(32505856->33554431) 00002000:00010000:2.0:1789429522.029685:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035ce00 00000100:00100000:2.0:1789429522.029715:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635139456 00000100:00100000:2.0:1789429522.029718:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635139456 00002000:00100000:2.0:1789429522.029733:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946f2035ea00 x1876351635139456/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.029742:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035ea00 with x1876351635139456 ext(24117248->25165823) 00002000:00010000:2.0:1789429522.029746:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035ea00 00000100:00100000:2.0:1789429522.029769:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11750 00000100:00100000:2.0:1789429522.029780:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+69:2368:x1876351635139328:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.030004:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11751 00000100:00100000:0.0:1789429522.030014:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+61:2370:x1876351635139456:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.060020:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.060441:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635139584 00000100:00100000:3.0:1789429522.060453:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635139584 00002000:00100000:3.0:1789429522.060508:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946f2035c700 x1876351635139584/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.060519:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035c700 with x1876351635139584 ext(33554432->34603007) 00002000:00010000:3.0:1789429522.060525:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035c700 00000100:00100000:3.0:1789429522.060562:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11752 00000100:00100000:3.0:1789429522.060572:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+71:2368:x1876351635139584:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.070679:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.071969:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+73:2369:x1876351635139200:12345-192.168.203.39@tcp:4:dd.0 Request processed in 53511us (54384us total) trans 4294969534 rc 0/0 00000100:00100000:3.0:1789429522.071981:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11748 00002000:00100000:3.0:1789429522.071994:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946f0879d180 x1876351635139200/t4294969534(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.072013:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879d180 with x1876351635139200 ext(31457280->32505855) 00002000:00010000:3.0:1789429522.072019:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879d180 00000100:00100000:3.0:1789429522.072046:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635139712 00000100:00100000:3.0:1789429522.072052:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635139712 00002000:00100000:3.0:1789429522.072082:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f2035ca80 x1876351635139712/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.072089:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035ca80 with x1876351635139712 ext(25165824->26214399) 00002000:00010000:3.0:1789429522.072093:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035ca80 00000100:00100000:3.0:1789429522.072354:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11753 00000100:00100000:3.0:1789429522.072364:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2035ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+63:2369:x1876351635139712:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.075273:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+65:2370:x1876351635139072:12345-192.168.203.39@tcp:4:dd.0 Request processed in 56639us (57624us total) trans 4294969535 rc 0/0 00000100:00100000:0.0:1789429522.075287:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11749 00002000:00100000:0.0:1789429522.075299:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946f0879dc00 x1876351635139072/t4294969535(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.075309:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879dc00 with x1876351635139072 ext(23068672->24117247) 00002000:00010000:0.0:1789429522.075316:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879dc00 00000100:00100000:2.0:1789429522.083470:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+73:2368:x1876351635139328:12345-192.168.203.39@tcp:4:dd.0 Request processed in 53682us (54209us total) trans 4294969536 rc 0/0 00000100:00100000:2.0:1789429522.083484:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11750 00002000:00100000:2.0:1789429522.083498:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946f2035ce00 x1876351635139328/t4294969536(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.083509:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035ce00 with x1876351635139328 ext(32505856->33554431) 00002000:00010000:2.0:1789429522.083516:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035ce00 00000100:00100000:3.0:1789429522.085545:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.086900:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635139840 00000100:00100000:0.0:1789429522.086912:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635139840 00002000:00100000:0.0:1789429522.086958:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946e10159880 x1876351635139840/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.086970:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10159880 with x1876351635139840 ext(34603008->35651583) 00002000:00010000:0.0:1789429522.086976:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10159880 00000100:00100000:0.0:1789429522.087013:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11754 00000100:00100000:0.0:1789429522.087023:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+74:2370:x1876351635139840:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.093622:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+65:2370:x1876351635139456:12345-192.168.203.39@tcp:4:dd.0 Request processed in 63600us (64298us total) trans 4294969537 rc 0/0 00000100:00100000:0.0:1789429522.093637:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11751 00002000:00100000:0.0:1789429522.093649:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946f2035ea00 x1876351635139456/t4294969537(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.093659:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035ea00 with x1876351635139456 ext(24117248->25165823) 00002000:00010000:0.0:1789429522.093666:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035ea00 00000100:00100000:0.0:1789429522.102506:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+75:2368:x1876351635139584:12345-192.168.203.39@tcp:4:dd.0 Request processed in 41923us (42484us total) trans 4294969538 rc 0/0 00000100:00100000:0.0:1789429522.102589:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11752 00002000:00100000:0.0:1789429522.102605:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946f2035c700 x1876351635139584/t4294969538(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.102616:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035c700 with x1876351635139584 ext(33554432->34603007) 00002000:00010000:0.0:1789429522.102623:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035c700 00000100:00100000:0.0:1789429522.120962:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2035ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+65:2369:x1876351635139712:12345-192.168.203.39@tcp:4:dd.0 Request processed in 48586us (50282us total) trans 4294969539 rc 0/0 00000100:00100000:0.0:1789429522.120978:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11753 00002000:00100000:0.0:1789429522.120994:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f2035ca80 x1876351635139712/t4294969539(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.121004:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2035ca80 with x1876351635139712 ext(25165824->26214399) 00002000:00010000:0.0:1789429522.121011:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2035ca80 00000100:00100000:2.0:1789429522.125700:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10159880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+75:2370:x1876351635139840:12345-192.168.203.39@tcp:4:dd.0 Request processed in 38668us (40152us total) trans 4294969540 rc 0/0 00000100:00100000:2.0:1789429522.125714:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11754 00002000:00100000:2.0:1789429522.125726:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946e10159880 x1876351635139840/t4294969540(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.125736:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10159880 with x1876351635139840 ext(34603008->35651583) 00002000:00010000:2.0:1789429522.125743:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10159880 00000100:00100000:0.0:1789429522.126961:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.127041:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.127096:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635139968 00000100:00100000:1.0:1789429522.127106:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635139968 00002000:00100000:1.0:1789429522.127146:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f29d55c00 x1876351635139968/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.127159:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d55c00 with x1876351635139968 ext(26214400->27262975) 00000100:00100000:3.0:1789429522.127159:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635140096 00000100:00100000:3.0:1789429522.127166:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635140096 00002000:00010000:1.0:1789429522.127167:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29d55c00 00000100:00100000:1.0:1789429522.127229:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11755 00000100:00100000:1.0:1789429522.127239:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+65:2369:x1876351635139968:12345-192.168.203.39@tcp:4:dd.0 00002000:00100000:3.0:1789429522.127316:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e0eac1f80 x1876351635140096/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.127326:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac1f80 with x1876351635140096 ext(35651584->36700159) 00002000:00010000:3.0:1789429522.127330:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eac1f80 00000100:00100000:3.0:1789429522.127397:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11756 00000100:00100000:3.0:1789429522.127406:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+75:2371:x1876351635140096:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429522.137601:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.137948:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635140224 00000100:00100000:3.0:1789429522.137960:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635140224 00002000:00100000:3.0:1789429522.139417:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946f0879d880 x1876351635140224/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.139437:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879d880 with x1876351635140224 ext(27262976->28311551) 00002000:00010000:3.0:1789429522.139445:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879d880 00000100:00100000:2.0:1789429522.139830:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11757 00000100:00100000:2.0:1789429522.139845:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+67:2368:x1876351635140224:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429522.145333:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+69:2369:x1876351635139968:12345-192.168.203.39@tcp:4:dd.0 Request processed in 18086us (18367us total) trans 4294969541 rc 0/0 00000100:00100000:2.0:1789429522.145347:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11755 00002000:00100000:2.0:1789429522.145359:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f29d55c00 x1876351635139968/t4294969541(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.145370:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29d55c00 with x1876351635139968 ext(26214400->27262975) 00002000:00010000:2.0:1789429522.145387:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29d55c00 00000100:00100000:1.0:1789429522.156715:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+77:2371:x1876351635140096:12345-192.168.203.39@tcp:4:dd.0 Request processed in 29300us (29663us total) trans 4294969542 rc 0/0 00000100:00100000:1.0:1789429522.156728:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11756 00002000:00100000:1.0:1789429522.156741:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e0eac1f80 x1876351635140096/t4294969542(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.156751:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac1f80 with x1876351635140096 ext(35651584->36700159) 00002000:00010000:1.0:1789429522.156758:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eac1f80 00000100:00100000:3.0:1789429522.157136:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.157274:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635140352 00000100:00100000:0.0:1789429522.157282:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635140352 00002000:00100000:0.0:1789429522.157318:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946e1015b800 x1876351635140352/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.157327:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015b800 with x1876351635140352 ext(36700160->37748735) 00002000:00010000:0.0:1789429522.157331:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1015b800 00000100:00100000:0.0:1789429522.157411:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11758 00000100:00100000:0.0:1789429522.157420:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1015b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+77:2370:x1876351635140352:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.181515:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.181556:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.181582:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.181615:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.181640:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635140864 00000100:00100000:3.0:1789429522.181650:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635140864 00002000:00100000:3.0:1789429522.181694:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946e1015b480 x1876351635140864/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.181706:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015b480 with x1876351635140864 ext(37748736->38797311) 00002000:00010000:3.0:1789429522.181713:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1015b480 00000100:00100000:3.0:1789429522.181730:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635140480 00000100:00100000:3.0:1789429522.181733:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635140480 00002000:00100000:3.0:1789429522.181747:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946e10159f80 x1876351635140480/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.181756:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10159f80 with x1876351635140480 ext(28311552->29360127) 00002000:00010000:3.0:1789429522.181759:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10159f80 00000100:00100000:3.0:1789429522.181771:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635140608 00000100:00100000:3.0:1789429522.181774:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635140608 00002000:00100000:3.0:1789429522.181786:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e10159500 x1876351635140608/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.181794:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10159500 with x1876351635140608 ext(29360128->30408703) 00002000:00010000:3.0:1789429522.181797:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10159500 00000100:00100000:3.0:1789429522.181813:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11759 00000100:00100000:3.0:1789429522.181822:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1015b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+79:2370:x1876351635140864:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.181974:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11760 00000100:00100000:3.0:1789429522.181982:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+70:2369:x1876351635140480:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.182068:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11761 00000100:00100000:3.0:1789429522.182075:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+71:2369:x1876351635140608:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.182239:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635140736 00000100:00100000:0.0:1789429522.182245:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635140736 00000100:00100000:0.0:1789429522.182283:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5863 00000100:00100000:0.0:1789429522.182293:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1015ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+73:44695:x1876351635140736:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429522.182304:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429522.182326:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361f2a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca96 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429522.182355:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 80 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429522.182372:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=1s v=(39 20) 00010000:00010000:0.0:1789429522.182387:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(1 39) 00010000:00010000:0.0:1789429522.182394:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361f2a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca96 expref: 74 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429522.182428:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 80 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429522.182442:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 80 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429522.182456:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648408704:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429522.182542:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789429522.193160:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+75:2368:x1876351635140224:12345-192.168.203.39@tcp:4:dd.0 Request processed in 53311us (55634us total) trans 4294969543 rc 0/0 00000100:00100000:1.0:1789429522.193177:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11757 00002000:00100000:1.0:1789429522.193191:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946f0879d880 x1876351635140224/t4294969543(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.193236:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879d880 with x1876351635140224 ext(27262976->28311551) 00002000:00010000:1.0:1789429522.193243:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879d880 00000100:00100000:1.0:1789429522.195425:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648408704:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429522.195459:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361f2a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->31457279] (req 30408704->31457279) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca96 expref: 74 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.195481:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93a600, rc 0) 00000100:00100000:1.0:1789429522.195538:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1015ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+74:44695:x1876351635140736:12345-192.168.203.39@tcp:101:dd.0 Request processed in 13247us (14032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429522.195547:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5863 00000100:00100000:1.0:1789429522.199811:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1015b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+81:2370:x1876351635140352:12345-192.168.203.39@tcp:4:dd.0 Request processed in 42382us (42666us total) trans 4294969544 rc 0/0 00000100:00100000:1.0:1789429522.199824:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11758 00002000:00100000:1.0:1789429522.200080:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946e1015b800 x1876351635140352/t4294969544(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.200091:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015b800 with x1876351635140352 ext(36700160->37748735) 00010000:00010000:1.0:1789429522.200102:0:18658:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 81 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.200123:0:18658:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 81 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429522.200132:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e1015b800 00000100:00100000:0.0:1789429522.205230:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1015b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+81:2370:x1876351635140864:12345-192.168.203.39@tcp:4:dd.0 Request processed in 23366us (23631us total) trans 4294969545 rc 0/0 00000100:00100000:0.0:1789429522.205245:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11759 00002000:00100000:0.0:1789429522.205258:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946e1015b480 x1876351635140864/t4294969545(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.205269:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015b480 with x1876351635140864 ext(37748736->38797311) 00010000:00010000:0.0:1789429522.205279:0:20673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 81 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429522.205298:0:20673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 81 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429522.205308:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e1015b480 00000100:00100000:3.0:1789429522.211702:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.212143:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635140992 00000100:00100000:0.0:1789429522.212155:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635140992 00002000:00100000:0.0:1789429522.212239:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946e10158380 x1876351635140992/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.212250:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10158380 with x1876351635140992 ext(38797312->39845887) 00010000:00010000:0.0:1789429522.212259:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 81 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429522.212277:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 81 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429522.212286:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e10158380 00000100:00100000:0.0:1789429522.212322:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1435 00000100:00100000:0.0:1789429522.212333:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+81:2370:x1876351635140992:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.215980:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10159f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+74:2369:x1876351635140480:12345-192.168.203.39@tcp:4:dd.0 Request processed in 33990us (34388us total) trans 4294969546 rc 0/0 00000100:00100000:0.0:1789429522.215995:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11760 00002000:00100000:0.0:1789429522.216006:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946e10159f80 x1876351635140480/t4294969546(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.216016:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10159f80 with x1876351635140480 ext(28311552->29360127) 00002000:00010000:0.0:1789429522.216022:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10159f80 00000100:00100000:2.0:1789429522.219425:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.219551:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635141120 00000100:00100000:0.0:1789429522.219562:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635141120 00000100:00100000:0.0:1789429522.219630:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5864 00000100:00100000:0.0:1789429522.219640:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+83:44696:x1876351635141120:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429522.219658:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429522.219677:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ca9d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429522.219707:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(1 39) 00010000:00010000:0.0:1789429522.219714:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 39) 00010000:00010000:0.0:1789429522.219720:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 84 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429522.219733:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 84 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429522.219745:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93bc00, rc 0) 00000100:00100000:0.0:1789429522.219850:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+84:44696:x1876351635141120:12345-192.168.203.39@tcp:101:dd.0 Request processed in 211us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429522.219858:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5864 00000100:00100000:0.0:1789429522.228253:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10159500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+74:2369:x1876351635140608:12345-192.168.203.39@tcp:4:dd.0 Request processed in 46167us (46626us total) trans 4294969547 rc 0/0 00000100:00100000:0.0:1789429522.228267:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11761 00002000:00100000:0.0:1789429522.228280:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e10159500 x1876351635140608/t4294969547(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.228291:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10159500 with x1876351635140608 ext(29360128->30408703) 00002000:00010000:0.0:1789429522.228297:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10159500 00000100:00100000:0.0:1789429522.234223:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10158380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+84:2370:x1876351635140992:12345-192.168.203.39@tcp:4:dd.0 Request processed in 21864us (22503us total) trans 4294969548 rc 0/0 00000100:00100000:0.0:1789429522.234236:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1435 00002000:00100000:0.0:1789429522.234247:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946e10158380 x1876351635140992/t4294969548(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.234257:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10158380 with x1876351635140992 ext(38797312->39845887) 00010000:00010000:0.0:1789429522.234267:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 84 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429522.234285:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 84 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429522.234294:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e10158380 00000100:00100000:2.0:1789429522.245607:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.245708:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635141248 00000100:00100000:3.0:1789429522.245718:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635141248 00010000:00010000:3.0:1789429522.245760:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 84 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429522.245802:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6261 00000100:00100000:3.0:1789429522.245812:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+84:2371:x1876351635141248:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429522.245826:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789429522.245845:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 30408704 -> 39845888 00010000:00010000:3.0:1789429522.245853:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 84 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.245987:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 84 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.246015:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eef67043/0xb4c3dad726361f23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [30408704->18446744073709551615] (req 30408704->31457279) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca8f expref: 84 pid: 20745 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.246047:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 39) 00010000:00010000:3.0:1789429522.246052:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 39) 00010000:00010000:3.0:1789429522.246060:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361f2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->39845887] (req 30408704->31457279) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca96 expref: 73 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.246071:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->39845887] (req 30408704->31457279) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca96 expref: 73 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.246080:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 39) 00010000:00010000:3.0:1789429522.246083:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 39) 00010000:00010000:3.0:1789429522.246087:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 83 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.246096:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 83 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.246132:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 83 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429522.246145:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e1015b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648408832:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429522.246328:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361f2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->39845887] (req 30408704->31457279) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca96 expref: 73 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429522.246339:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e1015a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648408960:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429522.246382:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429522.252793:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e1015b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648408832:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429522.252809:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e1015a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5824:1876351648408960:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429522.252832:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429522.252894:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+83:2371:x1876351635141248:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 7083us (7450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429522.252906:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6261 00000100:00100000:1.0:1789429522.290279:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.290420:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635141376 00000100:00100000:0.0:1789429522.290430:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635141376 00002000:00100000:0.0:1789429522.290480:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946f0879f800 x1876351635141376/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.290492:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879f800 with x1876351635141376 ext(30408704->31457279) 00002000:00010000:0.0:1789429522.290498:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879f800 00000100:00100000:0.0:1789429522.290532:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11762 00000100:00100000:0.0:1789429522.290542:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+74:2370:x1876351635141376:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.295047:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.298294:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635141504 00000100:00100000:3.0:1789429522.298309:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635141504 00002000:00100000:3.0:1789429522.298363:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946e0eac3480 x1876351635141504/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.298386:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac3480 with x1876351635141504 ext(39845888->40894463) 00002000:00010000:3.0:1789429522.298392:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eac3480 00000100:00100000:3.0:1789429522.298427:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11763 00000100:00100000:3.0:1789429522.298438:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+83:2369:x1876351635141504:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.315484:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+76:2370:x1876351635141376:12345-192.168.203.39@tcp:4:dd.0 Request processed in 24931us (25202us total) trans 4294969549 rc 0/0 00000100:00100000:3.0:1789429522.315500:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11762 00002000:00100000:3.0:1789429522.315514:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946f0879f800 x1876351635141376/t4294969549(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.315525:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879f800 with x1876351635141376 ext(30408704->31457279) 00002000:00010000:3.0:1789429522.315531:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879f800 00000100:00100000:3.0:1789429522.323132:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+85:2369:x1876351635141504:12345-192.168.203.39@tcp:4:dd.0 Request processed in 24686us (28084us total) trans 4294969550 rc 0/0 00000100:00100000:3.0:1789429522.323150:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11763 00002000:00100000:3.0:1789429522.323164:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946e0eac3480 x1876351635141504/t4294969550(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.323174:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac3480 with x1876351635141504 ext(39845888->40894463) 00002000:00010000:3.0:1789429522.323181:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eac3480 00000100:00100000:1.0:1789429522.326880:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.327026:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635141632 00000100:00100000:3.0:1789429522.327037:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635141632 00002000:00100000:3.0:1789429522.327085:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946f0879ed80 x1876351635141632/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.327098:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879ed80 with x1876351635141632 ext(31457280->32505855) 00002000:00010000:3.0:1789429522.327104:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879ed80 00000100:00100000:3.0:1789429522.327141:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11764 00000100:00100000:3.0:1789429522.327150:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+76:2371:x1876351635141632:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429522.328354:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.328610:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635141760 00000100:00100000:1.0:1789429522.328617:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635141760 00002000:00100000:1.0:1789429522.328653:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946e01bffb80 x1876351635141760/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.328664:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bffb80 with x1876351635141760 ext(40894464->41943039) 00002000:00010000:1.0:1789429522.328669:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bffb80 00000100:00100000:1.0:1789429522.328707:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11765 00000100:00100000:1.0:1789429522.328716:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+85:2368:x1876351635141760:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.341578:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+78:2371:x1876351635141632:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14418us (14711us total) trans 4294969551 rc 0/0 00000100:00100000:3.0:1789429522.341592:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11764 00002000:00100000:3.0:1789429522.341605:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946f0879ed80 x1876351635141632/t4294969551(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.341616:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879ed80 with x1876351635141632 ext(31457280->32505855) 00002000:00010000:3.0:1789429522.341623:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879ed80 00000100:00100000:1.0:1789429522.344960:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+87:2368:x1876351635141760:12345-192.168.203.39@tcp:4:dd.0 Request processed in 16235us (16600us total) trans 4294969552 rc 0/0 00000100:00100000:1.0:1789429522.344975:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11765 00002000:00100000:1.0:1789429522.344988:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946e01bffb80 x1876351635141760/t4294969552(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.344998:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bffb80 with x1876351635141760 ext(40894464->41943039) 00002000:00010000:1.0:1789429522.345004:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bffb80 00000100:00100000:2.0:1789429522.364480:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.364595:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635141888 00000100:00100000:1.0:1789429522.364605:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635141888 00002000:00100000:1.0:1789429522.364654:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946e01bfc000 x1876351635141888/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.364667:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfc000 with x1876351635141888 ext(41943040->42991615) 00002000:00010000:1.0:1789429522.364674:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfc000 00000100:00100000:1.0:1789429522.364744:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11766 00000100:00100000:1.0:1789429522.364756:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+87:2370:x1876351635141888:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.379591:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.381530:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635142016 00000100:00100000:0.0:1789429522.381545:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635142016 00002000:00100000:0.0:1789429522.381608:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946e1015a300 x1876351635142016/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.381619:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015a300 with x1876351635142016 ext(32505856->33554431) 00002000:00010000:0.0:1789429522.381625:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1015a300 00000100:00100000:0.0:1789429522.381661:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11767 00000100:00100000:0.0:1789429522.381670:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1015a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+78:2368:x1876351635142016:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429522.382236:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+89:2370:x1876351635141888:12345-192.168.203.39@tcp:4:dd.0 Request processed in 17478us (17761us total) trans 4294969553 rc 0/0 00000100:00100000:1.0:1789429522.382245:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11766 00002000:00100000:1.0:1789429522.382254:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946e01bfc000 x1876351635141888/t4294969553(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.382263:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfc000 with x1876351635141888 ext(41943040->42991615) 00002000:00010000:1.0:1789429522.382916:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfc000 00000100:00100000:1.0:1789429522.400757:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1015a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+80:2368:x1876351635142016:12345-192.168.203.39@tcp:4:dd.0 Request processed in 19078us (21165us total) trans 4294969554 rc 0/0 00000100:00100000:1.0:1789429522.400772:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11767 00002000:00100000:1.0:1789429522.400786:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946e1015a300 x1876351635142016/t4294969554(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.400796:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015a300 with x1876351635142016 ext(32505856->33554431) 00002000:00010000:1.0:1789429522.400803:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1015a300 00000100:00100000:2.0:1789429522.414020:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.414102:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635142144 00000100:00100000:3.0:1789429522.414113:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635142144 00002000:00100000:3.0:1789429522.414163:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946e01bfca80 x1876351635142144/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.414175:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfca80 with x1876351635142144 ext(33554432->34603007) 00002000:00010000:3.0:1789429522.414181:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfca80 00000100:00100000:3.0:1789429522.414267:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11768 00000100:00100000:3.0:1789429522.414277:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+80:2368:x1876351635142144:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.415776:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429522.416131:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635142272 00000100:00100000:2.0:1789429522.416139:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635142272 00002000:00100000:2.0:1789429522.416178:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946e1015b100 x1876351635142272/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.416189:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015b100 with x1876351635142272 ext(42991616->44040191) 00002000:00010000:2.0:1789429522.416234:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1015b100 00000100:00100000:2.0:1789429522.416259:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11769 00000100:00100000:2.0:1789429522.416268:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1015b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+89:2371:x1876351635142272:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.441784:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.441883:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635142400 00000100:00100000:0.0:1789429522.441893:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635142400 00002000:00100000:0.0:1789429522.441944:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946e10158e00 x1876351635142400/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.441956:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10158e00 with x1876351635142400 ext(44040192->45088767) 00002000:00010000:0.0:1789429522.441962:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10158e00 00000100:00100000:0.0:1789429522.441996:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11770 00000100:00100000:0.0:1789429522.442006:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+91:2370:x1876351635142400:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.455075:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.455926:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635142528 00000100:00100000:0.0:1789429522.455938:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635142528 00002000:00100000:0.0:1789429522.455985:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946e1015aa00 x1876351635142528/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.455997:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015aa00 with x1876351635142528 ext(34603008->35651583) 00002000:00010000:0.0:1789429522.456003:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1015aa00 00000100:00100000:0.0:1789429522.456035:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11771 00000100:00100000:0.0:1789429522.456045:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1015aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+82:2369:x1876351635142528:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429522.479956:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429522.482463:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+84:2368:x1876351635142144:12345-192.168.203.39@tcp:4:dd.0 Request processed in 68179us (68442us total) trans 4294969555 rc 0/0 00000100:00100000:2.0:1789429522.482475:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11768 00002000:00100000:2.0:1789429522.482486:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946e01bfca80 x1876351635142144/t4294969555(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.482496:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfca80 with x1876351635142144 ext(33554432->34603007) 00002000:00010000:2.0:1789429522.482504:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfca80 00000100:00100000:2.0:1789429522.482527:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635142656 00000100:00100000:2.0:1789429522.482533:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635142656 00002000:00100000:2.0:1789429522.482558:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946f0879f480 x1876351635142656/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.482574:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879f480 with x1876351635142656 ext(45088768->46137343) 00002000:00010000:2.0:1789429522.482577:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879f480 00000100:00100000:2.0:1789429522.482594:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11772 00000100:00100000:2.0:1789429522.482601:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+93:2371:x1876351635142656:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429522.483233:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1015b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+95:2371:x1876351635142272:12345-192.168.203.39@tcp:4:dd.0 Request processed in 66965us (67461us total) trans 4294969556 rc 0/0 00000100:00100000:2.0:1789429522.483242:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11769 00002000:00100000:2.0:1789429522.483249:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946e1015b100 x1876351635142272/t4294969556(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.483258:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015b100 with x1876351635142272 ext(42991616->44040191) 00002000:00010000:2.0:1789429522.483261:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1015b100 00000100:00100000:1.0:1789429522.488428:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10158e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+95:2370:x1876351635142400:12345-192.168.203.39@tcp:4:dd.0 Request processed in 46412us (46642us total) trans 4294969557 rc 0/0 00000100:00100000:1.0:1789429522.488442:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11770 00002000:00100000:1.0:1789429522.488456:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946e10158e00 x1876351635142400/t4294969557(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.488472:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10158e00 with x1876351635142400 ext(44040192->45088767) 00002000:00010000:1.0:1789429522.488478:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10158e00 00000100:00100000:3.0:1789429522.489419:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.489681:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.490993:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1015aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+84:2369:x1876351635142528:12345-192.168.203.39@tcp:4:dd.0 Request processed in 34944us (35922us total) trans 4294969558 rc 0/0 00000100:00100000:1.0:1789429522.491006:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11771 00002000:00100000:1.0:1789429522.491017:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946e1015aa00 x1876351635142528/t4294969558(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.491027:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015aa00 with x1876351635142528 ext(34603008->35651583) 00002000:00010000:1.0:1789429522.491034:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1015aa00 00000100:00100000:1.0:1789429522.491056:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635142784 00000100:00100000:1.0:1789429522.491062:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635142784 00002000:00100000:1.0:1789429522.491089:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e10158700 x1876351635142784/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.491097:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10158700 with x1876351635142784 ext(35651584->36700159) 00002000:00010000:1.0:1789429522.491099:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10158700 00000100:00100000:1.0:1789429522.491122:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635142912 00000100:00100000:1.0:1789429522.491125:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635142912 00002000:00100000:1.0:1789429522.491140:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e1015bb80 x1876351635142912/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.491148:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015bb80 with x1876351635142912 ext(46137344->47185919) 00002000:00010000:1.0:1789429522.491151:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1015bb80 00000100:00100000:1.0:1789429522.491170:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11773 00000100:00100000:1.0:1789429522.491179:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+84:2369:x1876351635142784:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429522.491589:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11774 00000100:00100000:1.0:1789429522.491597:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e1015bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+95:2370:x1876351635142912:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429522.498341:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+97:2371:x1876351635142656:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15728us (18382us total) trans 4294969559 rc 0/0 00000100:00100000:2.0:1789429522.498357:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11772 00002000:00100000:2.0:1789429522.498387:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946f0879f480 x1876351635142656/t4294969559(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.498397:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879f480 with x1876351635142656 ext(45088768->46137343) 00002000:00010000:2.0:1789429522.498404:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879f480 00000100:00100000:3.0:1789429522.516988:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.517462:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635143040 00000100:00100000:1.0:1789429522.517472:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635143040 00002000:00100000:1.0:1789429522.517514:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946e10158000 x1876351635143040/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.517526:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10158000 with x1876351635143040 ext(36700160->37748735) 00002000:00010000:1.0:1789429522.517531:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10158000 00000100:00100000:1.0:1789429522.517563:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11775 00000100:00100000:1.0:1789429522.517572:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+86:2369:x1876351635143040:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.518517:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10158700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+87:2369:x1876351635142784:12345-192.168.203.39@tcp:4:dd.0 Request processed in 27334us (29098us total) trans 4294969560 rc 0/0 00000100:00100000:0.0:1789429522.518532:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11773 00002000:00100000:0.0:1789429522.518541:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946e10158700 x1876351635142784/t4294969560(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.518549:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10158700 with x1876351635142784 ext(35651584->36700159) 00002000:00010000:0.0:1789429522.518553:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10158700 00000100:00100000:0.0:1789429522.531006:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e1015bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+97:2370:x1876351635142912:12345-192.168.203.39@tcp:4:dd.0 Request processed in 39400us (41315us total) trans 4294969561 rc 0/0 00000100:00100000:0.0:1789429522.531019:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11774 00002000:00100000:0.0:1789429522.531031:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e1015bb80 x1876351635142912/t4294969561(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.531040:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e1015bb80 with x1876351635142912 ext(46137344->47185919) 00002000:00010000:0.0:1789429522.531046:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e1015bb80 00000100:00100000:3.0:1789429522.543824:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.544323:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429522.544504:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635143168 00000100:00100000:2.0:1789429522.544515:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635143168 00002000:00100000:2.0:1789429522.544572:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946e10158a80 x1876351635143168/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.544592:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10158a80 with x1876351635143168 ext(47185920->48234495) 00002000:00010000:2.0:1789429522.544598:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10158a80 00000100:00100000:2.0:1789429522.544630:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635143296 00000100:00100000:2.0:1789429522.544634:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635143296 00002000:00100000:2.0:1789429522.544649:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946f08728000 x1876351635143296/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.544658:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728000 with x1876351635143296 ext(37748736->38797311) 00002000:00010000:2.0:1789429522.544662:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728000 00000100:00100000:2.0:1789429522.544690:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11776 00000100:00100000:2.0:1789429522.544700:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e10158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+97:2370:x1876351635143168:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.548260:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11777 00000100:00100000:0.0:1789429522.548283:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+88:2368:x1876351635143296:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429522.562583:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.564110:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10158000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+90:2369:x1876351635143040:12345-192.168.203.39@tcp:4:dd.0 Request processed in 46531us (47123us total) trans 4294969562 rc 0/0 00000100:00100000:0.0:1789429522.564123:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11775 00002000:00100000:0.0:1789429522.564135:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946e10158000 x1876351635143040/t4294969562(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.564145:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10158000 with x1876351635143040 ext(36700160->37748735) 00002000:00010000:0.0:1789429522.564151:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e10158000 00000100:00100000:0.0:1789429522.564175:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635143424 00000100:00100000:0.0:1789429522.564182:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635143424 00002000:00100000:0.0:1789429522.564235:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f0879df80 x1876351635143424/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.564244:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879df80 with x1876351635143424 ext(48234496->49283071) 00002000:00010000:0.0:1789429522.564248:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879df80 00000100:00100000:0.0:1789429522.564272:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11778 00000100:00100000:0.0:1789429522.564281:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+99:2371:x1876351635143424:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.584420:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.584660:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635143552 00000100:00100000:1.0:1789429522.584671:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635143552 00002000:00100000:1.0:1789429522.584720:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946e0eac3800 x1876351635143552/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.584731:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac3800 with x1876351635143552 ext(49283072->50331647) 00002000:00010000:1.0:1789429522.584736:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0eac3800 00000100:00100000:1.0:1789429522.585585:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11779 00000100:00100000:1.0:1789429522.585598:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+101:2371:x1876351635143552:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.586012:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.587793:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+90:2368:x1876351635143296:12345-192.168.203.39@tcp:4:dd.0 Request processed in 39514us (43464us total) trans 4294969563 rc 0/0 00000100:00100000:1.0:1789429522.587806:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11777 00002000:00100000:1.0:1789429522.587816:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946f08728000 x1876351635143296/t4294969563(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.587827:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728000 with x1876351635143296 ext(37748736->38797311) 00002000:00010000:1.0:1789429522.587833:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728000 00000100:00100000:3.0:1789429522.593730:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.594285:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635143808 00000100:00100000:3.0:1789429522.594295:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635143808 00000100:00100000:3.0:1789429522.594355:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5865 00000100:00100000:3.0:1789429522.594366:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+90:44695:x1876351635143808:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429522.594394:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429522.594414:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361f38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1caa4 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.594449:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 102 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.594464:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 39) 00010000:00010000:3.0:1789429522.594469:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(3 39) 00010000:00010000:3.0:1789429522.594474:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361f38 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caa4 expref: 91 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.594508:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 102 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.594522:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 102 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429522.594536:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0872a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648409088:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429522.594616:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789429522.595299:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e10158a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+103:2370:x1876351635143168:12345-192.168.203.39@tcp:4:dd.0 Request processed in 50598us (51485us total) trans 4294969564 rc 0/0 00000100:00100000:3.0:1789429522.595308:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11776 00002000:00100000:3.0:1789429522.595318:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946e10158a80 x1876351635143168/t4294969564(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.595327:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e10158a80 with x1876351635143168 ext(47185920->48234495) 00010000:00010000:3.0:1789429522.595335:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 103 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.595349:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 103 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429522.595357:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e10158a80 00000100:00100000:3.0:1789429522.595383:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635143680 00000100:00100000:3.0:1789429522.595389:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635143680 00002000:00100000:3.0:1789429522.595415:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946f08728a80 x1876351635143680/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.595423:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728a80 with x1876351635143680 ext(38797312->39845887) 00002000:00010000:3.0:1789429522.595427:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728a80 00000100:00100000:1.0:1789429522.595492:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11780 00000100:00100000:1.0:1789429522.595504:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+92:2370:x1876351635143680:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429522.599967:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+104:2371:x1876351635143552:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14364us (15546us total) trans 4294969565 rc 0/0 00000100:00100000:2.0:1789429522.599981:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11779 00002000:00100000:2.0:1789429522.599994:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946e0eac3800 x1876351635143552/t4294969565(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1789429522.600005:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+104:2371:x1876351635143424:12345-192.168.203.39@tcp:4:dd.0 Request processed in 35724us (37431us total) trans 4294969566 rc 0/0 00002000:00100000:2.0:1789429522.600005:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0eac3800 with x1876351635143552 ext(49283072->50331647) 00000100:00100000:1.0:1789429522.600012:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11778 00010000:00010000:2.0:1789429522.600015:0:19373:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 104 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1789429522.600017:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f0879df80 x1876351635143424/t4294969566(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.600025:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879df80 with x1876351635143424 ext(48234496->49283071) 00010000:00010000:1.0:1789429522.600030:0:19371:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 104 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429522.600036:0:19373:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 104 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.600040:0:19371:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 104 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789429522.600044:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946e0eac3800 00002000:00010000:1.0:1789429522.600047:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f0879df80 00000100:00100000:1.0:1789429522.603241:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0872a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648409088:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429522.603506:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361f38 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [39845888->40894463] (req 39845888->40894463) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caa4 expref: 93 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.603528:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc 0) 00000100:00100000:1.0:1789429522.603712:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+93:44695:x1876351635143808:12345-192.168.203.39@tcp:101:dd.0 Request processed in 9346us (9988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429522.603721:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5865 00000100:00100000:0.0:1789429522.611164:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.611262:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429522.611417:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635144064 00000100:00100000:2.0:1789429522.611432:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635144064 00000100:00100000:2.0:1789429522.611489:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5866 00000100:00100000:2.0:1789429522.611500:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c08ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+103:44696:x1876351635144064:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429522.611517:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429522.611535:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1caab expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429522.611566:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(3 39) 00010000:00010000:2.0:1789429522.611571:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(4 39) 00010000:00010000:2.0:1789429522.611577:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 104 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429522.611587:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 104 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429522.611599:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f546000, rc 0) 00000100:00100000:2.0:1789429522.611651:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c08ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+104:44696:x1876351635144064:12345-192.168.203.39@tcp:101:dd.0 Request processed in 153us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429522.611658:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5866 00000100:00100000:3.0:1789429522.612619:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635143936 00000100:00100000:3.0:1789429522.612627:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635143936 00002000:00100000:3.0:1789429522.612662:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f087b3800 x1876351635143936/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.612671:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b3800 with x1876351635143936 ext(50331648->51380223) 00010000:00010000:3.0:1789429522.612679:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 104 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.612694:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 104 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429522.612700:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f087b3800 00000100:00100000:3.0:1789429522.612725:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1436 00000100:00100000:3.0:1789429522.612734:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+104:2370:x1876351635143936:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429522.614413:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+93:2370:x1876351635143680:12345-192.168.203.39@tcp:4:dd.0 Request processed in 18903us (28393us total) trans 4294969567 rc 0/0 00000100:00100000:1.0:1789429522.614713:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11780 00002000:00100000:1.0:1789429522.614726:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946f08728a80 x1876351635143680/t4294969567(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.614736:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728a80 with x1876351635143680 ext(38797312->39845887) 00002000:00010000:1.0:1789429522.614742:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728a80 00000100:00100000:3.0:1789429522.623342:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+106:2370:x1876351635143936:12345-192.168.203.39@tcp:4:dd.0 Request processed in 10597us (12068us total) trans 4294969568 rc 0/0 00000100:00100000:3.0:1789429522.623380:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1436 00002000:00100000:3.0:1789429522.623393:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f087b3800 x1876351635143936/t4294969568(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.623403:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b3800 with x1876351635143936 ext(50331648->51380223) 00010000:00010000:3.0:1789429522.623414:0:15069:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 106 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429522.623433:0:15069:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 106 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429522.623442:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff946f087b3800 00000100:00100000:0.0:1789429522.635909:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429522.636036:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635144192 00000100:00100000:2.0:1789429522.636052:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635144192 00010000:00010000:2.0:1789429522.636097:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 106 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429522.636179:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6262 00000100:00100000:2.0:1789429522.636189:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+106:2369:x1876351635144192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429522.636310:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789429522.636328:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 39845888 -> 51380224 00010000:00010000:2.0:1789429522.636468:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 106 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429522.636484:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 106 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429522.636509:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b0165df/0xb4c3dad726361f31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [39845888->18446744073709551615] (req 39845888->40894463) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca9d expref: 106 pid: 6682 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429522.636525:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(4 39) 00010000:00010000:2.0:1789429522.636530:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(4 39) 00010000:00010000:2.0:1789429522.636539:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361f38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [39845888->51380223] (req 39845888->40894463) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caa4 expref: 92 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429522.636549:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361f38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [39845888->51380223] (req 39845888->40894463) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caa4 expref: 92 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429522.636558:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(4 39) 00010000:00010000:2.0:1789429522.636560:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(4 39) 00010000:00010000:2.0:1789429522.636565:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 105 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429522.636574:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 105 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429522.636626:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 105 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429522.636641:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01bfea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648409216:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429522.636735:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361f38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [39845888->51380223] (req 39845888->40894463) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caa4 expref: 92 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429522.636746:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e01bfd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648409344:192.168.203.39@tcp:105: 00000100:00100000:2.0:1789429522.636777:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f1962f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789429522.641986:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01bfea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648409216:192.168.203.39@tcp:105: 00000100:00100000:3.0:1789429522.642004:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e01bfd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5826:1876351648409344:192.168.203.39@tcp:105: 00010000:00010000:3.0:1789429522.642026:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789429522.642086:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+105:2369:x1876351635144192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5898us (6187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429522.642098:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6262 00000100:00100000:0.0:1789429522.659578:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1789429522.659578:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429522.659620:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.659692:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635144576 00000100:00100000:1.0:1789429522.659702:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635144576 00000100:00100000:1.0:1789429522.659772:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 289 00000100:00100000:1.0:1789429522.659782:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:44696:x1876351635144576:12345-192.168.203.39@tcp:35:dd.0 00000001:00080000:1.0:1789429522.660089:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977249 00000100:00100000:1.0:1789429522.660220:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+25:44696:x1876351635144576:12345-192.168.203.39@tcp:35:dd.0 Request processed in 418us (578us total) trans 4294977250 rc 0/0 00000100:00100000:1.0:1789429522.660228:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 289 00000020:00080000:1.0:1789429522.660234:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789429522.660297:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635144320 00000100:00100000:2.0:1789429522.660301:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635144320 00002000:00100000:2.0:1789429522.660328:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f087b3480 x1876351635144320/t0(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.660339:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b3480 with x1876351635144320 ext(51380224->52428799) 00002000:00010000:2.0:1789429522.660344:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b3480 00000100:00100000:2.0:1789429522.660369:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11781 00000100:00100000:2.0:1789429522.660385:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+105:2369:x1876351635144320:12345-192.168.203.39@tcp:4:dd.0 00000100:00080000:0.0:1789429522.660647:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429522.686140:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+107:2369:x1876351635144320:12345-192.168.203.39@tcp:4:dd.0 Request processed in 25747us (26559us total) trans 4294969569 rc 0/0 00000100:00100000:2.0:1789429522.686154:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11781 00002000:00100000:2.0:1789429522.686166:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f087b3480 x1876351635144320/t4294969569(0) o4->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.686182:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b3480 with x1876351635144320 ext(51380224->52428799) 00002000:00010000:2.0:1789429522.686189:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b3480 00000100:00100000:3.0:1789429522.687758:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.689836:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635144704 00000100:00100000:0.0:1789429522.689851:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635144704 00002000:00100000:0.0:1789429522.690477:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946f08729c00 x1876351635144704/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.690491:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08729c00 with x1876351635144704 ext(39845888->40894463) 00002000:00010000:0.0:1789429522.690498:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08729c00 00000100:00100000:0.0:1789429522.690528:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11782 00000100:00100000:0.0:1789429522.690538:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+93:2370:x1876351635144704:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.699798:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.699905:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635144832 00000100:00100000:0.0:1789429522.699915:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635144832 00002000:00100000:0.0:1789429522.699963:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946f08729880 x1876351635144832/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.699982:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08729880 with x1876351635144832 ext(40894464->41943039) 00002000:00010000:0.0:1789429522.699988:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08729880 00000100:00100000:0.0:1789429522.700024:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11783 00000100:00100000:0.0:1789429522.700034:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+95:2368:x1876351635144832:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.716079:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.716243:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635144960 00000100:00100000:0.0:1789429522.716254:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635144960 00002000:00100000:0.0:1789429522.716312:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946f41212850 x1876351635144960/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.716324:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f41212850 with x1876351635144960 ext(41943040->42991615) 00002000:00010000:0.0:1789429522.716330:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f41212850 00000100:00100000:3.0:1789429522.716750:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11784 00000100:00100000:3.0:1789429522.716765:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f41212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+97:2368:x1876351635144960:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.725399:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08729c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+99:2370:x1876351635144704:12345-192.168.203.39@tcp:4:dd.0 Request processed in 34847us (37629us total) trans 4294969570 rc 0/0 00000100:00100000:0.0:1789429522.725415:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11782 00002000:00100000:0.0:1789429522.725441:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946f08729c00 x1876351635144704/t4294969570(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.725453:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08729c00 with x1876351635144704 ext(39845888->40894463) 00002000:00010000:0.0:1789429522.725460:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08729c00 00000100:00100000:2.0:1789429522.730058:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429522.730087:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635145088 00000100:00100000:2.0:1789429522.730097:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635145088 00002000:00100000:2.0:1789429522.730141:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946e01bfe680 x1876351635145088/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.730152:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfe680 with x1876351635145088 ext(42991616->44040191) 00002000:00010000:2.0:1789429522.730157:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfe680 00000100:00100000:2.0:1789429522.730181:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11785 00000100:00100000:2.0:1789429522.730190:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+100:2368:x1876351635145088:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.736311:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+101:2368:x1876351635144832:12345-192.168.203.39@tcp:4:dd.0 Request processed in 36265us (36510us total) trans 4294969571 rc 0/0 00000100:00100000:0.0:1789429522.736327:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11783 00002000:00100000:0.0:1789429522.736343:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946f08729880 x1876351635144832/t4294969571(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.736361:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08729880 with x1876351635144832 ext(40894464->41943039) 00002000:00010000:0.0:1789429522.736368:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08729880 00000100:00100000:3.0:1789429522.739336:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f41212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+101:2368:x1876351635144960:12345-192.168.203.39@tcp:4:dd.0 Request processed in 22437us (23128us total) trans 4294969572 rc 0/0 00000100:00100000:3.0:1789429522.739351:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11784 00002000:00100000:3.0:1789429522.739489:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946f41212850 x1876351635144960/t4294969572(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.739501:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f41212850 with x1876351635144960 ext(41943040->42991615) 00002000:00010000:3.0:1789429522.739508:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f41212850 00000100:00100000:3.0:1789429522.745835:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+101:2368:x1876351635145088:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15634us (15776us total) trans 4294969573 rc 0/0 00000100:00100000:3.0:1789429522.745849:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11785 00002000:00100000:3.0:1789429522.745875:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946e01bfe680 x1876351635145088/t4294969573(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.745886:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfe680 with x1876351635145088 ext(42991616->44040191) 00002000:00010000:3.0:1789429522.745893:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfe680 00000100:00100000:2.0:1789429522.764362:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.764477:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635145216 00000100:00100000:3.0:1789429522.764488:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635145216 00002000:00100000:3.0:1789429522.764539:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946e01bfdc00 x1876351635145216/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.764552:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfdc00 with x1876351635145216 ext(44040192->45088767) 00002000:00010000:3.0:1789429522.764558:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfdc00 00000100:00100000:3.0:1789429522.764580:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11786 00000100:00100000:3.0:1789429522.764601:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+101:2371:x1876351635145216:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.784071:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+103:2371:x1876351635145216:12345-192.168.203.39@tcp:4:dd.0 Request processed in 19459us (19707us total) trans 4294969574 rc 0/0 00000100:00100000:3.0:1789429522.784086:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11786 00002000:00100000:3.0:1789429522.784100:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946e01bfdc00 x1876351635145216/t4294969574(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.784112:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfdc00 with x1876351635145216 ext(44040192->45088767) 00002000:00010000:3.0:1789429522.784119:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfdc00 00000100:00100000:2.0:1789429522.794430:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.794681:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635145344 00000100:00100000:1.0:1789429522.794692:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635145344 00002000:00100000:1.0:1789429522.794815:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946e01bfd880 x1876351635145344/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.794828:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfd880 with x1876351635145344 ext(45088768->46137343) 00002000:00010000:1.0:1789429522.794834:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfd880 00000100:00100000:1.0:1789429522.794863:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11787 00000100:00100000:1.0:1789429522.794873:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+103:2370:x1876351635145344:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429522.811765:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429522.811798:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635145472 00000100:00100000:2.0:1789429522.811808:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635145472 00002000:00100000:2.0:1789429522.811859:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e01bff800 x1876351635145472/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.812092:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bff800 with x1876351635145472 ext(46137344->47185919) 00002000:00010000:2.0:1789429522.812098:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bff800 00000100:00100000:2.0:1789429522.812137:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11788 00000100:00100000:2.0:1789429522.812148:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+105:2371:x1876351635145472:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429522.831461:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+107:2370:x1876351635145344:12345-192.168.203.39@tcp:4:dd.0 Request processed in 36579us (37029us total) trans 4294969575 rc 0/0 00000100:00100000:1.0:1789429522.831474:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11787 00002000:00100000:1.0:1789429522.831487:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946e01bfd880 x1876351635145344/t4294969575(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.831498:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfd880 with x1876351635145344 ext(45088768->46137343) 00002000:00010000:1.0:1789429522.831504:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfd880 00000100:00100000:1.0:1789429522.850060:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.851134:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635145600 00000100:00100000:0.0:1789429522.851148:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635145600 00002000:00100000:0.0:1789429522.851540:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f0879d500 x1876351635145600/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.851552:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879d500 with x1876351635145600 ext(47185920->48234495) 00002000:00010000:0.0:1789429522.851559:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879d500 00000100:00100000:0.0:1789429522.851597:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11789 00000100:00100000:0.0:1789429522.851609:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+107:2370:x1876351635145600:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429522.869315:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429522.871753:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+109:2371:x1876351635145472:12345-192.168.203.39@tcp:4:dd.0 Request processed in 59596us (59986us total) trans 4294969576 rc 0/0 00000100:00100000:0.0:1789429522.871770:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11788 00002000:00100000:0.0:1789429522.871786:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946e01bff800 x1876351635145472/t4294969576(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.871797:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bff800 with x1876351635145472 ext(46137344->47185919) 00002000:00010000:0.0:1789429522.871803:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bff800 00000100:00100000:0.0:1789429522.871833:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635145728 00000100:00100000:0.0:1789429522.871839:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635145728 00002000:00100000:0.0:1789429522.871874:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f0879e300 x1876351635145728/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.871882:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879e300 with x1876351635145728 ext(48234496->49283071) 00002000:00010000:0.0:1789429522.871886:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879e300 00000100:00100000:0.0:1789429522.871912:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11790 00000100:00100000:0.0:1789429522.871921:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+109:2369:x1876351635145728:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:3.0:1789429522.873429:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+111:2370:x1876351635145600:12345-192.168.203.39@tcp:4:dd.0 Request processed in 21818us (23374us total) trans 4294969577 rc 0/0 00000100:00100000:3.0:1789429522.873441:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11789 00002000:00100000:3.0:1789429522.873452:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f0879d500 x1876351635145600/t4294969577(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.873462:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879d500 with x1876351635145600 ext(47185920->48234495) 00002000:00010000:3.0:1789429522.873467:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879d500 00000100:00100000:1.0:1789429522.886321:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+111:2369:x1876351635145728:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14271us (16886us total) trans 4294969578 rc 0/0 00000100:00100000:1.0:1789429522.886336:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11790 00002000:00100000:1.0:1789429522.886350:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f0879e300 x1876351635145728/t4294969578(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429522.886362:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879e300 with x1876351635145728 ext(48234496->49283071) 00002000:00010000:1.0:1789429522.886368:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879e300 00000100:00100000:0.0:1789429522.891403:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.891463:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635145856 00000100:00100000:3.0:1789429522.891474:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635145856 00002000:00100000:3.0:1789429522.891525:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946f087b1500 x1876351635145856/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429522.891536:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b1500 with x1876351635145856 ext(49283072->50331647) 00002000:00010000:3.0:1789429522.891541:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b1500 00000100:00100000:3.0:1789429522.891572:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11791 00000100:00100000:3.0:1789429522.891582:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+111:2369:x1876351635145856:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:0.0:1789429522.905948:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+113:2369:x1876351635145856:12345-192.168.203.39@tcp:4:dd.0 Request processed in 14358us (14545us total) trans 4294969579 rc 0/0 00000100:00100000:0.0:1789429522.905961:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11791 00002000:00100000:0.0:1789429522.905972:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946f087b1500 x1876351635145856/t4294969579(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.905983:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b1500 with x1876351635145856 ext(49283072->50331647) 00002000:00010000:0.0:1789429522.905989:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b1500 00000100:00100000:3.0:1789429522.908754:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.908799:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.908894:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635146112 00000100:00100000:1.0:1789429522.908905:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635146112 00000100:00100000:1.0:1789429522.908960:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5867 00000100:00100000:1.0:1789429522.908971:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+113:44695:x1876351635146112:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429522.908990:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429522.909008:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abdd1913/0xb4c3dad726361f46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cab2 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.909041:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 106 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.909051:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(4 39) 00010000:00010000:1.0:1789429522.909056:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(5 39) 00010000:00010000:1.0:1789429522.909062:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abdd1913/0xb4c3dad726361f46 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cab2 expref: 114 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.909094:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 106 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.909108:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 106 pid: 8085 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429522.909123:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648409472:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429522.909227:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865600 going to sleep for 11 seconds 00000100:00100000:0.0:1789429522.909726:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635145984 00000100:00100000:0.0:1789429522.909732:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635145984 00002000:00100000:0.0:1789429522.909767:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f08728a80 x1876351635145984/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.909775:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728a80 with x1876351635145984 ext(50331648->51380223) 00002000:00010000:0.0:1789429522.909779:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728a80 00000100:00100000:0.0:1789429522.909806:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11792 00000100:00100000:0.0:1789429522.909815:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+115:2371:x1876351635145984:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:1.0:1789429522.919635:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:20986:1876351648409472:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429522.919680:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000abdd1913/0xb4c3dad726361f46 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->52428799] (req 51380224->52428799) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cab2 expref: 116 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.919702:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f072d8400, rc 0) 00000100:00100000:1.0:1789429522.919767:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+116:44695:x1876351635146112:12345-192.168.203.39@tcp:101:dd.0 Request processed in 10797us (11022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429522.919779:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5867 00000100:00100000:3.0:1789429522.920817:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429522.920892:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635146240 00000100:00100000:1.0:1789429522.920900:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635146240 00010000:00010000:1.0:1789429522.920935:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 107 pid: 8085 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429522.920970:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6263 00000100:00100000:1.0:1789429522.920978:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+107:2371:x1876351635146240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429522.920992:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789429522.921007:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb size from disk: 51380224 -> 52428800 00002000:00010000:1.0:1789429522.921011:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb mtime from disk: 1789429522 -> 1789429523 00002000:00010000:1.0:1789429522.921013:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x39:0x0] updating lvb ctime from disk: 1789429522 -> 1789429523 00010000:00010000:1.0:1789429522.921019:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 107 pid: 8085 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.921032:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 107 pid: 8085 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.921053:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a900eb4d/0xb4c3dad726361f3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 13 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caab expref: 107 pid: 8085 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.921068:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(5 39) 00010000:00010000:1.0:1789429522.921074:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(5 39) 00010000:00010000:1.0:1789429522.921082:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abdd1913/0xb4c3dad726361f46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cab2 expref: 115 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.921096:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abdd1913/0xb4c3dad726361f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cab2 expref: 115 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429522.921130:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000abdd1913/0xb4c3dad726361f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cab2 expref: 115 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429522.921144:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648409600:192.168.203.39@tcp:105: 00000100:00100000:1.0:1789429522.922351:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946e03865600 going to sleep for 11 seconds 00000100:00100000:0.0:1789429522.924882:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+116:2371:x1876351635145984:12345-192.168.203.39@tcp:4:dd.0 Request processed in 15059us (16072us total) trans 4294969580 rc 0/0 00000100:00100000:0.0:1789429522.924896:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11792 00002000:00100000:0.0:1789429522.924909:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f08728a80 x1876351635145984/t4294969580(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429522.924927:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728a80 with x1876351635145984 ext(50331648->51380223) 00002000:00010000:0.0:1789429522.924933:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728a80 00000100:00100000:2.0:1789429522.933026:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5825:1876351648409600:192.168.203.39@tcp:105: 00010000:00010000:2.0:1789429522.933053:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429522.933121:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+106:2371:x1876351635146240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12142us (12306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429522.933132:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6263 00000100:00100000:1.0:1789429522.949818:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429522.949905:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635146624 00000100:00100000:2.0:1789429522.949915:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635146624 00000100:00100000:2.0:1789429522.949984:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 290 00000100:00100000:2.0:1789429522.949993:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+34:44695:x1876351635146624:12345-192.168.203.39@tcp:35:dd.0 00000100:00080000:0.0:1789429522.950161:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429522.950273:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+35:44695:x1876351635146624:12345-192.168.203.39@tcp:35:dd.0 Request processed in 280us (464us total) trans 4294977251 rc 0/0 00000100:00100000:2.0:1789429522.950282:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 290 00000100:00100000:0.0:1789429522.953797:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429522.955188:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635146368 00000100:00100000:3.0:1789429522.955216:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635146368 00002000:00100000:2.0:1789429522.955357:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f087b0380 x1876351635146368/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/0 e 0 to 0 dl 1789429533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.955381:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b0380 with x1876351635146368 ext(51380224->52428799) 00002000:00010000:2.0:1789429522.955388:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b0380 00000100:00100000:2.0:1789429522.955458:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11793 00000100:00100000:2.0:1789429522.955468:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+116:2371:x1876351635146368:12345-192.168.203.39@tcp:4:dd.0 00000100:00100000:2.0:1789429522.975127:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+118:2371:x1876351635146368:12345-192.168.203.39@tcp:4:dd.0 Request processed in 19651us (21329us total) trans 4294969581 rc 0/0 00000100:00100000:2.0:1789429522.975141:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11793 00002000:00100000:2.0:1789429522.975153:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f087b0380 x1876351635146368/t4294969581(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:258/0 lens 488/448 e 0 to 0 dl 1789429533 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429522.975164:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b0380 with x1876351635146368 ext(51380224->52428799) 00002000:00010000:2.0:1789429522.975170:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b0380 00010000:00010000:0.0:1789429523.684600:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429523.855315:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429523.855376:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635146752 00000100:00100000:0.0:1789429523.855380:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429523.855388:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635146752 00000100:00080000:0.0:1789429523.855416:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429523.855472:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635146880 00000100:00100000:1.0:1789429523.855476:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635146880 00000100:00100000:1.0:1789429523.855508:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 271 00000100:00100000:1.0:1789429523.855517:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:5606:x1876351635146752:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429523.855534:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789429523.855574:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3d9c2d/0xb4c3dad726361727 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c76a expref: 7 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429523.855607:0:11354:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x33:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789429523.855616:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055575d98/0xb4c3dad726361505 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x33:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6a6 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429523.855631:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429523.855674:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:5606:x1876351635146752:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 158us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429523.855681:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 271 00000100:00100000:1.0:1789429523.855697:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 272 00000100:00100000:1.0:1789429523.855702:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+8:11155:x1876351635146880:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429523.855708:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789429523.855721:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000282fa1cf/0xb4c3dad726361c4b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x35:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8f9 expref: 8 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429523.855738:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dfe9c19/0xb4c3dad726361797 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x34:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c786 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789429523.855750:0:11354:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x31:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789429523.855758:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003343eb9d/0xb4c3dad726361177 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c56b expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429523.855768:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429523.855787:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:11155:x1876351635146880:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 84us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429523.855793:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 272 00000100:00080000:1.0:1789429523.855812:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429523.899861:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429523.899902:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635147008 00000100:00100000:0.0:1789429523.899912:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635147008 00000100:00100000:0.0:1789429523.899979:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 273 00000100:00100000:0.0:1789429523.899989:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+118:5607:x1876351635147008:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429523.900004:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 12 locks, starting at 0 00010000:00010000:0.0:1789429523.900045:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361f38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 12 type: EXT [39845888->51380223] (req 39845888->40894463) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caa4 expref: 118 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900066:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000965fd4ae/0xb4c3dad726361f2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 11 type: EXT [30408704->39845887] (req 30408704->31457279) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca96 expref: 117 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900077:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f81fdbd2/0xb4c3dad726361f1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 10 type: EXT [22020096->30408703] (req 22020096->23068671) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca88 expref: 116 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900089:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002464966/0xb4c3dad726361f0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 9 type: EXT [14680064->22020095] (req 14680064->15728639) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca7a expref: 115 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900103:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abdd1913/0xb4c3dad726361f46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 8 type: EXT [51380224->18446744073709551615] (req 51380224->52428799) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cab2 expref: 114 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900114:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcf7108e/0xb4c3dad726361f00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 7 type: EXT [8388608->14680063] (req 8388608->9437183) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca6c expref: 113 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900124:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d72859c/0xb4c3dad726361ef2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->5242879) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca5e expref: 112 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900133:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bc98c6/0xb4c3dad726361ee4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca50 expref: 111 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900143:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012f1099e/0xb4c3dad726361ed6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca42 expref: 110 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900153:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d03cb2be/0xb4c3dad726361ec8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ca34 expref: 109 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900180:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003847d626/0xb4c3dad7263618a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x37:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7da expref: 108 pid: 20986 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900219:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb6c3010/0xb4c3dad726360d64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x31:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c445 expref: 107 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429523.900240:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429523.900301:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12e09781-3d24-4c67-9972-bb781900e20d+106:5607:x1876351635147008:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 313us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429523.900309:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 273 00000001:00080000:0.0:1789429524.221316:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977248 is committed 00000001:00080000:0.0:1789429524.221331:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977245 is committed 00000001:00080000:0.0:1789429524.221338:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977250 is committed 00000001:00080000:0.0:1789429524.221344:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977251 is committed 00010000:00010000:1.0:1789429524.710509:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429524.851218:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429524.851258:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429524.859637:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635147136 00000100:00100000:1.0:1789429524.859651:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635147136 00000100:00100000:1.0:1789429524.859706:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635147264 00000100:00100000:1.0:1789429524.859710:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635147264 00000100:00100000:1.0:1789429524.859739:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21354 00000100:00100000:1.0:1789429524.859749:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:44724:x1876351635147136:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429524.859772:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429524.859795:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d9c00/0xb4c3dad726361f4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cab9 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.859857:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8400/0xb4c3dad726361f54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.859872:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8400/0xb4c3dad726361f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.859884:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8400/0xb4c3dad726361f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429524.859918:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429524.859921:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429524.859941:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8400/0xb4c3dad726361f54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.859964:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d9c00/0xb4c3dad726361f4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cab9 expref: 33 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.859982:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8400/0xb4c3dad726361f54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cab9 expref: 32 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.859990:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:1.0:1789429524.859993:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429524.859996:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f072d8400, rc 0) 00000100:00100000:1.0:1789429524.860057:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+32:44724:x1876351635147136:12345-192.168.203.39@tcp:101:dd.0 Request processed in 309us (8869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429524.860065:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21354 00000100:00100000:1.0:1789429524.860082:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21355 00000100:00100000:1.0:1789429524.860090:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:44725:x1876351635147264:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429524.860100:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429524.860107:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d9e00/0xb4c3dad726361f5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cac0 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.860135:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.860144:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.860151:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429524.860165:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429524.860168:0:15700:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429524.860177:0:15700:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.860226:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d9e00/0xb4c3dad726361f5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac0 expref: 22 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.860238:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac0 expref: 21 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429524.860246:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00000001:00080000:2.0:1789429524.860660:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969580 is committed 00000001:00080000:2.0:1789429524.860705:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969561 is committed 00000001:00080000:2.0:1789429524.861091:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969566 is committed 00000001:00080000:2.0:1789429524.861170:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969581 is committed 00000001:00080000:2.0:1789429524.861328:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969569 is committed 00010000:00010000:1.0:1789429524.861426:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429524.861432:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f072d8c00, rc 0) 00000100:00080000:1.0:1789429524.861759:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429524.864679:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:44725:x1876351635147264:12345-192.168.203.39@tcp:101:dd.0 Request processed in 4579us (13409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429524.864691:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21355 00000100:00100000:2.0:1789429524.867619:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429524.872795:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635147520 00000100:00100000:0.0:1789429524.872810:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635147520 00000100:00100000:0.0:1789429524.872875:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21356 00000100:00100000:0.0:1789429524.872886:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:44724:x1876351635147520:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429524.872906:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429524.872928:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361f69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cac7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.872998:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93bc00/0xb4c3dad726361f70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.873013:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93bc00/0xb4c3dad726361f70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.873025:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93bc00/0xb4c3dad726361f70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.873042:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a600/0xb4c3dad726361f77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.873053:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a600/0xb4c3dad726361f77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.873060:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a600/0xb4c3dad726361f77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874713:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361f7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874731:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874742:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361f7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429524.874754:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8a:0x0]: returning size 52428800 00010000:00010000:0.0:1789429524.874881:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93bc00/0xb4c3dad726361f70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874890:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93bc00/0xb4c3dad726361f70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874897:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93bc00/0xb4c3dad726361f70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874903:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f93bc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429524.874908:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93bc00/0xb4c3dad726361f70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874916:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93bc00/0xb4c3dad726361f70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874933:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:0.0:1789429524.874936:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429524.874941:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93bc00/0xb4c3dad726361f70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874948:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93bc00/0xb4c3dad726361f70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874961:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a600/0xb4c3dad726361f77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874969:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a600/0xb4c3dad726361f77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874975:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a600/0xb4c3dad726361f77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.874981:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f93a600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429524.874986:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a600/0xb4c3dad726361f77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429524.874989:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1789429524.874997:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a600/0xb4c3dad726361f77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875006:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b086329 (ffff946f120fd800) 00010000:00010000:0.0:1789429524.875009:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429524.875012:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a600/0xb4c3dad726361f77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875019:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a600/0xb4c3dad726361f77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875067:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93be00/0xb4c3dad726361f69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac7 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875082:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361f7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac7 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875089:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429524.875091:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429524.875093:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f93ba00, rc 0) 00000100:00100000:0.0:1789429524.875156:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+34:44724:x1876351635147520:12345-192.168.203.39@tcp:101:dd.0 Request processed in 2271us (7545us total) trans 4294977252 rc 0/0 00000100:00100000:0.0:1789429524.875165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21356 00000100:00100000:0.0:1789429524.875217:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635147776 00000100:00100000:0.0:1789429524.875224:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635147776 00000100:00100000:0.0:1789429524.875259:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21357 00000100:00100000:0.0:1789429524.875266:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:44725:x1876351635147776:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429524.875281:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429524.875290:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ac00/0xb4c3dad726361f8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875336:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361f93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875346:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875366:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875380:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361f9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875388:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875395:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875598:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875607:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875615:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429524.875623:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8a:0x0]: returning size 52428800 00010000:00010000:0.0:1789429524.875672:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361f93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875680:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361f93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875686:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875691:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f93a000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429524.875694:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361f93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875704:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361f93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875711:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:0.0:1789429524.875714:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429524.875717:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361f93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875722:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93a000/0xb4c3dad726361f93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875731:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361f9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875736:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361f9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875742:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875747:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f01652a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429524.875749:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361f9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875755:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361f9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875763:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b086329 (ffff946f120fd100) 00010000:00010000:0.0:1789429524.875765:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429524.875768:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361f9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875777:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652a00/0xb4c3dad726361f9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875807:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ac00/0xb4c3dad726361f8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cace expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875820:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cace expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429524.875827:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429524.875829:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429524.875831:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f01653800, rc 0) 00000100:00100000:0.0:1789429524.875857:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:44725:x1876351635147776:12345-192.168.203.39@tcp:101:dd.0 Request processed in 591us (876us total) trans 4294977253 rc 0/0 00000100:00100000:0.0:1789429524.875863:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21357 00000100:00100000:1.0:1789429524.885055:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429524.885222:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635147904 00000100:00100000:3.0:1789429524.885233:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635147904 00000100:00100000:3.0:1789429524.885303:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5868 00000100:00100000:3.0:1789429524.885313:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:44724:x1876351635147904:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429524.885330:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429524.885370:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c70c6135/0xb4c3dad726361faf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cad5 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789429524.885398:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 52428800, mtime: 0x6aa88713, atime: 0x0, ctime: 0x6aa88713, blocks: 0x19007 00010000:00010000:3.0:1789429524.885420:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=1222s v=(0 0) 00010000:00010000:3.0:1789429524.885425:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429524.885434:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c70c6135/0xb4c3dad726361faf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cad5 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429524.885452:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c70c6135/0xb4c3dad726361faf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cad5 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429524.885475:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5e00, rc 0) 00000100:00100000:3.0:1789429524.885547:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:44724:x1876351635147904:12345-192.168.203.39@tcp:101:dd.0 Request processed in 235us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429524.885554:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5868 00000100:00080000:1.0:1789429524.885671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429524.893242:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429524.893392:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635148032 00000100:00100000:3.0:1789429524.893404:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635148032 00000100:00100000:3.0:1789429524.893469:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5869 00000100:00100000:3.0:1789429524.893477:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:44725:x1876351635148032:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429524.893493:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429524.893511:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad726361fb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cadc expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429524.893549:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429524.893554:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429524.893838:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad726361fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cadc expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429524.893855:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad726361fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cadc expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429524.893868:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5800, rc 0) 00000100:00100000:3.0:1789429524.893941:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:44725:x1876351635148032:12345-192.168.203.39@tcp:101:dd.0 Request processed in 464us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429524.893948:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5869 00000100:00080000:1.0:1789429524.895720:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429525.095141:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.095247:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635148160 00000100:00100000:1.0:1789429525.095258:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635148160 00002000:00100000:1.0:1789429525.095308:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946e01bfed80 x1876351635148160/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.095319:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfed80 with x1876351635148160 ext(0->1048575) 00002000:00010000:1.0:1789429525.095326:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfed80 00000100:00100000:1.0:1789429525.095369:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11794 00000100:00100000:1.0:1789429525.095381:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635148160:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.108008:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429525.111939:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635148288 00000100:00100000:2.0:1789429525.111955:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635148288 00002000:00100000:2.0:1789429525.112007:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946f0879d180 x1876351635148288/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.112018:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879d180 with x1876351635148288 ext(0->1048575) 00002000:00010000:2.0:1789429525.112024:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879d180 00000100:00100000:2.0:1789429525.112050:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11795 00000100:00100000:2.0:1789429525.112058:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635148288:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.117785:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635148160:12345-192.168.203.39@tcp:3:dd.0 Request processed in 22396us (22644us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.118055:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11794 00002000:00100000:2.0:1789429525.118069:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946e01bfed80 x1876351635148160/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.118080:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfed80 with x1876351635148160 ext(0->1048575) 00002000:00010000:2.0:1789429525.118087:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfed80 00000100:00100000:2.0:1789429525.123164:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635148288:12345-192.168.203.39@tcp:3:dd.0 Request processed in 11096us (15154us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.123179:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11795 00002000:00100000:2.0:1789429525.123194:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (0->1048575) req@ffff946f0879d180 x1876351635148288/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.123255:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879d180 with x1876351635148288 ext(0->1048575) 00002000:00010000:2.0:1789429525.123262:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879d180 00000100:00100000:0.0:1789429525.148302:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.148350:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635148416 00000100:00100000:1.0:1789429525.148370:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635148416 00000100:00100000:0.0:1789429525.148386:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00002000:00100000:1.0:1789429525.148431:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946f087b0e00 x1876351635148416/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.148443:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b0e00 with x1876351635148416 ext(1048576->2097151) 00002000:00010000:1.0:1789429525.148448:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b0e00 00000100:00100000:1.0:1789429525.148487:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635148544 00000100:00100000:1.0:1789429525.148491:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635148544 00002000:00100000:1.0:1789429525.148506:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946f087b2a00 x1876351635148544/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.148515:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b2a00 with x1876351635148544 ext(1048576->2097151) 00002000:00010000:1.0:1789429525.148518:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b2a00 00000100:00100000:1.0:1789429525.148556:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11796 00000100:00100000:1.0:1789429525.148564:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635148416:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.149065:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11797 00000100:00100000:0.0:1789429525.149077:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635148544:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.179915:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635148544:12345-192.168.203.39@tcp:3:dd.0 Request processed in 30829us (31517us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.179930:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11797 00002000:00100000:2.0:1789429525.179944:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946f087b2a00 x1876351635148544/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.179955:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b2a00 with x1876351635148544 ext(1048576->2097151) 00002000:00010000:2.0:1789429525.179962:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b2a00 00000100:00100000:2.0:1789429525.182748:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635148416:12345-192.168.203.39@tcp:3:dd.0 Request processed in 34174us (34446us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.182761:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11796 00002000:00100000:2.0:1789429525.182775:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (1048576->2097151) req@ffff946f087b0e00 x1876351635148416/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.182786:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b0e00 with x1876351635148416 ext(1048576->2097151) 00002000:00010000:2.0:1789429525.183483:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b0e00 00000100:00100000:0.0:1789429525.194118:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.194163:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.194275:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635148800 00000100:00100000:3.0:1789429525.194286:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635148800 00002000:00100000:3.0:1789429525.194336:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f087b0700 x1876351635148800/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.194365:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b0700 with x1876351635148800 ext(3145728->4194303) 00002000:00010000:3.0:1789429525.194371:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b0700 00000100:00100000:3.0:1789429525.194397:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635148672 00000100:00100000:3.0:1789429525.194400:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635148672 00002000:00100000:3.0:1789429525.194415:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946f087b3b80 x1876351635148672/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.194428:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b3b80 with x1876351635148672 ext(2097152->3145727) 00002000:00010000:3.0:1789429525.194430:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b3b80 00000100:00100000:3.0:1789429525.194462:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11798 00000100:00100000:3.0:1789429525.194472:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635148800:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.195412:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11799 00000100:00100000:1.0:1789429525.195425:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635148672:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.213844:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635148800:12345-192.168.203.39@tcp:3:dd.0 Request processed in 19362us (19725us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429525.213858:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11798 00002000:00100000:3.0:1789429525.213871:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946f087b0700 x1876351635148800/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.213882:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b0700 with x1876351635148800 ext(3145728->4194303) 00002000:00010000:3.0:1789429525.213888:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b0700 00000100:00100000:0.0:1789429525.216884:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635148672:12345-192.168.203.39@tcp:3:dd.0 Request processed in 21452us (22710us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.216897:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11799 00002000:00100000:0.0:1789429525.216909:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946f087b3b80 x1876351635148672/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.216919:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b3b80 with x1876351635148672 ext(2097152->3145727) 00002000:00010000:0.0:1789429525.216926:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b3b80 00000100:00100000:2.0:1789429525.239605:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429525.239647:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.239731:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635148928 00000100:00100000:0.0:1789429525.239742:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635148928 00002000:00100000:0.0:1789429525.239796:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946e01bff480 x1876351635148928/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.239806:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bff480 with x1876351635148928 ext(2097152->3145727) 00002000:00010000:0.0:1789429525.239812:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bff480 00000100:00100000:0.0:1789429525.239835:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635149056 00000100:00100000:0.0:1789429525.239838:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635149056 00002000:00100000:0.0:1789429525.239851:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946e01bfdf80 x1876351635149056/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.239859:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfdf80 with x1876351635149056 ext(3145728->4194303) 00002000:00010000:0.0:1789429525.239862:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfdf80 00000100:00100000:0.0:1789429525.239886:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11800 00000100:00100000:0.0:1789429525.239894:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635148928:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.241318:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11801 00000100:00100000:2.0:1789429525.241335:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635149056:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.263295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.263421:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635149184 00000100:00100000:3.0:1789429525.263431:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635149184 00002000:00100000:3.0:1789429525.263478:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946e01bfd500 x1876351635149184/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.263489:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfd500 with x1876351635149184 ext(4194304->5242879) 00002000:00010000:3.0:1789429525.263494:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfd500 00000100:00100000:3.0:1789429525.263524:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11802 00000100:00100000:3.0:1789429525.263534:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635149184:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.268122:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.268231:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635149312 00000100:00100000:1.0:1789429525.268243:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635149312 00002000:00100000:1.0:1789429525.268289:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946e01bfc380 x1876351635149312/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.268301:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfc380 with x1876351635149312 ext(5242880->6291455) 00002000:00010000:1.0:1789429525.268307:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfc380 00000100:00100000:1.0:1789429525.268346:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11803 00000100:00100000:1.0:1789429525.268366:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635149312:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.270168:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.270213:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.270272:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635149440 00000100:00100000:0.0:1789429525.270279:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635149440 00002000:00100000:0.0:1789429525.270317:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946f0879dc00 x1876351635149440/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.270328:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879dc00 with x1876351635149440 ext(6291456->7340031) 00002000:00010000:0.0:1789429525.270333:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879dc00 00000100:00100000:0.0:1789429525.270364:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635149568 00000100:00100000:0.0:1789429525.270367:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635149568 00002000:00100000:0.0:1789429525.270383:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f0879d880 x1876351635149568/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.270390:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879d880 with x1876351635149568 ext(7340032->8388607) 00002000:00010000:0.0:1789429525.270394:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879d880 00000100:00100000:0.0:1789429525.270411:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11804 00000100:00100000:0.0:1789429525.270418:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+11:2370:x1876351635149440:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.271112:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11805 00000100:00100000:0.0:1789429525.271122:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351635149568:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.275848:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.275875:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.275899:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.275918:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.275961:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.275986:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635149824 00000100:00100000:1.0:1789429525.275994:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635149824 00000100:00100000:1.0:1789429525.276034:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635150080 00000100:00100000:1.0:1789429525.276036:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635150080 00000100:00100000:1.0:1789429525.276053:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 915 00000100:00100000:1.0:1789429525.276063:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+34:2371:x1876351635149824:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429525.276134:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+34:2371:x1876351635149824:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429525.276141:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 915 00000100:00100000:1.0:1789429525.276160:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 916 00000100:00100000:1.0:1789429525.276167:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2371:x1876351635150080:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429525.276228:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2371:x1876351635150080:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 61us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429525.276233:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 916 00000100:00100000:1.0:1789429525.276252:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635149696 00000100:00100000:1.0:1789429525.276255:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635149696 00000100:00100000:1.0:1789429525.276279:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 615 00000100:00100000:1.0:1789429525.276285:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635149696:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429525.276304:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635149696:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 19us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429525.276309:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 615 00000100:00100000:1.0:1789429525.276332:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635149952 00000100:00100000:1.0:1789429525.276336:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635149952 00000100:00100000:1.0:1789429525.276380:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635150208 00000100:00100000:1.0:1789429525.276384:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635150208 00000100:00100000:1.0:1789429525.276405:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 963 00000100:00100000:1.0:1789429525.276411:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635149952:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429525.276434:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635149952:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429525.276441:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 963 00000100:00100000:1.0:1789429525.276452:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 964 00000100:00100000:1.0:1789429525.276458:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635150208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429525.276476:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635150208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 19us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429525.276482:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 964 00000100:00080000:1.0:1789429525.276507:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429525.284894:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635149056:12345-192.168.203.39@tcp:3:dd.0 Request processed in 43546us (45227us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429525.284913:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11801 00002000:00100000:3.0:1789429525.284932:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (3145728->4194303) req@ffff946e01bfdf80 x1876351635149056/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.284944:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfdf80 with x1876351635149056 ext(3145728->4194303) 00002000:00010000:3.0:1789429525.284952:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfdf80 00000100:00100000:2.0:1789429525.292045:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635148928:12345-192.168.203.39@tcp:3:dd.0 Request processed in 52138us (52437us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.292940:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11800 00002000:00100000:2.0:1789429525.292961:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (2097152->3145727) req@ffff946e01bff480 x1876351635148928/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.292971:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bff480 with x1876351635148928 ext(2097152->3145727) 00002000:00010000:2.0:1789429525.292978:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bff480 00000100:00100000:2.0:1789429525.308494:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+12:2369:x1876351635149184:12345-192.168.203.39@tcp:3:dd.0 Request processed in 44951us (45198us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.308509:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11802 00002000:00100000:2.0:1789429525.308523:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946e01bfd500 x1876351635149184/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.308534:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfd500 with x1876351635149184 ext(4194304->5242879) 00002000:00010000:2.0:1789429525.308541:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfd500 00000100:00100000:2.0:1789429525.311833:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+10:2370:x1876351635149312:12345-192.168.203.39@tcp:3:dd.0 Request processed in 43467us (43710us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.311845:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11803 00002000:00100000:2.0:1789429525.311859:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946e01bfc380 x1876351635149312/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.311879:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfc380 with x1876351635149312 ext(5242880->6291455) 00002000:00010000:2.0:1789429525.311885:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfc380 00000100:00100000:0.0:1789429525.323333:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635149440:12345-192.168.203.39@tcp:3:dd.0 Request processed in 52903us (53163us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.323360:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11804 00002000:00100000:0.0:1789429525.323373:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946f0879dc00 x1876351635149440/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.323383:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879dc00 with x1876351635149440 ext(6291456->7340031) 00002000:00010000:0.0:1789429525.323389:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879dc00 00000100:00100000:0.0:1789429525.324492:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635149568:12345-192.168.203.39@tcp:3:dd.0 Request processed in 53369us (54287us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.324502:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11805 00002000:00100000:0.0:1789429525.324510:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f0879d880 x1876351635149568/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.324519:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879d880 with x1876351635149568 ext(7340032->8388607) 00002000:00010000:0.0:1789429525.324524:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879d880 00000100:00100000:1.0:1789429525.361897:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.361992:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.362520:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.362741:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635150336 00000100:00100000:0.0:1789429525.362752:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635150336 00002000:00100000:0.0:1789429525.362801:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946f0879f100 x1876351635150336/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.362812:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879f100 with x1876351635150336 ext(4194304->5242879) 00002000:00010000:0.0:1789429525.362817:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879f100 00000100:00100000:0.0:1789429525.362836:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635150464 00000100:00100000:0.0:1789429525.362839:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635150464 00002000:00100000:0.0:1789429525.362849:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946f0879ce00 x1876351635150464/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.362857:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879ce00 with x1876351635150464 ext(5242880->6291455) 00002000:00010000:0.0:1789429525.362860:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879ce00 00000100:00100000:0.0:1789429525.362876:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11806 00000100:00100000:0.0:1789429525.362884:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635150336:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.363420:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11807 00000100:00100000:3.0:1789429525.363433:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2368:x1876351635150464:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.365173:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635150720 00000100:00100000:2.0:1789429525.365186:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635150720 00002000:00100000:2.0:1789429525.365264:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f0879c380 x1876351635150720/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.365275:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879c380 with x1876351635150720 ext(7340032->8388607) 00002000:00010000:2.0:1789429525.365280:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879c380 00000100:00100000:1.0:1789429525.365468:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.365504:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635150592 00000100:00100000:1.0:1789429525.365508:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635150592 00002000:00100000:1.0:1789429525.365529:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946e0de0ed80 x1876351635150592/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.365539:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ed80 with x1876351635150592 ext(6291456->7340031) 00002000:00010000:1.0:1789429525.365542:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ed80 00000100:00100000:1.0:1789429525.365561:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11808 00000100:00100000:1.0:1789429525.365570:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2369:x1876351635150720:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.365898:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11809 00000100:00100000:3.0:1789429525.365908:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2369:x1876351635150592:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.391046:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2368:x1876351635150464:12345-192.168.203.39@tcp:3:dd.0 Request processed in 27607us (29043us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.391060:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11807 00002000:00100000:0.0:1789429525.391073:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (5242880->6291455) req@ffff946f0879ce00 x1876351635150464/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.391083:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879ce00 with x1876351635150464 ext(5242880->6291455) 00002000:00010000:0.0:1789429525.391090:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879ce00 00000100:00100000:3.0:1789429525.405443:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.405734:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351635150336:12345-192.168.203.39@tcp:3:dd.0 Request processed in 42848us (43843us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.405747:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11806 00002000:00100000:0.0:1789429525.405759:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (4194304->5242879) req@ffff946f0879f100 x1876351635150336/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.405769:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879f100 with x1876351635150336 ext(4194304->5242879) 00002000:00010000:0.0:1789429525.405776:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879f100 00000100:00100000:0.0:1789429525.405800:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635150848 00000100:00100000:0.0:1789429525.405807:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635150848 00002000:00100000:0.0:1789429525.405834:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946f0872b800 x1876351635150848/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.405842:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872b800 with x1876351635150848 ext(8388608->9437183) 00002000:00010000:0.0:1789429525.405845:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872b800 00000100:00100000:0.0:1789429525.405870:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11810 00000100:00100000:0.0:1789429525.405878:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0872b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635150848:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.407032:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.407462:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429525.407508:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429525.407541:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635151104 00000100:00100000:2.0:1789429525.407548:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635151104 00002000:00100000:2.0:1789429525.407587:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f0872ad80 x1876351635151104/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.407600:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872ad80 with x1876351635151104 ext(10485760->11534335) 00002000:00010000:2.0:1789429525.407606:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872ad80 00000100:00100000:2.0:1789429525.407632:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635150976 00000100:00100000:2.0:1789429525.407636:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635150976 00002000:00100000:2.0:1789429525.407653:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946e0de0f480 x1876351635150976/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.407662:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0f480 with x1876351635150976 ext(9437184->10485759) 00000100:00100000:1.0:1789429525.407665:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2369:x1876351635150592:12345-192.168.203.39@tcp:3:dd.0 Request processed in 41756us (42195us total) trans 0 rc 1048576/1048576 00002000:00010000:2.0:1789429525.407666:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0f480 00000100:00100000:1.0:1789429525.407682:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11809 00000100:00100000:2.0:1789429525.407684:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635151232 00000100:00100000:2.0:1789429525.407689:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635151232 00002000:00100000:1.0:1789429525.407693:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (6291456->7340031) req@ffff946e0de0ed80 x1876351635150592/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.407703:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ed80 with x1876351635150592 ext(6291456->7340031) 00002000:00100000:2.0:1789429525.407705:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946e01bff100 x1876351635151232/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00010000:1.0:1789429525.407709:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ed80 00002000:00100000:2.0:1789429525.407717:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bff100 with x1876351635151232 ext(11534336->12582911) 00002000:00010000:2.0:1789429525.407721:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bff100 00000100:00100000:1.0:1789429525.407739:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11811 00000100:00100000:2.0:1789429525.407904:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11812 00000100:00100000:2.0:1789429525.407915:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+10:2371:x1876351635150976:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.408631:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0872ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+10:2371:x1876351635151104:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.409822:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635150720:12345-192.168.203.39@tcp:3:dd.0 Request processed in 44244us (47294us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.409835:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11808 00002000:00100000:1.0:1789429525.409847:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (7340032->8388607) req@ffff946f0879c380 x1876351635150720/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.409857:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0879c380 with x1876351635150720 ext(7340032->8388607) 00002000:00010000:1.0:1789429525.409864:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0879c380 00000100:00100000:1.0:1789429525.409892:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11813 00000100:00100000:1.0:1789429525.409903:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351635151232:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.418829:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.418948:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.423778:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.424415:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635151360 00000100:00100000:0.0:1789429525.424426:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635151360 00000100:00100000:2.0:1789429525.424583:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635151488 00000100:00100000:2.0:1789429525.424589:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635151488 00002000:00100000:2.0:1789429525.424635:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946f08729f80 x1876351635151488/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.424646:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08729f80 with x1876351635151488 ext(13631488->14680063) 00002000:00010000:2.0:1789429525.424651:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08729f80 00000100:00100000:2.0:1789429525.424763:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11814 00000100:00100000:2.0:1789429525.424773:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+15:2370:x1876351635151488:12345-192.168.203.39@tcp:3:dd.0 00002000:00100000:1.0:1789429525.424898:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946f0872b480 x1876351635151360/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.424909:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872b480 with x1876351635151360 ext(12582912->13631487) 00002000:00010000:1.0:1789429525.424913:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872b480 00000100:00100000:0.0:1789429525.428549:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635151616 00000100:00100000:0.0:1789429525.428563:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635151616 00002000:00100000:0.0:1789429525.428613:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f08729500 x1876351635151616/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.428623:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08729500 with x1876351635151616 ext(14680064->15728639) 00002000:00010000:0.0:1789429525.428628:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08729500 00000100:00100000:0.0:1789429525.428655:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11815 00000100:00100000:0.0:1789429525.428664:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0872b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351635151360:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.429189:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11816 00000100:00100000:3.0:1789429525.429302:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635151616:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.429793:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.429834:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635151744 00000100:00100000:0.0:1789429525.429840:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635151744 00002000:00100000:0.0:1789429525.429870:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f087b0000 x1876351635151744/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.429880:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b0000 with x1876351635151744 ext(15728640->16777215) 00002000:00010000:0.0:1789429525.429885:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b0000 00000100:00100000:0.0:1789429525.429904:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11817 00000100:00100000:0.0:1789429525.429912:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351635151744:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.441540:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0872b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351635150848:12345-192.168.203.39@tcp:3:dd.0 Request processed in 35652us (36096us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.441554:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11810 00002000:00100000:2.0:1789429525.441568:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946f0872b800 x1876351635150848/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.441578:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872b800 with x1876351635150848 ext(8388608->9437183) 00002000:00010000:2.0:1789429525.441585:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872b800 00000100:00100000:2.0:1789429525.460868:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0872ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635151104:12345-192.168.203.39@tcp:3:dd.0 Request processed in 53110us (55372us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.460881:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11811 00002000:00100000:2.0:1789429525.460893:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946f0872ad80 x1876351635151104/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.460903:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872ad80 with x1876351635151104 ext(10485760->11534335) 00002000:00010000:2.0:1789429525.460908:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872ad80 00000100:00100000:0.0:1789429525.482132:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.482169:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.482239:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.482266:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635152000 00000100:00100000:0.0:1789429525.482275:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635152000 00002000:00100000:0.0:1789429525.482324:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f087b0a80 x1876351635152000/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.482335:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b0a80 with x1876351635152000 ext(9437184->10485759) 00002000:00010000:0.0:1789429525.482342:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b0a80 00000100:00100000:0.0:1789429525.482373:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635152256 00000100:00100000:0.0:1789429525.482378:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635152256 00002000:00100000:0.0:1789429525.482393:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946f087b1180 x1876351635152256/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.482400:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b1180 with x1876351635152256 ext(11534336->12582911) 00002000:00010000:0.0:1789429525.482403:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b1180 00000100:00100000:0.0:1789429525.482415:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635151872 00000100:00100000:0.0:1789429525.482418:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635151872 00002000:00100000:0.0:1789429525.482429:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946f087b2680 x1876351635151872/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.482436:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b2680 with x1876351635151872 ext(8388608->9437183) 00002000:00010000:0.0:1789429525.482439:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b2680 00000100:00100000:0.0:1789429525.482452:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11818 00000100:00100000:0.0:1789429525.482461:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351635152000:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.482709:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11819 00000100:00100000:2.0:1789429525.482718:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2370:x1876351635152256:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.483014:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11820 00000100:00100000:0.0:1789429525.483022:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351635151872:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.483421:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.483488:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635152128 00000100:00100000:0.0:1789429525.483494:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635152128 00002000:00100000:0.0:1789429525.483518:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946e01bfe300 x1876351635152128/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.483526:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfe300 with x1876351635152128 ext(10485760->11534335) 00002000:00010000:0.0:1789429525.483530:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfe300 00000100:00100000:0.0:1789429525.483552:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11821 00000100:00100000:0.0:1789429525.483559:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351635152128:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.483588:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351635150976:12345-192.168.203.39@tcp:3:dd.0 Request processed in 75675us (76127us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.483599:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11812 00002000:00100000:1.0:1789429525.483605:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946e0de0f480 x1876351635150976/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.483613:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0f480 with x1876351635150976 ext(9437184->10485759) 00002000:00010000:1.0:1789429525.483617:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0f480 00000100:00100000:1.0:1789429525.483692:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.483722:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.483746:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.483773:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.483821:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635152512 00000100:00100000:1.0:1789429525.483827:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635152512 00002000:00100000:1.0:1789429525.483851:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946e0de0df80 x1876351635152512/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.483860:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0df80 with x1876351635152512 ext(13631488->14680063) 00002000:00010000:1.0:1789429525.483863:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0df80 00000100:00100000:1.0:1789429525.483879:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635152768 00000100:00100000:1.0:1789429525.483882:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635152768 00002000:00100000:1.0:1789429525.483898:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946e0de0d500 x1876351635152768/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.483906:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0d500 with x1876351635152768 ext(15728640->16777215) 00002000:00010000:1.0:1789429525.483910:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0d500 00000100:00100000:1.0:1789429525.483922:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635152384 00000100:00100000:1.0:1789429525.483926:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635152384 00002000:00100000:1.0:1789429525.483939:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946e0de0f100 x1876351635152384/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.483953:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0f100 with x1876351635152384 ext(12582912->13631487) 00002000:00010000:1.0:1789429525.483956:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0f100 00000100:00100000:0.0:1789429525.483959:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635152640 00000100:00100000:0.0:1789429525.483962:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635152640 00000100:00100000:1.0:1789429525.483964:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11822 00000100:00100000:1.0:1789429525.483969:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351635152512:12345-192.168.203.39@tcp:3:dd.0 00002000:00100000:0.0:1789429525.483978:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946e0de0ce00 x1876351635152640/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.483985:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ce00 with x1876351635152640 ext(14680064->15728639) 00002000:00010000:0.0:1789429525.483988:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ce00 00000100:00100000:0.0:1789429525.483998:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11823 00000100:00100000:0.0:1789429525.484004:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351635152768:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.486601:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11824 00000100:00100000:1.0:1789429525.486624:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351635152384:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.486863:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11825 00000100:00100000:0.0:1789429525.486874:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351635152640:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.506661:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+14:2370:x1876351635151232:12345-192.168.203.39@tcp:3:dd.0 Request processed in 96751us (99145us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.506674:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11813 00002000:00100000:0.0:1789429525.506687:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946e01bff100 x1876351635151232/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.506774:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bff100 with x1876351635151232 ext(11534336->12582911) 00002000:00010000:0.0:1789429525.506781:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bff100 00000100:00100000:0.0:1789429525.512679:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0872b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351635151360:12345-192.168.203.39@tcp:3:dd.0 Request processed in 84005us (93848us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.512704:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11815 00002000:00100000:0.0:1789429525.512718:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946f0872b480 x1876351635151360/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.512728:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872b480 with x1876351635151360 ext(12582912->13631487) 00002000:00010000:0.0:1789429525.512735:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872b480 00000100:00100000:0.0:1789429525.513002:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08729f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+10:2370:x1876351635151488:12345-192.168.203.39@tcp:3:dd.0 Request processed in 88230us (94054us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.513010:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11814 00002000:00100000:0.0:1789429525.513016:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946f08729f80 x1876351635151488/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.513024:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08729f80 with x1876351635151488 ext(13631488->14680063) 00002000:00010000:0.0:1789429525.513028:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08729f80 00000100:00100000:2.0:1789429525.527033:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351635152256:12345-192.168.203.39@tcp:3:dd.0 Request processed in 44307us (44854us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.527045:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11819 00002000:00100000:2.0:1789429525.527057:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (11534336->12582911) req@ffff946f087b1180 x1876351635152256/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.527068:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b1180 with x1876351635152256 ext(11534336->12582911) 00002000:00010000:2.0:1789429525.527074:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b1180 00000100:00100000:0.0:1789429525.527612:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351635152000:12345-192.168.203.39@tcp:3:dd.0 Request processed in 45149us (45487us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.527624:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11818 00002000:00100000:0.0:1789429525.527631:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (9437184->10485759) req@ffff946f087b0a80 x1876351635152000/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.527639:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b0a80 with x1876351635152000 ext(9437184->10485759) 00002000:00010000:0.0:1789429525.527643:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b0a80 00000100:00100000:3.0:1789429525.527762:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+7:2371:x1876351635151616:12345-192.168.203.39@tcp:3:dd.0 Request processed in 98562us (103993us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429525.527771:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11816 00002000:00100000:3.0:1789429525.527777:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946f08729500 x1876351635151616/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.527785:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08729500 with x1876351635151616 ext(14680064->15728639) 00002000:00010000:3.0:1789429525.527790:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08729500 00000100:00100000:1.0:1789429525.527796:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635151744:12345-192.168.203.39@tcp:3:dd.0 Request processed in 97881us (98001us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.527805:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11817 00002000:00100000:1.0:1789429525.527814:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946f087b0000 x1876351635151744/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.527823:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b0000 with x1876351635151744 ext(15728640->16777215) 00002000:00010000:1.0:1789429525.527828:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b0000 00000100:00100000:3.0:1789429525.527903:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351635151872:12345-192.168.203.39@tcp:3:dd.0 Request processed in 44881us (45663us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429525.527912:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11820 00002000:00100000:3.0:1789429525.527920:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (8388608->9437183) req@ffff946f087b2680 x1876351635151872/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.527928:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b2680 with x1876351635151872 ext(8388608->9437183) 00002000:00010000:3.0:1789429525.527932:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b2680 00000100:00100000:3.0:1789429525.538807:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351635152512:12345-192.168.203.39@tcp:3:dd.0 Request processed in 54827us (55106us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429525.538819:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11822 00002000:00100000:3.0:1789429525.538831:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (13631488->14680063) req@ffff946e0de0df80 x1876351635152512/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.538840:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0df80 with x1876351635152512 ext(13631488->14680063) 00002000:00010000:3.0:1789429525.538846:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0df80 00000100:00100000:3.0:1789429525.547987:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351635152768:12345-192.168.203.39@tcp:3:dd.0 Request processed in 63972us (64255us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429525.548000:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11823 00002000:00100000:3.0:1789429525.549384:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (15728640->16777215) req@ffff946e0de0d500 x1876351635152768/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.549397:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0d500 with x1876351635152768 ext(15728640->16777215) 00002000:00010000:3.0:1789429525.549404:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0d500 00000100:00100000:2.0:1789429525.560843:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351635152640:12345-192.168.203.39@tcp:3:dd.0 Request processed in 73961us (77059us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.560856:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11825 00002000:00100000:2.0:1789429525.560870:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (14680064->15728639) req@ffff946e0de0ce00 x1876351635152640/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.560879:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ce00 with x1876351635152640 ext(14680064->15728639) 00002000:00010000:2.0:1789429525.560886:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ce00 00000100:00100000:1.0:1789429525.561141:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2370:x1876351635152384:12345-192.168.203.39@tcp:3:dd.0 Request processed in 74525us (77390us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.561151:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11824 00002000:00100000:1.0:1789429525.561160:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (12582912->13631487) req@ffff946e0de0f100 x1876351635152384/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.561171:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0f100 with x1876351635152384 ext(12582912->13631487) 00002000:00010000:1.0:1789429525.561176:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0f100 00000100:00100000:1.0:1789429525.570397:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635152128:12345-192.168.203.39@tcp:3:dd.0 Request processed in 86828us (86967us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.570413:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11821 00002000:00100000:1.0:1789429525.570425:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (10485760->11534335) req@ffff946e01bfe300 x1876351635152128/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.570435:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfe300 with x1876351635152128 ext(10485760->11534335) 00002000:00010000:1.0:1789429525.570441:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfe300 00000100:00100000:3.0:1789429525.667964:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429525.668057:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635152896 00000100:00100000:2.0:1789429525.668068:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635152896 00002000:00100000:2.0:1789429525.668115:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946f08728380 x1876351635152896/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.668126:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728380 with x1876351635152896 ext(16777216->17825791) 00002000:00010000:2.0:1789429525.668132:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728380 00000100:00100000:2.0:1789429525.668165:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11826 00000100:00100000:2.0:1789429525.668183:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635152896:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.668362:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648409856:0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.668413:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429525.668462:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648410368:0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.668499:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429525.668528:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429525.668534:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648409984:0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.668557:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429525.668584:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648410368 00000100:00100000:1.0:1789429525.668588:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648410368 00000100:00100000:1.0:1789429525.668628:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1789429525.668634:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648410368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.668678:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648410368:12345-0@lo:400:kworker.0 Request processed in 44us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429525.668685:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00080000:1.0:1789429525.668706:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429525.668734:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648410368:0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.668769:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648410112:0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.668794:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429525.668810:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789429525.668816:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648409728:0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.668843:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429525.668861:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0de0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648410240:0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.668879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429525.668901:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648409856 00000100:00100000:1.0:1789429525.668905:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648409856 00000100:00100000:1.0:1789429525.668937:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648409984 00000100:00100000:1.0:1789429525.668941:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648409984 00000100:00100000:1.0:1789429525.668962:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648410240 00000100:00100000:1.0:1789429525.668964:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648410240 00000100:00100000:1.0:1789429525.668983:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1789429525.668988:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648409856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.669022:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648409856:12345-0@lo:400:kworker.0 Request processed in 34us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429525.669028:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1789429525.669040:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1789429525.669046:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648409984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429525.669052:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648409728 00000100:00100000:0.0:1789429525.669056:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648409728 00000100:00100000:1.0:1789429525.669071:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648409984:12345-0@lo:400:kworker.0 Request processed in 26us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429525.669076:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1789429525.669082:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1789429525.669086:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1789429525.669088:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648409728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.669090:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648410240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429525.669237:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648410112 00000100:00100000:3.0:1789429525.669242:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648410112 00000100:00100000:3.0:1789429525.669271:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1789429525.669280:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648410112:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789429525.669403:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429525.669407:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429525.669434:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648409984:0@lo:400:kworker.0 00000100:00100000:2.0:1789429525.669446:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648409856:0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.669636:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648410240:12345-0@lo:400:kworker.0 Request processed in 543us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429525.669643:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1789429525.680417:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648410112:12345-0@lo:400:kworker.0 Request processed in 11129us (11613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429525.680432:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1789429525.681816:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.681844:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.681865:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.681882:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.681899:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.681924:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.681942:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.681961:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635153152 00000100:00100000:3.0:1789429525.681979:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635153152 00002000:00100000:3.0:1789429525.682020:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946f0872b100 x1876351635153152/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.682031:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872b100 with x1876351635153152 ext(18874368->19922943) 00002000:00010000:3.0:1789429525.682037:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872b100 00000100:00100000:3.0:1789429525.682057:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635153408 00000100:00100000:3.0:1789429525.682060:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635153408 00002000:00100000:3.0:1789429525.682074:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946f0872a300 x1876351635153408/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.682083:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872a300 with x1876351635153408 ext(20971520->22020095) 00002000:00010000:3.0:1789429525.682086:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872a300 00000100:00100000:3.0:1789429525.682096:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635153024 00000100:00100000:3.0:1789429525.682099:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635153024 00002000:00100000:3.0:1789429525.682115:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946f08728e00 x1876351635153024/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.682127:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728e00 with x1876351635153024 ext(17825792->18874367) 00002000:00010000:3.0:1789429525.682130:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728e00 00000100:00100000:3.0:1789429525.682144:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635153280 00000100:00100000:3.0:1789429525.682148:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635153280 00002000:00100000:3.0:1789429525.682163:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f0872aa00 x1876351635153280/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.682170:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872aa00 with x1876351635153280 ext(19922944->20971519) 00002000:00010000:3.0:1789429525.682173:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872aa00 00000100:00100000:3.0:1789429525.682187:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635153536 00000100:00100000:3.0:1789429525.682190:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635153536 00000100:00100000:0.0:1789429525.682219:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648409728:12345-0@lo:400:kworker.0 Request processed in 13127us (13371us total) trans 0 rc 0/0 00002000:00100000:3.0:1789429525.682228:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946f08728700 x1876351635153536/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1789429525.682234:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00002000:00100000:3.0:1789429525.682242:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728700 with x1876351635153536 ext(22020096->23068671) 00002000:00010000:3.0:1789429525.682246:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728700 00000100:00100000:3.0:1789429525.682259:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635153664 00000100:00100000:3.0:1789429525.682263:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635153664 00000100:00100000:0.0:1789429525.682278:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635153920 00002000:00100000:3.0:1789429525.682279:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946f0872bb80 x1876351635153664/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1789429525.682286:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635153920 00002000:00100000:3.0:1789429525.682292:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872bb80 with x1876351635153664 ext(23068672->24117247) 00002000:00010000:3.0:1789429525.682295:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872bb80 00002000:00100000:0.0:1789429525.682310:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f08729180 x1876351635153920/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1789429525.682315:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11827 00002000:00100000:0.0:1789429525.682325:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08729180 with x1876351635153920 ext(25165824->26214399) 00000100:00100000:3.0:1789429525.682329:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0872b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351635153152:12345-192.168.203.39@tcp:3:dd.0 00002000:00010000:0.0:1789429525.682332:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08729180 00000100:00100000:0.0:1789429525.682367:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11828 00000100:00100000:0.0:1789429525.682377:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0872a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351635153408:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.683744:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11829 00000100:00100000:0.0:1789429525.683940:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351635153024:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.684638:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11830 00000100:00100000:0.0:1789429525.684650:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0872aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351635153280:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.685874:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11831 00000100:00100000:2.0:1789429525.685889:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351635153536:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.686210:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648409728:0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.686233:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648410240:0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.686244:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0de0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648410112:0@lo:400:kworker.0 00000100:00100000:1.0:1789429525.686284:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11832 00000100:00100000:1.0:1789429525.686293:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0872bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+17:2370:x1876351635153664:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.686870:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11833 00000100:00100000:0.0:1789429525.686881:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351635153920:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.688446:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.691158:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635153792 00000100:00100000:1.0:1789429525.691171:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635153792 00002000:00100000:1.0:1789429525.691233:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946f0872a680 x1876351635153792/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.691243:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872a680 with x1876351635153792 ext(24117248->25165823) 00002000:00010000:1.0:1789429525.691249:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872a680 00000100:00100000:1.0:1789429525.691298:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11834 00000100:00100000:1.0:1789429525.691308:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0872a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+22:2370:x1876351635153792:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.695893:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+22:2370:x1876351635152896:12345-192.168.203.39@tcp:3:dd.0 Request processed in 27708us (27927us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.695908:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11826 00002000:00100000:2.0:1789429525.695922:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946f08728380 x1876351635152896/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.695933:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728380 with x1876351635152896 ext(16777216->17825791) 00002000:00010000:2.0:1789429525.695939:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728380 00000100:00100000:2.0:1789429525.709374:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429525.709417:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.709597:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635154176 00000100:00100000:3.0:1789429525.709608:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635154176 00002000:00100000:3.0:1789429525.709661:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946e01bfce00 x1876351635154176/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.709670:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfce00 with x1876351635154176 ext(17825792->18874367) 00002000:00010000:3.0:1789429525.709677:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfce00 00000100:00100000:3.0:1789429525.709704:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635154304 00000100:00100000:3.0:1789429525.709707:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635154304 00002000:00100000:3.0:1789429525.709721:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946e01bffb80 x1876351635154304/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.709729:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bffb80 with x1876351635154304 ext(18874368->19922943) 00002000:00010000:3.0:1789429525.709732:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bffb80 00000100:00100000:3.0:1789429525.709747:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11835 00000100:00100000:3.0:1789429525.709756:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635154176:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.710541:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.710834:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635154432 00000100:00100000:3.0:1789429525.710840:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635154432 00002000:00100000:3.0:1789429525.710867:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946e01bfc000 x1876351635154432/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.710877:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfc000 with x1876351635154432 ext(19922944->20971519) 00002000:00010000:3.0:1789429525.710880:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfc000 00000100:00100000:3.0:1789429525.710905:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11836 00000100:00100000:3.0:1789429525.710914:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2368:x1876351635154304:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.710943:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11837 00000100:00100000:1.0:1789429525.710956:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+9:2368:x1876351635154432:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.720720:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.720871:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.721063:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.721092:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635154560 00000100:00100000:3.0:1789429525.721101:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635154560 00002000:00100000:3.0:1789429525.721146:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946f2f091f80 x1876351635154560/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.721157:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091f80 with x1876351635154560 ext(20971520->22020095) 00002000:00010000:3.0:1789429525.721163:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f091f80 00000100:00100000:3.0:1789429525.721189:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635154688 00000100:00100000:3.0:1789429525.721192:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635154688 00002000:00100000:3.0:1789429525.721237:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946f2f093100 x1876351635154688/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.721244:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093100 with x1876351635154688 ext(22020096->23068671) 00002000:00010000:3.0:1789429525.721248:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f093100 00000100:00100000:3.0:1789429525.721258:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635154816 00000100:00100000:3.0:1789429525.721260:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635154816 00002000:00100000:3.0:1789429525.721274:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946f2f092680 x1876351635154816/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.721282:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092680 with x1876351635154816 ext(23068672->24117247) 00002000:00010000:3.0:1789429525.721285:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f092680 00000100:00100000:3.0:1789429525.721295:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11838 00000100:00100000:3.0:1789429525.721304:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2368:x1876351635154560:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.721551:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11839 00000100:00100000:2.0:1789429525.721560:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2368:x1876351635154688:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.722000:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429525.722017:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.722676:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635154944 00000100:00100000:0.0:1789429525.722684:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635154944 00002000:00100000:0.0:1789429525.722717:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946e01bfca80 x1876351635154944/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.722728:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfca80 with x1876351635154944 ext(24117248->25165823) 00002000:00010000:0.0:1789429525.722732:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfca80 00000100:00100000:0.0:1789429525.722743:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635155072 00000100:00100000:0.0:1789429525.722745:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635155072 00002000:00100000:0.0:1789429525.722756:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946e01bfd180 x1876351635155072/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.722764:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfd180 with x1876351635155072 ext(25165824->26214399) 00002000:00010000:0.0:1789429525.722767:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfd180 00000100:00100000:0.0:1789429525.722777:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11840 00000100:00100000:0.0:1789429525.722784:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2368:x1876351635154816:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.728312:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.728408:0:18633:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 16 min 3 max 116 00000100:00100000:2.0:1789429525.728415:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.728475:0:19371:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 16 min 3 max 116 00000100:00100000:0.0:1789429525.730686:0:18633:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_016' 00010000:00010000:3.0:1789429525.731412:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429525.732459:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635154048 00000100:00100000:2.0:1789429525.732471:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635154048 00002000:00100000:2.0:1789429525.732541:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946e01bfea00 x1876351635154048/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.732553:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfea00 with x1876351635154048 ext(16777216->17825791) 00002000:00010000:2.0:1789429525.732559:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfea00 00000100:00100000:2.0:1789429525.732580:0:18633:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 16 min 3 max 116 00000100:00100000:2.0:1789429525.732588:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635155200 00000100:00100000:2.0:1789429525.732591:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635155200 00002000:00100000:2.0:1789429525.732606:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f087bd500 x1876351635155200/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.732613:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bd500 with x1876351635155200 ext(26214400->27262975) 00002000:00010000:2.0:1789429525.732616:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bd500 00000100:00100000:0.0:1789429525.733365:0:25958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11841 00000100:00100000:0.0:1789429525.733380:0:25958:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351635154944:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.735989:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0872a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351635153408:12345-192.168.203.39@tcp:3:dd.0 Request processed in 53603us (54132us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.736002:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11828 00002000:00100000:0.0:1789429525.736014:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946f0872a300 x1876351635153408/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.736025:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872a300 with x1876351635153408 ext(20971520->22020095) 00002000:00010000:0.0:1789429525.736031:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872a300 00000100:00100000:0.0:1789429525.736064:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11842 00000100:00100000:0.0:1789429525.736075:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2368:x1876351635155072:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.737731:0:19371:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_017' 00000100:00100000:0.0:1789429525.747087:0:25959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11843 00000100:00100000:0.0:1789429525.747105:0:25959:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e01bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635154048:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.749133:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+19:2371:x1876351635153024:12345-192.168.203.39@tcp:3:dd.0 Request processed in 65369us (67257us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.749146:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11829 00002000:00100000:0.0:1789429525.749158:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946f08728e00 x1876351635153024/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.749168:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728e00 with x1876351635153024 ext(17825792->18874367) 00002000:00010000:0.0:1789429525.749182:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728e00 00000100:00100000:0.0:1789429525.749229:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11844 00000100:00100000:0.0:1789429525.749243:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351635155200:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.757004:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08728700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635153536:12345-192.168.203.39@tcp:3:dd.0 Request processed in 71110us (75093us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.757017:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11831 00002000:00100000:2.0:1789429525.757030:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946f08728700 x1876351635153536/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.757041:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08728700 with x1876351635153536 ext(22020096->23068671) 00002000:00010000:2.0:1789429525.757048:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08728700 00000100:00100000:3.0:1789429525.757308:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0872b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351635153152:12345-192.168.203.39@tcp:3:dd.0 Request processed in 74981us (75497us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429525.757316:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11827 00002000:00100000:3.0:1789429525.757323:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946f0872b100 x1876351635153152/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.757339:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872b100 with x1876351635153152 ext(18874368->19922943) 00002000:00010000:3.0:1789429525.757342:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872b100 00000100:00100000:1.0:1789429525.757763:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0872bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+14:2370:x1876351635153664:12345-192.168.203.39@tcp:3:dd.0 Request processed in 71470us (75837us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.757772:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11832 00002000:00100000:1.0:1789429525.757778:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946f0872bb80 x1876351635153664/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.757785:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872bb80 with x1876351635153664 ext(23068672->24117247) 00002000:00010000:1.0:1789429525.757789:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872bb80 00000100:00100000:0.0:1789429525.759971:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0872aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351635153280:12345-192.168.203.39@tcp:3:dd.0 Request processed in 75316us (78079us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.759984:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11830 00002000:00100000:0.0:1789429525.759995:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946f0872aa00 x1876351635153280/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.760012:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872aa00 with x1876351635153280 ext(19922944->20971519) 00002000:00010000:0.0:1789429525.760018:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872aa00 00000100:00100000:1.0:1789429525.774549:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0872a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+10:2370:x1876351635153792:12345-192.168.203.39@tcp:3:dd.0 Request processed in 83232us (86101us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.774562:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11834 00002000:00100000:1.0:1789429525.774574:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946f0872a680 x1876351635153792/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.774584:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0872a680 with x1876351635153792 ext(24117248->25165823) 00002000:00010000:1.0:1789429525.774590:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0872a680 00000100:00100000:0.0:1789429525.779785:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635153920:12345-192.168.203.39@tcp:3:dd.0 Request processed in 92895us (97830us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.779864:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11833 00002000:00100000:0.0:1789429525.779876:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946f08729180 x1876351635153920/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.779885:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f08729180 with x1876351635153920 ext(25165824->26214399) 00002000:00010000:0.0:1789429525.779891:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f08729180 00000100:00100000:3.0:1789429525.785294:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635154176:12345-192.168.203.39@tcp:3:dd.0 Request processed in 75530us (75921us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429525.785306:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11835 00002000:00100000:3.0:1789429525.785318:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (17825792->18874367) req@ffff946e01bfce00 x1876351635154176/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.785328:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfce00 with x1876351635154176 ext(17825792->18874367) 00002000:00010000:3.0:1789429525.785335:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfce00 00000100:00100000:1.0:1789429525.793814:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351635154304:12345-192.168.203.39@tcp:3:dd.0 Request processed in 82891us (84385us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.793827:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11836 00002000:00100000:1.0:1789429525.793840:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (18874368->19922943) req@ffff946e01bffb80 x1876351635154304/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.793852:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bffb80 with x1876351635154304 ext(18874368->19922943) 00002000:00010000:1.0:1789429525.793858:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bffb80 00000100:00100000:1.0:1789429525.801346:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2368:x1876351635154432:12345-192.168.203.39@tcp:3:dd.0 Request processed in 90384us (90798us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.801367:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11837 00002000:00100000:1.0:1789429525.801380:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (19922944->20971519) req@ffff946e01bfc000 x1876351635154432/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.801391:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfc000 with x1876351635154432 ext(19922944->20971519) 00002000:00010000:1.0:1789429525.801398:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfc000 00000100:00100000:2.0:1789429525.802497:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.802572:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635155328 00000100:00100000:1.0:1789429525.802581:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635155328 00002000:00100000:1.0:1789429525.802622:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946f087bc380 x1876351635155328/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.802632:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bc380 with x1876351635155328 ext(27262976->28311551) 00002000:00010000:1.0:1789429525.802637:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bc380 00000100:00100000:1.0:1789429525.802666:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11845 00000100:00100000:1.0:1789429525.802675:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:2370:x1876351635155328:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.804899:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351635154688:12345-192.168.203.39@tcp:3:dd.0 Request processed in 83332us (84018us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.804912:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11839 00002000:00100000:0.0:1789429525.804923:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (22020096->23068671) req@ffff946f2f093100 x1876351635154688/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.804933:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093100 with x1876351635154688 ext(22020096->23068671) 00002000:00010000:0.0:1789429525.804939:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f093100 00000100:00100000:1.0:1789429525.809779:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2368:x1876351635154816:12345-192.168.203.39@tcp:3:dd.0 Request processed in 86985us (88706us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.809792:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11840 00002000:00100000:1.0:1789429525.809804:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (23068672->24117247) req@ffff946f2f092680 x1876351635154816/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.809814:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092680 with x1876351635154816 ext(23068672->24117247) 00002000:00010000:1.0:1789429525.809820:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f092680 00000100:00100000:3.0:1789429525.812240:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.812720:0:25958:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2368:x1876351635154944:12345-192.168.203.39@tcp:3:dd.0 Request processed in 79341us (90718us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.812732:0:25958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11841 00002000:00100000:0.0:1789429525.812743:0:25958:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x39:0x0] (24117248->25165823) req@ffff946e01bfca80 x1876351635154944/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.812754:0:25958:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfca80 with x1876351635154944 ext(24117248->25165823) 00002000:00010000:0.0:1789429525.812760:0:25958:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfca80 00000100:00100000:0.0:1789429525.812784:0:25958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635155456 00000100:00100000:0.0:1789429525.812791:0:25958:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635155456 00002000:00100000:0.0:1789429525.812821:0:25958:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946f2f092d80 x1876351635155456/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.812830:0:25958:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092d80 with x1876351635155456 ext(28311552->29360127) 00002000:00010000:0.0:1789429525.812833:0:25958:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f092d80 00000100:00100000:0.0:1789429525.812852:0:25958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11846 00000100:00100000:0.0:1789429525.812861:0:25958:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:12e09781-3d24-4c67-9972-bb781900e20d+10:2371:x1876351635155456:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.814683:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351635154560:12345-192.168.203.39@tcp:3:dd.0 Request processed in 93372us (93965us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.814695:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11838 00002000:00100000:2.0:1789429525.814705:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (20971520->22020095) req@ffff946f2f091f80 x1876351635154560/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.814722:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091f80 with x1876351635154560 ext(20971520->22020095) 00002000:00010000:2.0:1789429525.814728:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f091f80 00000100:00100000:3.0:1789429525.816190:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429525.816244:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635155584 00000100:00100000:2.0:1789429525.816252:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635155584 00002000:00100000:2.0:1789429525.816294:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f2f092a00 x1876351635155584/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.816304:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092a00 with x1876351635155584 ext(26214400->27262975) 00002000:00010000:2.0:1789429525.816309:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f092a00 00000100:00100000:2.0:1789429525.816356:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11847 00000100:00100000:2.0:1789429525.816365:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351635155584:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.836356:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.836734:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635155712 00000100:00100000:1.0:1789429525.836745:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635155712 00002000:00100000:1.0:1789429525.836794:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946f2f090700 x1876351635155712/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.837133:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f090700 with x1876351635155712 ext(27262976->28311551) 00002000:00010000:1.0:1789429525.837143:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f090700 00000100:00100000:1.0:1789429525.837186:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11848 00000100:00100000:1.0:1789429525.837196:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2368:x1876351635155712:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.839299:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.839434:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+10:2370:x1876351635155328:12345-192.168.203.39@tcp:3:dd.0 Request processed in 36758us (36939us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.839448:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11845 00002000:00100000:1.0:1789429525.839460:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946f087bc380 x1876351635155328/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.839474:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bc380 with x1876351635155328 ext(27262976->28311551) 00002000:00010000:1.0:1789429525.839480:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bc380 00000100:00100000:1.0:1789429525.839503:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635155840 00000100:00100000:1.0:1789429525.839509:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635155840 00002000:00100000:1.0:1789429525.839538:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946e0de0c380 x1876351635155840/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.839546:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0c380 with x1876351635155840 ext(28311552->29360127) 00002000:00010000:1.0:1789429525.839549:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0c380 00000100:00100000:1.0:1789429525.839567:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11849 00000100:00100000:1.0:1789429525.839576:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2369:x1876351635155840:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.839684:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2368:x1876351635155072:12345-192.168.203.39@tcp:3:dd.0 Request processed in 103612us (117664us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.839693:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11842 00002000:00100000:0.0:1789429525.839699:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (25165824->26214399) req@ffff946e01bfd180 x1876351635155072/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.839708:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfd180 with x1876351635155072 ext(25165824->26214399) 00002000:00010000:0.0:1789429525.839711:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfd180 00000100:00100000:1.0:1789429525.840108:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.840129:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635156096 00000100:00100000:1.0:1789429525.840133:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635156096 00002000:00100000:1.0:1789429525.840153:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946e0de0ca80 x1876351635156096/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.840161:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ca80 with x1876351635156096 ext(30408704->31457279) 00002000:00010000:1.0:1789429525.840164:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ca80 00000100:00100000:1.0:1789429525.840178:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11850 00000100:00100000:1.0:1789429525.840185:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+10:2371:x1876351635156096:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.840900:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.841081:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.841103:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635156480 00000100:00100000:1.0:1789429525.841108:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635156480 00002000:00100000:1.0:1789429525.841133:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946e0de0ea00 x1876351635156480/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.841142:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ea00 with x1876351635156480 ext(32505856->33554431) 00002000:00010000:1.0:1789429525.841146:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ea00 00000100:00100000:1.0:1789429525.841164:0:18636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635155968 00000100:00100000:1.0:1789429525.841167:0:18636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635155968 00002000:00100000:1.0:1789429525.841180:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e0de0c700 x1876351635155968/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.841186:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0c700 with x1876351635155968 ext(29360128->30408703) 00002000:00010000:1.0:1789429525.841189:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0c700 00000100:00100000:1.0:1789429525.841227:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11851 00000100:00100000:1.0:1789429525.841235:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351635156480:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.841458:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351635155200:12345-192.168.203.39@tcp:3:dd.0 Request processed in 92219us (113043us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.841466:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11844 00002000:00100000:2.0:1789429525.841473:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f087bd500 x1876351635155200/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.841481:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bd500 with x1876351635155200 ext(26214400->27262975) 00002000:00010000:2.0:1789429525.841485:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bd500 00000100:00100000:2.0:1789429525.841504:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11852 00000100:00100000:2.0:1789429525.841511:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351635155968:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.843183:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.843378:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.843413:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635156224 00000100:00100000:3.0:1789429525.843420:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635156224 00002000:00100000:3.0:1789429525.843456:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946f2f093b80 x1876351635156224/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.843465:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093b80 with x1876351635156224 ext(31457280->32505855) 00002000:00010000:3.0:1789429525.843470:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f093b80 00000100:00100000:3.0:1789429525.843486:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635156608 00000100:00100000:3.0:1789429525.843489:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635156608 00002000:00100000:3.0:1789429525.843502:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946f2f093800 x1876351635156608/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.843515:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093800 with x1876351635156608 ext(30408704->31457279) 00002000:00010000:3.0:1789429525.843518:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f093800 00000100:00100000:3.0:1789429525.843532:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11853 00000100:00100000:3.0:1789429525.843539:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351635156224:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.844375:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.844408:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.844428:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.844505:0:25959:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e01bfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:2370:x1876351635154048:12345-192.168.203.39@tcp:3:dd.0 Request processed in 97405us (116202us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429525.844514:0:25959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11843 00002000:00100000:3.0:1789429525.844522:0:25959:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_017: refresh rw locks for [0x240000400:0x39:0x0] (16777216->17825791) req@ffff946e01bfea00 x1876351635154048/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.844529:0:25959:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e01bfea00 with x1876351635154048 ext(16777216->17825791) 00002000:00010000:3.0:1789429525.844533:0:25959:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e01bfea00 00000100:00100000:3.0:1789429525.844551:0:25959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635156864 00000100:00100000:3.0:1789429525.844555:0:25959:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635156864 00002000:00100000:3.0:1789429525.844575:0:25959:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_017: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946f2f093480 x1876351635156864/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.844581:0:25959:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093480 with x1876351635156864 ext(32505856->33554431) 00002000:00010000:3.0:1789429525.844584:0:25959:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f093480 00000100:00100000:3.0:1789429525.844601:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635156352 00000100:00100000:3.0:1789429525.844605:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635156352 00002000:00100000:3.0:1789429525.844618:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946f2f092300 x1876351635156352/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.844632:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092300 with x1876351635156352 ext(29360128->30408703) 00002000:00010000:3.0:1789429525.844635:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f092300 00000100:00100000:3.0:1789429525.844642:0:20672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635156736 00000100:00100000:3.0:1789429525.844645:0:20672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635156736 00002000:00100000:3.0:1789429525.844657:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946f2f091880 x1876351635156736/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.844663:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091880 with x1876351635156736 ext(31457280->32505855) 00002000:00010000:3.0:1789429525.844666:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f091880 00000100:00100000:3.0:1789429525.844675:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11854 00000100:00100000:3.0:1789429525.844681:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+15:2368:x1876351635156608:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.845096:0:25959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11855 00000100:00100000:3.0:1789429525.845104:0:25959:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351635156864:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.845323:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11856 00000100:00100000:0.0:1789429525.845332:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351635156352:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.845763:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11857 00000100:00100000:0.0:1789429525.845770:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+17:2368:x1876351635156736:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429525.849937:0:25958:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351635155456:12345-192.168.203.39@tcp:3:dd.0 Request processed in 37066us (37694us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.849950:0:25958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11846 00002000:00100000:1.0:1789429525.849961:0:25958:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946f2f092d80 x1876351635155456/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.849970:0:25958:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092d80 with x1876351635155456 ext(28311552->29360127) 00002000:00010000:1.0:1789429525.849977:0:25958:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f092d80 00000100:00100000:2.0:1789429525.855329:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2368:x1876351635155584:12345-192.168.203.39@tcp:3:dd.0 Request processed in 38954us (39134us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.855340:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11847 00002000:00100000:2.0:1789429525.855366:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (26214400->27262975) req@ffff946f2f092a00 x1876351635155584/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.855376:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092a00 with x1876351635155584 ext(26214400->27262975) 00002000:00010000:2.0:1789429525.855525:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f092a00 00000100:00100000:2.0:1789429525.866716:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2368:x1876351635155712:12345-192.168.203.39@tcp:3:dd.0 Request processed in 29510us (30375us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.866728:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11848 00002000:00100000:2.0:1789429525.866741:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (27262976->28311551) req@ffff946f2f090700 x1876351635155712/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.866751:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f090700 with x1876351635155712 ext(27262976->28311551) 00002000:00010000:2.0:1789429525.866757:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f090700 00000100:00100000:2.0:1789429525.876743:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2369:x1876351635155840:12345-192.168.203.39@tcp:3:dd.0 Request processed in 37157us (37440us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.876758:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11849 00002000:00100000:2.0:1789429525.876772:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (28311552->29360127) req@ffff946e0de0c380 x1876351635155840/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.876784:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0c380 with x1876351635155840 ext(28311552->29360127) 00002000:00010000:2.0:1789429525.876791:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0c380 00000100:00100000:2.0:1789429525.907534:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351635156096:12345-192.168.203.39@tcp:3:dd.0 Request processed in 67338us (67416us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.907549:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11850 00002000:00100000:2.0:1789429525.907563:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946e0de0ca80 x1876351635156096/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.907579:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ca80 with x1876351635156096 ext(30408704->31457279) 00002000:00010000:2.0:1789429525.907585:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ca80 00000100:00100000:3.0:1789429525.908020:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f093b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+10:2371:x1876351635156224:12345-192.168.203.39@tcp:3:dd.0 Request processed in 64478us (64847us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429525.908087:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11853 00002000:00100000:3.0:1789429525.908095:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946f2f093b80 x1876351635156224/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.908104:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093b80 with x1876351635156224 ext(31457280->32505855) 00002000:00010000:3.0:1789429525.908109:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f093b80 00000100:00100000:0.0:1789429525.908599:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635155968:12345-192.168.203.39@tcp:3:dd.0 Request processed in 67086us (67515us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.908607:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11852 00002000:00100000:0.0:1789429525.908615:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946e0de0c700 x1876351635155968/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.908623:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0c700 with x1876351635155968 ext(29360128->30408703) 00002000:00010000:0.0:1789429525.908627:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0c700 00000100:00100000:2.0:1789429525.908745:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f093800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2368:x1876351635156608:12345-192.168.203.39@tcp:3:dd.0 Request processed in 64062us (65365us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.908751:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11854 00002000:00100000:2.0:1789429525.908758:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (30408704->31457279) req@ffff946f2f093800 x1876351635156608/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.908765:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093800 with x1876351635156608 ext(30408704->31457279) 00002000:00010000:2.0:1789429525.908768:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f093800 00000100:00100000:2.0:1789429525.920196:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2368:x1876351635156352:12345-192.168.203.39@tcp:3:dd.0 Request processed in 74856us (75777us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.920223:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11856 00002000:00100000:2.0:1789429525.920235:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (29360128->30408703) req@ffff946f2f092300 x1876351635156352/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.920245:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f092300 with x1876351635156352 ext(29360128->30408703) 00002000:00010000:2.0:1789429525.920252:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f092300 00000100:00100000:0.0:1789429525.921077:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635156736:12345-192.168.203.39@tcp:3:dd.0 Request processed in 75302us (76643us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429525.921087:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11857 00002000:00100000:0.0:1789429525.921095:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (31457280->32505855) req@ffff946f2f091880 x1876351635156736/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.921103:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091880 with x1876351635156736 ext(31457280->32505855) 00002000:00010000:0.0:1789429525.921107:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f091880 00000100:00100000:1.0:1789429525.925941:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635156480:12345-192.168.203.39@tcp:3:dd.0 Request processed in 84693us (85030us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429525.925955:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11851 00002000:00100000:1.0:1789429525.925972:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946e0de0ea00 x1876351635156480/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.925983:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0ea00 with x1876351635156480 ext(32505856->33554431) 00002000:00010000:1.0:1789429525.925989:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0ea00 00000100:00100000:2.0:1789429525.929802:0:25959:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635156864:12345-192.168.203.39@tcp:3:dd.0 Request processed in 84686us (85415us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429525.929817:0:25959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11855 00002000:00100000:2.0:1789429525.929832:0:25959:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_017: refresh rw locks for [0x240000400:0x39:0x0] (32505856->33554431) req@ffff946f2f093480 x1876351635156864/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429525.929843:0:25959:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f093480 with x1876351635156864 ext(32505856->33554431) 00002000:00010000:2.0:1789429525.929850:0:25959:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f093480 00000100:00100000:1.0:1789429525.964519:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.964564:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.964596:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.964623:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.964639:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429525.964668:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635156992 00000100:00100000:1.0:1789429525.964679:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635156992 00002000:00100000:1.0:1789429525.964729:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946e0de0fb80 x1876351635156992/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.964739:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0fb80 with x1876351635156992 ext(33554432->34603007) 00002000:00010000:1.0:1789429525.964745:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0fb80 00000100:00100000:1.0:1789429525.964765:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635157120 00000100:00100000:1.0:1789429525.964768:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635157120 00002000:00100000:1.0:1789429525.964782:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946f1c00b800 x1876351635157120/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.964790:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00b800 with x1876351635157120 ext(34603008->35651583) 00002000:00010000:1.0:1789429525.964793:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00b800 00000100:00100000:1.0:1789429525.964803:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635157376 00000100:00100000:1.0:1789429525.964806:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635157376 00002000:00100000:1.0:1789429525.964818:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946f1c00ad80 x1876351635157376/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.964826:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00ad80 with x1876351635157376 ext(36700160->37748735) 00002000:00010000:1.0:1789429525.964829:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00ad80 00000100:00100000:1.0:1789429525.964841:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635157248 00000100:00100000:1.0:1789429525.964843:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635157248 00002000:00100000:1.0:1789429525.964857:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946f1c00a680 x1876351635157248/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.964876:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00a680 with x1876351635157248 ext(35651584->36700159) 00002000:00010000:1.0:1789429525.964879:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00a680 00000100:00100000:1.0:1789429525.964888:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635157504 00000100:00100000:1.0:1789429525.964891:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635157504 00002000:00100000:1.0:1789429525.964904:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946f1c00b100 x1876351635157504/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429525.964912:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00b100 with x1876351635157504 ext(37748736->38797311) 00002000:00010000:1.0:1789429525.964915:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00b100 00000100:00100000:1.0:1789429525.964929:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11858 00000100:00100000:1.0:1789429525.964939:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+10:2371:x1876351635156992:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.965756:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11859 00000100:00100000:0.0:1789429525.965771:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+10:2371:x1876351635157120:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.966664:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429525.966908:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635157632 00000100:00100000:0.0:1789429525.966915:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635157632 00002000:00100000:0.0:1789429525.966947:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946f087b1c00 x1876351635157632/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429525.966956:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b1c00 with x1876351635157632 ext(38797312->39845887) 00002000:00010000:0.0:1789429525.966961:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b1c00 00000100:00100000:0.0:1789429525.966984:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11860 00000100:00100000:0.0:1789429525.966993:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351635157376:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.967702:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11861 00000100:00100000:0.0:1789429525.967713:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+13:2371:x1876351635157248:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429525.968379:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11862 00000100:00100000:0.0:1789429525.968389:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351635157504:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.969949:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11863 00000100:00100000:2.0:1789429525.969967:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351635157632:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.974495:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.974524:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.974561:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429525.974592:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635157760 00000100:00100000:3.0:1789429525.974601:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635157760 00002000:00100000:3.0:1789429525.974647:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946f2f091180 x1876351635157760/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.974658:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091180 with x1876351635157760 ext(39845888->40894463) 00002000:00010000:3.0:1789429525.974664:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f091180 00000100:00100000:3.0:1789429525.974686:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635158016 00000100:00100000:3.0:1789429525.974689:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635158016 00002000:00100000:3.0:1789429525.974704:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946f34020000 x1876351635158016/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.974712:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34020000 with x1876351635158016 ext(41943040->42991615) 00002000:00010000:3.0:1789429525.974715:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34020000 00000100:00100000:3.0:1789429525.974726:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635157888 00000100:00100000:3.0:1789429525.974728:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635157888 00002000:00100000:3.0:1789429525.974741:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946f34071f80 x1876351635157888/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/0 e 0 to 0 dl 1789429536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429525.974749:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071f80 with x1876351635157888 ext(40894464->41943039) 00002000:00010000:3.0:1789429525.974752:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34071f80 00000100:00100000:3.0:1789429525.974766:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11864 00000100:00100000:3.0:1789429525.974776:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351635157760:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429525.975509:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11865 00000100:00100000:3.0:1789429525.975519:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+21:2370:x1876351635158016:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429525.975858:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11866 00000100:00100000:2.0:1789429525.975882:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351635157888:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429526.004837:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:12e09781-3d24-4c67-9972-bb781900e20d+22:2371:x1876351635157120:12345-192.168.203.39@tcp:3:dd.0 Request processed in 39061us (40262us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.004851:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11859 00002000:00100000:1.0:1789429526.004864:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946f1c00b800 x1876351635157120/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.004888:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00b800 with x1876351635157120 ext(34603008->35651583) 00002000:00010000:1.0:1789429526.004896:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00b800 00000100:00100000:0.0:1789429526.026473:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+20:2371:x1876351635157376:12345-192.168.203.39@tcp:3:dd.0 Request processed in 59470us (61865us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429526.026503:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11860 00002000:00100000:0.0:1789429526.026517:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946f1c00ad80 x1876351635157376/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.026526:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00ad80 with x1876351635157376 ext(36700160->37748735) 00002000:00010000:0.0:1789429526.026533:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00ad80 00000100:00100000:3.0:1789429526.028404:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429526.028434:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429526.028480:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429526.028496:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429526.028531:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429526.028739:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635158144 00000100:00100000:0.0:1789429526.028749:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635158144 00002000:00100000:0.0:1789429526.028811:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946f34072a00 x1876351635158144/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.028820:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072a00 with x1876351635158144 ext(33554432->34603007) 00002000:00010000:0.0:1789429526.028825:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34072a00 00000100:00100000:0.0:1789429526.028846:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635158272 00000100:00100000:0.0:1789429526.028850:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635158272 00002000:00100000:0.0:1789429526.028998:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946f34073100 x1876351635158272/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.029006:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073100 with x1876351635158272 ext(34603008->35651583) 00002000:00010000:0.0:1789429526.029009:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34073100 00000100:00100000:0.0:1789429526.029022:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635158400 00000100:00100000:0.0:1789429526.029025:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635158400 00002000:00100000:0.0:1789429526.029039:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946f34070a80 x1876351635158400/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.029047:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070a80 with x1876351635158400 ext(35651584->36700159) 00002000:00010000:0.0:1789429526.029049:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34070a80 00000100:00100000:0.0:1789429526.029066:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635158656 00000100:00100000:0.0:1789429526.029069:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635158656 00002000:00100000:0.0:1789429526.029079:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946f34071500 x1876351635158656/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.029086:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071500 with x1876351635158656 ext(37748736->38797311) 00002000:00010000:0.0:1789429526.029089:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34071500 00000100:00100000:0.0:1789429526.029098:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635158528 00000100:00100000:0.0:1789429526.029100:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635158528 00002000:00100000:0.0:1789429526.029109:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946f34070e00 x1876351635158528/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.029115:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070e00 with x1876351635158528 ext(36700160->37748735) 00002000:00010000:0.0:1789429526.029117:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34070e00 00000100:00100000:0.0:1789429526.029130:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11867 00000100:00100000:0.0:1789429526.029138:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2371:x1876351635158144:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429526.029707:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11868 00000100:00100000:2.0:1789429526.029720:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2371:x1876351635158272:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429526.030358:0:25958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11869 00000100:00100000:2.0:1789429526.030368:0:25958:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351635158400:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429526.031065:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11870 00000100:00100000:1.0:1789429526.031078:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+13:2371:x1876351635158656:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429526.032410:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11871 00000100:00100000:0.0:1789429526.032422:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351635158528:12345-192.168.203.39@tcp:3:dd.0 00000100:00080000:3.0:1789429526.032439:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429526.032656:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635157248:12345-192.168.203.39@tcp:3:dd.0 Request processed in 64943us (68030us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429526.032663:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11861 00002000:00100000:3.0:1789429526.032673:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946f1c00a680 x1876351635157248/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.032683:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00a680 with x1876351635157248 ext(35651584->36700159) 00002000:00010000:3.0:1789429526.032690:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00a680 00000100:00100000:1.0:1789429526.035673:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429526.035707:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429526.035736:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429526.035773:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429526.035800:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635158784 00000100:00100000:1.0:1789429526.035809:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635158784 00002000:00100000:1.0:1789429526.035853:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946f1c009180 x1876351635158784/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.035874:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c009180 with x1876351635158784 ext(38797312->39845887) 00002000:00010000:1.0:1789429526.035881:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c009180 00000100:00100000:1.0:1789429526.035900:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635158912 00000100:00100000:1.0:1789429526.035903:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635158912 00002000:00100000:1.0:1789429526.035918:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946f29da9180 x1876351635158912/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.035925:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da9180 with x1876351635158912 ext(39845888->40894463) 00002000:00010000:1.0:1789429526.035928:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da9180 00000100:00100000:1.0:1789429526.035950:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635159168 00000100:00100000:1.0:1789429526.035953:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635159168 00002000:00100000:1.0:1789429526.035968:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946f29daad80 x1876351635159168/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.035975:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29daad80 with x1876351635159168 ext(41943040->42991615) 00002000:00010000:1.0:1789429526.035979:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29daad80 00000100:00100000:1.0:1789429526.035989:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635159040 00000100:00100000:1.0:1789429526.035992:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635159040 00002000:00100000:1.0:1789429526.036004:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946f29dab480 x1876351635159040/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.036018:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29dab480 with x1876351635159040 ext(40894464->41943039) 00002000:00010000:1.0:1789429526.036021:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29dab480 00000100:00100000:1.0:1789429526.036031:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11872 00000100:00100000:1.0:1789429526.036038:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+19:2371:x1876351635158784:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429526.036543:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11873 00000100:00100000:1.0:1789429526.036552:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351635158912:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429526.036661:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11874 00000100:00100000:0.0:1789429526.036672:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29daad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351635159168:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429526.037116:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11875 00000100:00100000:1.0:1789429526.037125:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2371:x1876351635159040:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429526.043494:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429526.044008:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635159296 00000100:00100000:3.0:1789429526.044019:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635159296 00002000:00100000:3.0:1789429526.044087:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946f087bf100 x1876351635159296/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00080000:2.0:1789429526.044095:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1789429526.044098:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bf100 with x1876351635159296 ext(42991616->44040191) 00002000:00010000:3.0:1789429526.044104:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bf100 00000100:00100000:3.0:1789429526.044137:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11876 00000100:00100000:3.0:1789429526.044147:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635159296:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429526.064574:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429526.064756:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+18:2371:x1876351635157504:12345-192.168.203.39@tcp:3:dd.0 Request processed in 96366us (100113us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.064768:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11862 00002000:00100000:1.0:1789429526.064781:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946f1c00b100 x1876351635157504/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.064790:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c00b100 with x1876351635157504 ext(37748736->38797311) 00002000:00010000:1.0:1789429526.064796:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c00b100 00000100:00100000:1.0:1789429526.064820:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635159424 00000100:00100000:1.0:1789429526.064827:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635159424 00002000:00100000:1.0:1789429526.064859:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946f34072d80 x1876351635159424/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.064879:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072d80 with x1876351635159424 ext(44040192->45088767) 00000100:00100000:2.0:1789429526.064879:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+17:2371:x1876351635157632:12345-192.168.203.39@tcp:3:dd.0 Request processed in 94919us (98218us total) trans 0 rc 1048576/1048576 00002000:00010000:1.0:1789429526.064883:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34072d80 00000100:00100000:2.0:1789429526.064886:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11863 00002000:00100000:2.0:1789429526.064892:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946f087b1c00 x1876351635157632/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429526.064900:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b1c00 with x1876351635157632 ext(38797312->39845887) 00002000:00010000:2.0:1789429526.064903:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b1c00 00000100:00100000:1.0:1789429526.064906:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11877 00000100:00100000:1.0:1789429526.064915:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+16:2370:x1876351635159424:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429526.077698:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:12e09781-3d24-4c67-9972-bb781900e20d+16:2371:x1876351635156992:12345-192.168.203.39@tcp:3:dd.0 Request processed in 112750us (113178us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.077711:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11858 00002000:00100000:1.0:1789429526.077724:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946e0de0fb80 x1876351635156992/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.077734:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0de0fb80 with x1876351635156992 ext(33554432->34603007) 00002000:00010000:1.0:1789429526.077741:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0de0fb80 00000100:00100000:3.0:1789429526.079427:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429526.079560:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+14:2370:x1876351635158016:12345-192.168.203.39@tcp:3:dd.0 Request processed in 104042us (105033us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.079570:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11865 00002000:00100000:1.0:1789429526.079580:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946f34020000 x1876351635158016/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.079590:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34020000 with x1876351635158016 ext(41943040->42991615) 00002000:00010000:1.0:1789429526.079595:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34020000 00000100:00100000:1.0:1789429526.079617:0:15069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635159552 00000100:00100000:1.0:1789429526.079623:0:15069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635159552 00002000:00100000:1.0:1789429526.079651:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946f34073800 x1876351635159552/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.079658:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073800 with x1876351635159552 ext(45088768->46137343) 00002000:00010000:1.0:1789429526.079660:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34073800 00000100:00100000:1.0:1789429526.079686:0:15069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11878 00000100:00100000:1.0:1789429526.079695:0:15069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+14:2370:x1876351635159552:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429526.080831:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:12e09781-3d24-4c67-9972-bb781900e20d+14:2370:x1876351635157760:12345-192.168.203.39@tcp:3:dd.0 Request processed in 106051us (106338us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429526.080841:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11864 00002000:00100000:2.0:1789429526.080850:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946f2f091180 x1876351635157760/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429526.080865:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f2f091180 with x1876351635157760 ext(39845888->40894463) 00002000:00010000:2.0:1789429526.080870:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f2f091180 00000100:00100000:0.0:1789429526.093889:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:12e09781-3d24-4c67-9972-bb781900e20d+12:2371:x1876351635157888:12345-192.168.203.39@tcp:3:dd.0 Request processed in 117997us (119312us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429526.093908:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11866 00002000:00100000:0.0:1789429526.093923:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946f34071f80 x1876351635157888/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:261/0 lens 488/440 e 0 to 0 dl 1789429536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.093935:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071f80 with x1876351635157888 ext(40894464->41943039) 00002000:00010000:0.0:1789429526.093941:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34071f80 00000100:00100000:1.0:1789429526.099290:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2371:x1876351635158272:12345-192.168.203.39@tcp:3:dd.0 Request processed in 69563us (70844us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.099305:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11868 00002000:00100000:1.0:1789429526.099318:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (34603008->35651583) req@ffff946f34073100 x1876351635158272/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.099330:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073100 with x1876351635158272 ext(34603008->35651583) 00002000:00010000:1.0:1789429526.099337:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34073100 00000100:00100000:2.0:1789429526.099488:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351635158144:12345-192.168.203.39@tcp:3:dd.0 Request processed in 70333us (71074us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429526.099496:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11867 00002000:00100000:2.0:1789429526.099502:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (33554432->34603007) req@ffff946f34072a00 x1876351635158144/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429526.099510:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072a00 with x1876351635158144 ext(33554432->34603007) 00002000:00010000:2.0:1789429526.099513:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34072a00 00000100:00100000:1.0:1789429526.106409:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2371:x1876351635158656:12345-192.168.203.39@tcp:3:dd.0 Request processed in 75322us (77899us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.106423:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11870 00002000:00100000:1.0:1789429526.106437:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (37748736->38797311) req@ffff946f34071500 x1876351635158656/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.106447:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34071500 with x1876351635158656 ext(37748736->38797311) 00002000:00010000:1.0:1789429526.106453:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34071500 00000100:00100000:1.0:1789429526.119123:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429526.120652:0:25959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635159680 00000100:00100000:0.0:1789429526.120665:0:25959:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635159680 00002000:00100000:0.0:1789429526.120719:0:25959:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_017: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946f29da9f80 x1876351635159680/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.120730:0:25959:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da9f80 with x1876351635159680 ext(46137344->47185919) 00002000:00010000:0.0:1789429526.120737:0:25959:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da9f80 00000100:00100000:0.0:1789429526.120770:0:25959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11879 00000100:00100000:0.0:1789429526.120780:0:25959:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:12e09781-3d24-4c67-9972-bb781900e20d+12:2370:x1876351635159680:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429526.125130:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2371:x1876351635158784:12345-192.168.203.39@tcp:3:dd.0 Request processed in 89079us (89455us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.125142:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11872 00002000:00100000:1.0:1789429526.125155:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (38797312->39845887) req@ffff946f1c009180 x1876351635158784/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.125165:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c009180 with x1876351635158784 ext(38797312->39845887) 00002000:00010000:1.0:1789429526.125172:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c009180 00000100:00100000:3.0:1789429526.126034:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2371:x1876351635158528:12345-192.168.203.39@tcp:3:dd.0 Request processed in 93610us (97497us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429526.126053:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11871 00002000:00100000:3.0:1789429526.126063:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (36700160->37748735) req@ffff946f34070e00 x1876351635158528/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.126081:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070e00 with x1876351635158528 ext(36700160->37748735) 00002000:00010000:3.0:1789429526.126086:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34070e00 00000100:00100000:1.0:1789429526.126323:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429526.128250:0:19371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635159808 00000100:00100000:2.0:1789429526.128265:0:19371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635159808 00002000:00100000:2.0:1789429526.128320:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f29da8700 x1876351635159808/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429526.128333:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8700 with x1876351635159808 ext(47185920->48234495) 00002000:00010000:2.0:1789429526.128339:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da8700 00000100:00100000:2.0:1789429526.128382:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11880 00000100:00100000:2.0:1789429526.128393:0:19371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+14:2371:x1876351635159808:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429526.131677:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429526.132184:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635159936 00000100:00100000:3.0:1789429526.132194:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635159936 00002000:00100000:3.0:1789429526.132277:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f087be300 x1876351635159936/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.132288:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087be300 with x1876351635159936 ext(48234496->49283071) 00002000:00010000:3.0:1789429526.132294:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087be300 00000100:00100000:3.0:1789429526.132328:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11881 00000100:00100000:3.0:1789429526.132355:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+16:2370:x1876351635159936:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429526.140674:0:25958:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351635158400:12345-192.168.203.39@tcp:3:dd.0 Request processed in 110296us (112182us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429526.140687:0:25958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11869 00002000:00100000:3.0:1789429526.140700:0:25958:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x39:0x0] (35651584->36700159) req@ffff946f34070a80 x1876351635158400/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.140711:0:25958:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34070a80 with x1876351635158400 ext(35651584->36700159) 00002000:00010000:3.0:1789429526.140718:0:25958:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34070a80 00000100:00100000:1.0:1789429526.141889:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429526.141930:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429526.141962:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429526.141963:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635160064 00000100:00100000:2.0:1789429526.141972:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635160064 00002000:00100000:2.0:1789429526.142013:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946f29da8000 x1876351635160064/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429526.142024:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8000 with x1876351635160064 ext(49283072->50331647) 00002000:00010000:2.0:1789429526.142030:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da8000 00000100:00100000:0.0:1789429526.142035:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635160192 00000100:00100000:0.0:1789429526.142039:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635160192 00000100:00100000:2.0:1789429526.142055:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635160320 00000100:00100000:2.0:1789429526.142058:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635160320 00002000:00100000:0.0:1789429526.142060:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f29da8e00 x1876351635160192/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.142068:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8e00 with x1876351635160192 ext(50331648->51380223) 00002000:00100000:2.0:1789429526.142070:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946f29da9c00 x1876351635160320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00010000:0.0:1789429526.142071:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da8e00 00002000:00100000:2.0:1789429526.142078:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da9c00 with x1876351635160320 ext(42991616->44040191) 00002000:00010000:2.0:1789429526.142081:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da9c00 00000100:00100000:0.0:1789429526.142085:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11882 00000100:00100000:0.0:1789429526.142138:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+19:2370:x1876351635160064:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429526.147567:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11883 00000100:00100000:2.0:1789429526.147589:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+20:2369:x1876351635160192:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429526.148077:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11884 00000100:00100000:0.0:1789429526.148090:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351635160320:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429526.156317:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351635158912:12345-192.168.203.39@tcp:3:dd.0 Request processed in 119648us (120490us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429526.156331:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11873 00002000:00100000:3.0:1789429526.156343:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (39845888->40894463) req@ffff946f29da9180 x1876351635158912/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.156371:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da9180 with x1876351635158912 ext(39845888->40894463) 00002000:00010000:3.0:1789429526.156377:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da9180 00000100:00100000:0.0:1789429526.157402:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429526.157442:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429526.157462:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429526.157499:0:25958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635160448 00000100:00100000:0.0:1789429526.157506:0:25958:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635160448 00002000:00100000:0.0:1789429526.157546:0:25958:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946f087b1880 x1876351635160448/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.157555:0:25958:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b1880 with x1876351635160448 ext(44040192->45088767) 00002000:00010000:0.0:1789429526.157560:0:25958:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b1880 00000100:00100000:0.0:1789429526.157576:0:25958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635160576 00000100:00100000:0.0:1789429526.157580:0:25958:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635160576 00002000:00100000:0.0:1789429526.157594:0:25958:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f087b2d80 x1876351635160576/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.157601:0:25958:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b2d80 with x1876351635160576 ext(51380224->52428799) 00002000:00010000:0.0:1789429526.157604:0:25958:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b2d80 00000100:00100000:3.0:1789429526.157610:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29daad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+11:2371:x1876351635159168:12345-192.168.203.39@tcp:3:dd.0 Request processed in 120940us (121873us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429526.157616:0:25958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635160704 00000100:00100000:0.0:1789429526.157618:0:25958:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635160704 00000100:00100000:3.0:1789429526.157618:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11874 00002000:00100000:3.0:1789429526.157625:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (41943040->42991615) req@ffff946f29daad80 x1876351635159168/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.157629:0:25958:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946f087b3800 x1876351635160704/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.157636:0:25958:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b3800 with x1876351635160704 ext(45088768->46137343) 00002000:00010000:0.0:1789429526.157639:0:25958:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b3800 00000100:00100000:0.0:1789429526.157652:0:25958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11885 00000100:00100000:0.0:1789429526.157661:0:25958:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351635160448:12345-192.168.203.39@tcp:3:dd.0 00002000:00100000:3.0:1789429526.157706:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29daad80 with x1876351635159168 ext(41943040->42991615) 00002000:00010000:3.0:1789429526.157710:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29daad80 00000100:00100000:3.0:1789429526.157729:0:18636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11886 00000100:00100000:3.0:1789429526.157737:0:18636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+22:2370:x1876351635160576:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429526.158182:0:20672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11887 00000100:00100000:0.0:1789429526.158190:0:20672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351635160704:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:2.0:1789429526.170641:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429526.170765:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2371:x1876351635159040:12345-192.168.203.39@tcp:3:dd.0 Request processed in 133638us (134988us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.170778:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11875 00002000:00100000:1.0:1789429526.170794:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (40894464->41943039) req@ffff946f29dab480 x1876351635159040/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.170805:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29dab480 with x1876351635159040 ext(40894464->41943039) 00002000:00010000:1.0:1789429526.170812:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29dab480 00000100:00100000:1.0:1789429526.170839:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635160832 00000100:00100000:1.0:1789429526.170847:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635160832 00002000:00100000:1.0:1789429526.171070:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946f087bea00 x1876351635160832/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.171078:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bea00 with x1876351635160832 ext(46137344->47185919) 00002000:00010000:1.0:1789429526.171081:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bea00 00000100:00100000:1.0:1789429526.171106:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11888 00000100:00100000:1.0:1789429526.171116:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351635160832:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429526.172388:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:12e09781-3d24-4c67-9972-bb781900e20d+21:2371:x1876351635159296:12345-192.168.203.39@tcp:3:dd.0 Request processed in 128237us (128916us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.172397:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11876 00002000:00100000:1.0:1789429526.172406:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946f087bf100 x1876351635159296/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.172417:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bf100 with x1876351635159296 ext(42991616->44040191) 00002000:00010000:1.0:1789429526.172422:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bf100 00000100:00100000:2.0:1789429526.173267:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429526.173538:0:19374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635160960 00000100:00100000:3.0:1789429526.173546:0:19374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635160960 00002000:00100000:3.0:1789429526.173582:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f087be680 x1876351635160960/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.173592:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087be680 with x1876351635160960 ext(47185920->48234495) 00002000:00010000:3.0:1789429526.173597:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087be680 00000100:00100000:3.0:1789429526.173626:0:19374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11889 00000100:00100000:3.0:1789429526.174006:0:19374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351635160960:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429526.182033:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429526.182054:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648410496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429526.182111:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429526.182265:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648410496 00000100:00100000:1.0:1789429526.182272:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648410496 00000100:00100000:1.0:1789429526.182317:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1789429526.182324:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648410496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429526.182363:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429526.182407:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648410496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429526.182413:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1789429526.182453:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648410496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429526.183014:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+20:2370:x1876351635159424:12345-192.168.203.39@tcp:3:dd.0 Request processed in 118096us (118446us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429526.183023:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11877 00002000:00100000:3.0:1789429526.183033:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946f34072d80 x1876351635159424/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.183043:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34072d80 with x1876351635159424 ext(44040192->45088767) 00002000:00010000:3.0:1789429526.183049:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34072d80 00000100:00100000:0.0:1789429526.183289:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429526.183584:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635161088 00000100:00100000:3.0:1789429526.183590:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635161088 00002000:00100000:3.0:1789429526.183621:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f087b3480 x1876351635161088/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.183632:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b3480 with x1876351635161088 ext(48234496->49283071) 00002000:00010000:3.0:1789429526.183635:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b3480 00000100:00100000:3.0:1789429526.183659:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11890 00000100:00100000:3.0:1789429526.183667:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351635161088:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429526.184772:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789429526.184791:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648410624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429526.184844:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429526.184909:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648410624 00000100:00100000:1.0:1789429526.184914:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648410624 00000100:00100000:1.0:1789429526.185070:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1789429526.185079:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648410624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429526.185106:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 560660480 pending 0 free 3803185152 avail 3801088000 00000100:00100000:1.0:1789429526.185147:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648410624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429526.185153:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1789429526.185219:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648410624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429526.186685:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429526.186911:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635161216 00000100:00100000:1.0:1789429526.186920:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635161216 00002000:00100000:1.0:1789429526.187076:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946f34073b80 x1876351635161216/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.187088:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073b80 with x1876351635161216 ext(49283072->50331647) 00002000:00010000:1.0:1789429526.187094:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34073b80 00000100:00100000:1.0:1789429526.187128:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11891 00000100:00100000:1.0:1789429526.187137:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351635161216:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429526.193572:0:15069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:12e09781-3d24-4c67-9972-bb781900e20d+18:2370:x1876351635159552:12345-192.168.203.39@tcp:3:dd.0 Request processed in 113866us (114138us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.193586:0:15069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11878 00002000:00100000:1.0:1789429526.193599:0:15069:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946f34073800 x1876351635159552/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.193609:0:15069:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073800 with x1876351635159552 ext(45088768->46137343) 00002000:00010000:1.0:1789429526.193615:0:15069:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34073800 00000100:00100000:0.0:1789429526.202923:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429526.203876:0:19375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635161344 00000100:00100000:2.0:1789429526.203888:0:19375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635161344 00002000:00100000:2.0:1789429526.203938:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f09629880 x1876351635161344/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429526.203949:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f09629880 with x1876351635161344 ext(50331648->51380223) 00002000:00010000:2.0:1789429526.203956:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f09629880 00000100:00100000:2.0:1789429526.203992:0:19375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11892 00000100:00100000:2.0:1789429526.204002:0:19375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351635161344:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:1.0:1789429526.213697:0:19371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:12e09781-3d24-4c67-9972-bb781900e20d+15:2371:x1876351635159808:12345-192.168.203.39@tcp:3:dd.0 Request processed in 85299us (87367us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429526.213697:0:25959:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_017:12e09781-3d24-4c67-9972-bb781900e20d+15:2370:x1876351635159680:12345-192.168.203.39@tcp:3:dd.0 Request processed in 92909us (94575us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429526.213710:0:25959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11879 00002000:00100000:3.0:1789429526.213727:0:25959:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_017: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946f29da9f80 x1876351635159680/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.213736:0:25959:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da9f80 with x1876351635159680 ext(46137344->47185919) 00002000:00010000:3.0:1789429526.213743:0:25959:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da9f80 00000100:00100000:3.0:1789429526.213868:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:12e09781-3d24-4c67-9972-bb781900e20d+13:2370:x1876351635159936:12345-192.168.203.39@tcp:3:dd.0 Request processed in 81522us (82199us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.215553:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11880 00002000:00100000:1.0:1789429526.215569:0:19371:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f29da8700 x1876351635159808/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.215579:0:19371:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8700 with x1876351635159808 ext(47185920->48234495) 00002000:00010000:1.0:1789429526.215583:0:19371:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da8700 00000100:00100000:3.0:1789429526.220684:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11881 00002000:00100000:3.0:1789429526.220706:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f087be300 x1876351635159936/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.220718:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087be300 with x1876351635159936 ext(48234496->49283071) 00002000:00010000:3.0:1789429526.220725:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087be300 00000100:00100000:0.0:1789429526.237539:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429526.238180:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351635160320:12345-192.168.203.39@tcp:3:dd.0 Request processed in 90092us (96214us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429526.238193:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11884 00002000:00100000:0.0:1789429526.238230:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (42991616->44040191) req@ffff946f29da9c00 x1876351635160320/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.238242:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da9c00 with x1876351635160320 ext(42991616->44040191) 00002000:00010000:0.0:1789429526.238249:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da9c00 00000100:00100000:0.0:1789429526.238275:0:20973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635161472 00000100:00100000:0.0:1789429526.238282:0:20973:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635161472 00002000:00100000:0.0:1789429526.238318:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f0962b800 x1876351635161472/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/0 e 0 to 0 dl 1789429537 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.238326:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0962b800 with x1876351635161472 ext(51380224->52428799) 00002000:00010000:0.0:1789429526.238329:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0962b800 00000100:00100000:0.0:1789429526.238380:0:20973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11893 00000100:00100000:0.0:1789429526.238390:0:20973:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2371:x1876351635161472:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:3.0:1789429526.239055:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:12e09781-3d24-4c67-9972-bb781900e20d+10:2370:x1876351635160064:12345-192.168.203.39@tcp:3:dd.0 Request processed in 96960us (97168us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429526.239064:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11882 00002000:00100000:3.0:1789429526.239071:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946f29da8000 x1876351635160064/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.239079:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8000 with x1876351635160064 ext(49283072->50331647) 00002000:00010000:3.0:1789429526.239083:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da8000 00000100:00100000:2.0:1789429526.244516:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:12e09781-3d24-4c67-9972-bb781900e20d+8:2369:x1876351635160192:12345-192.168.203.39@tcp:3:dd.0 Request processed in 96926us (102575us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429526.244528:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11883 00002000:00100000:2.0:1789429526.244539:0:18633:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f29da8e00 x1876351635160192/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429526.244554:0:18633:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29da8e00 with x1876351635160192 ext(50331648->51380223) 00002000:00010000:2.0:1789429526.244560:0:18633:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f29da8e00 00000100:00100000:1.0:1789429526.248114:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351635160832:12345-192.168.203.39@tcp:3:dd.0 Request processed in 76988us (77805us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.248128:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11888 00002000:00100000:1.0:1789429526.248140:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x39:0x0] (46137344->47185919) req@ffff946f087bea00 x1876351635160832/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.248148:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087bea00 with x1876351635160832 ext(46137344->47185919) 00002000:00010000:1.0:1789429526.248155:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087bea00 00000100:00100000:1.0:1789429526.248294:0:19374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+18:2370:x1876351635160960:12345-192.168.203.39@tcp:3:dd.0 Request processed in 74659us (75030us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.248301:0:19374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11889 00002000:00100000:1.0:1789429526.248306:0:19374:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x39:0x0] (47185920->48234495) req@ffff946f087be680 x1876351635160960/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.248315:0:19374:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087be680 with x1876351635160960 ext(47185920->48234495) 00002000:00010000:1.0:1789429526.248318:0:19374:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087be680 00000100:00100000:2.0:1789429526.248580:0:20672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+16:2370:x1876351635160704:12345-192.168.203.39@tcp:3:dd.0 Request processed in 90388us (91114us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1789429526.248588:0:20672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11887 00002000:00100000:2.0:1789429526.248595:0:20672:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x39:0x0] (45088768->46137343) req@ffff946f087b3800 x1876351635160704/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429526.248603:0:20672:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b3800 with x1876351635160704 ext(45088768->46137343) 00002000:00010000:2.0:1789429526.248607:0:20672:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b3800 00000100:00100000:0.0:1789429526.249585:0:25958:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+14:2370:x1876351635160448:12345-192.168.203.39@tcp:3:dd.0 Request processed in 91920us (92182us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429526.249595:0:25958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11885 00002000:00100000:0.0:1789429526.249602:0:25958:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x39:0x0] (44040192->45088767) req@ffff946f087b1880 x1876351635160448/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.249616:0:25958:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b1880 with x1876351635160448 ext(44040192->45088767) 00002000:00010000:0.0:1789429526.249621:0:25958:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b1880 00000100:00100000:0.0:1789429526.254163:0:18636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635160576:12345-192.168.203.39@tcp:3:dd.0 Request processed in 96417us (96710us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429526.254189:0:18636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11886 00002000:00100000:0.0:1789429526.254234:0:18636:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f087b2d80 x1876351635160576/t0(0) o3->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.254244:0:18636:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b2d80 with x1876351635160576 ext(51380224->52428799) 00002000:00010000:0.0:1789429526.254250:0:18636:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b2d80 00000100:00100000:3.0:1789429526.260615:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+12:2370:x1876351635161088:12345-192.168.203.39@tcp:3:dd.0 Request processed in 76937us (77316us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1789429526.260628:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11890 00002000:00100000:3.0:1789429526.260641:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x39:0x0] (48234496->49283071) req@ffff946f087b3480 x1876351635161088/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429526.260651:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f087b3480 with x1876351635161088 ext(48234496->49283071) 00002000:00010000:3.0:1789429526.260658:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f087b3480 00000100:00100000:1.0:1789429526.282908:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+10:2370:x1876351635161216:12345-192.168.203.39@tcp:3:dd.0 Request processed in 95761us (96218us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1789429526.282921:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11891 00002000:00100000:1.0:1789429526.282934:0:18658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x39:0x0] (49283072->50331647) req@ffff946f34073b80 x1876351635161216/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429526.282945:0:18658:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f34073b80 with x1876351635161216 ext(49283072->50331647) 00002000:00010000:1.0:1789429526.282951:0:18658:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f34073b80 00000100:00100000:0.0:1789429526.283585:0:20973:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_015:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+8:2371:x1876351635161472:12345-192.168.203.39@tcp:3:dd.0 Request processed in 45193us (46055us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429526.283594:0:20973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11893 00002000:00100000:0.0:1789429526.283601:0:20973:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_015: refresh rw locks for [0x240000400:0x39:0x0] (51380224->52428799) req@ffff946f0962b800 x1876351635161472/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.283611:0:20973:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f0962b800 with x1876351635161472 ext(51380224->52428799) 00002000:00010000:0.0:1789429526.283615:0:20973:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f0962b800 00000100:00100000:0.0:1789429526.284618:0:19375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635161344:12345-192.168.203.39@tcp:3:dd.0 Request processed in 80611us (81699us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1789429526.284628:0:19375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11892 00002000:00100000:0.0:1789429526.284637:0:19375:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x39:0x0] (50331648->51380223) req@ffff946f09629880 x1876351635161344/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:262/0 lens 488/440 e 0 to 0 dl 1789429537 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429526.284646:0:19375:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f09629880 with x1876351635161344 ext(50331648->51380223) 00002000:00010000:0.0:1789429526.284652:0:19375:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f09629880 00000100:00100000:2.0:1789429526.317422:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429526.317553:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635161728 00000100:00100000:1.0:1789429526.317563:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635161728 00000100:00100000:1.0:1789429526.317623:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 291 00000100:00080000:2.0:1789429526.317759:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429526.317822:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+34:44724:x1876351635161728:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:1.0:1789429526.318060:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+35:44724:x1876351635161728:12345-192.168.203.39@tcp:35:dd.0 Request processed in 428us (646us total) trans 4294977254 rc 0/0 00000100:00100000:1.0:1789429526.318071:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 291 00000100:00100000:2.0:1789429526.320363:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429526.320442:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635161984 00000100:00100000:3.0:1789429526.320451:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635161984 00000100:00100000:3.0:1789429526.320521:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 292 00000100:00100000:3.0:1789429526.320531:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:44725:x1876351635161984:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:3.0:1789429526.320761:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:44725:x1876351635161984:12345-192.168.203.39@tcp:35:dd.0 Request processed in 223us (409us total) trans 4294977255 rc 0/0 00000100:00100000:3.0:1789429526.320768:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 292 00000100:00080000:2.0:1789429526.320931:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789429526.755410:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429527.185914:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429527.188448:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635162240 00000100:00100000:3.0:1789429527.188462:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635162240 00000100:00100000:3.0:1789429527.193431:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21358 00000100:00100000:3.0:1789429527.193455:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+35:44735:x1876351635162240:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429527.193480:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429527.193502:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726361fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cae3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429527.193599:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c400/0xb4c3dad726361fc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429527.193614:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c400/0xb4c3dad726361fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429527.193629:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c400/0xb4c3dad726361fc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429527.193641:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8a:0x0]: returning size 52428800 00010000:00010000:3.0:1789429527.193757:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726361fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cae3 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429527.193776:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c400/0xb4c3dad726361fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cae3 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429527.193785:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:3.0:1789429527.193788:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789429527.193791:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31c400, rc 0) 00000100:00100000:3.0:1789429527.193866:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+37:44735:x1876351635162240:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 422us (7961us total) trans 4294977256 rc 0/0 00000100:00100000:3.0:1789429527.193877:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21358 00010000:00010000:3.0:1789429527.779371:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429528.803432:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429529.154411:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.154517:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635162368 00000100:00100000:0.0:1789429529.154531:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635162368 00000100:00100000:0.0:1789429529.154617:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5870 00000100:00100000:0.0:1789429529.154630:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635162368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.154652:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.154678:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726361fd2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1caea expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.154720:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1789429529.154737:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726361fd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1052671] (req 0->1052671) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caea expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.154754:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a90d82a/0xb4c3dad726361fd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->1052671] (req 0->1052671) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caea expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.154768:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2acc00, rc -11) 00000100:00100000:0.0:1789429529.154850:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635162368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 222us (454us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.154857:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5870 00000100:00080000:1.0:1789429529.154982:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429529.170188:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429529.170298:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635162496 00000100:00100000:1.0:1789429529.170312:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635162496 00000100:00100000:1.0:1789429529.170390:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5871 00000100:00100000:1.0:1789429529.170400:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635162496:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429529.170423:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429529.170446:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361fd9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1caf1 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.170484:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789429529.170498:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361fd9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->2101247] (req 0->2101247) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caf1 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.170515:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361fd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->2101247] (req 0->2101247) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caf1 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.170527:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc -11) 00000100:00100000:1.0:1789429529.170597:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635162496:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 198us (424us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789429529.170604:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5871 00000100:00100000:3.0:1789429529.201621:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429529.201945:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635162624 00000100:00100000:2.0:1789429529.201959:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635162624 00000100:00100000:0.0:1789429529.206041:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5872 00000100:00100000:0.0:1789429529.206063:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635162624:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.206089:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.206116:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726361fe0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1caf8 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.206314:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1789429529.206342:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726361fe0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 0->3149823) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caf8 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.206361:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726361fe0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->3149823] (req 0->3149823) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caf8 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.206375:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc -11) 00000100:00100000:0.0:1789429529.209710:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635162624:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3636us (8086us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.209727:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5872 00000100:00100000:2.0:1789429529.235529:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429529.235571:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.236162:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635162752 00000100:00100000:3.0:1789429529.236177:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635162752 00000100:00100000:3.0:1789429529.236272:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635162880 00000100:00100000:3.0:1789429529.236275:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635162880 00000100:00100000:3.0:1789429529.236303:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5873 00000100:00100000:3.0:1789429529.236315:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635162752:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.236349:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.236375:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726361fe7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1caff expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.236413:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(3 0) 00010000:00010000:3.0:1789429529.236429:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726361fe7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->4198399] (req 0->4198399) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caff expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.236446:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726361fe7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->4198399] (req 0->4198399) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1caff expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.236460:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31c000, rc -11) 00000100:00100000:3.0:1789429529.236534:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635162752:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 221us (1018us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.236541:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5873 00000100:00100000:3.0:1789429529.236562:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5874 00000100:00100000:3.0:1789429529.236570:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635162880:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.236578:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.236586:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fa4c768/0xb4c3dad726361fee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb06 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.236599:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(4 0) 00010000:00010000:3.0:1789429529.236606:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000004fa4c768/0xb4c3dad726361fee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->5246975] (req 0->5246975) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb06 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.236616:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fa4c768/0xb4c3dad726361fee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->5246975] (req 0->5246975) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb06 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.236625:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d400, rc -11) 00000100:00100000:3.0:1789429529.236646:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635162880:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 78us (1076us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.236653:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5874 00000100:00100000:0.0:1789429529.266422:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.268336:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635163008 00000100:00100000:3.0:1789429529.268357:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635163008 00000100:00100000:3.0:1789429529.268438:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5875 00000100:00100000:3.0:1789429529.268452:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635163008:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.268477:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.268503:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079968f50/0xb4c3dad726361ff5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb0d expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.268541:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(5 0) 00010000:00010000:3.0:1789429529.268558:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000079968f50/0xb4c3dad726361ff5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->6295551] (req 0->6295551) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb0d expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.268582:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079968f50/0xb4c3dad726361ff5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->6295551] (req 0->6295551) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb0d expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.268599:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d200, rc -11) 00000100:00100000:3.0:1789429529.274084:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635163008:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 5614us (7652us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.274102:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5875 00000100:00100000:3.0:1789429529.281192:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429529.282126:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635163136 00000100:00100000:1.0:1789429529.282142:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635163136 00000100:00100000:1.0:1789429529.282257:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5876 00000100:00100000:1.0:1789429529.282269:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635163136:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429529.282294:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429529.282320:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361ffc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb14 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.282370:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(6 0) 00010000:00010000:1.0:1789429529.282386:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361ffc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->7344127] (req 0->7344127) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb14 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.282403:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726361ffc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->7344127] (req 0->7344127) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb14 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.282416:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc -11) 00000100:00100000:1.0:1789429529.282495:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635163136:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 227us (1317us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789429529.282502:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5876 00000100:00100000:2.0:1789429529.292291:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.293264:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635163264 00000100:00100000:0.0:1789429529.293279:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635163264 00000100:00100000:0.0:1789429529.293358:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5877 00000100:00100000:0.0:1789429529.293371:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635163264:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.293395:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.293419:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362003 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb1b expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.293459:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(7 0) 00010000:00010000:0.0:1789429529.293475:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362003 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->8392703] (req 0->8392703) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb1b expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.293493:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362003 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->8392703] (req 0->8392703) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb1b expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.293506:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc -11) 00000100:00100000:0.0:1789429529.293592:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635163264:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 224us (1311us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.293601:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5877 00000100:00100000:3.0:1789429529.313378:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.313465:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635163392 00000100:00100000:0.0:1789429529.313483:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635163392 00000100:00100000:0.0:1789429529.313570:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5878 00000100:00100000:0.0:1789429529.313583:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635163392:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.313607:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.313633:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad72636200a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb22 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.313672:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(8 0) 00010000:00010000:0.0:1789429529.313691:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad72636200a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->9441279] (req 0->9441279) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb22 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.313712:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad72636200a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->9441279] (req 0->9441279) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb22 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.313727:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc -11) 00000100:00100000:0.0:1789429529.313819:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635163392:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 238us (448us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.313826:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5878 00000100:00100000:3.0:1789429529.328688:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.328949:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635163520 00000100:00100000:0.0:1789429529.328963:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635163520 00000100:00100000:0.0:1789429529.329046:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5879 00000100:00100000:0.0:1789429529.329059:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635163520:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.329082:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.329108:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362011 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb29 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.329155:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(9 0) 00010000:00010000:0.0:1789429529.329171:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362011 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->10489855] (req 0->10489855) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb29 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.329188:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362011 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->10489855] (req 0->10489855) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb29 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.329236:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc -11) 00000100:00100000:0.0:1789429529.329311:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635163520:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 255us (771us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.329319:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5879 00000100:00100000:0.0:1789429529.341353:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.341651:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635163648 00000100:00100000:3.0:1789429529.341664:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635163648 00000100:00100000:3.0:1789429529.341728:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5880 00000100:00100000:3.0:1789429529.341741:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635163648:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.341762:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.341786:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079968f50/0xb4c3dad726362018 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb30 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.341823:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(10 0) 00010000:00010000:3.0:1789429529.341848:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000079968f50/0xb4c3dad726362018 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->11538431] (req 0->11538431) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb30 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.341866:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079968f50/0xb4c3dad726362018 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->11538431] (req 0->11538431) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb30 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.341887:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d200, rc -11) 00000100:00100000:3.0:1789429529.341959:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635163648:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 219us (618us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.341966:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5880 00000100:00100000:2.0:1789429529.351396:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.351784:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635163776 00000100:00100000:0.0:1789429529.351798:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635163776 00000100:00100000:0.0:1789429529.351887:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5881 00000100:00100000:0.0:1789429529.351900:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635163776:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.351927:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.351955:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad72636201f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb37 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.352002:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(11 0) 00010000:00010000:0.0:1789429529.352021:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad72636201f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->12587007] (req 0->12587007) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb37 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.352039:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad72636201f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->12587007] (req 0->12587007) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb37 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.352054:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc -11) 00000100:00100000:0.0:1789429529.352135:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635163776:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 237us (753us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.352145:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5881 00000100:00100000:3.0:1789429529.360622:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.360688:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635163904 00000100:00100000:3.0:1789429529.360702:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635163904 00000100:00100000:3.0:1789429529.360763:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5882 00000100:00100000:3.0:1789429529.360775:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635163904:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.360799:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.360823:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079968f50/0xb4c3dad726362026 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb3e expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.360935:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(12 0) 00010000:00010000:3.0:1789429529.360951:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000079968f50/0xb4c3dad726362026 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->13635583] (req 0->13635583) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb3e expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.360970:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079968f50/0xb4c3dad726362026 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->13635583] (req 0->13635583) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb3e expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.360986:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d200, rc -11) 00000100:00100000:3.0:1789429529.361061:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635163904:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 287us (453us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.361069:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5882 00000001:00080000:3.0:1789429529.367797:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977253 is committed 00000001:00080000:3.0:1789429529.367817:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977252 is committed 00000001:00080000:3.0:1789429529.367823:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977254 is committed 00000001:00080000:3.0:1789429529.367833:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977256 is committed 00000001:00080000:3.0:1789429529.367838:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977255 is committed 00000100:00100000:3.0:1789429529.376918:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.377065:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635164032 00000100:00100000:3.0:1789429529.377077:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635164032 00000100:00100000:3.0:1789429529.377144:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5883 00000100:00100000:3.0:1789429529.377158:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635164032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.377181:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.377221:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad72636202d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb45 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.377258:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(13 0) 00010000:00010000:3.0:1789429529.377275:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad72636202d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->14684159] (req 0->14684159) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb45 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.377292:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad72636202d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->14684159] (req 0->14684159) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb45 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.377304:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31c000, rc -11) 00000100:00100000:3.0:1789429529.377389:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635164032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 234us (488us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.377397:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5883 00000100:00100000:2.0:1789429529.394951:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.395028:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635164160 00000100:00100000:3.0:1789429529.395042:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635164160 00000100:00100000:3.0:1789429529.395110:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5884 00000100:00100000:3.0:1789429529.395121:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635164160:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.395146:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.395182:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362034 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb4c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.395246:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(14 0) 00010000:00010000:3.0:1789429529.395262:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362034 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->15732735] (req 0->15732735) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb4c expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.395280:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362034 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->15732735] (req 0->15732735) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb4c expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.395295:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429529.395595:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635164160:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 474us (659us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.395604:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5884 00000100:00100000:2.0:1789429529.414735:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.414813:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635164288 00000100:00100000:3.0:1789429529.414828:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635164288 00000100:00100000:3.0:1789429529.414896:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5885 00000100:00100000:3.0:1789429529.414908:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635164288:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.414931:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.414955:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad72636203b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb53 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.414991:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(15 0) 00010000:00010000:3.0:1789429529.415006:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad72636203b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->16781311] (req 0->16781311) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb53 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.415023:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad72636203b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->16781311] (req 0->16781311) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb53 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.415036:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31c000, rc -11) 00000100:00100000:3.0:1789429529.415106:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635164288:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 201us (390us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.415114:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5885 00000100:00100000:2.0:1789429529.438690:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.439562:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635164416 00000100:00100000:0.0:1789429529.439578:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635164416 00000100:00100000:0.0:1789429529.439664:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5886 00000100:00100000:0.0:1789429529.439678:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635164416:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.439703:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.439727:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362042 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb5a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.439768:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(16 0) 00010000:00010000:0.0:1789429529.439782:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362042 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->17829887] (req 0->17829887) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb5a expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.439798:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362042 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->17829887] (req 0->17829887) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb5a expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.439818:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc -11) 00000100:00100000:0.0:1789429529.439907:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635164416:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 232us (1231us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.439916:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5886 00000100:00100000:2.0:1789429529.455808:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.460483:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635164544 00000100:00100000:3.0:1789429529.460506:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635164544 00000100:00100000:3.0:1789429529.460613:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5887 00000100:00100000:3.0:1789429529.460626:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635164544:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.460651:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.460677:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726362049 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb61 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.460720:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(17 0) 00010000:00010000:3.0:1789429529.460738:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726362049 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18878463] (req 0->18878463) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb61 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.460757:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726362049 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18878463] (req 0->18878463) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb61 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.460774:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31c000, rc -11) 00000100:00100000:3.0:1789429529.460920:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635164544:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 295us (5126us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.460929:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5887 00000100:00100000:2.0:1789429529.478991:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.479095:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635164672 00000100:00100000:3.0:1789429529.479109:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635164672 00000100:00100000:3.0:1789429529.479182:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5888 00000100:00100000:3.0:1789429529.479195:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635164672:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.479266:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.479291:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726362050 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb68 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.479339:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(18 0) 00010000:00010000:3.0:1789429529.479356:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726362050 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->19927039] (req 0->19927039) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb68 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.479374:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726362050 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->19927039] (req 0->19927039) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb68 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.479389:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31c000, rc -11) 00000100:00100000:3.0:1789429529.479471:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635164672:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 279us (494us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.479478:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5888 00000100:00100000:0.0:1789429529.489033:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.489313:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635164800 00000100:00100000:3.0:1789429529.489334:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635164800 00000100:00100000:3.0:1789429529.489397:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5889 00000100:00100000:3.0:1789429529.489409:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635164800:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.489434:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.489459:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726362057 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb6f expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.489500:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(19 0) 00010000:00010000:3.0:1789429529.489517:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726362057 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->20975615] (req 0->20975615) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb6f expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.489535:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002afd4425/0xb4c3dad726362057 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->20975615] (req 0->20975615) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb6f expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.489550:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31c000, rc -11) 00000100:00100000:3.0:1789429529.489693:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635164800:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 285us (674us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.489701:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5889 00000100:00100000:0.0:1789429529.523263:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.523410:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635164928 00000100:00100000:3.0:1789429529.523424:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635164928 00000100:00100000:3.0:1789429529.523496:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5890 00000100:00100000:3.0:1789429529.523508:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635164928:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.523533:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.523556:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636205e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb76 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.523594:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(20 0) 00010000:00010000:3.0:1789429529.523608:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636205e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->22024191] (req 0->22024191) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb76 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.523625:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636205e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->22024191] (req 0->22024191) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb76 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.523641:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429529.523722:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635164928:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 216us (473us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.523730:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5890 00000100:00100000:3.0:1789429529.545036:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.545188:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635165056 00000100:00100000:0.0:1789429529.545240:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635165056 00000100:00100000:0.0:1789429529.545329:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5891 00000100:00100000:0.0:1789429529.545342:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635165056:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.545368:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.545399:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad726362065 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb7d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.545443:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(21 0) 00010000:00010000:0.0:1789429529.545469:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad726362065 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->23072767] (req 0->23072767) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb7d expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.545489:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad726362065 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->23072767] (req 0->23072767) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb7d expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.545506:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc -11) 00000100:00100000:0.0:1789429529.545583:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635165056:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 242us (560us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.545590:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5891 00000100:00100000:2.0:1789429529.564082:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.564245:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635165184 00000100:00100000:3.0:1789429529.564258:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635165184 00000100:00100000:3.0:1789429529.564332:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5892 00000100:00100000:3.0:1789429529.564345:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635165184:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.564369:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.564394:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636206c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb84 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.564433:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(22 0) 00010000:00010000:3.0:1789429529.564449:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636206c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->24121343] (req 0->24121343) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb84 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.564472:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636206c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->24121343] (req 0->24121343) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb84 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.564488:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429529.564566:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635165184:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 224us (500us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.564574:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5892 00000100:00100000:2.0:1789429529.587151:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.588477:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635165312 00000100:00100000:0.0:1789429529.588494:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635165312 00000100:00100000:0.0:1789429529.588581:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5893 00000100:00100000:0.0:1789429529.588593:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635165312:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.588617:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.588644:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad726362073 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb8b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.588685:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(23 0) 00010000:00010000:0.0:1789429529.588704:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad726362073 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->25169919] (req 0->25169919) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb8b expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.588721:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad726362073 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->25169919] (req 0->25169919) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb8b expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.588737:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc -11) 00000100:00100000:0.0:1789429529.588828:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635165312:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 237us (1693us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.588836:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5893 00000100:00100000:1.0:1789429529.601434:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.601776:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635165440 00000100:00100000:0.0:1789429529.601791:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635165440 00000100:00100000:0.0:1789429529.601876:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5894 00000100:00100000:0.0:1789429529.601888:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635165440:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.601913:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.601937:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad72636207a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb92 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.601981:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(24 0) 00010000:00010000:0.0:1789429529.601998:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad72636207a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->26218495] (req 0->26218495) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb92 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.602016:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad72636207a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->26218495] (req 0->26218495) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb92 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.602034:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc -11) 00000100:00100000:0.0:1789429529.602416:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635165440:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 528us (1005us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.602425:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5894 00000100:00100000:2.0:1789429529.613355:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.613503:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635165568 00000100:00100000:3.0:1789429529.613517:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635165568 00000100:00100000:3.0:1789429529.613595:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5895 00000100:00100000:3.0:1789429529.613608:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635165568:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.613630:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.613654:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362081 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cb99 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.613696:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(25 0) 00010000:00010000:3.0:1789429529.613712:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362081 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->27267071] (req 0->27267071) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb99 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.613729:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362081 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->27267071] (req 0->27267071) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cb99 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.613742:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429529.613818:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635165568:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 214us (480us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.613826:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5895 00000100:00100000:2.0:1789429529.635995:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.637872:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635165696 00000100:00100000:0.0:1789429529.637894:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635165696 00000100:00100000:0.0:1789429529.638049:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5896 00000100:00100000:0.0:1789429529.638062:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635165696:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.638084:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.638118:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad726362088 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cba0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.638164:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(26 0) 00010000:00010000:0.0:1789429529.638180:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad726362088 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->28315647] (req 0->28315647) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cba0 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.638196:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad726362088 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->28315647] (req 0->28315647) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cba0 expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.638233:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc -11) 00000100:00100000:0.0:1789429529.638313:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635165696:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 254us (2333us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.638330:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5896 00000100:00100000:1.0:1789429529.657624:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.657718:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635165824 00000100:00100000:3.0:1789429529.657733:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635165824 00000100:00100000:3.0:1789429529.657844:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5897 00000100:00100000:3.0:1789429529.658631:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635165824:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.658673:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.658699:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636208f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cba7 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.658736:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(27 0) 00010000:00010000:3.0:1789429529.658753:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636208f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->29364223] (req 0->29364223) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cba7 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.658768:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636208f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->29364223] (req 0->29364223) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cba7 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.658782:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429529.658859:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635165824:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1005us (1250us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.658872:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5897 00000100:00100000:2.0:1789429529.679677:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429529.680143:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635165952 00000100:00100000:1.0:1789429529.680154:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635165952 00000100:00100000:1.0:1789429529.680226:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5898 00000100:00100000:1.0:1789429529.680236:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635165952:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429529.680255:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429529.680273:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad726362096 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbae expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.680308:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(28 0) 00010000:00010000:1.0:1789429529.680331:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad726362096 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->30412799] (req 0->30412799) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbae expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.680345:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad726362096 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->30412799] (req 0->30412799) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbae expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.680358:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc -11) 00000100:00100000:1.0:1789429529.680421:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635165952:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 186us (753us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789429529.680428:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5898 00000100:00100000:2.0:1789429529.704594:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.704683:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635166080 00000100:00100000:3.0:1789429529.704693:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635166080 00000100:00100000:3.0:1789429529.704755:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5899 00000100:00100000:3.0:1789429529.704765:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635166080:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.704783:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.704802:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636209d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbb5 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.704834:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(29 0) 00010000:00010000:3.0:1789429529.704848:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636209d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->31461375] (req 0->31461375) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbb5 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.704876:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636209d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->31461375] (req 0->31461375) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbb5 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.704894:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429529.704969:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635166080:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 204us (384us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.704977:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5899 00000100:00100000:2.0:1789429529.747311:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.747491:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635166208 00000100:00100000:0.0:1789429529.747502:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635166208 00000100:00100000:0.0:1789429529.747561:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5900 00000100:00100000:0.0:1789429529.747571:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635166208:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.747589:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.747606:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263620a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbbc expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.747646:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(30 0) 00010000:00010000:0.0:1789429529.747661:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263620a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->32509951] (req 0->32509951) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbbc expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.747675:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263620a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->32509951] (req 0->32509951) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbbc expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.747687:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc -11) 00000100:00100000:0.0:1789429529.747746:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635166208:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 177us (446us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.747754:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5900 00000100:00100000:2.0:1789429529.774425:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.774570:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635166336 00000100:00100000:3.0:1789429529.774580:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635166336 00000100:00100000:3.0:1789429529.774646:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5901 00000100:00100000:3.0:1789429529.774664:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635166336:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.774682:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.774701:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbc3 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.774730:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(31 0) 00010000:00010000:3.0:1789429529.774744:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->33558527] (req 0->33558527) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbc3 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.774757:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->33558527] (req 0->33558527) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbc3 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.774770:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429529.774964:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635166336:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 307us (546us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.774971:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5901 00000100:00100000:2.0:1789429529.800341:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.803375:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635166464 00000100:00100000:0.0:1789429529.803391:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635166464 00000100:00100000:0.0:1789429529.803520:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5902 00000100:00100000:0.0:1789429529.803532:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635166464:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.803548:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.803568:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263620b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbca expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.803597:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(32 0) 00010000:00010000:0.0:1789429529.803609:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263620b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->34607103] (req 0->34607103) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbca expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.803623:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263620b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->34607103] (req 0->34607103) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbca expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.803647:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc -11) 00000100:00100000:0.0:1789429529.803714:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635166464:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 185us (3383us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.803722:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5902 00000100:00100000:2.0:1789429529.825804:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:3.0:1789429529.830003:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429529.837054:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635166592 00000100:00100000:0.0:1789429529.837069:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635166592 00000100:00100000:1.0:1789429529.838824:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5903 00000100:00100000:1.0:1789429529.838836:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635166592:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429529.838852:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429529.838870:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad7263620b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbd1 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.838915:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(33 0) 00010000:00010000:1.0:1789429529.838928:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad7263620b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->35655679] (req 0->35655679) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbd1 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.838941:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad7263620b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->35655679] (req 0->35655679) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbd1 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.838959:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc -11) 00000100:00100000:1.0:1789429529.839023:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635166592:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 190us (13229us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789429529.839029:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5903 00000100:00100000:2.0:1789429529.845486:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.845620:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635166720 00000100:00100000:3.0:1789429529.845631:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635166720 00000100:00100000:3.0:1789429529.845797:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5904 00000100:00100000:3.0:1789429529.845809:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635166720:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.845825:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.845843:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbd8 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.845870:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(34 0) 00010000:00010000:3.0:1789429529.845892:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->36704255] (req 0->36704255) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbd8 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.845914:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->36704255] (req 0->36704255) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbd8 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.845927:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429529.845985:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635166720:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 178us (508us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.845992:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5904 00000100:00100000:2.0:1789429529.873159:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429529.873389:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635166848 00000100:00100000:1.0:1789429529.873401:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635166848 00000100:00100000:1.0:1789429529.873457:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5905 00000100:00100000:1.0:1789429529.873467:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635166848:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429529.873484:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429529.873614:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad7263620c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbdf expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.873644:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(35 0) 00010000:00010000:1.0:1789429529.873657:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad7263620c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->37752831] (req 0->37752831) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbdf expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.873670:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad7263620c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->37752831] (req 0->37752831) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbdf expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.873683:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc -11) 00000100:00100000:1.0:1789429529.873748:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635166848:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 282us (611us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789429529.873755:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5905 00000100:00100000:2.0:1789429529.919247:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.919339:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635166976 00000100:00100000:0.0:1789429529.919350:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635166976 00000100:00100000:0.0:1789429529.919452:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5906 00000100:00100000:0.0:1789429529.919463:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635166976:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.919481:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.919508:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263620ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbe6 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.919542:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(36 0) 00010000:00010000:0.0:1789429529.919555:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263620ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->38801407] (req 0->38801407) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbe6 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.919568:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263620ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->38801407] (req 0->38801407) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbe6 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.919581:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc -11) 00000100:00100000:0.0:1789429529.919642:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635166976:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 180us (402us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.919649:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5906 00000100:00100000:2.0:1789429529.944389:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429529.944617:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635167104 00000100:00100000:0.0:1789429529.944627:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635167104 00000100:00100000:0.0:1789429529.944688:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5907 00000100:00100000:0.0:1789429529.944699:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635167104:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1789429529.944715:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429529.944732:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007215c1bd/0xb4c3dad7263620d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbed expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.944762:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(37 0) 00010000:00010000:0.0:1789429529.944775:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000007215c1bd/0xb4c3dad7263620d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->39849983] (req 0->39849983) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbed expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.944791:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007215c1bd/0xb4c3dad7263620d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->39849983] (req 0->39849983) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbed expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429529.944810:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad600, rc -11) 00000100:00100000:0.0:1789429529.944873:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635167104:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 176us (494us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789429529.944890:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5907 00000100:00100000:2.0:1789429529.960076:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.960711:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635167232 00000100:00100000:3.0:1789429529.960722:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635167232 00000100:00100000:3.0:1789429529.960780:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5908 00000100:00100000:3.0:1789429529.960791:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635167232:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429529.960808:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429529.960826:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbf4 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.960858:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(38 0) 00010000:00010000:3.0:1789429529.960873:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->40898559] (req 0->40898559) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbf4 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.960896:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->40898559] (req 0->40898559) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbf4 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429529.960908:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429529.960971:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635167232:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 181us (905us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429529.960979:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5908 00000100:00100000:2.0:1789429529.975001:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429529.975099:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635167360 00000100:00100000:1.0:1789429529.975109:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635167360 00000100:00100000:1.0:1789429529.975164:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5909 00000100:00100000:1.0:1789429529.975174:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635167360:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429529.975191:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429529.975250:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad7263620e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cbfb expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.975288:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(39 0) 00010000:00010000:1.0:1789429529.975300:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad7263620e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->41947135] (req 0->41947135) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbfb expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.975328:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000416dad11/0xb4c3dad7263620e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->41947135] (req 0->41947135) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cbfb expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429529.975340:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4c00, rc -11) 00000100:00100000:1.0:1789429529.975389:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635167360:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 217us (399us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789429529.975396:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5909 00000100:00100000:0.0:1789429529.988090:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429529.991065:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635167488 00000100:00100000:3.0:1789429529.991078:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635167488 00000100:00100000:2.0:1789429529.991253:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5910 00000100:00100000:2.0:1789429529.991264:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635167488:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1789429529.991281:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429529.991300:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061c418f7/0xb4c3dad7263620ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc02 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429529.991338:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(40 0) 00010000:00010000:2.0:1789429529.991352:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000061c418f7/0xb4c3dad7263620ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->42995711] (req 0->42995711) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc02 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429529.991366:0:20986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061c418f7/0xb4c3dad7263620ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->42995711] (req 0->42995711) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc02 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429529.991382:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31b600, rc -11) 00000100:00100000:2.0:1789429529.991939:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635167488:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 675us (3857us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789429529.991948:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5910 00000100:00100000:2.0:1789429530.006693:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429530.006921:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635167616 00000100:00100000:3.0:1789429530.006931:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635167616 00000100:00100000:3.0:1789429530.006989:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5911 00000100:00100000:3.0:1789429530.006998:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c08c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635167616:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429530.007017:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429530.007034:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc09 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.007064:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(41 0) 00010000:00010000:3.0:1789429530.007077:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->44044287] (req 0->44044287) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc09 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.007090:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->44044287] (req 0->44044287) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc09 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.007105:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429530.007171:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c08c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635167616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 174us (488us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429530.007178:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5911 00000100:00100000:1.0:1789429530.021332:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429530.021477:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635167744 00000100:00100000:2.0:1789429530.021488:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635167744 00000100:00100000:2.0:1789429530.021558:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5912 00000100:00100000:2.0:1789429530.021569:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635167744:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1789429530.021955:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429530.021976:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069460dda/0xb4c3dad7263620f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc10 expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429530.022007:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=1s v=(42 0) 00010000:00010000:2.0:1789429530.022582:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000069460dda/0xb4c3dad7263620f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->45092863] (req 0->45092863) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc10 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429530.022599:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069460dda/0xb4c3dad7263620f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->45092863] (req 0->45092863) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc10 expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429530.022614:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31b200, rc -11) 00000100:00100000:2.0:1789429530.022671:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635167744:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1104us (1358us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789429530.022679:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5912 00000100:00100000:2.0:1789429530.040041:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429530.040163:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635167872 00000100:00100000:3.0:1789429530.040174:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635167872 00000100:00100000:3.0:1789429530.040315:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5913 00000100:00100000:3.0:1789429530.040334:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635167872:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429530.040352:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429530.040371:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc17 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.040400:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(1 42) 00010000:00010000:3.0:1789429530.040425:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->46141439] (req 0->46141439) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc17 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.040437:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad7263620ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->46141439] (req 0->46141439) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc17 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.040450:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429530.040508:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635167872:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 176us (476us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429530.040515:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5913 00000100:00100000:0.0:1789429530.066166:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429530.066354:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635168000 00000100:00100000:3.0:1789429530.066364:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635168000 00000100:00100000:3.0:1789429530.066425:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5914 00000100:00100000:3.0:1789429530.066435:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635168000:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429530.066452:0:20745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429530.066470:0:20745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362106 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc1e expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.066508:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(2 42) 00010000:00010000:3.0:1789429530.066525:0:20745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362106 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->47190015] (req 0->47190015) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc1e expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.066543:0:20745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362106 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->47190015] (req 0->47190015) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc1e expref: 7 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.066562:0:20745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429530.066635:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635168000:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 201us (492us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429530.066641:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5914 00000100:00100000:1.0:1789429530.092774:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429530.093242:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635168128 00000100:00100000:3.0:1789429530.093253:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635168128 00000100:00100000:3.0:1789429530.093328:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5915 00000100:00100000:3.0:1789429530.093337:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635168128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429530.093355:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429530.093373:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636210d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc25 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.093399:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(3 42) 00010000:00010000:3.0:1789429530.093412:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636210d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->48238591] (req 0->48238591) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc25 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.093424:0:8085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636210d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->48238591] (req 0->48238591) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc25 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.093436:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429530.093495:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635168128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 159us (730us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429530.093503:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5915 00000100:00100000:2.0:1789429530.110274:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429530.110407:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635168256 00000100:00100000:3.0:1789429530.110417:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635168256 00000100:00100000:3.0:1789429530.110476:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5916 00000100:00100000:3.0:1789429530.110486:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635168256:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429530.110503:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429530.110522:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362114 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc2c expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.110548:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(4 42) 00010000:00010000:3.0:1789429530.110560:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362114 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->49287167] (req 0->49287167) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc2c expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.110580:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad726362114 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->49287167] (req 0->49287167) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc2c expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.110593:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429530.110652:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635168256:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 168us (388us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429530.110660:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5916 00000100:00100000:0.0:1789429530.133348:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429530.133503:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635168384 00000100:00100000:3.0:1789429530.133514:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635168384 00000100:00100000:3.0:1789429530.133576:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5917 00000100:00100000:3.0:1789429530.133586:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635168384:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1789429530.133604:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429530.133623:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636211b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc33 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.133650:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(5 42) 00010000:00010000:3.0:1789429530.133663:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636211b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->50335743] (req 0->50335743) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc33 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.133677:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d1de26/0xb4c3dad72636211b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->50335743] (req 0->50335743) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc33 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429530.133690:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31d600, rc -11) 00000100:00100000:3.0:1789429530.133750:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635168384:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 166us (410us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789429530.133758:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5917 00000100:00100000:1.0:1789429530.148030:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429530.148645:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635168512 00000100:00100000:0.0:1789429530.148657:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635168512 00000100:00100000:1.0:1789429530.148818:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5918 00000100:00100000:1.0:1789429530.148828:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635168512:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429530.149350:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429530.149369:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726362122 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc3a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429530.149404:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(6 42) 00010000:00010000:1.0:1789429530.149417:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726362122 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->51384319] (req 0->51384319) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc3a expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429530.149431:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726362122 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->51384319] (req 0->51384319) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc3a expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429530.149442:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc -11) 00000100:00100000:1.0:1789429530.149517:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635168512:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 690us (1495us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789429530.149525:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5918 00000100:00100000:2.0:1789429530.162069:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429530.162349:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635168640 00000100:00100000:1.0:1789429530.162360:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635168640 00000100:00100000:1.0:1789429530.162414:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5919 00000100:00100000:1.0:1789429530.162423:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635168640:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1789429530.162440:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429530.162458:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726362129 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc41 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429530.162486:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x39:0x0].0x0 since=0s v=(7 42) 00010000:00010000:1.0:1789429530.162500:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-11, rc=-11) ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726362129 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->52432895] (req 0->52432895) gid 0 flags: 0x44000020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc41 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429530.162513:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ac33494/0xb4c3dad726362129 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->52432895] (req 0->52432895) gid 0 flags: 0x44801020000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc41 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429530.162531:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4400, rc -11) 00000100:00100000:1.0:1789429530.162734:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635168640:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 311us (673us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789429530.162741:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5919 00000100:00100000:0.0:1789429530.393642:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429530.393688:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429530.393755:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429530.394151:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635168768 00000100:00100000:2.0:1789429530.394161:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635168768 00000100:00100000:2.0:1789429530.394228:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 617 00000100:00100000:2.0:1789429530.394239:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635168768:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429530.394306:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635168768:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429530.394323:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 617 00000100:00100000:0.0:1789429530.394638:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429530.394655:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429530.394674:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429530.397565:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635169024 00000100:00100000:3.0:1789429530.397579:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635169024 00000100:00100000:3.0:1789429530.397701:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635169280 00000100:00100000:3.0:1789429530.397704:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635169280 00000100:00100000:3.0:1789429530.397734:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 967 00000100:00100000:3.0:1789429530.397744:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635169024:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429530.397920:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635169024:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 167us (4220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429530.397929:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 967 00000100:00100000:3.0:1789429530.397947:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 968 00000100:00100000:3.0:1789429530.397954:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635169280:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429530.397982:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635169280:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429530.397988:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 968 00000100:00080000:3.0:1789429530.398015:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429530.398020:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429530.398309:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635169408 00000100:00100000:0.0:1789429530.398323:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635169408 00000100:00100000:0.0:1789429530.398360:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 969 00000100:00100000:0.0:1789429530.398367:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635169408:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429530.398396:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635169408:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (3721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429530.398401:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 969 00000100:00080000:0.0:1789429530.398419:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429530.398694:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635168896 00000100:00100000:0.0:1789429530.398699:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635168896 00000100:00100000:0.0:1789429530.398740:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635169152 00000100:00100000:0.0:1789429530.398744:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635169152 00000100:00100000:0.0:1789429530.398767:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 920 00000100:00100000:0.0:1789429530.398774:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+34:2369:x1876351635168896:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:3.0:1789429530.398939:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429530.399029:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+34:2369:x1876351635168896:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 255us (4390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429530.399037:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 920 00000100:00100000:0.0:1789429530.399051:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 921 00000100:00100000:0.0:1789429530.399058:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0962ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635169152:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429530.399088:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0962ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635169152:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (4431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429530.399093:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 921 00000100:00100000:2.0:1789429530.787708:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648410752:0@lo:400:kworker.0 00000100:00100000:2.0:1789429530.787776:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429530.787827:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648411264:0@lo:400:kworker.0 00000100:00100000:2.0:1789429530.787849:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429530.787873:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429530.787878:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648411136:0@lo:400:kworker.0 00000100:00100000:2.0:1789429530.787901:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429530.787926:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648410880:0@lo:400:kworker.0 00000100:00100000:2.0:1789429530.787946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429530.787958:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648411392:0@lo:400:kworker.0 00000100:00100000:2.0:1789429530.787972:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429530.787983:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429530.787987:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648411008:0@lo:400:kworker.0 00000100:00100000:2.0:1789429530.788001:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429530.788023:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648411264 00000100:00100000:2.0:1789429530.788030:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648411264 00000100:00100000:2.0:1789429530.788070:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648410880 00000100:00100000:2.0:1789429530.788072:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648410880 00000100:00100000:2.0:1789429530.788083:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648411008 00000100:00100000:2.0:1789429530.788085:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648411008 00000100:00100000:2.0:1789429530.788101:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:2.0:1789429530.788108:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648411264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429530.788150:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648411264:12345-0@lo:400:kworker.0 Request processed in 43us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429530.788157:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:2.0:1789429530.788182:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:2.0:1789429530.788188:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648410880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429530.788302:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:3.0:1789429530.788319:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648411008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429530.788368:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648410752 00000100:00100000:0.0:1789429530.788374:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648410752 00000100:00100000:0.0:1789429530.788402:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1789429530.788409:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648410752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429530.788435:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648411008:12345-0@lo:400:kworker.0 Request processed in 124us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429530.788442:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:0.0:1789429530.788450:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648410752:12345-0@lo:400:kworker.0 Request processed in 40us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429530.788457:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1789429530.788463:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648411136 00000100:00100000:3.0:1789429530.788468:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648411136 00000100:00100000:3.0:1789429530.788496:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648411392 00000100:00100000:3.0:1789429530.788499:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648411392 00000100:00100000:3.0:1789429530.788520:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1789429530.788526:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648411136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429530.788555:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648411136:12345-0@lo:400:kworker.0 Request processed in 30us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429530.788562:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1789429530.788574:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1789429530.788580:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648411392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429530.788603:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648411392:12345-0@lo:400:kworker.0 Request processed in 23us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429530.788609:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00080000:0.0:1789429530.788614:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429530.788619:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429530.788623:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429530.788655:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648411008:0@lo:400:kworker.0 00000100:00100000:3.0:1789429530.788670:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648411136:0@lo:400:kworker.0 00000100:00100000:0.0:1789429530.788674:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648411392:0@lo:400:kworker.0 00000100:00100000:3.0:1789429530.788686:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648410752:0@lo:400:kworker.0 00000100:00100000:3.0:1789429530.788700:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648411264:0@lo:400:kworker.0 00000100:00100000:2.0:1789429530.791576:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648410880:12345-0@lo:400:kworker.0 Request processed in 3380us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429530.791589:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:1.0:1789429530.796384:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648410880:0@lo:400:kworker.0 00010000:00010000:1.0:1789429530.851370:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429531.299471:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648411520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429531.299560:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429531.299574:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648411648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429531.300060:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429531.303153:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648411648 00000100:00100000:1.0:1789429531.303168:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648411648 00000100:00100000:1.0:1789429531.303386:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1789429531.303398:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648411648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429531.303437:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429531.305186:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648411648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1777us (5113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429531.305213:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1789429531.306143:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648411648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429531.314441:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429531.314597:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648411520 00000100:00100000:1.0:1789429531.314611:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648411520 00000100:00100000:1.0:1789429531.314658:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1789429531.314667:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648411520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429531.314704:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 560660480 pending 0 free 3803185152 avail 3801088000 00000100:00100000:1.0:1789429531.314886:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648411520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 219us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429531.314894:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1789429531.317710:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648411520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789429531.875468:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429532.899775:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429533.927731:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429534.948514:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429535.517459:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429535.517492:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429535.517529:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429535.517548:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429535.517572:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429535.517589:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429535.517630:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429535.517664:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635169792 00000100:00100000:0.0:1789429535.517673:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635169792 00000100:00100000:0.0:1789429535.517725:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635170304 00000100:00100000:0.0:1789429535.517728:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635170304 00000100:00100000:0.0:1789429535.517743:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635169920 00000100:00100000:0.0:1789429535.517746:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635169920 00000100:00100000:0.0:1789429535.517759:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635170176 00000100:00100000:0.0:1789429535.517762:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635170176 00000100:00100000:0.0:1789429535.517776:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 972 00000100:00100000:0.0:1789429535.517785:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635169792:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429535.517849:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635169792:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 65us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429535.517857:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 972 00000100:00100000:0.0:1789429535.517874:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 973 00000100:00100000:0.0:1789429535.517879:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635170304:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429535.517903:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2370:x1876351635170304:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429535.517910:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 973 00000100:00100000:0.0:1789429535.517920:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 974 00000100:00100000:0.0:1789429535.517927:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635169920:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429535.517948:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635169920:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429535.517953:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 974 00000100:00100000:0.0:1789429535.517963:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 975 00000100:00100000:0.0:1789429535.517969:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635170176:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429535.517988:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635170176:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 20us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429535.517993:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 975 00000100:00100000:0.0:1789429535.518009:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635170048 00000100:00100000:0.0:1789429535.518012:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635170048 00000100:00100000:0.0:1789429535.518036:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635169664 00000100:00100000:0.0:1789429535.518038:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635169664 00000100:00100000:0.0:1789429535.518055:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 925 00000100:00100000:0.0:1789429535.518062:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f09628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635170048:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429535.518090:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f09628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635170048:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429535.518096:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 925 00000100:00100000:0.0:1789429535.518108:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 926 00000100:00100000:0.0:1789429535.518114:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+34:2370:x1876351635169664:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429535.518137:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+34:2370:x1876351635169664:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429535.518143:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 926 00000100:00080000:0.0:1789429535.518165:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429535.518169:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429535.518171:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429535.519140:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635169536 00000100:00100000:2.0:1789429535.519148:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635169536 00000100:00100000:2.0:1789429535.519235:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 619 00000100:00100000:2.0:1789429535.519244:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635169536:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429535.519296:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635169536:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 54us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429535.519303:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 619 00000100:00100000:0.0:1789429535.778361:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429535.778434:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635170560 00000100:00100000:3.0:1789429535.778444:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635170560 00000100:00100000:3.0:1789429535.778492:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 293 00000100:00100000:3.0:1789429535.778500:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+34:45271:x1876351635170560:12345-192.168.203.39@tcp:35:rm.0 00000100:00100000:3.0:1789429535.778762:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+35:45271:x1876351635170560:12345-192.168.203.39@tcp:35:rm.0 Request processed in 261us (563us total) trans 4294977257 rc 0/0 00000100:00100000:3.0:1789429535.778770:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 293 00000100:00100000:2.0:1789429535.784986:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429535.785044:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635170816 00000100:00100000:3.0:1789429535.785052:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635170816 00000100:00100000:3.0:1789429535.785104:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21359 00000100:00100000:3.0:1789429535.785116:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+35:45271:x1876351635170816:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:3.0:1789429535.785168:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789429535.785196:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f93ba00/0xb4c3dad726361f7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac7 expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.785363:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c400/0xb4c3dad726361fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8a:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cae3 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.785381:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652600/0xb4c3dad726361cb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c91c expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.785391:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:3.0:1789429535.785401:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8400/0xb4c3dad726361f54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cab9 expref: 32 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.785410:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:3.0:1789429535.785413:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789429535.785436:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.785450:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac0 expref: 21 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.785458:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.785492:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac0 expref: 21 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.785505:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac0 expref: 21 pid: 15700 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429535.785523:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648411776:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429535.785595:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2002d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429535.794430:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb40e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648411776:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429535.794464:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429535.796305:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429535.796484:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635170944 00000100:00100000:0.0:1789429535.796493:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635170944 00010000:00010000:0.0:1789429535.796533:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac0 expref: 22 pid: 15700 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429535.796574:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6264 00000100:00100000:0.0:1789429535.796584:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2371:x1876351635170944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429535.796599:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429535.796606:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac0 expref: 22 pid: 15700 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.796619:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac0 expref: 22 pid: 15700 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.796639:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f072d8c00/0xb4c3dad726361f62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cac0 expref: 22 pid: 15700 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.796655:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:0.0:1789429535.796660:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.796668:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.796674:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.796691:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429535.796747:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351635170944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 164us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429535.796754:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6264 00010000:00010000:2.0:1789429535.800314:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.800333:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.800368:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362137 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.800381:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362137 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.800392:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362137 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.801832:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.801852:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cace expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.801860:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.801898:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cace expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.801915:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cace expref: 20 pid: 5841 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429535.801930:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648411904:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429535.802031:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f2002d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789429535.808837:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429535.808910:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635171072 00000100:00100000:0.0:1789429535.808921:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635171072 00010000:00010000:0.0:1789429535.808964:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361fa1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cace expref: 21 pid: 5841 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429535.809005:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6265 00000100:00100000:0.0:1789429535.809014:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351635171072:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429535.809028:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429535.809035:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361fa1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cace expref: 21 pid: 5841 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.809048:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cace expref: 21 pid: 5841 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.809069:0:11354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429535.809075:0:11354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.809086:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.809093:0:11354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.809127:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429535.809192:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2371:x1876351635171072:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 178us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429535.809225:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6265 00010000:00010000:2.0:1789429535.809424:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01653800/0xb4c3dad726361fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cace expref: 20 pid: 5841 timeout: 1333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429535.809442:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb42a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5841:1876351648411904:192.168.203.39@tcp:104: 00010000:00010000:2.0:1789429535.809465:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.809474:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.809481:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789429535.810765:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].26, 64 off9856 00000004:00080000:2.0:1789429535.810777:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1233790575962ns, next at 1234790573273ns, rc = 0 00010000:00010000:2.0:1789429535.810842:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362145 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810860:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810870:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810878:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362145 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810885:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362145 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810892:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810905:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789429535.810924:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810930:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810936:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810942:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31d200 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429535.810946:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810954:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810968:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:2.0:1789429535.810971:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789429535.810975:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810982:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d200/0xb4c3dad72636213e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.810999:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.811006:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.811012:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.811017:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31c000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429535.811020:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.811026:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.811033:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970ce00) 00010000:00010000:2.0:1789429535.811035:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429535.811038:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429535.811045:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c000/0xb4c3dad726362130 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789429535.811063:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086655975 reply state 00000000b4356b75 transno 4294977258 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362137 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429535.811070:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789429535.811148:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+33:45271:x1876351635170816:12345-192.168.203.39@tcp:36:rm.0 Request processed in 26033us (26166us total) trans 4294977258 rc 0/0 00000100:00100000:2.0:1789429535.811156:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21359 00010000:00010000:0.0:1789429535.811695:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789429535.811703:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362145 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.811710:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31a600 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:0.0:1789429535.811713:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362145 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.811719:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.811730:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:0.0:1789429535.811733:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789429535.811736:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362145 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.811741:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362145 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429535.811753:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429535.811755:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429535.811756:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429535.816696:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362137 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.816715:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362137 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.816723:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362137 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.816729:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31ba00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429535.816734:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362137 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.816741:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362137 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.816757:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b086329 (ffff946f051ef300) 00010000:00010000:3.0:1789429535.816760:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429535.816765:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362137 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429535.816771:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362137 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3b086329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429535.910513:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648412160:0@lo:400:kworker.0 00000100:00100000:2.0:1789429535.910611:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429535.910700:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648412672:0@lo:400:kworker.0 00000100:00100000:2.0:1789429535.910731:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429535.910766:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429535.910775:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648412288:0@lo:400:kworker.0 00000100:00100000:2.0:1789429535.910797:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429535.910906:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648412160 00000100:00100000:1.0:1789429535.910914:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648412160 00000100:00100000:1.0:1789429535.910966:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648412288 00000100:00100000:1.0:1789429535.910969:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648412288 00000100:00100000:1.0:1789429535.910995:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1789429535.911003:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648412160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429535.911062:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648412160:12345-0@lo:400:kworker.0 Request processed in 59us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429535.911069:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1789429535.911086:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1789429535.911092:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648412288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429535.911118:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648412288:12345-0@lo:400:kworker.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429535.911124:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1789429535.911159:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648412288:0@lo:400:kworker.0 00000100:00100000:1.0:1789429535.911170:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648412160:0@lo:400:kworker.0 00000100:00100000:0.0:1789429535.911309:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648412416:0@lo:400:kworker.0 00000100:00100000:0.0:1789429535.911340:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429535.911367:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789429535.911373:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648412032:0@lo:400:kworker.0 00000100:00100000:0.0:1789429535.911401:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429535.911430:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648412544:0@lo:400:kworker.0 00000100:00100000:0.0:1789429535.911451:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429535.911493:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648412672 00000100:00100000:0.0:1789429535.911497:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648412672 00000100:00100000:0.0:1789429535.911527:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648412416 00000100:00100000:0.0:1789429535.911530:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648412416 00000100:00100000:0.0:1789429535.911545:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1789429535.911551:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648412672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429535.911588:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648412672:12345-0@lo:400:kworker.0 Request processed in 36us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429535.911594:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1789429535.911607:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1789429535.911612:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648412416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429535.911644:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648412416:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429535.911649:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1789429535.911670:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648412544 00000100:00100000:0.0:1789429535.911673:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648412544 00000100:00100000:0.0:1789429535.911694:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1789429535.911701:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648412544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429535.911729:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648412544:12345-0@lo:400:kworker.0 Request processed in 29us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429535.911735:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00080000:0.0:1789429535.911749:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429535.911754:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429535.911757:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429535.911786:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648412544:0@lo:400:kworker.0 00000100:00100000:0.0:1789429535.911795:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648412416:0@lo:400:kworker.0 00000100:00100000:0.0:1789429535.911817:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648412672:0@lo:400:kworker.0 00000100:00100000:1.0:1789429535.911981:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648412032 00000100:00100000:1.0:1789429535.911987:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648412032 00000100:00100000:1.0:1789429535.912025:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1789429535.912031:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648412032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429535.912070:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648412032:12345-0@lo:400:kworker.0 Request processed in 39us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429535.912075:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:0.0:1789429535.912751:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648412032:0@lo:400:kworker.0 00010000:00010000:2.0:1789429535.971477:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429536.420459:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648412800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429536.420583:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429536.420585:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429536.420600:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648412928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429536.420636:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429536.420670:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648412800 00000100:00100000:0.0:1789429536.420676:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648412800 00000100:00100000:0.0:1789429536.420717:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648412928 00000100:00100000:0.0:1789429536.420720:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648412928 00000100:00100000:0.0:1789429536.420733:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789429536.420741:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648412800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429536.420773:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 560660480 pending 0 free 3803185152 avail 3801088000 00000100:00100000:0.0:1789429536.420814:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648412800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429536.420820:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789429536.420835:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1789429536.420841:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648412928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429536.420859:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429536.420891:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648412928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429536.420897:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1789429536.422285:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648412800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429536.423266:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648412928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429536.996409:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429538.020331:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789429538.460623:0:26338:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_33a skipping SLOW test 33a 00010000:00010000:0.0:1789429539.044684:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429539.577089:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977258 is committed 00000004:00080000:0.0:1789429539.577100:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 36 committed 00000100:00100000:0.0:1789429539.577402:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648413056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789429539.577467:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429539.577573:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648413056 00000100:00100000:3.0:1789429539.577581:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648413056 00000100:00100000:3.0:1789429539.577642:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5920 00000100:00100000:3.0:1789429539.577650:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648413056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789429539.577675:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:57 count 1 00010000:00010000:3.0:1789429539.577698:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429539.577723:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c70c6135/0xb4c3dad726361faf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cad5 expref: 5 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429539.577733:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad726361fb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cadc expref: 5 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429539.577741:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=9s v=(8 42) 00010000:00010000:3.0:1789429539.577745:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789429539.577750:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 5/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429539.577775:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad726361fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cadc expref: 5 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429539.577788:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad726361fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cadc expref: 5 pid: 6680 timeout: 1337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429539.577799:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648413184:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429539.577915:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c70c6135/0xb4c3dad726361faf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cad5 expref: 5 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429539.577924:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c70c6135/0xb4c3dad726361faf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cad5 expref: 5 pid: 6682 timeout: 1337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429539.577939:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648413312:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429539.577963:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f120edf00 going to sleep for 11 seconds 00000100:00080000:0.0:1789429539.578401:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429539.581736:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb43b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648413312:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429539.587674:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429539.587766:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635171200 00000100:00100000:0.0:1789429539.587776:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635171200 00010000:00010000:0.0:1789429539.587834:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c70c6135/0xb4c3dad726361faf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cad5 expref: 6 pid: 6682 timeout: 1337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429539.587876:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6266 00000100:00100000:0.0:1789429539.587886:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635171200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429539.587901:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429539.587907:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c70c6135/0xb4c3dad726361faf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cad5 expref: 6 pid: 6682 timeout: 1337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.587920:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c70c6135/0xb4c3dad726361faf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cad5 expref: 6 pid: 6682 timeout: 1337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.587943:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c70c6135/0xb4c3dad726361faf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x39:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cad5 expref: 6 pid: 6682 timeout: 1337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.587959:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429539.588004:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635171200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 119us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429539.588011:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6266 00000100:00080000:1.0:1789429539.588103:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429539.588311:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1876351648413184:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429539.588337:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429539.687730:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429539.687824:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635171328 00000100:00100000:0.0:1789429539.687834:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635171328 00010000:00010000:0.0:1789429539.687893:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad726361fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cadc expref: 6 pid: 6680 timeout: 1337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429539.687932:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6267 00000100:00100000:0.0:1789429539.687941:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635171328:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429539.687955:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429539.687961:0:11354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad726361fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cadc expref: 6 pid: 6680 timeout: 1337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.687974:0:11354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad726361fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cadc expref: 6 pid: 6680 timeout: 1337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.687995:0:11354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000977ec969/0xb4c3dad726361fb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x39:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cadc expref: 6 pid: 6680 timeout: 1337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.688010:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429539.688014:0:11354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429539.688020:0:11354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.688029:0:11354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.688054:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429539.688109:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635171328:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 168us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429539.688125:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6267 00010000:00010000:3.0:1789429539.688286:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429539.688296:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429539.688305:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429539.688323:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429539.688342:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789429539.688710:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789429539.688716:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.688725:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31c400 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:0.0:1789429539.688730:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.688739:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.688751:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.688759:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040f2120a/0xb4c3dad72636214c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429539.688778:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429539.688780:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429539.688781:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789429539.689412:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429539.705302:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648413056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 127644us (127826us total) trans 4294969582 rc 0/0 00000100:00100000:3.0:1789429539.705330:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5920 00000004:00080000:1.0:1789429539.705607:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e0eb40a80/2, rc 0, transno 4294969582 00000100:00100000:1.0:1789429539.705614:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648413056:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789429540.069638:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429540.081333:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969582 is committed 00000001:02000400:2.0:1789429540.348992:0:26389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 19:45:39 (1789429539) 00000100:00100000:3.0:1789429540.633093:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429540.633135:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429540.633172:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429540.633251:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429540.633274:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429540.633290:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635171712 00000100:00100000:3.0:1789429540.633293:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429540.633300:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635171712 00000100:00100000:3.0:1789429540.633314:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429540.633342:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635172224 00000100:00100000:1.0:1789429540.633345:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635172224 00000100:00100000:0.0:1789429540.633397:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635171456 00000100:00100000:0.0:1789429540.633401:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635171456 00000100:00100000:0.0:1789429540.633432:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 621 00000100:00100000:0.0:1789429540.633441:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635171456:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429540.633511:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635171456:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429540.633519:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 621 00000100:00100000:2.0:1789429540.633753:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635171968 00000100:00100000:2.0:1789429540.633758:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635171968 00000100:00100000:2.0:1789429540.633791:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635171584 00000100:00100000:2.0:1789429540.633794:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635171584 00000100:00100000:2.0:1789429540.633814:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 930 00000100:00100000:2.0:1789429540.633821:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351635171968:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429540.633863:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351635171968:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 42us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429540.633870:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 930 00000100:00100000:2.0:1789429540.633884:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 931 00000100:00100000:2.0:1789429540.633890:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2369:x1876351635171584:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429540.633915:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+30:2369:x1876351635171584:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429540.633921:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 931 00000100:00100000:2.0:1789429540.637314:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635171840 00000100:00100000:2.0:1789429540.637327:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635171840 00000100:00100000:2.0:1789429540.637380:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635172096 00000100:00100000:2.0:1789429540.637384:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635172096 00000100:00100000:2.0:1789429540.637417:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 978 00000100:00100000:2.0:1789429540.637429:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635171712:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429540.637670:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635171712:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 244us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429540.637679:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 978 00000100:00100000:2.0:1789429540.637707:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 979 00000100:00100000:2.0:1789429540.637714:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635172224:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429540.637739:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635172224:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (4489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429540.637745:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 979 00000100:00100000:2.0:1789429540.637761:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 980 00000100:00100000:2.0:1789429540.637767:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635171840:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429540.637786:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635171840:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 19us (4492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429540.637791:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 980 00000100:00100000:2.0:1789429540.637801:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 981 00000100:00100000:2.0:1789429540.637807:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635172096:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429540.637831:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635172096:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (4517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429540.637836:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 981 00000100:00080000:0.0:1789429540.640408:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429540.640417:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429541.027827:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648413568:0@lo:400:kworker.0 00000100:00100000:2.0:1789429541.027946:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429541.027976:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648413440:0@lo:400:kworker.0 00000100:00100000:2.0:1789429541.028016:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648414080:0@lo:400:kworker.0 00000100:00100000:0.0:1789429541.028032:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429541.028051:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429541.028079:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f08728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648413952:0@lo:400:kworker.0 00000100:00100000:0.0:1789429541.028107:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429541.028112:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648413440 00000100:00100000:2.0:1789429541.028120:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648413440 00000100:00100000:2.0:1789429541.028163:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1789429541.028173:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648413440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429541.028253:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3300:x1876351648413440:12345-0@lo:400:kworker.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429541.028272:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1789429541.028413:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648413568 00000100:00100000:3.0:1789429541.028418:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648413568 00000100:00100000:0.0:1789429541.028435:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3300:1876351648413440:0@lo:400:kworker.0 00000100:00100000:3.0:1789429541.028448:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648413952 00000100:00100000:3.0:1789429541.028452:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648413952 00000100:00100000:0.0:1789429541.028478:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648414080 00000100:00100000:0.0:1789429541.028483:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648414080 00000100:00100000:3.0:1789429541.028488:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1789429541.028499:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648413568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429541.028522:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1789429541.028531:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648414080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429541.028568:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648413568:12345-0@lo:400:kworker.0 Request processed in 70us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429541.028575:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648414080:12345-0@lo:400:kworker.0 Request processed in 44us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429541.028581:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:0.0:1789429541.028587:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1789429541.028604:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00080000:0.0:1789429541.028611:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429541.028613:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648413952:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789429541.028616:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429541.028659:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1876351648413952:12345-0@lo:400:kworker.0 Request processed in 47us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429541.028666:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:0.0:1789429541.028673:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648413568:0@lo:400:kworker.0 00000100:00100000:0.0:1789429541.028685:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648414080:0@lo:400:kworker.0 00000100:00100000:3.0:1789429541.028706:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f08728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3300:1876351648413952:0@lo:400:kworker.0 00000100:00100000:1.0:1789429541.029423:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648413696:0@lo:400:kworker.0 00000100:00100000:1.0:1789429541.029469:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429541.029548:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789429541.029556:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648413824:0@lo:400:kworker.0 00000100:00100000:1.0:1789429541.029581:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429541.029767:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648413824 00000100:00100000:3.0:1789429541.029774:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648413824 00000100:00100000:3.0:1789429541.029833:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:3.0:1789429541.029841:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648413824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429541.029895:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648413824:12345-0@lo:400:kworker.0 Request processed in 56us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429541.029901:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00080000:1.0:1789429541.030169:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429541.030193:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969582 gen 2 00000004:00080000:1.0:1789429541.030220:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e0eb40a80, transno 4294969582 00000100:00100000:1.0:1789429541.030248:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648413824:0@lo:400:kworker.0 00000100:00100000:0.0:1789429541.030260:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648413696 00000100:00100000:0.0:1789429541.030265:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648413696 00000100:00100000:0.0:1789429541.030987:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:0.0:1789429541.030998:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648413696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429541.031075:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1876351648413696:12345-0@lo:400:kworker.0 Request processed in 80us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429541.031083:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:1.0:1789429541.031243:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3298:1876351648413696:0@lo:400:kworker.0 00000100:00080000:2.0:1789429541.034162:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789429541.091484:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429541.539496:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648414336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429541.539560:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429541.539619:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648414208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429541.539638:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429541.539755:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648414336 00000100:00100000:1.0:1789429541.539762:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648414336 00000100:00100000:3.0:1789429541.539779:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648414208 00000100:00100000:3.0:1789429541.539785:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648414208 00000100:00100000:1.0:1789429541.539816:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1789429541.539830:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648414336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429541.539864:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 560660480 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1789429541.539907:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648414336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429541.542302:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648414336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429541.550758:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:3.0:1789429541.550786:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648414208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429541.550830:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50790400 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429541.550834:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1789429541.550921:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648414208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (11280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429541.550928:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1789429541.551056:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648414208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429542.115481:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789429542.300981:0:26437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_33b Need two or more clients, have 1 00010000:00010000:0.0:1789429543.139438:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429544.164473:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789429544.212330:0:26485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 19:45:43 (1789429543) 00010000:00010000:0.0:1789429545.189032:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429545.576344:0:26535:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_33c needs >= 2 MDTs 00000100:00100000:0.0:1789429545.764565:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429545.764605:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429545.764632:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429545.764655:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635172480 00000100:00100000:0.0:1789429545.764658:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429545.764665:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635172480 00000100:00100000:0.0:1789429545.764677:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429545.764699:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429545.764729:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635172864 00000100:00100000:3.0:1789429545.764734:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635172864 00000100:00100000:3.0:1789429545.764764:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 935 00000100:00100000:0.0:1789429545.764771:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429545.764779:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2369:x1876351635172480:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429545.764806:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 936 00000100:00100000:0.0:1789429545.764817:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351635172864:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429545.764861:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:2369:x1876351635172480:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429545.764869:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 935 00000100:00080000:3.0:1789429545.764894:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429545.764902:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635172352 00000100:00100000:1.0:1789429545.764908:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635172352 00000100:00100000:2.0:1789429545.764957:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635172608 00000100:00100000:2.0:1789429545.764962:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635172608 00000100:00100000:1.0:1789429545.765030:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 623 00000100:00100000:1.0:1789429545.765038:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635172352:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429545.765081:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635172736 00000100:00100000:2.0:1789429545.765085:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635172736 00000100:00100000:2.0:1789429545.765109:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635172992 00000100:00100000:2.0:1789429545.765111:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635172992 00000100:00100000:2.0:1789429545.765129:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635173120 00000100:00100000:2.0:1789429545.765132:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635173120 00000100:00100000:2.0:1789429545.765145:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 984 00000100:00100000:2.0:1789429545.765151:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635172608:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429545.766671:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351635172864:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1852us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429545.766681:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 936 00000100:00100000:0.0:1789429545.766716:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 985 00000100:00100000:0.0:1789429545.766726:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635172992:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429545.766954:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635172992:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 231us (2252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429545.766961:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 985 00000100:00100000:0.0:1789429545.766978:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5921 00000100:00100000:0.0:1789429545.766985:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2367:x1876351635172736:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:0.0:1789429545.767010:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad72636113f 00000100:00080000:0.0:1789429545.767019:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946e02cdf000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789429545.767098:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969606 00000100:00100000:0.0:1789429545.767396:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+2:2367:x1876351635172736:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 410us (2737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429545.767409:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5921 00000100:00100000:0.0:1789429545.767435:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5922 00000100:00100000:0.0:1789429545.767441:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2367:x1876351635173120:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:0.0:1789429545.767458:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad7263611a8 00000100:00080000:0.0:1789429545.767463:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946f3f330800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789429545.767486:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969606 00000100:00100000:0.0:1789429545.767571:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+2:2367:x1876351635173120:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 129us (2803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429545.767581:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5922 00010000:00010000:0.0:1789429545.767607:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429545.767611:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789429545.767692:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429545.767696:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429545.771678:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635172608:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 6341us (6859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429545.771691:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 984 00000100:00100000:1.0:1789429545.774634:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635172352:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 9586us (10017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429545.774648:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 623 00000100:00100000:0.0:1789429546.147585:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648414720:0@lo:400:kworker.0 00000100:00100000:0.0:1789429546.147663:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429546.147734:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789429546.147742:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648414592:0@lo:400:kworker.0 00000100:00100000:3.0:1789429546.147835:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648414720 00000100:00100000:3.0:1789429546.147843:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648414720 00000100:00100000:3.0:1789429546.147914:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:3.0:1789429546.147927:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648414720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429546.148294:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648414464:0@lo:400:kworker.0 00000100:00100000:2.0:1789429546.148348:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648414848:0@lo:400:kworker.0 00000100:00100000:3.0:1789429546.149606:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648414720:12345-0@lo:400:kworker.0 Request processed in 1680us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429546.149617:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00080000:3.0:1789429546.149673:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429546.149858:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429546.149918:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648415104:0@lo:400:kworker.0 00000100:00100000:0.0:1789429546.149955:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429546.149997:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648414720:0@lo:400:kworker.0 00000100:00100000:0.0:1789429546.150027:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648415104 00000100:00100000:0.0:1789429546.150032:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648415104 00000100:00100000:0.0:1789429546.150074:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:0.0:1789429546.150082:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648415104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429546.150127:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648415104:12345-0@lo:400:kworker.0 Request processed in 45us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429546.150132:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:0.0:1789429546.150160:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648415104:0@lo:400:kworker.0 00000100:00100000:1.0:1789429546.151708:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429546.151758:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648414976:0@lo:400:kworker.0 00000100:00100000:1.0:1789429546.151787:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429546.151828:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648414592 00000100:00100000:1.0:1789429546.151834:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648414592 00000100:00100000:1.0:1789429546.151864:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648414976 00000100:00100000:1.0:1789429546.151867:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648414976 00000100:00100000:1.0:1789429546.151904:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:1.0:1789429546.151911:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648414592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429546.151950:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648414592:12345-0@lo:400:kworker.0 Request processed in 40us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429546.151955:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:1.0:1789429546.151970:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1789429546.151975:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648414976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429546.151998:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648414976:12345-0@lo:400:kworker.0 Request processed in 23us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429546.152003:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1789429546.152038:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648414976:0@lo:400:kworker.0 00000100:00100000:2.0:1789429546.152259:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429546.152452:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648414464 00000100:00100000:0.0:1789429546.152456:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648414464 00000100:00100000:0.0:1789429546.152495:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1789429546.152502:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648414464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429546.152540:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648414464:12345-0@lo:400:kworker.0 Request processed in 39us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429546.152547:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1789429546.152587:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648414592:0@lo:400:kworker.0 00000100:00080000:3.0:1789429546.152680:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429546.152685:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429546.152741:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648414848 00000100:00100000:1.0:1789429546.152745:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648414848 00000100:00100000:1.0:1789429546.152792:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1789429546.152799:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648414848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429546.152834:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648414848:12345-0@lo:400:kworker.0 Request processed in 35us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429546.152839:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1789429546.152865:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648414464:0@lo:400:kworker.0 00000100:00080000:3.0:1789429546.154992:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429546.155110:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648414848:0@lo:400:kworker.0 00010000:00010000:0.0:1789429546.212785:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429546.659438:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789429546.659468:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648415232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429546.659529:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429546.659589:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648415360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429546.659611:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429546.659647:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648415232 00000100:00100000:0.0:1789429546.659655:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648415232 00000100:00100000:0.0:1789429546.659704:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648415360 00000100:00100000:0.0:1789429546.659708:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648415360 00000100:00100000:0.0:1789429546.659724:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1789429546.659731:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648415232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429546.659763:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 560660480 pending 0 free 3855613952 avail 3853516800 00000100:00100000:0.0:1789429546.659806:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648415232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429546.659813:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1789429546.659830:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1789429546.659837:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648415360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429546.659854:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429546.659880:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648415360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429546.659885:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1789429546.660006:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648415232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429546.660020:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648415360:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429547.237513:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429547.350729:0:26583:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 33d: dependent transactions should trigger COS ========================================================== 19:45:46 (1789429546) 00010000:00010000:0.0:1789429548.259445:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789429548.760735:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:2.0:1789429548.760752:0:7635:0:(genops.c:885:class_export_put()) final put ffff946e02cd8000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000001:00100000:2.0:1789429548.760784:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:2.0:1789429548.760786:0:7635:0:(genops.c:885:class_export_put()) final put ffff946e02cdd800/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:1.0:1789429548.763132:0:22526:0:(genops.c:844:class_export_destroy()) destroying export ffff946e02cd8000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 for lustre-OST0001 00000020:00000080:1.0:1789429548.763237:0:22526:0:(genops.c:844:class_export_destroy()) destroying export ffff946e02cdd800/12e09781-3d24-4c67-9972-bb781900e20d for lustre-OST0001 00000020:00000080:1.0:1789429548.763254:0:22526:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946f3f330800 for lustre-OST0001 00000020:00000080:1.0:1789429548.763259:0:22526:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946e02cdf000 for lustre-OST0001 00000001:02000400:0.0:1789429548.941479:0:26633:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_33d needs >= 2 MDTs 00010000:00010000:0.0:1789429549.283405:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429550.307618:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429550.879294:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429550.879409:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635173376 00000100:00100000:0.0:1789429550.879419:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635173376 00000100:00100000:0.0:1789429550.879475:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 940 00000100:00100000:0.0:1789429550.879486:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+30:2368:x1876351635173376:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:2.0:1789429550.879690:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429550.881642:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429550.881712:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429550.881735:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429550.881759:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429550.881787:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635173632 00000100:00100000:3.0:1789429550.881794:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635173632 00000100:00100000:3.0:1789429550.881855:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 941 00000100:00100000:3.0:1789429550.881865:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351635173632:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429550.881927:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2368:x1876351635173632:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 63us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429550.881934:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 941 00000100:00100000:3.0:1789429550.881954:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635173504 00000100:00100000:3.0:1789429550.881958:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635173504 00000100:00100000:3.0:1789429550.881980:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635173760 00000100:00100000:3.0:1789429550.881983:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635173760 00000100:00100000:3.0:1789429550.881999:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 988 00000100:00100000:3.0:1789429550.882004:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635173504:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429550.882028:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635173504:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429550.882035:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 988 00000100:00100000:3.0:1789429550.882044:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 989 00000100:00100000:3.0:1789429550.882050:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635173760:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429550.882067:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635173760:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 18us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429550.882072:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 989 00000100:00100000:1.0:1789429550.882194:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+30:2368:x1876351635173376:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 2709us (2916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429550.882222:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 940 00000100:00080000:2.0:1789429550.882289:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429550.882294:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429550.882868:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635173248 00000100:00100000:0.0:1789429550.882876:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635173248 00000100:00100000:0.0:1789429550.882949:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 625 00000100:00100000:0.0:1789429550.882957:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635173248:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429550.883008:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635173248:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 52us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429550.883014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 625 00000001:02000400:2.0:1789429551.164974:0:26682:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 19:45:49 (1789429549) 00000100:00100000:3.0:1789429551.269478:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648415488:0@lo:400:kworker.0 00000100:00100000:3.0:1789429551.269549:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429551.269632:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648415488 00000100:00100000:1.0:1789429551.269641:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648415488 00000100:00100000:1.0:1789429551.269688:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1789429551.269697:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648415488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429551.272251:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648415488:0@lo:400:kworker.0 00000100:00100000:1.0:1789429551.272252:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648415488:12345-0@lo:400:kworker.0 Request processed in 2549us (2696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429551.272269:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:3.0:1789429551.272276:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789429551.272288:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648415616:0@lo:400:kworker.0 00000100:00100000:3.0:1789429551.272335:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429551.272464:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648415616 00000100:00100000:1.0:1789429551.272471:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648415616 00000100:00100000:1.0:1789429551.272551:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:1.0:1789429551.272562:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648415616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429551.272617:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648415616:12345-0@lo:400:kworker.0 Request processed in 58us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429551.272624:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00100000:3.0:1789429551.272685:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648415616:0@lo:400:kworker.0 00000100:00100000:3.0:1789429551.272796:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648415744:0@lo:400:kworker.0 00000100:00100000:2.0:1789429551.272818:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648416128:0@lo:400:kworker.0 00000100:00100000:3.0:1789429551.272827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429551.272855:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429551.272865:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429551.272875:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648415872:0@lo:400:kworker.0 00000100:00100000:2.0:1789429551.272884:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429551.272892:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648416000:0@lo:400:kworker.0 00000100:00100000:3.0:1789429551.272906:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429551.272920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429551.272945:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648415744 00000100:00100000:3.0:1789429551.272950:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648415744 00000100:00100000:2.0:1789429551.272954:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648416128 00000100:00100000:2.0:1789429551.272959:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648416128 00000100:00100000:3.0:1789429551.272992:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648416000 00000100:00100000:3.0:1789429551.272996:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648416000 00000100:00100000:2.0:1789429551.272997:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648415872 00000100:00100000:2.0:1789429551.273002:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648415872 00000100:00100000:3.0:1789429551.273028:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:2.0:1789429551.273033:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1789429551.273038:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648415744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429551.273045:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648416128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429551.273109:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648415744:12345-0@lo:400:kworker.0 Request processed in 73us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429551.273116:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:3.0:1789429551.273130:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:3.0:1789429551.273136:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648416000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429551.273218:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1789429551.273226:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f08728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648415872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429551.273276:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648416128:12345-0@lo:400:kworker.0 Request processed in 235us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429551.273284:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00080000:2.0:1789429551.273307:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429551.273310:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429551.273312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429551.273336:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648416128:0@lo:400:kworker.0 00000100:00100000:3.0:1789429551.273434:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648416000:12345-0@lo:400:kworker.0 Request processed in 297us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429551.273442:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:2.0:1789429551.273453:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648416000:0@lo:400:kworker.0 00000100:00100000:3.0:1789429551.273483:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648415744:0@lo:400:kworker.0 00000100:00100000:0.0:1789429551.273515:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f08728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648415872:12345-0@lo:400:kworker.0 Request processed in 289us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429551.273521:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648415872:0@lo:400:kworker.0 00000100:00100000:0.0:1789429551.273526:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00010000:00010000:3.0:1789429551.332706:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429551.780515:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648416384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429551.780585:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429551.780662:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429551.780670:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f8d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648416256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429551.780694:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429551.780753:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648416384 00000100:00100000:2.0:1789429551.780762:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648416384 00000100:00100000:1.0:1789429551.780770:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648416256 00000100:00100000:1.0:1789429551.780777:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648416256 00000100:00100000:2.0:1789429551.780822:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1789429551.780833:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648416384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429551.780867:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 560660480 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429551.780929:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648416384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429551.780939:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1789429551.780957:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1789429551.780963:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648416256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429551.780980:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429551.781008:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648416256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429551.781013:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1789429551.781091:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f8d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648416256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429551.781105:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648416384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789429552.355459:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789429552.663405:0:26731:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_33e needs >= 2 MDTs 00010000:00010000:3.0:1789429553.381382:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789429554.339181:0:26779:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 34: no lock timeout under IO ============= 19:45:53 (1789429553) 00010000:00010000:0.0:1789429554.403387:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429554.835921:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429554.836009:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635173888 00000100:00100000:3.0:1789429554.836018:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635173888 00000100:00080000:2.0:1789429554.836129:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429554.836364:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21360 00000100:00100000:3.0:1789429554.836378:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+30:46813:x1876351635173888:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:3.0:1789429554.836398:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429554.836421:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d400/0xb4c3dad726362153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc48 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429554.836489:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ce00/0xb4c3dad72636215a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429554.836502:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ce00/0xb4c3dad72636215a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429554.836513:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ce00/0xb4c3dad72636215a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429554.836545:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789429554.836549:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789429554.836566:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ce00/0xb4c3dad72636215a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429554.836589:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d400/0xb4c3dad726362153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc48 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429554.836606:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ce00/0xb4c3dad72636215a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc48 expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429554.836614:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8800) 00010000:00010000:3.0:1789429554.836617:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789429554.836620:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31ce00, rc 0) 00000100:00100000:3.0:1789429554.836681:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:46813:x1876351635173888:12345-192.168.203.39@tcp:101:rm.0 Request processed in 304us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429554.836689:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21360 00000100:00100000:0.0:1789429554.844438:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429554.844767:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635174016 00000100:00100000:2.0:1789429554.844777:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635174016 00000100:00100000:2.0:1789429554.844836:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21361 00000100:00100000:2.0:1789429554.844846:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0eb40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:46813:x1876351635174016:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:2.0:1789429554.844864:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429554.844883:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ae00/0xb4c3dad726362161 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc4f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.844952:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362168 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.844966:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362168 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.844977:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362168 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845037:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad72636216f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845045:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad72636216f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845052:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad72636216f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845292:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362168 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845300:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362168 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845307:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362168 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845313:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31b000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429554.845317:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362168 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845325:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362168 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845552:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8800) 00010000:00010000:2.0:1789429554.845556:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429554.845562:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362168 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845568:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362168 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845581:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad72636216f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845587:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad72636216f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845592:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad72636216f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845597:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31b600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429554.845600:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad72636216f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845605:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad72636216f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845612:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ce0eb6 (ffff946f051ef900) 00010000:00010000:2.0:1789429554.845615:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429554.845618:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad72636216f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845624:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad72636216f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845656:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ae00/0xb4c3dad726362161 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc4f expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845665:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8800) 00010000:00010000:2.0:1789429554.845668:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429554.845671:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ae00/0xb4c3dad726362161 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc4f expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429554.845680:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31ae00, rc 0) 00000100:00100000:2.0:1789429554.845747:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0eb40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:46813:x1876351635174016:12345-192.168.203.39@tcp:101:rm.0 Request processed in 902us (1319us total) trans 0 rc 301/301 00000100:00100000:2.0:1789429554.845755:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21361 00010000:00010000:0.0:1789429555.427638:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429555.994032:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429555.994084:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429555.994114:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429555.994159:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635174272 00000100:00100000:3.0:1789429555.994173:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635174272 00000100:00100000:3.0:1789429555.994287:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635174528 00000100:00100000:3.0:1789429555.994291:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635174528 00000100:00100000:3.0:1789429555.994330:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 945 00000100:00100000:3.0:1789429555.994341:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635174272:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429555.994397:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 946 00000100:00100000:2.0:1789429555.994410:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0de0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351635174528:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429555.994438:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635174272:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 96us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429555.994452:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 945 00000100:00100000:2.0:1789429555.994454:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0de0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351635174528:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 44us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429555.994465:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 946 00000100:00080000:3.0:1789429555.994481:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429555.994563:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635174144 00000100:00100000:0.0:1789429555.994569:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635174144 00000100:00100000:0.0:1789429555.994609:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 627 00000100:00100000:0.0:1789429555.994617:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635174144:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429555.994650:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635174144:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 34us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429555.994657:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 627 00000100:00100000:3.0:1789429555.998748:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429555.998804:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429555.999235:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635174400 00000100:00100000:0.0:1789429555.999260:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635174400 00000100:00080000:3.0:1789429555.999307:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429555.999338:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635174656 00000100:00100000:0.0:1789429555.999342:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635174656 00000100:00100000:3.0:1789429555.999356:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 992 00000100:00100000:3.0:1789429555.999376:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351635174400:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429555.999379:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 993 00000100:00100000:0.0:1789429555.999393:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635174656:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429555.999472:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635174656:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 82us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429555.999481:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 993 00000100:00080000:0.0:1789429555.999508:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429556.003011:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351635174400:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 3625us (4262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429556.003029:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 992 00000100:00100000:2.0:1789429556.388533:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648416512:0@lo:400:kworker.0 00000100:00100000:2.0:1789429556.388661:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429556.388746:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648417024:0@lo:400:kworker.0 00000100:00100000:2.0:1789429556.388781:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429556.388821:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789429556.388829:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648416640:0@lo:400:kworker.0 00000100:00100000:2.0:1789429556.388861:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429556.388883:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648417152:0@lo:400:kworker.0 00000100:00100000:2.0:1789429556.388911:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429556.388948:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648416768:0@lo:400:kworker.0 00000100:00100000:2.0:1789429556.388973:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429556.388996:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429556.389002:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648416896:0@lo:400:kworker.0 00000100:00100000:2.0:1789429556.389241:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429556.389291:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648417024 00000100:00100000:2.0:1789429556.389302:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648417024 00000100:00100000:2.0:1789429556.389378:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648416640 00000100:00100000:2.0:1789429556.389383:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648416640 00000100:00100000:2.0:1789429556.389404:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648416768 00000100:00100000:2.0:1789429556.389406:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648416768 00000100:00100000:2.0:1789429556.389433:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1789429556.389444:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648417024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429556.389526:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648417024:12345-0@lo:400:kworker.0 Request processed in 83us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429556.389534:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1789429556.389553:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1789429556.389559:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648416640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429556.389588:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648416640:12345-0@lo:400:kworker.0 Request processed in 30us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429556.389594:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1789429556.389607:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:2.0:1789429556.389613:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648416768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429556.389789:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648416768:12345-0@lo:400:kworker.0 Request processed in 175us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429556.389798:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1789429556.389803:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648416512 00000100:00100000:0.0:1789429556.389811:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648416512 00000100:00100000:2.0:1789429556.389829:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648417152 00000100:00100000:2.0:1789429556.389835:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648417152 00000100:00100000:0.0:1789429556.389853:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:0.0:1789429556.389864:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648416512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429556.389871:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648416896 00000100:00100000:2.0:1789429556.389876:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648416896 00000100:00100000:2.0:1789429556.389909:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1789429556.389913:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648416512:12345-0@lo:400:kworker.0 Request processed in 50us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429556.389922:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648417152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429556.389925:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1789429556.389973:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648417152:12345-0@lo:400:kworker.0 Request processed in 54us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429556.389975:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1789429556.389988:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1789429556.389989:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648416896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429556.390025:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648416896:12345-0@lo:400:kworker.0 Request processed in 40us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429556.390031:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1789429556.390114:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648416640:0@lo:400:kworker.0 00000100:00100000:1.0:1789429556.390139:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648417152:0@lo:400:kworker.0 00000100:00100000:1.0:1789429556.390147:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648416512:0@lo:400:kworker.0 00000100:00100000:1.0:1789429556.390158:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648417024:0@lo:400:kworker.0 00000100:00080000:2.0:1789429556.390227:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429556.390233:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429556.390236:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429556.390274:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648416896:0@lo:400:kworker.0 00000100:00100000:2.0:1789429556.390285:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648416768:0@lo:400:kworker.0 00010000:00010000:0.0:1789429556.451468:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429556.905744:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429556.905777:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648417280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429556.905874:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429556.906092:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648417280 00000100:00100000:0.0:1789429556.906176:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648417280 00000100:00100000:0.0:1789429556.906345:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:02000000:0.0:1789429556.906354:0:6684:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429556.907491:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429556.907517:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648417408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429556.907601:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429556.908113:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648417408 00000100:00100000:1.0:1789429556.908129:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648417408 00000100:00100000:1.0:1789429556.908172:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:02000000:1.0:1789429556.908178:0:6683:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429556.908187:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648417408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429556.910398:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 560660480 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1789429556.910531:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648417408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2341us (2925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429556.910544:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1789429556.910777:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648417408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429556.916940:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648417280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429556.916998:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429556.917902:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648417280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1011us (12022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429556.917922:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1789429556.918090:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648417280:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429557.476826:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429557.935527:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429557.935631:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635174912 00000100:00100000:2.0:1789429557.935645:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635174912 00000100:00080000:0.0:1789429557.935779:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429557.935819:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21362 00000100:02000000:2.0:1789429557.935830:0:5841:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429557.939043:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00010000:00010000:0.0:1789429558.499455:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429559.523860:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429560.547655:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429561.109694:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429561.109747:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429561.109794:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429561.109820:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429561.109843:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429561.110027:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635175296 00000100:00100000:0.0:1789429561.110041:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635175296 00000100:00100000:3.0:1789429561.110109:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635175552 00000100:00100000:3.0:1789429561.110116:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635175552 00000100:00100000:0.0:1789429561.110138:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5923 00000100:02000000:0.0:1789429561.110146:0:13238:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:2.0:1789429561.110231:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635175040 00000100:00100000:2.0:1789429561.110237:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635175040 00000100:00100000:2.0:1789429561.110271:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 629 00000100:02000000:2.0:1789429561.110275:0:5831:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429561.110685:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2367:x1876351635175296:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:0.0:1789429561.110730:0:13238:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad726360d17 00000100:00080000:0.0:1789429561.110741:0:13238:0:(import.c:65:import_set_state_nolock()) ffff946f06fb4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789429561.110792:0:13238:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969582 00000100:00100000:0.0:1789429561.111141:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+2:2367:x1876351635175296:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 462us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429561.111727:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635175424 00000100:00100000:1.0:1789429561.111735:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635175424 00000100:00100000:1.0:1789429561.111796:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635175168 00000100:00100000:1.0:1789429561.111800:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635175168 00000100:00100000:1.0:1789429561.111832:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 950 00000100:02000000:1.0:1789429561.111836:0:6704:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429561.111840:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429561.111950:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5924 00000100:02000000:3.0:1789429561.111955:0:6682:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429561.111966:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2367:x1876351635175552:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:3.0:1789429561.111993:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad726361632 00000100:00080000:3.0:1789429561.112002:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946f3f334000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789429561.112038:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969582 00000100:00100000:3.0:1789429561.112539:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f65fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+2:2367:x1876351635175552:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 575us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429561.112549:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5924 00000100:00100000:3.0:1789429561.112611:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 951 00000100:02000000:3.0:1789429561.112615:0:15700:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429561.112617:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00010000:00010000:3.0:1789429561.112656:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789429561.112670:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429561.112677:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789429561.112697:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429561.114892:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635175040:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429561.115190:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5923 00000100:00100000:2.0:1789429561.115928:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635175040:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1042us (6232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429561.115939:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 629 00000100:00100000:0.0:1789429561.507705:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648417920:0@lo:400:kworker.0 00000100:00100000:0.0:1789429561.507811:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429561.507854:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648417792:0@lo:400:kworker.0 00000100:00100000:3.0:1789429561.507906:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429561.507940:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648417920 00000100:00100000:0.0:1789429561.507952:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648417920 00000100:00100000:3.0:1789429561.507958:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648417792 00000100:00100000:3.0:1789429561.507964:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648417792 00000100:00100000:2.0:1789429561.508024:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648417664:0@lo:400:kworker.0 00000100:00100000:2.0:1789429561.508063:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429561.508096:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648418176:0@lo:400:kworker.0 00000100:00100000:1.0:1789429561.508117:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648417536:0@lo:400:kworker.0 00000100:00100000:2.0:1789429561.508119:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429561.508156:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429561.508157:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648418176 00000100:00100000:2.0:1789429561.508161:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648418176 00000100:00100000:1.0:1789429561.508180:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0eb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648418048:0@lo:400:kworker.0 00000100:00100000:1.0:1789429561.508222:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429561.508251:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1789429561.508268:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648417536 00000100:02000000:0.0:1789429561.508272:0:8085:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429561.508272:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648417536 00000001:00020000:0.0:1789429561.508275:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429561.508296:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648417664 00000100:00100000:0.0:1789429561.508300:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648417664 00000100:00100000:1.0:1789429561.508300:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:02000000:1.0:1789429561.508304:0:5833:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429561.508310:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648417536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429561.508319:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648418048 00000100:00100000:0.0:1789429561.508321:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648418048 00000100:00100000:1.0:1789429561.508371:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648417536:12345-0@lo:400:kworker.0 Request processed in 61us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429561.508379:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1789429561.508440:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648417536:0@lo:400:kworker.0 00000100:00100000:3.0:1789429561.512216:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:02000000:3.0:1789429561.512227:0:15669:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429561.512231:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429561.512255:0:5839:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 6 min 3 max 116 00000100:00100000:3.0:1789429561.512385:0:5839:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_006' 00000100:00100000:3.0:1789429561.512580:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:02000000:3.0:1789429561.512583:0:5839:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429561.512585:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429561.516815:0:5840:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 7 min 3 max 116 00000100:00100000:0.0:1789429561.516831:0:5840:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_007' 00000100:00100000:2.0:1789429561.517246:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:02000000:2.0:1789429561.517328:0:20986:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429561.517333:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429561.517376:0:26936:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 7 min 3 max 116 00000100:00100000:2.0:1789429561.517390:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:02000000:2.0:1789429561.517393:0:26936:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429561.517395:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00080000:1.0:1789429561.518556:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429561.518568:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429561.518571:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789429561.571691:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:1.0:1789429561.939447:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429561.960381:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+32:46871:x1876351635174912:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429561.960414:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429561.960417:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789429561.960447:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ce00/0xb4c3dad72636215a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc48 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.960469:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f04fb8800) 00010000:00010000:1.0:1789429561.960479:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789429561.960495:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad726362176 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc56 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.960753:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636217d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.960766:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636217d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.960776:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636217d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.960789:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726362184 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.960796:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726362184 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.960803:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726362184 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789429561.961623:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x36:0x0], index 1: 0 00010000:00010000:1.0:1789429561.961907:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad72636218b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.961920:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad72636218b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.961929:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad72636218b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.961966:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636217d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.961973:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636217d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.961979:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636217d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.961985:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c4a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429561.961988:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636217d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.961994:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636217d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.962005:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cc00) 00010000:00010000:1.0:1789429561.962009:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429561.962013:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636217d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.962019:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636217d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429561.962030:0:5841:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008321e874 reply state 00000000a1b31441 transno 4294977259 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726362184 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429561.962038:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789429561.962068:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad726362176 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc56 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.962100:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad72636218b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc56 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429561.962108:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8e:0x0].0x0 (ffff946f0970c200) 00010000:00010000:1.0:1789429561.962110:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789429561.962112:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4000, rc 0) 00000100:00100000:1.0:1789429561.962193:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+34:46871:x1876351635174912:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1837us (4026681us total) trans 4294977259 rc 0/0 00000100:00100000:1.0:1789429561.962232:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21362 00010000:00010000:0.0:1789429561.980348:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726362184 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429561.980366:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726362184 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429561.980374:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726362184 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429561.980380:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c4800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429561.980384:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726362184 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429561.980391:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726362184 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429561.980407:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ce0eb6 (ffff946f0970cd00) 00010000:00010000:0.0:1789429561.980410:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429561.980415:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726362184 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429561.980422:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad726362184 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429561.985342:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429561.985689:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635175680 00000100:00100000:3.0:1789429561.985700:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635175680 00000100:00100000:3.0:1789429561.985747:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5925 00000100:02000000:3.0:1789429561.985753:0:6681:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429561.985760:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2367:x1876351635175680:12345-192.168.203.39@tcp:8:dd.0 00010000:00080000:3.0:1789429561.985792:0:6681:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t0 exp 0000000000000000 cur 1259 last 0 00000020:00000080:3.0:1789429561.985822:0:6681:0:(genops.c:1384:class_connect()) connect: client 12e09781-3d24-4c67-9972-bb781900e20d, cookie 0xb4c3dad726362199 00002000:00100000:3.0:1789429561.985832:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 12e09781-3d24-4c67-9972-bb781900e20d/ffff946f3f39a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789429561.985856:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789429561.986094:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789429561.986123:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946f3f399000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789429561.986196:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2367:x1876351635175680:12345-192.168.203.39@tcp:8:dd.0 Request processed in 435us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429561.986234:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5925 00000100:00100000:3.0:1789429561.989310:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429561.989547:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635175808 00000100:00100000:0.0:1789429561.989556:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635175808 00000100:00100000:0.0:1789429561.989625:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5926 00000100:02000000:0.0:1789429561.989631:0:13238:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429561.989640:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+6:46871:x1876351635175808:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429561.989659:0:13238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429561.989680:0:13238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc5d expref: -99 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429561.989706:0:13238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789429561.989726:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=1259s v=(0 0) 00010000:00010000:0.0:1789429561.989731:0:13238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429561.989740:0:13238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429561.989757:0:13238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 7 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429561.989769:0:13238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad600, rc 0) 00000100:00100000:0.0:1789429561.989831:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+7:46871:x1876351635175808:12345-192.168.203.39@tcp:101:dd.0 Request processed in 192us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429561.989838:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5926 00000100:00080000:1.0:1789429561.989898:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429562.010297:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429562.011340:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635176064 00000100:00100000:3.0:1789429562.011353:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635176064 00000100:00100000:3.0:1789429562.011415:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 294 00000100:02000000:3.0:1789429562.011421:0:5842:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429562.011430:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f05ace850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+33:46871:x1876351635176064:12345-192.168.203.39@tcp:35:dd.0 00000001:00080000:3.0:1789429562.011723:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977260 00000100:00100000:3.0:1789429562.012311:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f05ace850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+35:46871:x1876351635176064:12345-192.168.203.39@tcp:35:dd.0 Request processed in 880us (2021us total) trans 4294977261 rc 0/0 00000100:00100000:3.0:1789429562.012320:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 294 00000020:00080000:3.0:1789429562.012325:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789429562.020233:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789429562.020254:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648418304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429562.020318:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429562.020455:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648418304 00000100:00100000:1.0:1789429562.020463:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648418304 00000100:00100000:1.0:1789429562.020514:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:02000000:1.0:1789429562.020519:0:6683:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429562.020526:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648418304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429562.020550:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429562.020595:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648418304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429562.020602:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1789429562.020829:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648418304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429562.021280:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648418432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429562.021316:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429562.021421:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648418432 00000100:00100000:1.0:1789429562.021426:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648418432 00000100:00100000:1.0:1789429562.021464:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:02000000:1.0:1789429562.021467:0:6684:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429562.021473:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648418432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429562.021498:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1789429562.021541:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648418432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429562.021548:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1789429562.021625:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648418432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429562.040684:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429562.040779:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635176192 00000100:00100000:0.0:1789429562.040792:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635176192 00000100:00100000:0.0:1789429562.040858:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21363 00000100:02000000:0.0:1789429562.040864:0:5840:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429562.040867:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429562.053482:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429562.053596:0:19373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635176320 00000100:00100000:3.0:1789429562.053608:0:19373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635176320 00002000:00100000:3.0:1789429562.053662:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x36:0x0] (0->51199) req@ffff946e05044000 x1876351635176320/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:298/0 lens 488/0 e 0 to 0 dl 1789429573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429562.053673:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044000 with x1876351635176320 ext(0->51199) 00002000:00010000:3.0:1789429562.053680:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e05044000 00000100:00100000:3.0:1789429562.053716:0:19373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11894 00000100:02000000:3.0:1789429562.053722:0:19373:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429562.053726:0:19373:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00010000:00010000:3.0:1789429562.596335:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429563.619511:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429564.067582:0:5841:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 8 min 3 max 116 00000100:00100000:1.0:1789429564.067613:0:5841:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_008' 00000001:00100000:3.0:1789429564.154105:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00010000:00010000:3.0:1789429564.645965:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789429565.185805:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977259 is committed 00000001:00080000:2.0:1789429565.185831:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977261 is committed 00000001:00020000:2.0:1789429565.195360:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000001:00020000:1.0:1789429565.207666:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429565.207740:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2369:x1876351635175424:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:3.0:1789429565.207813:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429565.207870:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f34071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2369:x1876351635175424:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 186us (4098121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429565.207880:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 950 00000100:00100000:0.0:1789429565.226350:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f081cb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635175168:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429565.226486:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f081cb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635175168:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 373us (4116691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429565.226498:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 951 00000100:00080000:1.0:1789429565.226699:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789429565.563378:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429565.563490:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648417920:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789429565.563571:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429565.563655:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648417920:12345-0@lo:400:kworker.0 Request processed in 252us (4055843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429565.563667:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1789429565.564282:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648417920:0@lo:400:kworker.0 00000001:00020000:0.0:1789429565.571968:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429565.572040:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648417792:12345-0@lo:400:kworker.0 00000001:00020000:3.0:1789429565.572151:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429565.572172:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648418176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429565.572239:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648417792:12345-0@lo:400:kworker.0 Request processed in 252us (4064330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429565.572249:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:3.0:1789429565.572384:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648418176:12345-0@lo:400:kworker.0 Request processed in 223us (4064263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429565.572393:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1789429565.572664:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648418176:0@lo:400:kworker.0 00000100:00080000:1.0:1789429565.573601:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429565.573610:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429565.574151:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648417792:0@lo:400:kworker.0 00000001:00020000:1.0:1789429565.579358:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429565.579407:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648417664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429565.579575:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648417664:12345-0@lo:400:kworker.0 Request processed in 200us (4071511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429565.579584:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1789429565.580113:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648417664:0@lo:400:kworker.0 00000001:00020000:0.0:1789429565.603528:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429565.603610:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648418048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429565.603766:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648418048:12345-0@lo:400:kworker.0 Request processed in 218us (4095542us total) trans 0 rc 0/0 00000100:00080000:1.0:1789429565.604134:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429565.605362:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1789429565.605387:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0eb43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648418048:0@lo:400:kworker.0 00010000:00010000:3.0:1789429565.668681:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789429565.669502:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:1.0:1789429565.669509:0:6707:0:(genops.c:885:class_export_put()) final put ffff946f06fb7800/12e09781-3d24-4c67-9972-bb781900e20d 00000001:00100000:1.0:1789429565.669547:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:1.0:1789429565.669550:0:6707:0:(genops.c:885:class_export_put()) final put ffff946f3f330000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:2.0:1789429565.669807:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff946f06fb7800/12e09781-3d24-4c67-9972-bb781900e20d for lustre-OST0000 00000020:00000080:2.0:1789429565.669853:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff946f3f330000/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 for lustre-OST0000 00000020:00000080:2.0:1789429565.669866:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946f06fb4800 for lustre-OST0000 00000020:00000080:2.0:1789429565.669870:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946f3f334000 for lustre-OST0000 00000001:00020000:0.0:1789429566.107318:0:19373:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429566.107374:0:19373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635176320:12345-192.168.203.39@tcp:4:dd.0 00000100:00080000:1.0:1789429566.107687:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429566.112096:0:19373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:12e09781-3d24-4c67-9972-bb781900e20d+8:2368:x1876351635176320:12345-192.168.203.39@tcp:4:dd.0 Request processed in 4746us (4058607us total) trans 4294969607 rc 0/0 00000100:00100000:0.0:1789429566.112114:0:19373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11894 00002000:00100000:0.0:1789429566.112127:0:19373:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x36:0x0] (0->51199) req@ffff946e05044000 x1876351635176320/t4294969607(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:298/0 lens 488/448 e 0 to 0 dl 1789429573 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429566.112137:0:19373:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e05044000 with x1876351635176320 ext(0->51199) 00002000:00010000:0.0:1789429566.112145:0:19373:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946e05044000 00000001:00020000:1.0:1789429566.115301:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429566.115331:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:46873:x1876351635176192:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429566.115354:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429566.115379:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad7263621a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc64 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429566.115444:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429566.115457:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429566.115470:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429566.115501:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429566.115505:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429566.115522:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429566.115543:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad7263621a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429566.115560:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429566.115567:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cd00) 00010000:00010000:1.0:1789429566.115570:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429566.115573:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c4800, rc 0) 00000100:00100000:1.0:1789429566.115644:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:46873:x1876351635176192:12345-192.168.203.39@tcp:101:dd.0 Request processed in 330us (4074973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429566.115653:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21363 00000100:00100000:1.0:1789429566.129405:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429566.129497:0:26937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635176576 00000100:00100000:2.0:1789429566.129507:0:26937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635176576 00000100:00100000:2.0:1789429566.129562:0:26937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21364 00000100:02000000:2.0:1789429566.129567:0:26937:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429566.142627:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429566.229529:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429566.229571:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429566.229758:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635176704 00000100:00100000:2.0:1789429566.229768:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635176704 00000100:00100000:2.0:1789429566.229826:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 631 00000100:02000000:2.0:1789429566.229831:0:5831:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:2.0:1789429566.229839:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635176704:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429566.229917:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635176704:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 78us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429566.229924:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 631 00000100:00100000:1.0:1789429566.230302:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635176832 00000100:00100000:1.0:1789429566.230308:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635176832 00000100:00100000:1.0:1789429566.230348:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 955 00000100:02000000:1.0:1789429566.230352:0:26938:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429566.230354:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429566.629616:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648418560:0@lo:400:kworker.0 00000100:00100000:1.0:1789429566.629690:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429566.629823:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648418560 00000100:00100000:0.0:1789429566.629830:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648418560 00000100:00100000:0.0:1789429566.629887:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:02000000:0.0:1789429566.629893:0:5834:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429566.629900:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648418560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429566.630127:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648418688:0@lo:400:kworker.0 00000100:00100000:2.0:1789429566.630158:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429566.630237:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648418688 00000100:00100000:2.0:1789429566.630241:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648418688 00000100:00100000:2.0:1789429566.630276:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:02000000:2.0:1789429566.630279:0:5839:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429566.630282:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429566.637673:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648418944:0@lo:400:kworker.0 00000100:00100000:3.0:1789429566.637735:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429566.637781:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429566.637787:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648418816:0@lo:400:kworker.0 00000100:00100000:3.0:1789429566.637810:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429566.637840:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648418944 00000100:00100000:3.0:1789429566.637847:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648418944 00000100:00100000:2.0:1789429566.638145:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648419200:0@lo:400:kworker.0 00000100:00100000:2.0:1789429566.638177:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429566.638217:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429566.638223:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648419072:0@lo:400:kworker.0 00000100:00100000:2.0:1789429566.638257:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429566.638298:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648418816 00000100:00100000:2.0:1789429566.638302:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648418816 00000100:00100000:2.0:1789429566.638333:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648419072 00000100:00100000:2.0:1789429566.638336:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648419072 00000100:00100000:2.0:1789429566.638355:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:02000000:2.0:1789429566.638360:0:15669:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429566.638363:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429566.638375:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:02000000:2.0:1789429566.638378:0:5841:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429566.638380:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429566.638394:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648419200 00000100:00100000:2.0:1789429566.638397:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648419200 00000100:00100000:2.0:1789429566.638436:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:02000000:2.0:1789429566.638439:0:6681:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429566.638440:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429566.639447:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648418560:12345-0@lo:400:kworker.0 Request processed in 9544us (9753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429566.639460:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:3.0:1789429566.641377:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:02000000:3.0:1789429566.641384:0:6682:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429566.641387:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429566.643430:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648418560:0@lo:400:kworker.0 00010000:00010000:3.0:1789429566.691467:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429567.139518:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648419328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429567.139586:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429567.139742:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648419328 00000100:00100000:1.0:1789429567.139750:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648419328 00000100:00100000:1.0:1789429567.139825:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:02000000:1.0:1789429567.139830:0:9195:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429567.139838:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648419328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429567.139859:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47382528 pending 1703936 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429567.139917:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648419328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429567.139923:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:1.0:1789429567.139966:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648419328:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789429567.140185:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429567.140314:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648419456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429567.140347:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429567.140598:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648419456 00000100:00100000:2.0:1789429567.140604:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648419456 00000100:00100000:2.0:1789429567.140653:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:02000000:2.0:1789429567.140656:0:6683:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:2.0:1789429567.140664:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648419456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429567.140688:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429567.140724:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648419456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429567.140729:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00080000:3.0:1789429567.140790:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429567.140847:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648419456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789429567.715345:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429568.739614:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429569.240065:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969607 is committed 00010000:00010000:3.0:1789429569.764558:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:3.0:1789429570.243314:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429570.269382:0:26937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:46873:x1876351635176576:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429570.269413:0:26937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429570.269444:0:26937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d400/0xb4c3dad7263621b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc6b expref: -99 pid: 26937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429570.269593:0:26937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c600/0xb4c3dad7263621bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429570.269609:0:26937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c600/0xb4c3dad7263621bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429570.269623:0:26937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c600/0xb4c3dad7263621bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429570.269638:0:26937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d800/0xb4c3dad7263621c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429570.269645:0:26937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d800/0xb4c3dad7263621c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429570.269656:0:26937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d800/0xb4c3dad7263621c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789429570.269931:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789429570.274638:0:26937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274660:0:26937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274688:0:26937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429570.274701:0:26937:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8e:0x0]: returning size 51200 00010000:00010000:2.0:1789429570.274850:0:26937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c600/0xb4c3dad7263621bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274859:0:26937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c600/0xb4c3dad7263621bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274866:0:26937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c600/0xb4c3dad7263621bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274873:0:26937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31c600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429570.274877:0:26937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c600/0xb4c3dad7263621bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274885:0:26937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c600/0xb4c3dad7263621bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274899:0:26937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cd00) 00010000:00010000:2.0:1789429570.274901:0:26937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429570.274907:0:26937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c600/0xb4c3dad7263621bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274912:0:26937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31c600/0xb4c3dad7263621bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274925:0:26937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d800/0xb4c3dad7263621c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274931:0:26937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d800/0xb4c3dad7263621c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274937:0:26937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d800/0xb4c3dad7263621c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274941:0:26937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31d800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429570.274944:0:26937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d800/0xb4c3dad7263621c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274950:0:26937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d800/0xb4c3dad7263621c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274962:0:26937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ce0eb6 (ffff946f04fb8d00) 00010000:00010000:2.0:1789429570.274964:0:26937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429570.274967:0:26937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d800/0xb4c3dad7263621c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.274973:0:26937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d800/0xb4c3dad7263621c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.275031:0:26937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31d400/0xb4c3dad7263621b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 24 pid: 26937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.275046:0:26937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 23 pid: 26937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429570.275054:0:26937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8e:0x0].0x0 (ffff946f0970c200) 00010000:00010000:2.0:1789429570.275057:0:26937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789429570.275059:0:26937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31ac00, rc 0) 00000100:00100000:2.0:1789429570.275135:0:26937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:46873:x1876351635176576:12345-192.168.203.39@tcp:101:dd.0 Request processed in 5872us (4145738us total) trans 4294977262 rc 0/0 00000100:00100000:2.0:1789429570.275145:0:26937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21364 00000100:00100000:0.0:1789429570.282899:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429570.283045:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635176960 00000100:00100000:3.0:1789429570.283055:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635176960 00000100:00100000:3.0:1789429570.283102:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5927 00000100:02000000:3.0:1789429570.283107:0:6680:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429570.296809:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2367:x1876351635176960:12345-192.168.203.39@tcp:8:dd.0 00010000:00080000:0.0:1789429570.297504:0:6680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1268 last 0 00000020:00000080:0.0:1789429570.297537:0:6680:0:(genops.c:1384:class_connect()) connect: client 217af837-ec0e-4ad4-94fa-9fc2e0e9f711, cookie 0xb4c3dad7263621d8 00002000:00100000:0.0:1789429570.297548:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 217af837-ec0e-4ad4-94fa-9fc2e0e9f711/ffff946e02cdd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789429570.297570:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789429570.297693:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789429570.297746:0:6680:0:(import.c:65:import_set_state_nolock()) ffff946e02cd8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789429570.297813:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2367:x1876351635176960:12345-192.168.203.39@tcp:8:dd.0 Request processed in 1015us (14924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429570.297822:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5927 00000100:00100000:2.0:1789429570.302723:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429570.302809:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635177088 00000100:00100000:3.0:1789429570.302821:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635177088 00000100:00100000:3.0:1789429570.302911:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5928 00000100:02000000:3.0:1789429570.302917:0:20986:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429570.302927:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:46873:x1876351635177088:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1789429570.302947:0:20986:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429570.302976:0:20986:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc72 expref: -99 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429570.303025:0:20986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 5 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429570.303034:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x36:0x0].0x0 since=9s v=(0 0) 00010000:00010000:3.0:1789429570.303039:0:20986:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789429570.303044:0:20986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 4/0,0 mode: --/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429570.303078:0:20986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 5 pid: 13238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:3.1F:1789429570.303093:0:20986:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00000100:00080000:2.0:1789429570.305138:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789429570.310426:0:20986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 5 pid: 13238 timeout: 1269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429570.310459:0:20986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648419584:192.168.203.39@tcp:104: 00000001:00020000:0.0:1789429570.311136:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429570.311176:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635176832:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:2.0:1789429570.311325:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429570.311410:0:20986:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f199dd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429570.314389:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635176832:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 3232us (4084857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429570.314405:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 955 00000100:00100000:2.0:1789429570.321635:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429570.322343:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635177216 00000100:00100000:1.0:1789429570.322354:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635177216 00010000:00010000:1.0:1789429570.322411:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 6 pid: 13238 timeout: 1269 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429570.322464:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6268 00000100:02000000:1.0:1789429570.322471:0:5825:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429570.322474:0:5825:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00080000:2.0:1789429570.324175:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429570.325443:0:20986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:20986:1876351648419584:192.168.203.39@tcp:104: 00010000:00010000:3.0:1789429570.325478:0:20986:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 3/0,0 mode: --/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 7 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429570.325499:0:20986:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31da00, rc 0) 00000100:00100000:3.0:1789429570.325577:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:46873:x1876351635177088:12345-192.168.203.39@tcp:101:dd.0 Request processed in 22651us (22862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429570.325586:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5928 00000001:00020000:3.0:1789429570.692277:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429570.692332:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648419200:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789429570.692521:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429570.692648:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648419200:0@lo:400:kworker.0 00000100:00100000:3.0:1789429570.692663:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648419200:12345-0@lo:400:kworker.0 Request processed in 304us (4054415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429570.692675:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000001:00020000:3.0:1789429570.699987:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429570.700052:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648418816:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789429570.700243:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429570.700321:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648418816:12345-0@lo:400:kworker.0 Request processed in 320us (4062508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429570.700330:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1789429570.705878:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648418816:0@lo:400:kworker.0 00000001:00020000:1.0:1789429570.715356:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429570.715389:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648418688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429570.715516:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648418688:12345-0@lo:400:kworker.0 Request processed in 146us (4085355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429570.715525:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:2.0:1789429570.715910:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648418688:0@lo:400:kworker.0 00000001:00020000:2.0:1789429570.731366:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429570.731422:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648419072:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789429570.731615:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429570.731739:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648419072:12345-0@lo:400:kworker.0 Request processed in 358us (4093480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429570.731749:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1789429570.733544:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648419072:0@lo:400:kworker.0 00000001:00020000:0.0:1789429570.739330:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429570.739384:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648418944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429570.739495:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648418944:12345-0@lo:400:kworker.0 Request processed in 151us (4101759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429570.739505:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00080000:1.0:1789429570.739699:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429570.739827:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648418944:0@lo:400:kworker.0 00010000:00010000:3.0:1789429570.787355:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429571.349801:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429571.349856:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429571.349893:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429571.349917:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429571.349920:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635177600 00000100:00100000:2.0:1789429571.349932:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635177600 00000100:00100000:3.0:1789429571.349951:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429571.349982:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635177472 00000100:00100000:2.0:1789429571.349985:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635177856 00000100:00100000:3.0:1789429571.349987:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635177472 00000100:00100000:2.0:1789429571.349991:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635177856 00000100:00100000:2.0:1789429571.350024:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1000 00000100:02000000:2.0:1789429571.350030:0:13238:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429571.350033:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429571.350066:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635177728 00000100:00100000:2.0:1789429571.350069:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635177728 00000100:00100000:2.0:1789429571.350102:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 959 00000100:02000000:2.0:1789429571.350105:0:15700:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429571.350108:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429571.350184:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635177344 00000100:00100000:0.0:1789429571.350189:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635177344 00000100:00100000:3.0:1789429571.350190:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 960 00000100:02000000:3.0:1789429571.350195:0:6704:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429571.350226:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429571.350259:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1001 00000100:02000000:3.0:1789429571.350263:0:6680:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429571.350266:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429571.350267:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 633 00000100:02000000:0.0:1789429571.350273:0:5833:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429571.350281:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635177344:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429571.350353:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635177344:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 74us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429571.350361:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 633 00010000:00100000:0.0:1789429571.363461:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621a0 req@ffff946f29dea300 x1876351635177216/t0(0) o103->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:306/0 lens 328/0 e 0 to 0 dl 1789429581 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789429571.363484:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 8 pid: 13238 timeout: 1269 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:0.1F:1789429571.363496:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:0.0:1789429571.366582:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 8 pid: 13238 timeout: 1270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429571.747462:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648420096:0@lo:400:kworker.0 00000100:00100000:3.0:1789429571.747531:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429571.747588:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429571.747595:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648419968:0@lo:400:kworker.0 00000100:00100000:3.0:1789429571.747621:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429571.747666:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648420096 00000100:00100000:3.0:1789429571.747673:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648420096 00000100:00100000:3.0:1789429571.747717:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:02000000:3.0:1789429571.747722:0:20986:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429571.747725:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429571.748494:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648419712:0@lo:400:kworker.0 00000100:00100000:1.0:1789429571.748548:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429571.748600:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648420224:0@lo:400:kworker.0 00000100:00100000:1.0:1789429571.748628:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429571.748653:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789429571.748659:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648419840:0@lo:400:kworker.0 00000100:00100000:1.0:1789429571.748679:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429571.748693:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648420352:0@lo:400:kworker.0 00000100:00100000:1.0:1789429571.748712:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429571.748792:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648419712 00000100:00100000:3.0:1789429571.748799:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648419712 00000100:00100000:3.0:1789429571.748841:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:02000000:3.0:1789429571.748845:0:5834:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429571.748856:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648419712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429571.748912:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648419712:12345-0@lo:400:kworker.0 Request processed in 60us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429571.748919:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1789429571.748952:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648419968 00000100:00100000:3.0:1789429571.748956:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648419968 00000100:00100000:3.0:1789429571.748975:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648420224 00000100:00100000:3.0:1789429571.748978:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648420224 00000100:00100000:3.0:1789429571.748991:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648419840 00000100:00100000:3.0:1789429571.748993:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648419840 00000100:00100000:3.0:1789429571.749018:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:02000000:3.0:1789429571.749021:0:15669:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429571.749024:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429571.749084:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:02000000:1.0:1789429571.749088:0:26936:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429571.749090:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429571.749102:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:02000000:1.0:1789429571.749105:0:5839:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429571.749107:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429571.749137:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648419712:0@lo:400:kworker.0 00000100:00100000:0.0:1789429571.764345:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648420352 00000100:00100000:0.0:1789429571.764360:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648420352 00000100:00100000:0.0:1789429571.764421:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:02000000:0.0:1789429571.764427:0:6682:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429571.764430:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00010000:00010000:3.0:1789429571.811738:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429572.259812:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429572.259841:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648420480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429572.259925:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429572.260633:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648420480 00000100:00100000:0.0:1789429572.260642:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648420480 00000100:00100000:0.0:1789429572.260713:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:02000000:0.0:1789429572.260718:0:6684:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429572.260726:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648420480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429572.260758:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3855613952 avail 3853516800 00000100:00100000:0.0:1789429572.260809:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648420480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429572.260816:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00080000:2.0:1789429572.260885:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429572.261103:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648420480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429572.264416:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648420608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429572.264482:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429572.265577:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648420608 00000100:00100000:0.0:1789429572.265588:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648420608 00000100:00100000:0.0:1789429572.265659:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:02000000:0.0:1789429572.265665:0:9195:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429572.265675:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648420608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429572.265711:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429572.265775:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648420608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429572.265782:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00080000:2.0:1789429572.265855:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429572.265978:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648420608:0@lo:13:osp-pre-1-0.0 00010000:00100000:0.0:1789429572.387373:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621a0 req@ffff946f29dea300 x1876351635177216/t0(0) o103->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:306/0 lens 328/0 e 0 to 0 dl 1789429581 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789429572.387393:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 8 pid: 13238 timeout: 1270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:0.1:1789429572.387406:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:0.0:1789429572.388874:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 8 pid: 13238 timeout: 1271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429572.835631:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00100000:0.0:1789429573.411512:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621a0 req@ffff946f29dea300 x1876351635177216/t0(0) o103->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:306/0 lens 328/0 e 0 to 0 dl 1789429581 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789429573.411530:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 8 pid: 13238 timeout: 1271 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:0.1:1789429573.411544:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:0.0:1789429573.411552:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 8 pid: 13238 timeout: 1272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429573.859411:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789429574.347434:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000001:00020000:3.0:1789429574.411645:0:5825:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429574.432953:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635177216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789429574.432980:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789429574.433012:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb size from disk: 0 -> 51200 00002000:00010000:3.0:1789429574.433017:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb mtime from disk: 0 -> 1789429562 00002000:00010000:3.0:1789429574.433020:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb ctime from disk: 0 -> 1789429562 00002000:00010000:3.0:1789429574.433022:0:5825:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x36:0x0] updating lvb blocks from disk: 1 -> 131 00010000:00010000:3.0:1789429574.433031:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 7 pid: 13238 timeout: 1272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429574.433049:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 7 pid: 13238 timeout: 1272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429574.433072:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007215c1bd/0xb4c3dad7263621a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc5d expref: 7 pid: 13238 timeout: 1272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429574.433090:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=4s v=(1 0) 00010000:00010000:3.0:1789429574.433094:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1789429574.433102:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429574.433112:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429574.433153:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429574.433168:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648420736:192.168.203.39@tcp:105: 00000100:00080000:2.0:1789429574.435747:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429574.436346:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f199dd180 going to sleep for 11 seconds 00000100:00100000:1.0:1789429574.439432:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5825:1876351648420736:192.168.203.39@tcp:105: 00010000:00010000:1.0:1789429574.439471:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429574.439527:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2370:x1876351635177216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6616us (4117902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429574.439539:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6268 00000100:00100000:2.0:1789429574.440282:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429574.440405:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635177984 00000100:00100000:3.0:1789429574.440414:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635177984 00002000:00100000:3.0:1789429574.440483:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x36:0x0] (0->4095) req@ffff946f29de9880 x1876351635177984/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:310/0 lens 488/0 e 0 to 0 dl 1789429585 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429574.440495:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9880 with x1876351635177984 ext(0->4095) 00002000:00010000:3.0:1789429574.440500:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29de9880 00000100:00100000:3.0:1789429574.440521:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11895 00000100:02000000:3.0:1789429574.440526:0:6685:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429574.440528:0:6685:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00080000:2.0:1789429574.440641:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789429574.883477:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789429575.365933:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977262 is committed 00000001:00020000:0.0:1789429575.411319:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429575.411377:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635177472:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429575.411469:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635177472:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 135us (4061551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429575.411489:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 960 00000100:00080000:2.0:1789429575.411799:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789429575.411852:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429575.412088:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635177728:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429575.412140:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635177728:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 280us (4062189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429575.412148:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 959 00000100:00080000:2.0:1789429575.417391:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:1.0:1789429575.419298:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429575.419341:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635177600:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429575.419427:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635177600:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 116us (4069570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429575.419446:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1000 00000001:00020000:1.0:1789429575.420033:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429575.420048:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635177856:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429575.420087:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2369:x1876351635177856:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 45us (4070193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429575.420094:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1001 00000001:00020000:3.0:1789429575.803369:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429575.803417:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648420096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429575.803522:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648420096:12345-0@lo:400:kworker.0 Request processed in 139us (4055989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429575.803531:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00080000:2.0:1789429575.803653:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:1.0:1789429575.803742:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429575.803764:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648420224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429575.803826:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648420224:12345-0@lo:400:kworker.0 Request processed in 76us (4055196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429575.803832:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1789429575.803876:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648420224:0@lo:400:kworker.0 00000100:00080000:1.0:1789429575.803902:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789429575.803953:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429575.803965:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648419840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429575.804036:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648419840:12345-0@lo:400:kworker.0 Request processed in 75us (4055354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429575.804041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000001:00020000:3.0:1789429575.804327:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429575.804351:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648419968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429575.804390:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648419968:12345-0@lo:400:kworker.0 Request processed in 57us (4056768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429575.804396:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00080000:2.0:1789429575.804450:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429575.804511:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648419840:0@lo:400:kworker.0 00000100:00100000:0.0:1789429575.804621:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648419968:0@lo:400:kworker.0 00000100:00100000:0.0:1789429575.804632:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648420096:0@lo:400:kworker.0 00000001:00020000:1.0:1789429575.835315:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429575.835372:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648420352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429575.835490:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648420352:12345-0@lo:400:kworker.0 Request processed in 161us (4086776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429575.835499:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1789429575.835630:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648420352:0@lo:400:kworker.0 00000100:00080000:2.0:1789429575.835745:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789429575.907451:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429576.470874:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429576.470919:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429576.470950:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429576.471064:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635178112 00000100:00100000:1.0:1789429576.471075:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635178112 00000100:00100000:1.0:1789429576.471126:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 635 00000100:02000000:1.0:1789429576.471130:0:5831:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429576.471138:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635178112:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429576.471234:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635178112:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 95us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429576.471241:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 635 00000100:00100000:0.0:1789429576.471608:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429576.471650:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429576.471719:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635178240 00000100:00100000:0.0:1789429576.471723:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635178240 00000100:00100000:0.0:1789429576.471754:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635178496 00000100:00100000:0.0:1789429576.471757:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635178496 00000100:00100000:0.0:1789429576.471777:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 964 00000100:02000000:0.0:1789429576.471781:0:5840:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429576.471784:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429576.471820:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 965 00000100:02000000:0.0:1789429576.471823:0:26938:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429576.471825:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429576.475375:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635178368 00000100:00100000:2.0:1789429576.475393:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635178368 00000100:00100000:2.0:1789429576.475602:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635178624 00000100:00100000:2.0:1789429576.475607:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635178624 00000100:00080000:1.0:1789429576.475778:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429576.475805:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1004 00000100:02000000:1.0:1789429576.475810:0:13238:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429576.475813:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429576.476606:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1005 00000100:02000000:2.0:1789429576.476611:0:6681:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429576.476613:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429576.869167:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648420992:0@lo:400:kworker.0 00000100:00100000:0.0:1789429576.869176:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648421248:0@lo:400:kworker.0 00000100:00100000:1.0:1789429576.869256:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648421120:0@lo:400:kworker.0 00000100:00100000:3.0:1789429576.870100:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648420864:0@lo:400:kworker.0 00000100:00100000:0.0:1789429576.872838:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429576.872881:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429576.872942:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648421248 00000100:00100000:0.0:1789429576.872951:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648421248 00000100:00100000:0.0:1789429576.873016:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:02000000:0.0:1789429576.873021:0:6680:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429576.873025:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429576.873038:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648420992 00000100:00100000:0.0:1789429576.873042:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648420992 00000100:00100000:2.0:1789429576.873059:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648421504:0@lo:400:kworker.0 00000100:00100000:0.0:1789429576.873068:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:02000000:0.0:1789429576.873072:0:6704:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429576.873074:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429576.873103:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429576.873160:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648421504 00000100:00100000:0.0:1789429576.873164:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648421504 00000100:00100000:0.0:1789429576.873191:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:02000000:0.0:1789429576.873194:0:20986:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429576.873196:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429576.874515:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429576.875539:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648421120 00000100:00100000:0.0:1789429576.875549:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648421120 00000100:00100000:0.0:1789429576.875606:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:02000000:0.0:1789429576.875611:0:26936:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429576.875614:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429576.876597:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429576.876654:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648421376:0@lo:400:kworker.0 00000100:00100000:3.0:1789429576.876697:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429576.876727:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648421376 00000100:00100000:3.0:1789429576.876732:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648421376 00000100:00100000:3.0:1789429576.876763:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:02000000:3.0:1789429576.876767:0:15669:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429576.876769:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429576.876918:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648420864 00000100:00100000:0.0:1789429576.876922:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648420864 00000100:00100000:0.0:1789429576.876954:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:02000000:0.0:1789429576.876957:0:5833:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429576.876964:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648420864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429576.877029:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648420864:12345-0@lo:400:kworker.0 Request processed in 66us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429576.877047:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1789429576.877933:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648420864:0@lo:400:kworker.0 00010000:00010000:3.0:1789429576.931484:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429577.379620:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648421632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429577.379687:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429577.379897:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648421632 00000100:00100000:0.0:1789429577.379905:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648421632 00000100:00100000:0.0:1789429577.379979:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:02000000:0.0:1789429577.379985:0:6683:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429577.379995:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648421632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429577.380028:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429577.380072:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648421632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429577.380079:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00080000:1.0:1789429577.380270:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429577.380311:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648421632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429577.382341:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648421760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429577.382402:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429577.382505:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648421760 00000100:00100000:1.0:1789429577.382513:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648421760 00000100:00100000:1.0:1789429577.382574:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:02000000:1.0:1789429577.382579:0:6684:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429577.382586:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648421760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429577.382616:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3855613952 avail 3853516800 00000100:00080000:0.0:1789429577.382681:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429577.392737:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648421760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10142us (10325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429577.392752:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789429577.393088:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648421760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789429577.957073:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:0.0:1789429578.515495:0:6685:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429578.515605:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635177984:12345-192.168.203.39@tcp:3:dd.0 00000100:00100000:0.0:1789429578.515866:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2371:x1876351635177984:12345-192.168.203.39@tcp:3:dd.0 Request processed in 356us (4075585us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789429578.515875:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11895 00002000:00100000:0.0:1789429578.515886:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x36:0x0] (0->4095) req@ffff946f29de9880 x1876351635177984/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:310/0 lens 488/4536 e 0 to 0 dl 1789429585 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429578.515896:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f29de9880 with x1876351635177984 ext(0->4095) 00002000:00010000:0.0:1789429578.515902:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f29de9880 00000100:00080000:1.0:1789429578.521901:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429578.528324:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429578.529945:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635178752 00000100:00100000:2.0:1789429578.529968:0:18945:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635178752 00002000:00100000:2.0:1789429578.530021:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x36:0x0] (4096->53247) req@ffff946f054d4000 x1876351635178752/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:314/0 lens 488/0 e 0 to 0 dl 1789429589 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429578.530033:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4000 with x1876351635178752 ext(4096->53247) 00002000:00010000:2.0:1789429578.530040:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054d4000 00000100:00100000:2.0:1789429578.530082:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11896 00000100:02000000:2.0:1789429578.530087:0:18945:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429578.538216:0:18945:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00010000:00010000:3.0:1789429578.979453:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429580.003417:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:1.0:1789429580.531385:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429580.531437:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635178496:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:0.0:1789429580.531484:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429580.531531:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635178496:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 131us (4059879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429580.531539:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 965 00000001:00020000:3.0:1789429580.531608:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429580.531633:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635178240:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429580.531663:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635178240:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 47us (4060056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429580.531669:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 964 00000001:00020000:2.0:1789429580.531742:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429580.531759:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635178624:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429580.531813:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635178624:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 63us (4060862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429580.531820:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1005 00000100:00080000:1.0:1789429580.532084:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429580.532088:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:1.0:1789429580.541176:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429580.541257:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351635178368:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429580.541353:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351635178368:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 161us (4070432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429580.541363:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1004 00000100:00080000:0.0:1789429580.541898:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:1.0:1789429580.931308:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000001:00020000:3.0:1789429580.931308:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429580.931355:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648421376:12345-0@lo:400:kworker.0 00000001:00020000:2.0:1789429580.931451:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429580.931459:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648421376:12345-0@lo:400:kworker.0 Request processed in 137us (4054760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429580.931466:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648420992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429580.931473:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1789429580.931535:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648420992:12345-0@lo:400:kworker.0 Request processed in 75us (4058654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429580.931542:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648421376:0@lo:400:kworker.0 00000100:00100000:2.0:1789429580.931545:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:2.0:1789429580.931590:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648420992:0@lo:400:kworker.0 00000100:00100000:1.0:1789429580.932971:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648421504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429580.933041:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648421504:12345-0@lo:400:kworker.0 Request processed in 1719us (4059938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429580.933050:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1789429580.933175:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648421504:0@lo:400:kworker.0 00000100:00080000:0.0:1789429580.933320:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429580.933327:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789429580.939899:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429580.939965:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648421120:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789429580.940142:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429580.940745:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648421120:12345-0@lo:400:kworker.0 Request processed in 830us (4066231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429580.940755:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:1.0:1789429580.945524:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648421120:0@lo:400:kworker.0 00000001:00020000:3.0:1789429580.947385:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429580.947431:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648421248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429580.947535:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648421248:12345-0@lo:400:kworker.0 Request processed in 138us (4074703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429580.947545:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00080000:0.0:1789429580.947622:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429580.947780:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648421248:0@lo:400:kworker.0 00010000:00010000:3.0:1789429581.027462:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429581.592952:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429581.593050:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429581.593085:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429581.593111:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429581.593135:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429581.593162:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635179008 00000100:00100000:0.0:1789429581.593170:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635179008 00000100:00100000:0.0:1789429581.593242:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635179264 00000100:00100000:0.0:1789429581.593245:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635179264 00000100:00100000:0.0:1789429581.593269:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 969 00000100:02000000:0.0:1789429581.593275:0:15700:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429581.593278:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429581.593292:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 970 00000100:02000000:0.0:1789429581.593295:0:5841:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429581.593297:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429581.593383:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635179136 00000100:00100000:2.0:1789429581.593388:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635179136 00000100:00100000:2.0:1789429581.593420:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635179392 00000100:00100000:2.0:1789429581.593423:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635179392 00000100:00100000:2.0:1789429581.593441:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1008 00000100:02000000:2.0:1789429581.593444:0:6682:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429581.593446:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429581.593457:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1009 00000100:02000000:2.0:1789429581.593459:0:6681:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429581.593461:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429581.595963:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635178880 00000100:00100000:1.0:1789429581.595977:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635178880 00000100:00100000:1.0:1789429581.596099:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 637 00000100:02000000:1.0:1789429581.596104:0:5831:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429581.596114:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635178880:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429581.596215:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d05450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635178880:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 89us (3267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429581.596223:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 637 00000100:00100000:1.0:1789429581.988074:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648422144:0@lo:400:kworker.0 00000100:00100000:0.0:1789429581.988107:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648421888:0@lo:400:kworker.0 00000100:00100000:3.0:1789429581.988311:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648422272:0@lo:400:kworker.0 00000100:00100000:2.0:1789429581.988529:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648422016:0@lo:400:kworker.0 00000100:00100000:1.0:1789429581.988764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429581.988867:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648422144 00000100:00100000:1.0:1789429581.988878:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648422144 00000100:00100000:1.0:1789429581.989066:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:02000000:1.0:1789429581.989072:0:26938:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429581.989075:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429581.989504:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429581.989659:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648422400:0@lo:400:kworker.0 00000100:00100000:0.0:1789429581.989707:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429581.989772:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648422400 00000100:00100000:0.0:1789429581.989780:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648422400 00000100:00100000:0.0:1789429581.989826:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:02000000:0.0:1789429581.989831:0:15669:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429581.989834:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429581.990040:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648421888 00000100:00100000:1.0:1789429581.990046:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648421888 00000100:00100000:1.0:1789429581.990083:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:02000000:1.0:1789429581.990086:0:5834:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429581.990093:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648421888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429581.990155:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d06050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648421888:12345-0@lo:400:kworker.0 Request processed in 62us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429581.990162:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1789429581.990228:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648421888:0@lo:400:kworker.0 00000100:00100000:3.0:1789429581.994068:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429581.994181:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648422272 00000100:00100000:1.0:1789429581.994195:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648422272 00000100:00100000:1.0:1789429581.994290:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:02000000:1.0:1789429581.994296:0:13238:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429581.994300:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429581.995118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429581.995194:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648422528:0@lo:400:kworker.0 00000100:00100000:1.0:1789429581.995235:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648422016 00000100:00100000:1.0:1789429581.995245:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648422016 00000100:00100000:2.0:1789429581.995279:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429581.995306:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:02000000:1.0:1789429581.995312:0:26936:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429581.995315:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429581.996789:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648422528 00000100:00100000:3.0:1789429581.996805:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648422528 00000100:00100000:3.0:1789429581.996885:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:02000000:3.0:1789429581.996891:0:6680:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429581.996895:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00010000:00010000:0.0:1789429582.055461:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429582.499536:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648422656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429582.499641:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429582.499712:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429582.499725:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648422784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429582.499732:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648422656 00000100:00100000:0.0:1789429582.499746:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648422656 00000100:00100000:1.0:1789429582.499757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789429582.499918:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429582.500058:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648422784 00000100:00100000:0.0:1789429582.500065:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648422784 00000100:00080000:3.0:1789429582.500249:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429582.502715:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:02000000:1.0:1789429582.502725:0:6683:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429582.502749:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648422656:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429582.502869:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:02000000:0.0:1789429582.502880:0:9195:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429582.502902:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648422784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429582.502963:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3855613952 avail 3853516800 00000100:00100000:0.0:1789429582.503155:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648422784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 267us (3400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429582.503163:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1789429582.503311:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648422784:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429582.503324:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429582.503437:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648422656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 701us (3796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429582.503448:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1789429582.503583:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648422656:0@lo:13:osp-pre-1-0.0 00000001:00020000:0.0:1789429582.611409:0:18945:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429582.631102:0:18945:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635178752:12345-192.168.203.39@tcp:3:dd.0 00000100:00080000:3.0:1789429582.633222:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429582.646812:0:18945:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635178752:12345-192.168.203.39@tcp:3:dd.0 Request processed in 15878us (4118477us total) trans 0 rc 49152/49152 00000100:00100000:0.0:1789429582.646832:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11896 00002000:00100000:0.0:1789429582.646849:0:18945:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x36:0x0] (4096->53247) req@ffff946f054d4000 x1876351635178752/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:314/0 lens 488/440 e 0 to 0 dl 1789429589 ref 1 fl Complete:/600/0 rc 49152/49152 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429582.646862:0:18945:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f054d4000 with x1876351635178752 ext(4096->53247) 00002000:00010000:0.0:1789429582.646870:0:18945:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946f054d4000 00000100:00100000:0.0:1789429582.655277:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429582.655374:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635179648 00000100:00100000:2.0:1789429582.655390:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635179648 00000100:00100000:2.0:1789429582.655502:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 295 00000100:02000000:2.0:1789429582.655510:0:21208:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:2.0:1789429582.655531:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:46873:x1876351635179648:12345-192.168.203.39@tcp:35:dd.0 00000100:00080000:3.0:1789429582.655645:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429582.656274:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:46873:x1876351635179648:12345-192.168.203.39@tcp:35:dd.0 Request processed in 743us (1009us total) trans 4294977263 rc 0/0 00000100:00100000:2.0:1789429582.656284:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 295 00010000:00010000:3.0:1789429583.075381:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429584.099969:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429585.123433:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429585.632056:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977263 is committed 00000001:00020000:0.0:1789429585.659301:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000001:00020000:1.0:1789429585.659308:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429585.659353:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635179008:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:3.0:1789429585.659402:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429585.659407:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429585.659456:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635179008:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 139us (4066342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429585.659466:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 969 00000100:00100000:1.0:1789429585.661571:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635179136:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429585.661667:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635179136:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 2349us (4068616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429585.661678:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1008 00000001:00020000:2.0:1789429585.667325:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000001:00020000:0.0:1789429585.667393:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429585.667395:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635179264:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429585.667410:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c08dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635179392:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:3.0:1789429585.667488:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429585.667492:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429585.667500:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c08dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635179392:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 99us (4074414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429585.667513:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1009 00000100:00100000:3.0:1789429585.682256:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635179264:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 14904us (4089106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429585.682271:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 970 00000001:00020000:1.0:1789429586.043400:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429586.043450:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648422144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429586.043555:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648422144:12345-0@lo:400:kworker.0 Request processed in 142us (4054792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429586.043564:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:0.0:1789429586.043640:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648422144:0@lo:400:kworker.0 00000100:00080000:3.0:1789429586.043651:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789429586.051274:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429586.051304:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648422016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429586.051419:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648422016:12345-0@lo:400:kworker.0 Request processed in 132us (4056315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429586.051428:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000001:00020000:1.0:1789429586.051516:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429586.051545:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648422272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429586.051600:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648422272:12345-0@lo:400:kworker.0 Request processed in 77us (4057543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429586.051608:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1789429586.051625:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648422016:0@lo:400:kworker.0 00000100:00100000:2.0:1789429586.051693:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648422272:0@lo:400:kworker.0 00000100:00080000:3.0:1789429586.051808:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:2.0:1789429586.059320:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000001:00020000:0.0:1789429586.059329:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429586.059377:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648422400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429586.059377:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648422528:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789429586.059485:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429586.059491:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429586.059643:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648422400:0@lo:400:kworker.0 00000100:00100000:0.0:1789429586.059650:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648422400:12345-0@lo:400:kworker.0 Request processed in 309us (4069940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429586.059660:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:1.0:1789429586.059686:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648422528:0@lo:400:kworker.0 00000100:00100000:2.0:1789429586.059744:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648422528:12345-0@lo:400:kworker.0 Request processed in 251us (4064307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429586.059752:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00010000:00010000:0.0:1789429586.147817:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429586.716706:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429586.716748:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429586.716783:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429586.716800:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429586.716820:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429586.717055:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635180032 00000100:00100000:2.0:1789429586.717066:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635180032 00000100:00100000:2.0:1789429586.717124:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635180288 00000100:00100000:2.0:1789429586.717127:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635180288 00000100:00100000:2.0:1789429586.717150:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1012 00000100:02000000:2.0:1789429586.717155:0:8085:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429586.717158:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429586.717268:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635179776 00000100:00100000:1.0:1789429586.717273:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635179776 00000100:00100000:1.0:1789429586.717308:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 639 00000100:02000000:1.0:1789429586.717311:0:5831:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429586.717318:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635179776:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429586.717389:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635179776:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429586.717396:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 639 00000100:00100000:1.0:1789429586.717429:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635179904 00000100:00100000:1.0:1789429586.717432:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635179904 00000100:00100000:1.0:1789429586.717452:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635180160 00000100:00100000:1.0:1789429586.717454:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635180160 00000100:00100000:1.0:1789429586.717474:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 974 00000100:02000000:1.0:1789429586.717477:0:5840:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429586.717479:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429586.717491:0:26937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 975 00000100:02000000:1.0:1789429586.717493:0:26937:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429586.717495:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429586.717505:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1013 00000100:02000000:1.0:1789429586.717507:0:6682:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429586.717508:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429587.107706:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648423296:0@lo:400:kworker.0 00000100:00100000:3.0:1789429587.107771:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429587.107823:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429587.107830:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648423168:0@lo:400:kworker.0 00000100:00100000:3.0:1789429587.107854:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429587.108244:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648423040:0@lo:400:kworker.0 00000100:00100000:0.0:1789429587.108275:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429587.108300:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648423552:0@lo:400:kworker.0 00000100:00100000:0.0:1789429587.108321:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429587.108345:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789429587.108351:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648422912:0@lo:400:kworker.0 00000100:00100000:0.0:1789429587.108379:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429587.108401:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648423424:0@lo:400:kworker.0 00000100:00100000:0.0:1789429587.108421:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429587.108452:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648422912 00000100:00100000:0.0:1789429587.108459:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648422912 00000100:00100000:0.0:1789429587.108505:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:02000000:0.0:1789429587.108510:0:5833:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429587.108517:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648422912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429587.108566:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648422912:12345-0@lo:400:kworker.0 Request processed in 50us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429587.108574:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1789429587.108608:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648423168 00000100:00100000:0.0:1789429587.108612:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648423168 00000100:00100000:0.0:1789429587.108632:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648423040 00000100:00100000:0.0:1789429587.108635:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648423040 00000100:00100000:0.0:1789429587.108651:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648423424 00000100:00100000:0.0:1789429587.108654:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648423424 00000100:00100000:0.0:1789429587.108671:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:02000000:0.0:1789429587.108674:0:15700:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429587.108677:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429587.108688:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:02000000:0.0:1789429587.108690:0:5839:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429587.108692:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429587.108702:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:02000000:0.0:1789429587.108705:0:15669:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429587.108706:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429587.108729:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648422912:0@lo:400:kworker.0 00000100:00100000:0.0:1789429587.108755:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648423296 00000100:00100000:0.0:1789429587.108759:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648423296 00000100:00100000:0.0:1789429587.108779:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648423552 00000100:00100000:0.0:1789429587.108782:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648423552 00000100:00100000:0.0:1789429587.108799:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:02000000:0.0:1789429587.108801:0:6681:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429587.108803:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429587.108951:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:02000000:2.0:1789429587.108954:0:13238:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429587.108957:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00010000:00010000:3.0:1789429587.171958:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429587.619450:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648423680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429587.619547:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429587.622032:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648423808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429587.622138:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429587.622213:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648423680 00000100:00100000:3.0:1789429587.622226:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648423680 00000100:00100000:3.0:1789429587.622293:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648423808 00000100:00100000:3.0:1789429587.622296:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648423808 00000100:00100000:3.0:1789429587.622315:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:02000000:3.0:1789429587.622322:0:6684:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429587.622331:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648423680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429587.622747:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429587.622824:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648423680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 488us (3271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429587.622826:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:02000000:1.0:1789429587.622834:0:6683:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429587.622838:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1789429587.622847:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648423808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429587.622882:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1789429587.622942:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648423808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429587.622948:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1789429587.623044:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648423808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429587.624969:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648423680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429588.196825:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429588.455370:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429588.455405:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635180416 00000100:00100000:3.0:1789429588.455415:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635180416 00000100:00100000:3.0:1789429588.455466:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21365 00000100:02000000:3.0:1789429588.455471:0:6704:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429588.455474:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00080000:3.0:1789429588.455483:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789429589.219421:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429590.243767:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:2.0:1789429590.780409:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429590.780568:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2369:x1876351635179904:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429590.780737:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2369:x1876351635179904:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 301us (4063927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429590.780749:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 974 00000100:00080000:3.0:1789429590.784831:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789429590.811856:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429590.811948:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635180032:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429590.812075:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635180032:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 184us (4095325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429590.812087:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1012 00000100:00080000:3.0:1789429590.812277:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:3.0:1789429590.814931:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429590.815000:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635180288:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429590.815118:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635180288:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 170us (4098332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429590.815128:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1013 00000100:00080000:0.0:1789429590.816146:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:2.0:1789429590.819434:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429590.819511:0:26937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635180160:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429590.819660:0:26937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635180160:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 206us (4102836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429590.819672:0:26937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 975 00000100:00080000:0.0:1789429590.820174:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789429591.179982:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429591.180029:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648423040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429591.180175:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648423040:12345-0@lo:400:kworker.0 Request processed in 175us (4071898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429591.180185:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:1.0:1789429591.181360:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648423040:0@lo:400:kworker.0 00000001:00020000:2.0:1789429591.181445:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429591.181483:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648423168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429591.181583:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648423168:12345-0@lo:400:kworker.0 Request processed in 126us (4073723us total) trans 0 rc 0/0 00000100:00080000:0.0:1789429591.181587:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429591.181594:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:3.0:1789429591.183319:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648423168:0@lo:400:kworker.0 00000001:00020000:0.0:1789429591.187365:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000001:00020000:2.0:1789429591.187365:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429591.187500:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648423424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429591.187645:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648423424:12345-0@lo:400:kworker.0 Request processed in 263us (4079221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429591.187656:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1789429591.187827:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648423424:0@lo:400:kworker.0 00000100:00100000:2.0:1789429591.193095:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648423296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429591.193282:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648423296:12345-0@lo:400:kworker.0 Request processed in 5900us (4085509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429591.193295:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:1.0:1789429591.194047:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648423296:0@lo:400:kworker.0 00000100:00080000:3.0:1789429591.199126:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429591.199143:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:1.0:1789429591.203528:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429591.203599:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648423552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429591.203752:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648423552:12345-0@lo:400:kworker.0 Request processed in 206us (4095428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429591.203773:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00080000:0.0:1789429591.203883:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429591.205427:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648423552:0@lo:400:kworker.0 00010000:00010000:3.0:1789429591.267401:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429591.833678:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429591.834171:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429591.834240:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429591.834276:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429591.834306:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429591.834356:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635180672 00000100:00100000:1.0:1789429591.834369:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635180672 00000100:00100000:1.0:1789429591.834436:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635180928 00000100:00100000:1.0:1789429591.834439:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635180928 00000100:00100000:1.0:1789429591.834461:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 979 00000100:02000000:1.0:1789429591.834468:0:26938:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429591.834471:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429591.834487:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635180800 00000100:00100000:1.0:1789429591.834491:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635180800 00000100:00100000:1.0:1789429591.834515:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635181056 00000100:00100000:1.0:1789429591.834517:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635181056 00000100:00100000:1.0:1789429591.834537:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1016 00000100:02000000:1.0:1789429591.834540:0:6680:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429591.834542:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429591.834554:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1017 00000100:02000000:1.0:1789429591.834556:0:20745:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429591.834558:0:20745:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429591.834570:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 980 00000100:02000000:1.0:1789429591.834572:0:26936:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429591.834573:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429591.835507:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635180544 00000100:00100000:2.0:1789429591.835520:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635180544 00000100:00100000:2.0:1789429591.835628:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 641 00000100:02000000:2.0:1789429591.835634:0:5834:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:2.0:1789429591.835644:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635180544:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429591.835750:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635180544:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 109us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429591.835767:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 641 00000100:00100000:2.0:1789429592.228482:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648424320:0@lo:400:kworker.0 00000100:00100000:2.0:1789429592.228574:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429592.228649:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789429592.228655:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648424192:0@lo:400:kworker.0 00000100:00100000:2.0:1789429592.228683:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429592.228724:0:26937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648424192 00000100:00100000:1.0:1789429592.228841:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648423936:0@lo:400:kworker.0 00000100:00100000:1.0:1789429592.229027:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429592.229057:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648424448:0@lo:400:kworker.0 00000100:00100000:1.0:1789429592.229084:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429592.229111:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789429592.229116:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648424064:0@lo:400:kworker.0 00000100:00100000:1.0:1789429592.229138:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429592.229159:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648424576:0@lo:400:kworker.0 00000100:00100000:1.0:1789429592.229178:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429592.229232:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648424448 00000100:00100000:1.0:1789429592.229240:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648424448 00000100:00100000:1.0:1789429592.229291:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648424064 00000100:00100000:1.0:1789429592.229294:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648424064 00000100:00100000:1.0:1789429592.229316:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:02000000:1.0:1789429592.229322:0:15700:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429592.229326:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429592.229337:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1789429592.229478:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648423936 00000100:00100000:0.0:1789429592.229483:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648423936 00000100:00100000:0.0:1789429592.229520:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:02000000:0.0:1789429592.229523:0:5831:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429592.229531:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648423936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429592.229597:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648423936:12345-0@lo:400:kworker.0 Request processed in 67us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429592.229604:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1789429592.229703:0:26937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648424192 00000100:02000000:1.0:1789429592.229752:0:5840:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429592.229754:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429592.229790:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648423936:0@lo:400:kworker.0 00000100:00100000:3.0:1789429592.229811:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648424320 00000100:00100000:3.0:1789429592.229818:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648424320 00000100:00100000:1.0:1789429592.229832:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648424576 00000100:00100000:1.0:1789429592.229838:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648424576 00000100:00100000:3.0:1789429592.229884:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:02000000:3.0:1789429592.229888:0:13238:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429592.229890:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429592.230125:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:02000000:1.0:1789429592.230130:0:6681:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429592.230132:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429592.230226:0:26937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:02000000:2.0:1789429592.230230:0:26937:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429592.230232:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00010000:00010000:0.0:1789429592.291761:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:0.0:1789429592.532028:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429592.532108:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+32:46946:x1876351635180416:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:0.0:1789429592.532140:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429592.532189:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263621e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc79 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.532305:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263621ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.532324:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263621ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.532340:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263621ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429592.532393:0:6704:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789429592.532398:0:6704:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429592.532425:0:6704:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263621ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.532455:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ada00/0xb4c3dad7263621e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc79 expref: 34 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.532480:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263621ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc79 expref: 33 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.532489:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cd00) 00010000:00010000:0.0:1789429592.532492:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429592.532497:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad600, rc 0) 00000100:00100000:0.0:1789429592.532602:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+33:46946:x1876351635180416:12345-192.168.203.39@tcp:101:rm.0 Request processed in 554us (4077238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429592.532613:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21365 00000100:00080000:3.0:1789429592.533073:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429592.549493:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429592.549871:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635181184 00000100:00100000:0.0:1789429592.549889:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635181184 00000100:00100000:0.0:1789429592.550068:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5929 00000100:02000000:0.0:1789429592.550076:0:8085:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429592.550089:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:2369:x1876351635181184:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:0.0:1789429592.550114:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429592.550139:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc80 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.550186:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=18s v=(0 1) 00010000:00010000:0.0:1789429592.550192:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429592.550244:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 7 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.550267:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 7 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.550284:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429592.550362:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:2369:x1876351635181184:12345-192.168.203.39@tcp:101:rm.0 Request processed in 277us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429592.550370:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5929 00000100:00080000:3.0:1789429592.559234:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429592.559486:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429592.559557:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635181440 00000100:00100000:0.0:1789429592.559572:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635181440 00000100:00100000:0.0:1789429592.559644:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21366 00000100:02000000:0.0:1789429592.559651:0:15669:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429592.559661:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+33:46946:x1876351635181440:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:0.0:1789429592.559982:0:15669:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789429592.560022:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4000/0xb4c3dad72636218b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc56 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.560060:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8e:0x0].0x0 (ffff946f0970c200) 00010000:00010000:0.0:1789429592.560074:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad7263621ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc79 expref: 32 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.560083:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cd00) 00010000:00010000:0.0:1789429592.560087:0:15669:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429592.560115:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.560130:0:15669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.560140:0:15669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429592.560488:0:15669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:0.1:1789429592.560500:0:15669:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:0.0:1789429592.568565:0:15669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 22 pid: 5840 timeout: 1291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429592.568604:0:15669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648424704:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429592.570253:0:15669:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f34538cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789429592.574948:0:15669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648424704:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429592.574998:0:15669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429592.576510:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429592.576602:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635181568 00000100:00100000:3.0:1789429592.576613:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635181568 00010000:00010000:3.0:1789429592.576706:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 23 pid: 5840 timeout: 1291 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429592.576751:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6269 00000100:02000000:3.0:1789429592.576757:0:5824:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429592.576761:0:5824:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00080000:0.0:1789429592.577022:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429592.739610:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648424832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429592.739710:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429592.739910:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648424832 00000100:00100000:3.0:1789429592.739921:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648424832 00000100:00100000:3.0:1789429592.739995:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:02000000:3.0:1789429592.740002:0:6684:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429592.740012:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648424832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429592.740060:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429592.740123:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648424832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429592.740132:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1789429592.740192:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648424832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429592.740413:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429592.740423:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648424960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429592.740456:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429592.741684:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648424960 00000100:00100000:0.0:1789429592.741699:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648424960 00000100:00100000:0.0:1789429592.741806:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:02000000:0.0:1789429592.741812:0:9195:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429592.741822:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648424960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429592.741890:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3855613952 avail 3853516800 00000100:00100000:0.0:1789429592.741987:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648424960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429592.741994:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1789429592.742094:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648424960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789429593.317190:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00100000:0.0:1789429593.571412:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621ae req@ffff946f0879c700 x1876351635181568/t0(0) o103->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:328/0 lens 328/0 e 0 to 0 dl 1789429603 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789429593.571447:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 24 pid: 5840 timeout: 1291 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:0.1:1789429593.571461:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:0.0:1789429593.571473:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 24 pid: 5840 timeout: 1292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429594.341619:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00100000:0.0:1789429594.595392:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621ae req@ffff946f0879c700 x1876351635181568/t0(0) o103->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:328/0 lens 328/0 e 0 to 0 dl 1789429603 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789429594.595417:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 24 pid: 5840 timeout: 1292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:0.1:1789429594.595433:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:0.0:1789429594.595446:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 24 pid: 5840 timeout: 1293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429595.367269:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00100000:1.0:1789429595.622976:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621ae req@ffff946f0879c700 x1876351635181568/t0(0) o103->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:328/0 lens 328/0 e 0 to 0 dl 1789429603 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789429595.622999:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 24 pid: 5840 timeout: 1293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:1.1F:1789429595.623014:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:1.0:1789429595.623050:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 24 pid: 5840 timeout: 1294 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00020000:3.0:1789429595.892266:0:20745:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429595.892343:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635181056:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429595.892474:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635181056:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 189us (4058164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429595.892486:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1017 00000100:00080000:0.0:1789429595.893263:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:2.0:1789429595.899379:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429595.899457:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635180800:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429595.899596:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:2368:x1876351635180800:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 198us (4065355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429595.899607:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1016 00000001:00020000:3.0:1789429595.900087:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429595.900110:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2369:x1876351635180928:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429595.900170:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:2369:x1876351635180928:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 74us (4065892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429595.900179:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 980 00000100:00080000:0.0:1789429595.900638:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429595.900646:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:1.0:1789429595.916786:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429595.916896:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635180672:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429595.917050:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635180672:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 245us (4082880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429595.917061:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 979 00000100:00080000:0.0:1789429595.918871:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789429596.291316:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000001:00020000:1.0:1789429596.291349:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429596.291376:0:26937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648424192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429596.291398:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648424064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429596.291509:0:26937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648424192:12345-0@lo:400:kworker.0 Request processed in 177us (4062821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429596.291518:0:26937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1789429596.291526:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1876351648424064:12345-0@lo:400:kworker.0 Request processed in 146us (4062380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429596.291539:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:2.0:1789429596.291610:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3298:1876351648424064:0@lo:400:kworker.0 00000100:00100000:3.0:1789429596.291707:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648424192:0@lo:400:kworker.0 00000100:00080000:0.0:1789429596.293347:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789429596.299375:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429596.299457:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648424320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429596.299598:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648424320:12345-0@lo:400:kworker.0 Request processed in 208us (4071023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429596.299609:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00080000:0.0:1789429596.299756:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429596.299891:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648424320:0@lo:400:kworker.0 00000001:00020000:3.0:1789429596.300000:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429596.300626:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648424448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429596.300719:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648424448:12345-0@lo:400:kworker.0 Request processed in 133us (4071634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429596.300729:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00080000:0.0:1789429596.300823:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429596.300930:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648424448:0@lo:400:kworker.0 00000001:00020000:2.0:1789429596.307433:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429596.307509:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648424576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429596.307667:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648424576:12345-0@lo:400:kworker.0 Request processed in 216us (4078486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429596.307678:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00080000:0.0:1789429596.307853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429596.307953:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648424576:0@lo:400:kworker.0 00010000:00010000:0.0:1789429596.388401:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:0.0:1789429596.635305:0:5824:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429596.635340:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635181568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429596.635361:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429596.635374:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 22 pid: 5840 timeout: 1294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429596.635391:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 22 pid: 5840 timeout: 1294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429596.635414:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4800/0xb4c3dad7263621ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc64 expref: 22 pid: 5840 timeout: 1294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429596.635734:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cd00) 00010000:00010000:0.0:1789429596.635741:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429596.635752:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429596.635764:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429596.635802:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429596.635870:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351635181568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 551us (4059371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429596.635880:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6269 00010000:00010000:2.0:1789429596.635900:0:15669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429596.635922:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429596.635961:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad726362202 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429596.635976:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad726362202 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429596.635988:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad726362202 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429596.636395:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429596.636406:0:15669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 20 pid: 26937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429596.636413:0:15669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429596.636451:0:15669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 20 pid: 26937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:2.1F:1789429596.636460:0:15669:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:2.0:1789429596.643108:0:15669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 20 pid: 26937 timeout: 1295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429596.643143:0:15669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648425088:192.168.203.39@tcp:104: 00000100:00100000:2.0:1789429596.643782:0:15669:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f29cdf180 going to sleep for 11 seconds 00000100:00100000:3.0:1789429596.649498:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429596.649807:0:15669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:15669:1876351648425088:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429596.649912:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635181696 00000100:00100000:1.0:1789429596.649922:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635181696 00010000:00010000:2.0:1789429596.649937:0:15669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429596.649977:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 21 pid: 26937 timeout: 1295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429596.650088:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6270 00000100:02000000:1.0:1789429596.650096:0:5825:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429596.655185:0:5825:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429596.950682:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429596.950738:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429596.950791:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429596.950890:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635181952 00000100:00100000:2.0:1789429596.950901:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635182208 00000100:00100000:0.0:1789429596.950905:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635181952 00000100:00100000:2.0:1789429596.950907:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635182208 00000100:00100000:2.0:1789429596.950969:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1020 00000100:02000000:2.0:1789429596.950975:0:20986:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429596.950979:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429596.950985:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 984 00000100:02000000:0.0:1789429596.950989:0:6704:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429596.950992:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429596.951116:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635181824 00000100:00100000:3.0:1789429596.951122:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635181824 00000100:00100000:3.0:1789429596.951163:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 643 00000100:02000000:3.0:1789429596.951167:0:5834:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429596.951384:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429596.951449:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635182080 00000100:00100000:2.0:1789429596.951453:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635182080 00000100:00100000:2.0:1789429596.951487:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1021 00000100:02000000:2.0:1789429596.951490:0:6682:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429596.951492:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429596.951621:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635181824:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429596.951752:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635181824:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 138us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429596.951760:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 643 00000100:00100000:1.0:1789429597.347659:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648425600:0@lo:400:kworker.0 00000100:00100000:1.0:1789429597.347768:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429597.347848:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789429597.347855:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648425472:0@lo:400:kworker.0 00000100:00100000:1.0:1789429597.347884:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429597.347932:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648425472 00000100:00100000:1.0:1789429597.347943:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648425472 00000100:00100000:1.0:1789429597.348000:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:02000000:1.0:1789429597.348007:0:5841:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429597.348010:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429597.348235:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648425216:0@lo:400:kworker.0 00000100:00100000:3.0:1789429597.348259:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648425344:0@lo:400:kworker.0 00000100:00100000:3.0:1789429597.348315:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429597.348348:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648425856:0@lo:400:kworker.0 00000100:00100000:3.0:1789429597.348369:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429597.348433:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648425600 00000100:00100000:3.0:1789429597.348438:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648425600 00000100:00100000:2.0:1789429597.348464:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429597.348471:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648425856 00000100:00100000:3.0:1789429597.348475:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648425856 00000100:00100000:2.0:1789429597.348501:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648425728:0@lo:400:kworker.0 00000100:00100000:3.0:1789429597.348506:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:02000000:3.0:1789429597.348511:0:6680:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429597.348513:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429597.348528:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:02000000:3.0:1789429597.348531:0:8085:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:2.0:1789429597.348536:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00020000:3.0:1789429597.348536:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:3.0:1789429597.348575:0:26937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648425344 00000100:00100000:3.0:1789429597.348579:0:26937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648425344 00000100:00100000:2.0:1789429597.348627:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648425728 00000100:00100000:2.0:1789429597.348631:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648425728 00000100:00100000:3.0:1789429597.348644:0:26937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:02000000:3.0:1789429597.348648:0:26937:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429597.348650:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:2.0:1789429597.348669:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:02000000:2.0:1789429597.348673:0:5840:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:2.0:1789429597.348688:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429597.348851:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648425216 00000100:00100000:0.0:1789429597.348856:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648425216 00000100:00100000:0.0:1789429597.348902:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:02000000:0.0:1789429597.348905:0:5833:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429597.348915:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648425216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429597.348994:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648425216:12345-0@lo:400:kworker.0 Request processed in 83us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429597.349003:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1789429597.350437:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648425216:0@lo:400:kworker.0 00010000:00010000:3.0:1789429597.411475:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00100000:1.0:1789429597.675121:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621ca req@ffff946f3f179500 x1876351635181696/t0(0) o103->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:332/0 lens 328/0 e 0 to 0 dl 1789429607 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789429597.675145:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 22 pid: 26937 timeout: 1295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:1.1:1789429597.675159:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:1.0:1789429597.675480:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 22 pid: 26937 timeout: 1296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429597.859847:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648425984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429597.859956:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429597.860383:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648425984 00000100:00100000:3.0:1789429597.860395:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648425984 00000100:00100000:3.0:1789429597.860481:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:02000000:3.0:1789429597.860489:0:6683:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429597.860500:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648425984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429597.860746:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429597.860840:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648425984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 343us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429597.860848:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1789429597.860968:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648426112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429597.861084:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429597.861239:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648426112 00000100:00100000:0.0:1789429597.861246:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648426112 00000100:00100000:0.0:1789429597.861277:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:02000000:0.0:1789429597.861281:0:6684:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:0.0:1789429597.861288:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648426112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429597.861317:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3855613952 avail 3853516800 00000100:00100000:0.0:1789429597.861360:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648426112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429597.861368:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1789429597.861418:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648426112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429597.861871:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648425984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429598.436601:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00100000:3.0:1789429598.692182:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621ca req@ffff946f3f179500 x1876351635181696/t0(0) o103->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:332/0 lens 328/0 e 0 to 0 dl 1789429607 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789429598.692226:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 22 pid: 26937 timeout: 1296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:3.1:1789429598.692239:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:3.0:1789429598.692250:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 22 pid: 26937 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429599.459441:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00100000:1.0:1789429599.716618:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621ca req@ffff946f3f179500 x1876351635181696/t0(0) o103->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:332/0 lens 328/0 e 0 to 0 dl 1789429607 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789429599.716635:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 22 pid: 26937 timeout: 1297 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:1.1:1789429599.716646:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:1.0:1789429599.716653:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 22 pid: 26937 timeout: 1298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429600.483566:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:2.0:1789429600.731298:0:5825:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00010000:00100000:1.0:1789429600.739346:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621ca req@ffff946f3f179500 x1876351635181696/t0(0) o103->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:332/0 lens 328/0 e 0 to 0 dl 1789429607 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789429600.739365:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 22 pid: 26937 timeout: 1298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:1.1:1789429600.739376:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:1.0:1789429600.739386:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 22 pid: 26937 timeout: 1299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789429600.751884:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351635181696:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429600.751907:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429600.751919:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 21 pid: 26937 timeout: 1299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429600.751939:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 21 pid: 26937 timeout: 1299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429600.751960:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ac00/0xb4c3dad7263621ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc6b expref: 21 pid: 26937 timeout: 1299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429600.751978:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8e:0x0].0x0 (ffff946f0970c200) 00010000:00010000:2.0:1789429600.751984:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429600.751993:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429600.752000:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429600.752036:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429600.752090:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351635181696:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 309us (4102612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429600.752100:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6270 00010000:00010000:1.0:1789429600.755690:0:15669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.755705:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789429600.756811:0:15669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].29, 64 off10048 00000004:00080000:1.0:1789429600.756822:0:15669:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1298736621177ns, next at 1299736618989ns, rc = 0 00010000:00010000:1.0:1789429600.756898:0:15669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726362210 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789429600.756909:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789429600.756913:0:15669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726362210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.756925:0:15669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726362210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.756935:0:15669:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726362210 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.756942:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726362210 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.756950:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726362210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.756978:0:15669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789429600.756998:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757003:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757010:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757016:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31b000 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429600.757022:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757030:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757043:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8e:0x0].0x0 (ffff946f0970c200) 00010000:00010000:1.0:1789429600.757046:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789429600.757051:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757058:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b000/0xb4c3dad726362209 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757075:0:15669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757086:0:15669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757092:0:15669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757097:0:15669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2adc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:1.0:1789429600.757100:0:15669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757105:0:15669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757112:0:15669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cd00) 00010000:00010000:1.0:1789429600.757114:0:15669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789429600.757117:0:15669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.757122:0:15669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad7263621fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789429600.757138:0:15669:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000099fcd8b4 reply state 00000000fa1dd642 transno 4294977264 ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad726362202 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429600.757146:0:15669:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789429600.757234:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+33:46946:x1876351635181440:12345-192.168.203.39@tcp:36:rm.0 Request processed in 8197572us (8197751us total) trans 4294977264 rc 0/0 00000100:00100000:1.0:1789429600.757243:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21366 00010000:00010000:2.0:1789429600.757356:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789429600.757363:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726362210 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429600.757374:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c4c00 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:2.0:1789429600.757378:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726362210 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429600.757385:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726362210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429600.757395:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8e:0x0].0x0 (ffff946f0970c200) 00010000:00010000:2.0:1789429600.757397:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789429600.757412:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726362210 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429600.757418:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4c00/0xb4c3dad726362210 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429600.757433:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429600.757435:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429600.757437:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429600.761166:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad726362202 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429600.761183:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad726362202 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429600.761190:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad726362202 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429600.761197:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31b600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429600.761237:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad726362202 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429600.761246:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad726362202 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429600.761261:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ce0eb6 (ffff946f051efe00) 00010000:00010000:3.0:1789429600.761264:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429600.761268:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad726362202 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429600.761274:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b600/0xb4c3dad726362202 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15669 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789429600.985486:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977264 is committed 00000004:00080000:3.0:1789429600.985498:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 43 committed 00000100:00100000:3.0:1789429600.985722:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789429600.985738:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648426240:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789429600.985813:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429600.985952:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648426240 00000100:00100000:1.0:1789429600.985960:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648426240 00000100:00100000:1.0:1789429600.986017:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5930 00000100:02000000:1.0:1789429600.986022:0:20745:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429600.986029:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648426240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789429600.986052:0:20745:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:54 count 1 00010000:00010000:1.0:1789429600.986075:0:20745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.986097:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.986107:0:20745:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 6 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.986116:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=8s v=(0 0) 00010000:00010000:1.0:1789429600.986120:0:20745:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429600.986125:0:20745:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429600.986147:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 6 pid: 8085 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:02000000:1.1:1789429600.986157:0:20745:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:1.0:1789429600.986164:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 6 pid: 8085 timeout: 1299 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429600.986177:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648426368:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429600.986266:0:20745:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 6 pid: 20986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:1.1:1789429600.986274:0:20745:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:1.0:1789429600.986278:0:20745:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 6 pid: 20986 timeout: 1299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429600.986288:0:20745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f087bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648426496:192.168.203.39@tcp:104: 00000100:00100000:1.0:1789429600.986307:0:20745:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f32232900 going to sleep for 11 seconds 00000100:00080000:3.0:1789429600.986653:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429600.990913:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648426496:192.168.203.39@tcp:104: 00000100:00100000:3.0:1789429600.991122:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429600.991188:0:11354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635182336 00000100:00100000:1.0:1789429600.991196:0:11354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635182336 00010000:00010000:1.0:1789429600.991274:0:11354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 7 pid: 20986 timeout: 1299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429600.991303:0:11354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6271 00000100:02000000:1.0:1789429600.991307:0:11354:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429600.991310:0:11354:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00080000:3.0:1789429600.991390:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429600.998818:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429600.998932:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635182464 00000100:00100000:3.0:1789429600.998941:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635182464 00010000:00010000:3.0:1789429600.998994:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 7 pid: 8085 timeout: 1299 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429600.999032:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6272 00000100:02000000:3.0:1789429600.999037:0:5826:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:3.0:1789429600.999040:0:5826:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00080000:0.0:1789429600.999090:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429600.999187:0:20745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:20745:1876351648426368:192.168.203.39@tcp:104: 00010000:00010000:1.0:1789429600.999243:0:20745:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00020000:0.0:1789429601.019282:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429601.019314:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635182208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429601.019432:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2370:x1876351635182208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 136us (4068693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429601.019441:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1020 00000001:00020000:0.0:1789429601.020121:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429601.020134:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635182080:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429601.020244:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+7:2370:x1876351635182080:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 115us (4068860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429601.020251:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1021 00000001:00020000:2.0:1789429601.025044:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429601.025101:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f0879fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351635181952:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429601.025188:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f0879fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+30:2370:x1876351635181952:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 130us (4074520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429601.025197:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 984 00000100:00080000:0.0:1789429601.025979:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789429601.419293:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429601.419323:0:26937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648425344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429601.419426:0:26937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1876351648425344:12345-0@lo:400:kworker.0 Request processed in 120us (4071110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429601.419434:0:26937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:3.0:1789429601.419536:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3299:1876351648425344:0@lo:400:kworker.0 00000001:00020000:0.0:1789429601.419745:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429601.419831:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648425472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429601.419889:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648425472:12345-0@lo:400:kworker.0 Request processed in 136us (4072003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429601.419896:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00080000:3.0:1789429601.420093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429601.422105:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29debb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648425472:0@lo:400:kworker.0 00000001:00020000:2.0:1789429601.427357:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000001:00020000:0.0:1789429601.427375:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429601.427389:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648425856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429601.427414:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648425728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429601.427487:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648425856:12345-0@lo:400:kworker.0 Request processed in 117us (4079115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429601.427497:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1789429601.427545:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f087bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648425856:0@lo:400:kworker.0 00000100:00100000:0.0:1789429601.428453:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648425728:12345-0@lo:400:kworker.0 Request processed in 118us (4078967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429601.428472:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1789429601.428538:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648425728:0@lo:400:kworker.0 00000100:00080000:3.0:1789429601.428959:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:1.0:1789429601.452282:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429601.452328:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648425600:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789429601.452379:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429601.452428:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648425600:12345-0@lo:400:kworker.0 Request processed in 130us (4104658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429601.452442:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1789429601.452676:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648425600:0@lo:400:kworker.0 00010000:00010000:0.0:1789429601.512548:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00100000:1.0:1789429602.019320:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621df req@ffff946f3f17aa00 x1876351635182336/t0(0) o103->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:336/0 lens 328/0 e 0 to 0 dl 1789429611 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789429602.019339:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 7 pid: 20986 timeout: 1299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:1.1:1789429602.019352:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:1.0:1789429602.019360:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 7 pid: 20986 timeout: 1300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00100000:1.0:1789429602.019374:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621f4 req@ffff946f415c5180 x1876351635182464/t0(0) o103->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:336/0 lens 328/0 e 0 to 0 dl 1789429611 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789429602.019383:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 7 pid: 8085 timeout: 1299 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:02000000:1.1:1789429602.019390:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:1.0:1789429602.019394:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 7 pid: 8085 timeout: 1300 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429602.077250:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429602.077278:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429602.077295:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429602.077311:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429602.077330:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429602.077354:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635182592 00000100:00100000:1.0:1789429602.077362:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635182592 00000100:00100000:1.0:1789429602.077400:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 645 00000100:02000000:1.0:1789429602.077406:0:5831:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:1.0:1789429602.077412:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635182592:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429602.077469:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635182592:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 57us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429602.077476:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 645 00000100:00100000:1.0:1789429602.077504:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635182848 00000100:00100000:1.0:1789429602.077507:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635182848 00000100:00100000:1.0:1789429602.077531:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635183104 00000100:00100000:1.0:1789429602.077533:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635183104 00000100:00100000:1.0:1789429602.077548:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1024 00000100:02000000:1.0:1789429602.077551:0:13238:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429602.077553:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429602.077563:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1025 00000100:02000000:1.0:1789429602.077565:0:6681:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429602.077567:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429602.077575:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635182720 00000100:00100000:1.0:1789429602.077577:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635182720 00000100:00100000:1.0:1789429602.077594:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635182976 00000100:00100000:1.0:1789429602.077596:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635182976 00000100:00100000:1.0:1789429602.077613:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 988 00000100:02000000:1.0:1789429602.077615:0:15700:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429602.077617:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:1.0:1789429602.077626:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 989 00000100:02000000:1.0:1789429602.077628:0:26938:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:1.0:1789429602.077630:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00080000:1.0:1789429602.077723:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429602.077728:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429602.468907:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648426624:0@lo:400:kworker.0 00000100:00100000:0.0:1789429602.468973:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429602.469011:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648427136:0@lo:400:kworker.0 00000100:00100000:0.0:1789429602.469035:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429602.469063:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429602.469068:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648427008:0@lo:400:kworker.0 00000100:00100000:0.0:1789429602.469091:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429602.469118:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648426752:0@lo:400:kworker.0 00000100:00100000:0.0:1789429602.469141:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429602.469157:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648427264:0@lo:400:kworker.0 00000100:00100000:0.0:1789429602.469175:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429602.469192:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429602.469197:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648426880:0@lo:400:kworker.0 00000100:00100000:0.0:1789429602.469237:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429602.469267:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648427136 00000100:00100000:0.0:1789429602.469275:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648427136 00000100:00100000:0.0:1789429602.469314:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648426752 00000100:00100000:0.0:1789429602.469317:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648426752 00000100:00100000:0.0:1789429602.469333:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648426880 00000100:00100000:0.0:1789429602.469336:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648426880 00000100:00100000:0.0:1789429602.469355:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:02000000:0.0:1789429602.469360:0:15669:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429602.469363:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429602.469374:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648427008 00000100:00100000:0.0:1789429602.469377:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648427008 00000100:00100000:0.0:1789429602.469397:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648427264 00000100:00100000:0.0:1789429602.469400:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648427264 00000100:00100000:0.0:1789429602.469426:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:02000000:0.0:1789429602.469428:0:8085:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429602.469430:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429602.469441:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:02000000:0.0:1789429602.469443:0:6704:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429602.469445:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429602.469455:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:02000000:0.0:1789429602.469458:0:6680:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000001:00020000:0.0:1789429602.469459:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00100000:0.0:1789429602.469468:0:26937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:02000000:0.0:1789429602.469471:0:26937:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429602.470944:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648426624 00000100:00100000:3.0:1789429602.470952:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648426624 00000100:00100000:3.0:1789429602.470998:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:02000000:3.0:1789429602.471002:0:5834:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:3.0:1789429602.471009:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648426624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429602.471082:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648426624:12345-0@lo:400:kworker.0 Request processed in 74us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429602.471088:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1789429602.471142:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648426624:0@lo:400:kworker.0 00000001:00020000:0.0:1789429602.471413:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 sleeping for 4000ms 00000100:00080000:0.0:1789429602.471441:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789429602.532531:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429602.979403:0:20986:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 7 min 3 max 116 00000100:00100000:2.0:1789429602.979426:0:20986:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_007' 00000100:00100000:2.0:1789429602.980176:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429602.980195:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648427392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429602.980279:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429602.980337:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648427392 00000100:00100000:2.0:1789429602.980344:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648427392 00000100:00100000:2.0:1789429602.980387:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:02000000:2.0:1789429602.980392:0:6684:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:2.0:1789429602.980398:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648427392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429602.980432:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429602.980483:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648427392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429602.980490:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1789429602.980534:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648427392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429602.992384:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429602.992405:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648427520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429602.992483:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429602.992543:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648427520 00000100:00100000:2.0:1789429602.992551:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648427520 00000100:00100000:2.0:1789429602.992601:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:02000000:2.0:1789429602.992607:0:9195:0:(service.c:2495:ptlrpc_server_handle_request()) *** cfs_fail_loc=512, val=0*** 00000100:00100000:2.0:1789429602.992615:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876351648427520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429602.992653:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429602.992703:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3299:x1876351648427520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429602.992710:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1789429602.992754:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648427520:0@lo:13:osp-pre-1-0.0 00010000:00100000:1.0:1789429603.043403:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621f4 req@ffff946f415c5180 x1876351635182464/t0(0) o103->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:336/0 lens 328/0 e 0 to 0 dl 1789429611 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789429603.043422:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 8 pid: 8085 timeout: 1300 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:02000000:1.1:1789429603.043436:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:1.0:1789429603.043443:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 8 pid: 8085 timeout: 1302 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00100000:1.0:1789429603.043456:0:5829:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xb4c3dad7263621df req@ffff946f3f17aa00 x1876351635182336/t0(0) o103->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:336/0 lens 328/0 e 0 to 0 dl 1789429611 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789429603.043474:0:5829:0:(ldlm_lockd.c:241:expired_lock_main()) ### prolong the busy lock ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 8 pid: 20986 timeout: 1300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:1.1:1789429603.043482:0:5829:0:(ldlm_lockd.c:390:__ldlm_add_waiting_lock()) *** cfs_fail_loc=512, val=0*** 00010000:00010000:1.0:1789429603.043486:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 50, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 8 pid: 20986 timeout: 1302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429603.556437:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:02000000:3.0:1789429604.071109:0:5829:0:(ldlm_lockd.c:238:expired_lock_main()) *** cfs_fail_loc=511, val=0*** 00010000:00020000:3.0:1789429604.071132:0:5829:0:(ldlm_lockd.c:255:expired_lock_main()) ### lock callback timer expired after 1s: evicting client at 192.168.203.39@tcp ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 8 pid: 20986 timeout: 1302 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789429604.106875:0:5829:0:(genops.c:1633:class_fail_export()) disconnecting export ffff946e02cdd800/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:3.0:1789429604.106993:0:5829:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad7263621d8 00000020:00010000:3.0:1789429604.107004:0:5829:0:(genops.c:1920:obd_stale_export_put()) Put export ffff946e02cdd800: total 0 00000100:00080000:3.0:1789429604.107012:0:5829:0:(import.c:65:import_set_state_nolock()) ffff946e02cd8000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1789429604.107469:0:5828:0:(genops.c:1906:obd_stale_export_get()) Get export ffff946e02cdd800: total 0 00010000:00010000:2.0:1789429604.107477:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429604.107541:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946e02cdd800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789429604.107601:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 8 pid: 20986 timeout: 1302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429604.107648:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946e02cdd800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789429604.107671:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429604.107673:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429604.107675:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789429604.107692:0:5829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969607 00000020:00080000:2.0:1789429604.107985:0:5829:0:(genops.c:1650:class_fail_export()) disconnected export ffff946e02cdd800/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00010000:00010000:2.0:1789429604.107992:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1ce1744/0xb4c3dad7263621df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc72 expref: 4 pid: 20986 timeout: 1302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:2.0:1789429604.108012:0:5829:0:(ldlm_lockd.c:238:expired_lock_main()) *** cfs_fail_loc=511, val=0*** 00010000:00020000:2.0:1789429604.108018:0:5829:0:(ldlm_lockd.c:255:expired_lock_main()) ### lock callback timer expired after 1s: evicting client at 192.168.203.39@tcp ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 8 pid: 8085 timeout: 1302 lvb_type: 1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789429604.108027:0:5829:0:(genops.c:1633:class_fail_export()) disconnecting export ffff946f3f39a000/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:2.0:1789429604.108032:0:5829:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad726362199 00000020:00010000:2.0:1789429604.108038:0:5829:0:(genops.c:1920:obd_stale_export_put()) Put export ffff946f3f39a000: total 0 00000100:00080000:2.0:1789429604.108043:0:5829:0:(import.c:65:import_set_state_nolock()) ffff946f3f399000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789429604.108062:0:5829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969607 00000020:00080000:2.0:1789429604.108118:0:5829:0:(genops.c:1650:class_fail_export()) disconnected export ffff946f3f39a000/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00010000:1.0:1789429604.109464:0:5827:0:(genops.c:1906:obd_stale_export_get()) Get export ffff946f3f39a000: total 0 00010000:00010000:1.0:1789429604.109532:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946f3f39a000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789429604.109576:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 5 pid: 8085 timeout: 1302 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429604.109623:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1789429604.109629:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789429604.109636:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429604.109649:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429604.109713:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd459654/0xb4c3dad7263621f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x36:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc80 expref: 5 pid: 8085 timeout: 1302 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429604.109734:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946f3f39a000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789429604.109747:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429604.109749:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429604.109751:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429604.109924:0:20745:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429604.109935:0:20745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429604.109947:0:20745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429604.109955:0:20745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429604.109975:0:20745:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789429604.111097:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3299:x1876351648426240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3125060us (3125275us total) trans 4294969608 rc 0/0 00000100:00100000:0.0:1789429604.111111:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5930 00010000:00010000:0.0:1789429604.111162:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789429604.111170:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429604.111182:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c4c00 already unused, calling callback (ffffffffc179a8b0) 00010000:00010000:0.0:1789429604.111188:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429604.111234:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429604.111568:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429604.111578:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000416dad11/0xb4c3dad726362217 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789429604.112047:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f054d6a00/2, rc 0, transno 4294969608 00000100:00100000:3.0:1789429604.112058:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648426240:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789429604.112125:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429604.112127:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429604.112129:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429604.579531:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429604.848145:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429604.852428:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635183232 00000100:00100000:3.0:1789429604.852444:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635183232 00000100:00100000:3.0:1789429604.852516:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21367 00000100:02000000:3.0:1789429604.852522:0:26936:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429604.852525:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00080000:0.0:1789429604.852567:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:1.0:1789429605.054696:0:11354:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429605.055567:0:11354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+3:2371:x1876351635182336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429605.055639:0:11354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429605.055644:0:11354:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie b4c3dad7263621df) 00010000:00010000:1.0:1789429605.055646:0:11354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429605.055716:0:11354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+3:2371:x1876351635182336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1005us (4064965us total) trans 0 rc 116/116 00000100:00100000:1.0:1789429605.055739:0:11354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6271 00000001:00020000:2.0:1789429605.099045:0:5826:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429605.099073:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+3:2369:x1876351635182464:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789429605.099098:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789429605.099103:0:5826:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie b4c3dad7263621f4) 00010000:00010000:2.0:1789429605.099106:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789429605.099167:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:12e09781-3d24-4c67-9972-bb781900e20d+3:2369:x1876351635182464:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 106us (4100355us total) trans 0 rc 116/116 00000100:00100000:2.0:1789429605.099175:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6272 00000001:00080000:1.0:1789429605.102866:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969608 is committed 00000001:00100000:1.0:1789429605.102888:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000001:00100000:1.0:1789429605.102896:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00010000:00010000:0.0:1789429605.603435:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:0.0:1789429606.115697:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429606.115746:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351635182976:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429606.115849:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2370:x1876351635182976:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 139us (4038517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429606.115858:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 989 00000100:00080000:1.0:1789429606.116223:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:1.0:1789429606.131317:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429606.131378:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635182720:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429606.131479:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635182720:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 148us (4054165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429606.131489:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 988 00000100:00080000:0.0:1789429606.132734:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789429606.164084:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429606.164120:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+1:2370:x1876351635183104:12345-192.168.203.39@tcp:400:kworker.0 00000020:00080000:0.0:1789429606.164132:0:6681:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.39@tcp 00000100:00100000:0.0:1789429606.164240:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+1:2370:x1876351635183104:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 142us (4086943us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789429606.164249:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1025 00000020:00000080:0.0:1789429606.164267:0:6681:0:(genops.c:885:class_export_put()) final put ffff946e02cdd800/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:1.0:1789429606.164575:0:17042:0:(genops.c:844:class_export_destroy()) destroying export ffff946e02cdd800/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 for lustre-OST0001 00000020:00000080:1.0:1789429606.164635:0:17042:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946e02cd8000 for lustre-OST0001 00000001:00020000:0.0:1789429606.171557:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:0.0:1789429606.171602:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+1:2370:x1876351635182848:12345-192.168.203.39@tcp:400:kworker.0 00000020:00080000:0.0:1789429606.171621:0:13238:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.39@tcp 00000100:00100000:0.0:1789429606.171737:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+1:2370:x1876351635182848:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 165us (4094456us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789429606.171747:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1024 00000020:00000080:0.0:1789429606.171777:0:13238:0:(genops.c:885:class_export_put()) final put ffff946f3f39a000/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:3.0:1789429606.172255:0:22526:0:(genops.c:844:class_export_destroy()) destroying export ffff946f3f39a000/12e09781-3d24-4c67-9972-bb781900e20d for lustre-OST0001 00000020:00000080:3.0:1789429606.174127:0:22526:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946f3f399000 for lustre-OST0001 00000100:00100000:2.0:1789429606.188978:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429606.189026:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429606.189107:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635183360 00000100:00100000:0.0:1789429606.189117:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635183360 00000100:00100000:0.0:1789429606.189162:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635183488 00000100:00100000:0.0:1789429606.189166:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635183488 00000100:00100000:0.0:1789429606.189189:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5931 00000100:02000000:0.0:1789429606.189194:0:6682:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:0.0:1789429606.189233:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2367:x1876351635183360:12345-192.168.203.39@tcp:8:ptlrpcd_01_00.0 00010000:00080000:0.0:1789429606.189269:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1304 last 0 00000100:00100000:3.0:1789429606.189276:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5932 00000100:02000000:3.0:1789429606.189281:0:20745:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:3.0:1789429606.189287:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2367:x1876351635183488:12345-192.168.203.39@tcp:8:ptlrpcd_01_00.0 00000020:00000080:0.0:1789429606.189305:0:6682:0:(genops.c:1384:class_connect()) connect: client 217af837-ec0e-4ad4-94fa-9fc2e0e9f711, cookie 0xb4c3dad72636221e 00010000:00080000:3.0:1789429606.189306:0:20745:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t0 exp 0000000000000000 cur 1304 last 0 00002000:00100000:0.0:1789429606.189320:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 217af837-ec0e-4ad4-94fa-9fc2e0e9f711/ffff946f04e08800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 2097152 ocd_index: 0 ocd_group 0 00000020:00000080:3.0:1789429606.189331:0:20745:0:(genops.c:1384:class_connect()) connect: client 12e09781-3d24-4c67-9972-bb781900e20d, cookie 0xb4c3dad726362225 00002000:00100000:3.0:1789429606.189340:0:20745:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 12e09781-3d24-4c67-9972-bb781900e20d/ffff946f3f3d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 2097152 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789429606.189348:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:3.0:1789429606.189349:0:20745:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789429606.196331:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789429606.196377:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946f416d9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789429606.196461:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2367:x1876351635183360:12345-192.168.203.39@tcp:8:ptlrpcd_01_00.0 Request processed in 7256us (7490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429606.196473:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5931 00002000:00080000:3.0:1789429606.198860:0:20745:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789429606.198904:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946f3f20f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789429606.198978:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+6:2367:x1876351635183488:12345-192.168.203.39@tcp:8:ptlrpcd_01_00.0 Request processed in 9689us (9949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429606.198989:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5932 00000001:00020000:1.0:1789429606.476304:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:1.0:1789429606.476337:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648426752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429606.476443:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648426752:12345-0@lo:400:kworker.0 Request processed in 126us (4007300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429606.476452:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1789429606.477097:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648426752:0@lo:400:kworker.0 00000001:00020000:2.0:1789429606.478232:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429606.478286:0:26937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648426880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429606.478375:0:26937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648426880:12345-0@lo:400:kworker.0 Request processed in 132us (4009136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429606.478383:0:26937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00080000:0.0:1789429606.478613:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429606.478781:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648426880:0@lo:400:kworker.0 00000001:00020000:3.0:1789429606.491331:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429606.491392:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648427136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429606.491533:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648427136:12345-0@lo:400:kworker.0 Request processed in 188us (4022497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429606.491542:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:2.0:1789429606.491919:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648427136:0@lo:400:kworker.0 00000100:00080000:0.0:1789429606.492501:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789429606.547351:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:2.0:1789429606.547404:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648427008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429606.548441:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648427008:12345-0@lo:400:kworker.0 Request processed in 1072us (4079344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429606.548453:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:3.0:1789429606.548707:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648427008:0@lo:400:kworker.0 00000100:00080000:0.0:1789429606.550312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:3.0:1789429606.572924:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 512 awake 00000100:00100000:3.0:1789429606.572981:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648427264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429606.573095:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648427264:12345-0@lo:400:kworker.0 Request processed in 157us (4103918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429606.573105:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1789429606.573301:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969608 gen 2 00000004:00080000:1.0:1789429606.573309:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f054d6a00, transno 4294969608 00000100:00100000:1.0:1789429606.573333:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648427264:0@lo:400:kworker.0 00000100:00080000:0.0:1789429606.573411:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789429606.627511:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429607.192628:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429607.192686:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429607.192717:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429607.192767:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429607.192791:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635183872 00000100:00100000:0.0:1789429607.192802:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635183872 00000100:00100000:2.0:1789429607.192806:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429607.192844:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635183744 00000100:00100000:2.0:1789429607.192849:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635183744 00000100:00100000:0.0:1789429607.192863:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635184128 00000100:00100000:0.0:1789429607.192868:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635184128 00000100:00100000:2.0:1789429607.192885:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635184000 00000100:00100000:2.0:1789429607.192890:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635184000 00000100:00100000:0.0:1789429607.192904:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1028 00000100:02000000:0.0:1789429607.192910:0:13238:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429607.192914:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:2.0:1789429607.192924:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 993 00000100:02000000:2.0:1789429607.192929:0:5840:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:2.0:1789429607.192932:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429607.192935:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 994 00000100:02000000:0.0:1789429607.192940:0:5839:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429607.192942:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00080000:0.0:1789429607.192958:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429607.193018:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635183616 00000100:00100000:1.0:1789429607.193023:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635183616 00000100:00100000:1.0:1789429607.193052:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 647 00000100:02000000:1.0:1789429607.193055:0:5833:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:1.0:1789429607.193062:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f091f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635183616:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429607.193138:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f091f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635183616:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429607.193145:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 647 00000100:00100000:1.0:1789429607.193183:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1029 00000100:02000000:1.0:1789429607.193186:0:20986:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429607.193188:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:2.0:1789429607.587489:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648427648:0@lo:400:kworker.0 00000100:00100000:2.0:1789429607.587564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429607.587719:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648428032:0@lo:400:kworker.0 00000100:00100000:0.0:1789429607.587764:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429607.587815:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648427904:0@lo:400:kworker.0 00000100:00100000:0.0:1789429607.587844:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429607.587869:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429607.587874:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648427776:0@lo:400:kworker.0 00000100:00100000:0.0:1789429607.587895:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429607.587922:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648427904 00000100:00100000:0.0:1789429607.587928:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648427904 00000100:00100000:0.0:1789429607.587982:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648427776 00000100:00100000:0.0:1789429607.587986:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648427776 00000100:00100000:0.0:1789429607.588008:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:02000000:0.0:1789429607.588013:0:6704:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429607.588016:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429607.588031:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:02000000:0.0:1789429607.588033:0:15700:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429607.588035:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429607.588057:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648428032 00000100:00100000:0.0:1789429607.588060:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648428032 00000100:00100000:0.0:1789429607.588087:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:02000000:0.0:1789429607.588090:0:8085:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429607.588093:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429607.588234:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648427648 00000100:00100000:1.0:1789429607.588238:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648427648 00000100:00100000:1.0:1789429607.588276:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:02000000:1.0:1789429607.588279:0:5831:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:1.0:1789429607.588286:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648427648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429607.588608:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429607.588617:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648428288:0@lo:400:kworker.0 00000100:00100000:3.0:1789429607.588645:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429607.588672:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648428288 00000100:00100000:3.0:1789429607.588675:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648428288 00000100:00100000:3.0:1789429607.588698:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:02000000:3.0:1789429607.588700:0:6680:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429607.588702:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429607.588764:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789429607.588773:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648428160:0@lo:400:kworker.0 00000100:00100000:0.0:1789429607.588799:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429607.588868:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648428160 00000100:00100000:3.0:1789429607.588872:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648428160 00000100:00100000:3.0:1789429607.588937:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:02000000:3.0:1789429607.588940:0:5841:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429607.588942:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429607.589039:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648427648:12345-0@lo:400:kworker.0 Request processed in 754us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429607.589047:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1789429607.589256:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f17bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648427648:0@lo:400:kworker.0 00010000:00010000:0.0:1789429607.653287:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429608.099446:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f415c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648428416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429608.099517:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429608.099649:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648428416 00000100:00100000:2.0:1789429608.099656:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648428416 00000100:00100000:2.0:1789429608.099721:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:02000000:2.0:1789429608.099726:0:6683:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:2.0:1789429608.099732:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648428416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429608.099772:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44761088 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429608.099812:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648428416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429608.099821:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00080000:1.0:1789429608.099877:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429608.100003:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f415c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648428416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429608.100609:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429608.100622:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648428544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429608.100655:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429608.100798:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648428544 00000100:00100000:3.0:1789429608.100805:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648428544 00000100:00100000:3.0:1789429608.100906:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:02000000:3.0:1789429608.100910:0:6684:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:3.0:1789429608.100917:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648428544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429608.100940:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3855613952 avail 3853516800 00000100:00100000:3.0:1789429608.100981:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648428544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429608.100987:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1789429608.101019:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648428544:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789429608.101140:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789429608.675410:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:1.0:1789429608.915466:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429608.916334:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:12e09781-3d24-4c67-9972-bb781900e20d+31:47006:x1876351635183232:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429608.916418:0:26936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429608.916447:0:26936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636222c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc87 expref: -99 pid: 26936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429608.916515:0:26936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad726362233 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429608.916529:0:26936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad726362233 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429608.916540:0:26936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad726362233 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429608.916577:0:26936:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429608.916581:0:26936:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429608.916602:0:26936:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad726362233 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429608.916626:0:26936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c4a00/0xb4c3dad72636222c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc87 expref: 33 pid: 26936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429608.916650:0:26936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad726362233 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc87 expref: 32 pid: 26936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429608.916659:0:26936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cd00) 00010000:00010000:1.0:1789429608.916662:0:26936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429608.916665:0:26936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5e00, rc 0) 00000100:00100000:1.0:1789429608.917107:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:12e09781-3d24-4c67-9972-bb781900e20d+32:47006:x1876351635183232:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1626us (4068969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429608.917117:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21367 00000100:00100000:2.0:1789429608.920137:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429608.920319:0:26937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635184384 00000100:00100000:1.0:1789429608.920333:0:26937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635184384 00000100:00100000:1.0:1789429608.920416:0:26937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21368 00000100:02000000:1.0:1789429608.920425:0:26937:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429608.920429:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00080000:0.0:1789429608.932251:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789429609.712139:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789429610.332261:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000001:00100000:0.0:1789429610.332292:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00010000:00010000:1.0:1789429610.725091:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:3.0:1789429611.205556:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429611.205616:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635184128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429611.205745:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635184128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 169us (4013025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429611.205756:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1029 00000100:00080000:3.0:1789429611.205811:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:1.0:1789429611.259604:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429611.259661:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2369:x1876351635183744:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429611.259791:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:2369:x1876351635183744:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 166us (4067022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429611.259802:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 993 00000100:00080000:3.0:1789429611.259941:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789429611.259951:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429611.259968:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351635184000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429611.260000:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:2369:x1876351635184000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 43us (4067196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429611.260008:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 994 00000100:00080000:3.0:1789429611.260027:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789429611.278805:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429611.278894:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635183872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429611.279032:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635183872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 206us (4086344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429611.279043:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1028 00000100:00080000:3.0:1789429611.279377:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:2.0:1789429611.643382:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429611.643457:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648428160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429611.643611:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648428160:12345-0@lo:400:kworker.0 Request processed in 208us (4054810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429611.643621:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000001:00020000:0.0:1789429611.643762:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429611.643782:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648428032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429611.643827:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648428032:12345-0@lo:400:kworker.0 Request processed in 57us (4056062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429611.643835:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00080000:3.0:1789429611.644111:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429611.644118:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429611.644259:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648428160:0@lo:400:kworker.0 00000100:00100000:1.0:1789429611.644276:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648428032:0@lo:400:kworker.0 00000001:00020000:2.0:1789429611.644371:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429611.644384:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648427776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429611.644455:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648427776:12345-0@lo:400:kworker.0 Request processed in 76us (4056558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429611.644462:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:3.0:1789429611.644707:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648427776:0@lo:400:kworker.0 00000001:00020000:0.0:1789429611.645525:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429611.645573:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648428288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429611.645678:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648428288:12345-0@lo:400:kworker.0 Request processed in 142us (4057031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429611.645686:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00080000:3.0:1789429611.645790:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429611.646098:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648428288:0@lo:400:kworker.0 00000001:00020000:3.0:1789429611.677290:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429611.677432:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648427904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429611.677583:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648427904:12345-0@lo:400:kworker.0 Request processed in 274us (4089736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429611.677593:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1789429611.679313:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648427904:0@lo:400:kworker.0 00000100:00080000:0.0:1789429611.682042:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789429611.749013:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429612.313286:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429612.314678:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429612.317125:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429612.317177:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429612.317237:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429612.317287:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635184768 00000100:00100000:3.0:1789429612.317300:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635184768 00000100:00100000:3.0:1789429612.317374:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635185024 00000100:00100000:3.0:1789429612.317378:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635185024 00000100:00100000:2.0:1789429612.317403:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635184512 00000100:00100000:2.0:1789429612.317410:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635184512 00000100:00100000:3.0:1789429612.317421:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1032 00000100:02000000:3.0:1789429612.317429:0:27100:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429612.317432:0:27100:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:3.0:1789429612.317453:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1033 00000100:00100000:2.0:1789429612.317456:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 649 00000100:02000000:3.0:1789429612.317458:0:6681:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:02000000:2.0:1789429612.317462:0:5834:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429612.317462:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:2.0:1789429612.317475:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635184512:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429612.318811:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635184640 00000100:00100000:0.0:1789429612.318826:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635184640 00000100:00100000:0.0:1789429612.318905:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635184896 00000100:00100000:0.0:1789429612.318910:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635184896 00000100:00100000:0.0:1789429612.318940:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 998 00000100:02000000:0.0:1789429612.318945:0:15669:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429612.318948:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429612.318977:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 999 00000100:02000000:0.0:1789429612.318980:0:5840:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429612.318982:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:2.0:1789429612.321666:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635184512:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 4179us (4538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429612.321685:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 649 00000100:00100000:3.0:1789429612.707676:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648428928:0@lo:400:kworker.0 00000100:00100000:3.0:1789429612.707787:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429612.707863:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789429612.707870:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648428800:0@lo:400:kworker.0 00000100:00100000:3.0:1789429612.707895:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429612.707915:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648429312:0@lo:400:kworker.0 00000100:00100000:3.0:1789429612.707943:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429612.707981:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648428928 00000100:00100000:3.0:1789429612.707991:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648428928 00000100:00100000:3.0:1789429612.708048:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648428800 00000100:00100000:3.0:1789429612.708052:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648428800 00000100:00100000:3.0:1789429612.708077:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:02000000:3.0:1789429612.708083:0:5839:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429612.708087:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:3.0:1789429612.708103:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:02000000:3.0:1789429612.708106:0:15700:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429612.708108:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:3.0:1789429612.708119:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648429312 00000100:00100000:3.0:1789429612.708122:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648429312 00000100:00100000:2.0:1789429612.708254:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648428672:0@lo:400:kworker.0 00000100:00100000:2.0:1789429612.708302:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429612.708339:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648428672 00000100:00100000:2.0:1789429612.708345:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648429184:0@lo:400:kworker.0 00000100:00100000:0.0:1789429612.708347:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648428672 00000100:00100000:2.0:1789429612.708367:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429612.708397:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429612.708403:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1789429612.708405:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648429056:0@lo:400:kworker.0 00000100:02000000:0.0:1789429612.708409:0:5831:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:0.0:1789429612.708420:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648428672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429612.708431:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429612.708464:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648429184 00000100:00100000:2.0:1789429612.708469:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648429184 00000100:00100000:0.0:1789429612.708496:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648428672:12345-0@lo:400:kworker.0 Request processed in 78us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429612.708503:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1789429612.708507:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:02000000:2.0:1789429612.708509:0:26938:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:2.0:1789429612.708512:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:2.0:1789429612.708544:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648428672:0@lo:400:kworker.0 00000100:00100000:0.0:1789429612.708549:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648429056 00000100:00100000:0.0:1789429612.708554:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648429056 00000100:00100000:0.0:1789429612.708581:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:02000000:0.0:1789429612.708584:0:13238:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429612.708587:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:3.0:1789429612.708693:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:02000000:3.0:1789429612.708697:0:20986:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429612.708699:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00010000:00010000:1.0:1789429612.771466:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:0.0:1789429612.987368:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429612.987421:0:26937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:12e09781-3d24-4c67-9972-bb781900e20d+32:47006:x1876351635184384:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429612.987459:0:26937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429612.987463:0:26937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789429612.987508:0:26937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad726362233 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc87 expref: 32 pid: 26936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.987536:0:26937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970cd00) 00010000:00010000:0.0:1789429612.987559:0:26937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429612.987584:0:26937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636223a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc8e expref: -99 pid: 26937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.989288:0:26937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726362241 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.989318:0:26937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726362241 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.989336:0:26937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726362241 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.989355:0:26937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726362248 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.989361:0:26937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726362248 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.989367:0:26937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726362248 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789429612.996688:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3a:0x0], index 0: 0 00010000:00010000:0.0:1789429612.997085:0:26937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636224f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.997106:0:26937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636224f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.997123:0:26937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636224f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.997167:0:26937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726362241 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.997174:0:26937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726362241 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.997182:0:26937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726362241 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.997188:0:26937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad600 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429612.997193:0:26937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726362241 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.997230:0:26937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726362241 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.997245:0:26937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f120fd900) 00010000:00010000:0.0:1789429612.997248:0:26937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429612.997255:0:26937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726362241 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.997262:0:26937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad600/0xb4c3dad726362241 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429612.997277:0:26937:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ce0461ca reply state 00000000f2357a97 transno 4294977265 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726362248 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429612.997287:0:26937:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789429612.997330:0:26937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad72636223a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc8e expref: 34 pid: 26937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.997352:0:26937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636224f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc8e expref: 33 pid: 26937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429612.997360:0:26937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8f:0x0].0x0 (ffff946f120fda00) 00010000:00010000:0.0:1789429612.997362:0:26937:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789429612.997365:0:26937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429612.998123:0:26937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:12e09781-3d24-4c67-9972-bb781900e20d+34:47006:x1876351635184384:12345-192.168.203.39@tcp:101:dd.0 Request processed in 10729us (4077993us total) trans 4294977265 rc 0/0 00000100:00100000:0.0:1789429612.998136:0:26937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21368 00010000:00010000:0.0:1789429613.006116:0:3284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726362248 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429613.006144:0:3284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726362248 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429613.006153:0:3284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726362248 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429613.006161:0:3284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2adc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429613.006166:0:3284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726362248 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429613.006176:0:3284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726362248 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429613.006197:0:3284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ce0eb6 (ffff946f120fdc00) 00010000:00010000:0.0:1789429613.006242:0:3284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429613.006248:0:3284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726362248 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429613.006255:0:3284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2adc00/0xb4c3dad726362248 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26937 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429613.006814:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429613.007167:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635185152 00000100:00100000:2.0:1789429613.007371:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635185152 00000100:00100000:2.0:1789429613.007435:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5933 00000100:02000000:2.0:1789429613.007442:0:6682:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:2.0:1789429613.007450:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2367:x1876351635185152:12345-192.168.203.39@tcp:8:dd.0 00010000:00080000:2.0:1789429613.007494:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t0 exp 0000000000000000 cur 1310 last 0 00000020:00000080:2.0:1789429613.007770:0:6682:0:(genops.c:1384:class_connect()) connect: client 12e09781-3d24-4c67-9972-bb781900e20d, cookie 0xb4c3dad72636225d 00002000:00100000:2.0:1789429613.007785:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 12e09781-3d24-4c67-9972-bb781900e20d/ffff946e03782800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 260702208 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789429613.007922:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789429613.013234:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789429613.013302:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946e03781000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789429613.013417:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d983b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+6:2367:x1876351635185152:12345-192.168.203.39@tcp:8:dd.0 Request processed in 5964us (6607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429613.013430:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5933 00000100:00100000:3.0:1789429613.017414:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429613.017538:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635185280 00000100:00100000:0.0:1789429613.017557:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635185280 00000100:00100000:0.0:1789429613.017652:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5934 00000100:02000000:0.0:1789429613.017659:0:8085:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:0.0:1789429613.017670:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+6:47006:x1876351635185280:12345-192.168.203.39@tcp:101:dd.0 00000100:00080000:3.0:1789429613.017810:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789429613.017903:0:8085:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429613.017931:0:8085:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362264 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc95 expref: -99 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789429613.017969:0:8085:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789429613.017998:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=1310s v=(0 0) 00010000:00010000:0.0:1789429613.018004:0:8085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789429613.018016:0:8085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362264 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc95 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429613.018040:0:8085:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362264 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc95 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429613.018056:0:8085:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2adc00, rc 0) 00000100:00100000:0.0:1789429613.018137:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+7:47006:x1876351635185280:12345-192.168.203.39@tcp:101:dd.0 Request processed in 469us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429613.018145:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5934 00000100:00100000:0.0:1789429613.040138:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429613.040420:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635185536 00000100:00100000:3.0:1789429613.040434:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635185536 00000100:00080000:0.0:1789429613.042123:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429613.043251:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 296 00000100:02000000:3.0:1789429613.043263:0:5842:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:3.0:1789429613.043286:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+33:47006:x1876351635185536:12345-192.168.203.39@tcp:35:dd.0 00000001:00080000:3.0:1789429613.047214:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294977266 00000100:00100000:3.0:1789429613.047431:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+35:47006:x1876351635185536:12345-192.168.203.39@tcp:35:dd.0 Request processed in 4152us (7299us total) trans 4294977267 rc 0/0 00000100:00100000:3.0:1789429613.047444:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 296 00000020:00080000:3.0:1789429613.047451:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789429613.063606:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429613.063852:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635185664 00000100:00100000:0.0:1789429613.063868:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635185664 00000100:00100000:0.0:1789429613.063985:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21369 00000100:02000000:0.0:1789429613.063992:0:5841:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429613.063996:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00080000:3.0:1789429613.064155:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429613.067432:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429613.074757:0:20673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635185792 00000100:00100000:1.0:1789429613.074783:0:20673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635185792 00002000:00100000:1.0:1789429613.075358:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x3a:0x0] (0->51199) req@ffff946f1c1a0380 x1876351635185792/t0(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:349/0 lens 488/0 e 0 to 0 dl 1789429624 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429613.075374:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a0380 with x1876351635185792 ext(0->51199) 00002000:00010000:1.0:1789429613.075383:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1a0380 00000100:00100000:1.0:1789429613.075482:0:20673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11897 00000100:02000000:1.0:1789429613.075489:0:20673:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429613.075493:0:20673:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:2.0:1789429613.219562:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429613.219568:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429613.219594:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648429568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429613.219594:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648429440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429613.221270:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429613.221604:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648429440 00000100:00100000:3.0:1789429613.221617:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648429440 00000100:00100000:3.0:1789429613.221718:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:02000000:3.0:1789429613.221725:0:9195:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:3.0:1789429613.221735:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648429440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429613.221785:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44761088 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429613.221990:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29debb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648429440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 256us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429613.221998:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1789429613.222179:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29de8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648429440:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789429613.222266:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429613.223255:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429613.236130:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648429568 00000100:00100000:2.0:1789429613.236153:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648429568 00000100:00100000:2.0:1789429613.236286:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:02000000:2.0:1789429613.236295:0:6683:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:2.0:1789429613.236307:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648429568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429613.236350:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429613.236482:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648429568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (13229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429613.236494:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1789429613.236561:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648429568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789429613.236621:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789429613.795549:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429614.819749:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429615.843902:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789429616.345058:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977265 is committed 00000001:00080000:0.0:1789429616.345078:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977267 is committed 00000001:00020000:0.0:1789429616.388819:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429616.388875:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635185024:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429616.388976:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2369:x1876351635185024:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 143us (4071738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429616.388986:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1033 00000100:00080000:2.0:1789429616.391641:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:3.0:1789429616.403384:0:27100:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429616.403438:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635184768:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429616.403551:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635184768:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 152us (4086372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429616.403560:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1032 00000100:00080000:2.0:1789429616.404812:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:3.0:1789429616.411295:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429616.411349:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2369:x1876351635184896:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429616.411444:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2369:x1876351635184896:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 135us (4096775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429616.411454:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 999 00000100:00080000:1.0:1789429616.411957:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789429616.419314:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429616.419367:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635184640:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429616.419466:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635184640:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 138us (4106286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429616.419476:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 998 00000100:00080000:1.0:1789429616.419578:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789429616.763390:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429616.763491:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648429056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429616.765101:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648429056:12345-0@lo:400:kworker.0 Request processed in 1691us (4056663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429616.765116:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000001:00020000:2.0:1789429616.765457:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429616.765472:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648428800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429616.765491:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648429056:0@lo:400:kworker.0 00000100:00100000:2.0:1789429616.765552:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648428800:12345-0@lo:400:kworker.0 Request processed in 87us (4057654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429616.765559:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1789429616.765646:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648428800:0@lo:400:kworker.0 00000100:00080000:1.0:1789429616.765794:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:2.0:1789429616.779332:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429616.779390:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648428928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429616.779503:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648428928:12345-0@lo:400:kworker.0 Request processed in 156us (4071715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429616.779513:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00080000:1.0:1789429616.779682:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429616.781518:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648428928:0@lo:400:kworker.0 00000001:00020000:0.0:1789429616.781814:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429616.781852:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648429312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429616.781935:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648429312:12345-0@lo:400:kworker.0 Request processed in 112us (4073990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429616.781944:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000001:00020000:2.0:1789429616.782007:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429616.782020:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648429184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429616.782020:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648429312:0@lo:400:kworker.0 00000100:00100000:2.0:1789429616.782071:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648429184:12345-0@lo:400:kworker.0 Request processed in 57us (4073703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429616.782078:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1789429616.782095:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648429184:0@lo:400:kworker.0 00000100:00080000:1.0:1789429616.785837:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429616.785847:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1789429616.853669:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00010000:00010000:1.0:1789429616.870275:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:1.0:1789429617.131308:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429617.131360:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+20:47011:x1876351635185664:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1789429617.131385:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789429617.131414:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72636226b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cc9c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429617.131490:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429617.131579:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429617.131594:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429617.131641:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429617.131645:0:5841:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429617.131664:0:5841:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429617.131699:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad72636226b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc9c expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429617.131718:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc9c expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429617.131727:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c100) 00010000:00010000:1.0:1789429617.131731:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429617.131734:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5200, rc 0) 00000100:00100000:1.0:1789429617.131805:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:47011:x1876351635185664:12345-192.168.203.39@tcp:101:dd.0 Request processed in 476us (4068216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429617.131813:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21369 00000100:00100000:3.0:1789429617.138039:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429617.139112:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635186048 00000100:00100000:2.0:1789429617.139124:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635186048 00000100:00100000:2.0:1789429617.139190:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21370 00000100:02000000:2.0:1789429617.139196:0:26936:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:2.0:1789429617.139238:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000001:00020000:3.0:1789429617.139262:0:20673:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429617.139295:0:20673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+6:2371:x1876351635185792:12345-192.168.203.39@tcp:4:dd.0 00000100:00080000:1.0:1789429617.139708:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429617.144773:0:20673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_014:12e09781-3d24-4c67-9972-bb781900e20d+8:2371:x1876351635185792:12345-192.168.203.39@tcp:4:dd.0 Request processed in 5492us (4077345us total) trans 4294969583 rc 0/0 00000100:00100000:2.0:1789429617.144787:0:20673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11897 00002000:00100000:2.0:1789429617.144800:0:20673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_014: refresh rw locks for [0x240000400:0x3a:0x0] (0->51199) req@ffff946f1c1a0380 x1876351635185792/t4294969583(0) o4->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:349/0 lens 488/448 e 0 to 0 dl 1789429624 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789429617.144810:0:20673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f1c1a0380 with x1876351635185792 ext(0->51199) 00002000:00010000:2.0:1789429617.144817:0:20673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f1c1a0380 00000100:00100000:3.0:1789429617.433302:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429617.433346:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429617.433380:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429617.433411:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429617.433701:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635186176 00000100:00100000:2.0:1789429617.433712:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635186176 00000100:00100000:2.0:1789429617.433773:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 651 00000100:02000000:2.0:1789429617.433778:0:5834:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:2.0:1789429617.433788:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635186176:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429617.433870:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635186176:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 85us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429617.433881:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 651 00000100:00100000:2.0:1789429617.433912:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635186432 00000100:00100000:2.0:1789429617.433915:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635186432 00000100:00100000:2.0:1789429617.433944:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635186560 00000100:00100000:2.0:1789429617.433946:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635186560 00000100:00100000:2.0:1789429617.433967:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1036 00000100:02000000:2.0:1789429617.433970:0:6682:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:2.0:1789429617.433972:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:2.0:1789429617.433986:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1037 00000100:02000000:2.0:1789429617.433988:0:6680:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:2.0:1789429617.433990:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429617.434221:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635186304 00000100:00100000:1.0:1789429617.434227:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635186304 00000100:00100000:1.0:1789429617.434265:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1003 00000100:02000000:1.0:1789429617.434268:0:6704:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429617.434270:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429617.827581:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648429696:0@lo:400:kworker.0 00000100:00100000:1.0:1789429617.827656:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429617.827777:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648429696 00000100:00100000:2.0:1789429617.827786:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648429696 00000100:00100000:3.0:1789429617.827813:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648430080:0@lo:400:kworker.0 00000100:00100000:2.0:1789429617.827838:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:02000000:2.0:1789429617.827843:0:5833:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:3.0:1789429617.827845:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429617.827850:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648429696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429617.827877:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648429952:0@lo:400:kworker.0 00000100:00100000:3.0:1789429617.827925:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429617.827950:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429617.827956:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648429824:0@lo:400:kworker.0 00000100:00100000:3.0:1789429617.827985:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429617.828010:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648429952 00000100:00100000:3.0:1789429617.828013:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648429952 00000100:00100000:3.0:1789429617.828039:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648429824 00000100:00100000:3.0:1789429617.828042:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648429824 00000100:00100000:3.0:1789429617.828061:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:02000000:3.0:1789429617.828064:0:15669:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429617.828066:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:3.0:1789429617.828077:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:02000000:3.0:1789429617.828080:0:15700:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429617.828082:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:3.0:1789429617.828127:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648430080 00000100:00100000:3.0:1789429617.828130:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648430080 00000100:00100000:3.0:1789429617.828152:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:02000000:3.0:1789429617.828154:0:6681:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429617.828156:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:3.0:1789429617.828555:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789429617.828607:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429617.828617:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648430336:0@lo:400:kworker.0 00000100:00100000:0.0:1789429617.828649:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429617.828689:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648430336 00000100:00100000:0.0:1789429617.828693:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648430336 00000100:00100000:0.0:1789429617.828720:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:02000000:0.0:1789429617.828723:0:13238:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429617.828725:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:3.0:1789429617.830108:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648430208:0@lo:400:kworker.0 00000100:00100000:3.0:1789429617.830162:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429617.830280:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648430208 00000100:00100000:0.0:1789429617.830300:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648430208 00000100:00100000:2.0:1789429617.830396:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648429696:12345-0@lo:400:kworker.0 Request processed in 2544us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429617.830406:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1789429617.830461:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:02000000:0.0:1789429617.830466:0:5841:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429617.830468:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429617.831683:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648429696:0@lo:400:kworker.0 00010000:00010000:0.0:1789429617.891656:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429618.340944:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648430464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429618.341014:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429618.341453:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648430464 00000100:00100000:1.0:1789429618.341461:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648430464 00000100:00100000:1.0:1789429618.341567:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:02000000:1.0:1789429618.341572:0:9195:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:1.0:1789429618.341581:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648430464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429618.341604:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47382528 pending 1703936 free 3855613952 avail 3853516800 00000100:00080000:0.0:1789429618.341628:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429618.341675:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1876351648430464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429618.341683:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1789429618.341714:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648430464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429618.346464:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789429618.346486:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648430592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429618.346550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429618.346681:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648430592 00000100:00100000:2.0:1789429618.346690:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648430592 00000100:00100000:2.0:1789429618.346752:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:02000000:2.0:1789429618.346757:0:6683:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:2.0:1789429618.346767:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648430592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429618.346800:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44761088 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429618.346859:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648430592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429618.346866:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00080000:0.0:1789429618.346934:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789429618.346938:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648430592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789429618.915388:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429619.939741:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429620.963565:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:2.0:1789429621.195324:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429621.195374:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:47011:x1876351635186048:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1789429621.195398:0:26936:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429621.195422:0:26936:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cca3 expref: -99 pid: 26936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.195494:0:26936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362280 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.195509:0:26936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.195523:0:26936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.195550:0:26936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31bc00/0xb4c3dad726362287 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.195558:0:26936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31bc00/0xb4c3dad726362287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.195569:0:26936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31bc00/0xb4c3dad726362287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.195914:0:26936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a200/0xb4c3dad72636228e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.195925:0:26936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a200/0xb4c3dad72636228e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.195933:0:26936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a200/0xb4c3dad72636228e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429621.195948:0:26936:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x8f:0x0]: returning size 51200 00010000:00010000:2.0:1789429621.196087:0:26936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196096:0:26936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362280 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196103:0:26936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362280 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196109:0:26936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31ba00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429621.196113:0:26936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362280 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196120:0:26936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362280 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196133:0:26936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c100) 00010000:00010000:2.0:1789429621.196136:0:26936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429621.196141:0:26936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362280 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196147:0:26936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ba00/0xb4c3dad726362280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196160:0:26936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31bc00/0xb4c3dad726362287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196167:0:26936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31bc00/0xb4c3dad726362287 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196177:0:26936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31bc00/0xb4c3dad726362287 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196182:0:26936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f2f31bc00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:2.0:1789429621.196185:0:26936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31bc00/0xb4c3dad726362287 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196191:0:26936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31bc00/0xb4c3dad726362287 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196250:0:26936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1ce0eb6 (ffff946f051ef600) 00010000:00010000:2.0:1789429621.196253:0:26936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789429621.196257:0:26936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31bc00/0xb4c3dad726362287 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196263:0:26936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31bc00/0xb4c3dad726362287 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1ce0eb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26936 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196306:0:26936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a600/0xb4c3dad726362279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cca3 expref: 24 pid: 26936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196320:0:26936:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a200/0xb4c3dad72636228e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cca3 expref: 23 pid: 26936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429621.196327:0:26936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8f:0x0].0x0 (ffff946f120fda00) 00010000:00010000:2.0:1789429621.196330:0:26936:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789429621.196332:0:26936:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31a200, rc 0) 00000100:00100000:2.0:1789429621.196412:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:47011:x1876351635186048:12345-192.168.203.39@tcp:101:dd.0 Request processed in 1073us (4058389us total) trans 4294977268 rc 0/0 00000100:00100000:2.0:1789429621.196425:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21370 00000100:00080000:0.0:1789429621.196939:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429621.209136:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429621.209244:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635186688 00000100:00100000:0.0:1789429621.209255:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635186688 00000100:00100000:0.0:1789429621.209316:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5935 00000100:02000000:0.0:1789429621.209321:0:20745:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:0.0:1789429621.209328:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2367:x1876351635186688:12345-192.168.203.39@tcp:8:dd.0 00010000:00080000:0.0:1789429621.209360:0:20745:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1319 last 0 00000020:00000080:0.0:1789429621.209395:0:20745:0:(genops.c:1384:class_connect()) connect: client 217af837-ec0e-4ad4-94fa-9fc2e0e9f711, cookie 0xb4c3dad72636229c 00002000:00100000:0.0:1789429621.209407:0:20745:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 217af837-ec0e-4ad4-94fa-9fc2e0e9f711/ffff946f416d8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 257687552 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789429621.209429:0:20745:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789429621.209521:0:20745:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789429621.209562:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946f416dc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789429621.209637:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2367:x1876351635186688:12345-192.168.203.39@tcp:8:dd.0 Request processed in 307us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429621.209655:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5935 00000100:00100000:3.0:1789429621.219197:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429621.219386:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635186816 00000100:00100000:0.0:1789429621.219396:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635186816 00000100:00100000:0.0:1789429621.219621:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5936 00000100:02000000:0.0:1789429621.219627:0:27100:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:0.0:1789429621.219637:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:47011:x1876351635186816:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1789429621.219666:0:27100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429621.219685:0:27100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263622a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ccaa expref: -99 pid: 27100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429621.219718:0:27100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362264 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc95 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429621.219728:0:27100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3a:0x0].0x0 since=9s v=(0 0) 00010000:00010000:0.0:1789429621.219732:0:27100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789429621.219738:0:27100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263622a3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccaa expref: 7 pid: 27100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429621.219771:0:27100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362264 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc95 expref: 7 pid: 8085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:02000000:0.1:1789429621.219782:0:27100:0:(ldlm_lockd.c:391:__ldlm_add_waiting_lock()) *** cfs_fail_loc=511, val=0*** 00000100:00080000:1.0:1789429621.220530:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789429621.227853:0:27100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362264 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc95 expref: 7 pid: 8085 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429621.227880:0:27100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27100:1876351648430720:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429621.227990:0:27100:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f341a2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789429621.240118:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429621.240275:0:27100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:27100:1876351648430720:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429621.240318:0:27100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263622a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccaa expref: 7 pid: 27100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429621.240340:0:27100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ada00, rc 0) 00000100:00100000:0.0:1789429621.240800:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:47011:x1876351635186816:12345-192.168.203.39@tcp:101:dd.0 Request processed in 21164us (21610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429621.240809:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5936 00000100:00100000:3.0:1789429621.240883:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635186944 00000100:00100000:3.0:1789429621.240891:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635186944 00010000:00010000:3.0:1789429621.240942:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362264 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc95 expref: 8 pid: 8085 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429621.240977:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6273 00000100:02000000:3.0:1789429621.240981:0:5825:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429621.240984:0:5825:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00080000:0.0:1789429621.241229:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789429621.452878:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977268 is committed 00000001:00020000:2.0:1789429621.493018:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429621.493074:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635186560:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429621.493157:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635186560:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 117us (4059744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429621.493165:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1037 00000100:00080000:0.0:1789429621.493692:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:2.0:1789429621.499311:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429621.499370:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635186432:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:0.0:1789429621.499596:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429621.499657:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635186432:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 330us (4066307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429621.499666:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1036 00000001:00020000:1.0:1789429621.500038:0:6704:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429621.500069:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351635186304:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429621.500114:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351635186304:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 67us (4066732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429621.500125:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1003 00000100:00080000:0.0:1789429621.500250:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:1.0:1789429621.883331:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429621.883379:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648430208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429621.883491:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648430208:12345-0@lo:400:kworker.0 Request processed in 146us (4053327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429621.883500:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1789429621.883793:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648430208:0@lo:400:kworker.0 00000100:00080000:0.0:1789429621.883884:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789429621.883957:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429621.883969:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648429824:12345-0@lo:400:kworker.0 00000001:00020000:1.0:1789429621.884166:0:6681:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429621.884197:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648430080:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789429621.884245:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429621.884277:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648430080:12345-0@lo:400:kworker.0 Request processed in 103us (4056429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429621.884286:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1789429621.884294:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648430080:0@lo:400:kworker.0 00000100:00100000:3.0:1789429621.884772:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648429824:12345-0@lo:400:kworker.0 Request processed in 806us (4056794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429621.884779:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1789429621.891077:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648429824:0@lo:400:kworker.0 00000001:00020000:2.0:1789429621.891288:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429621.891328:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648430336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429621.891422:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648430336:12345-0@lo:400:kworker.0 Request processed in 124us (4062771us total) trans 0 rc 0/0 00000100:00080000:0.0:1789429621.891431:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429621.891433:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1789429621.891531:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648430336:0@lo:400:kworker.0 00000001:00020000:2.0:1789429621.901185:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429621.901259:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648429952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429621.901366:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648429952:12345-0@lo:400:kworker.0 Request processed in 166us (4073439us total) trans 0 rc 0/0 00000100:00080000:0.0:1789429621.901371:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429621.901382:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1789429621.902148:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648429952:0@lo:400:kworker.0 00000001:00100000:3.0:1789429621.969395:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000001:00080000:3.0:1789429621.969681:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969583 is committed 00010000:00010000:0.0:1789429621.994368:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:02000000:2.0:1789429622.243370:0:5829:0:(ldlm_lockd.c:238:expired_lock_main()) *** cfs_fail_loc=511, val=0*** 00010000:00020000:2.0:1789429622.243389:0:5829:0:(ldlm_lockd.c:255:expired_lock_main()) ### lock callback timer expired after 1s: evicting client at 192.168.203.39@tcp ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362264 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc95 expref: 7 pid: 8085 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789429622.314775:0:5829:0:(genops.c:1633:class_fail_export()) disconnecting export ffff946e03782800/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:2.0:1789429622.314790:0:5829:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad72636225d 00000020:00010000:2.0:1789429622.314799:0:5829:0:(genops.c:1920:obd_stale_export_put()) Put export ffff946e03782800: total 0 00000100:00080000:2.0:1789429622.314804:0:5829:0:(import.c:65:import_set_state_nolock()) ffff946e03781000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789429622.314854:0:5829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969583 00000020:00080000:2.0:1789429622.315085:0:5829:0:(genops.c:1650:class_fail_export()) disconnected export ffff946e03782800/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00010000:0.0:1789429622.315153:0:5827:0:(genops.c:1906:obd_stale_export_get()) Get export ffff946e03782800: total 0 00010000:00010000:0.0:1789429622.315157:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429622.315192:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946e03782800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1789429622.315253:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3a:0x0] updating lvb size from disk: 0 -> 51200 00002000:00010000:0.0:1789429622.315257:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3a:0x0] updating lvb mtime from disk: 0 -> 1789429613 00002000:00010000:0.0:1789429622.315380:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3a:0x0] updating lvb ctime from disk: 0 -> 1789429613 00002000:00010000:0.0:1789429622.315383:0:5827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3a:0x0] updating lvb blocks from disk: 1 -> 131 00010000:00010000:0.0:1789429622.315396:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362264 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc95 expref: 4 pid: 8085 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429622.315426:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1789429622.315431:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 1) 00010000:00010000:0.0:1789429622.315441:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263622a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccaa expref: 5 pid: 27100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429622.315451:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263622a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccaa expref: 5 pid: 27100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429622.315504:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd459654/0xb4c3dad7263622a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccaa expref: 5 pid: 27100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429622.315520:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a1180 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_01:lustre-OST0000_UUID:5827:1876351648430848:192.168.203.39@tcp:105: 00000100:00100000:0.0:1789429622.315641:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f05068600 going to sleep for 11 seconds 00000100:00100000:3.0:1789429622.325057:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429622.325177:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a1180 pname:cluuid:pid:xid:nid:opc:job ldlm_bl_01:lustre-OST0000_UUID:5827:1876351648430848:192.168.203.39@tcp:105: 00010000:00010000:0.0:1789429622.325237:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c9c49c0/0xb4c3dad726362264 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc95 expref: 4 pid: 8085 timeout: 1320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429622.325262:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946e03782800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789429622.325296:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429622.325299:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429622.325300:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429622.325357:0:25958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635187072 00000100:00100000:1.0:1789429622.325364:0:25958:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635187072 00002000:00100000:1.0:1789429622.325411:0:25958:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x3a:0x0] (0->4095) req@ffff946e0d980700 x1876351635187072/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:358/0 lens 488/0 e 0 to 0 dl 1789429633 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429622.325420:0:25958:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d980700 with x1876351635187072 ext(0->4095) 00002000:00010000:1.0:1789429622.325425:0:25958:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d980700 00000100:00100000:1.0:1789429622.325455:0:25958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11898 00000100:02000000:1.0:1789429622.325460:0:25958:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429622.325464:0:25958:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:3.0:1789429622.550085:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429622.550131:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429622.550165:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429622.550194:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429622.550249:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429622.550271:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429622.550298:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635187200 00000100:00100000:3.0:1789429622.550306:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635187200 00000100:00100000:1.0:1789429622.550476:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635187328 00000100:00100000:1.0:1789429622.550481:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635187328 00000100:00100000:1.0:1789429622.550522:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635187712 00000100:00100000:1.0:1789429622.550525:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635187712 00000100:00100000:1.0:1789429622.550549:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1007 00000100:02000000:1.0:1789429622.550554:0:26938:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429622.550558:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429622.550573:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1008 00000100:02000000:1.0:1789429622.550576:0:5839:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429622.550578:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429622.550770:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635187584 00000100:00100000:0.0:1789429622.550775:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635187584 00000100:00100000:0.0:1789429622.550813:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635187840 00000100:00100000:0.0:1789429622.550816:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635187840 00000100:00100000:0.0:1789429622.550838:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635187456 00000100:00100000:0.0:1789429622.550841:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635187456 00000100:00100000:0.0:1789429622.550858:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1040 00000100:02000000:0.0:1789429622.550861:0:8085:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429622.550863:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429622.550876:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1041 00000100:02000000:0.0:1789429622.550878:0:20745:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429622.550880:0:20745:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429622.550892:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5937 00000100:02000000:0.0:1789429622.550894:0:6680:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:0.0:1789429622.550900:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2368:x1876351635187456:12345-192.168.203.39@tcp:400:kworker.0 00000020:00080000:0.0:1789429622.550908:0:6680:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.39@tcp 00000100:00100000:0.0:1789429622.550968:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2368:x1876351635187456:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 67us (718us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789429622.550976:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5937 00000100:00100000:3.0:1789429622.551231:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 653 00000100:02000000:3.0:1789429622.551235:0:5831:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:3.0:1789429622.551242:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635187200:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429622.551447:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635187200:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 205us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429622.551454:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 653 00000100:00100000:3.0:1789429622.595552:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429622.596532:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635187968 00000100:00100000:1.0:1789429622.596549:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635187968 00000100:00100000:1.0:1789429622.596613:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5938 00000100:02000000:1.0:1789429622.596619:0:6681:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:1.0:1789429622.596627:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2367:x1876351635187968:12345-192.168.203.39@tcp:8:ptlrpcd_00_00.0 00010000:00080000:1.0:1789429622.596682:0:6681:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t4294969583 exp 0000000000000000 cur 1320 last 0 00000020:00000080:1.0:1789429622.596720:0:6681:0:(genops.c:1384:class_connect()) connect: client 12e09781-3d24-4c67-9972-bb781900e20d, cookie 0xb4c3dad7263622aa 00002000:00100000:1.0:1789429622.596733:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 12e09781-3d24-4c67-9972-bb781900e20d/ffff946f416f3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 2097152 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789429622.596745:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789429622.597524:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789429622.597562:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946f416f0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789429622.597696:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:12e09781-3d24-4c67-9972-bb781900e20d+6:2367:x1876351635187968:12345-192.168.203.39@tcp:8:ptlrpcd_00_00.0 Request processed in 1067us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429622.597705:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5938 00000100:00100000:1.0:1789429622.954008:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648430976:0@lo:400:kworker.0 00000100:00100000:3.0:1789429622.954017:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648431232:0@lo:400:kworker.0 00000100:00100000:2.0:1789429622.954146:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648431360:0@lo:400:kworker.0 00000100:00100000:0.0:1789429622.954231:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648431104:0@lo:400:kworker.0 00000100:00100000:1.0:1789429622.955152:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429622.955225:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648431488:0@lo:400:kworker.0 00000100:00100000:1.0:1789429622.955256:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429622.955314:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648430976 00000100:00100000:1.0:1789429622.955323:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648430976 00000100:00100000:1.0:1789429622.955368:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:02000000:1.0:1789429622.955373:0:5833:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:1.0:1789429622.955380:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648430976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429622.955432:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648430976:12345-0@lo:400:kworker.0 Request processed in 52us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429622.955439:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:1.0:1789429622.955496:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648430976:0@lo:400:kworker.0 00000100:00100000:1.0:1789429622.955527:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648431488 00000100:00100000:1.0:1789429622.955530:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648431488 00000100:00100000:1.0:1789429622.955557:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:02000000:1.0:1789429622.955559:0:26936:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429622.955562:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:2.0:1789429622.959829:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429622.960031:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429622.960490:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648431232 00000100:00100000:2.0:1789429622.960500:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648431232 00000100:00100000:2.0:1789429622.960559:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:02000000:2.0:1789429622.960564:0:5841:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:2.0:1789429622.960567:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429622.960702:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648431360 00000100:00100000:1.0:1789429622.960707:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648431360 00000100:00100000:1.0:1789429622.960747:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:02000000:1.0:1789429622.960749:0:6680:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429622.960751:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429622.962858:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429622.962918:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648431616:0@lo:400:kworker.0 00000100:00100000:0.0:1789429622.962951:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429622.962973:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648431104 00000100:00100000:2.0:1789429622.962980:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648431104 00000100:00100000:2.0:1789429622.963032:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:02000000:2.0:1789429622.963044:0:15669:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:2.0:1789429622.963047:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429622.963196:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648431616 00000100:00100000:1.0:1789429622.963230:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648431616 00000100:00100000:1.0:1789429622.963260:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:02000000:1.0:1789429622.963263:0:27100:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429622.963265:0:27100:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00010000:00010000:0.0:1789429623.011491:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429623.459444:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429623.459466:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648431744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429623.459537:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429623.459663:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648431744 00000100:00100000:2.0:1789429623.459671:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648431744 00000100:00100000:2.0:1789429623.459731:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:02000000:2.0:1789429623.459736:0:6684:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:2.0:1789429623.459745:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648431744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429623.459783:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 46071808 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429623.459857:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648431744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429623.459865:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789429623.459914:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648431744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789429623.460021:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429623.460400:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789429623.460411:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648431872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429623.460442:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429623.460555:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648431872 00000100:00100000:2.0:1789429623.460560:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648431872 00000100:00100000:2.0:1789429623.460605:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:02000000:2.0:1789429623.460608:0:9195:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:2.0:1789429623.460614:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648431872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429623.460647:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44761088 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429623.460689:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3299:x1876351648431872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429623.460695:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00080000:0.0:1789429623.460749:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429623.460818:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648431872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429624.035413:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429625.062447:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:1.0:1789429625.307297:0:5825:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429625.307340:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f095a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+2:2370:x1876351635186944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429625.307360:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789429625.307365:0:5825:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie b4c3dad726362264) 00010000:00010000:1.0:1789429625.307367:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429625.307483:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f095a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:12e09781-3d24-4c67-9972-bb781900e20d+2:2370:x1876351635186944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 173us (4067374us total) trans 0 rc 116/116 00000100:00100000:1.0:1789429625.307492:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6273 00010000:00010000:1.0:1789429626.083506:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:1.0:1789429626.379468:0:25958:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429626.379513:0:25958:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635187072:12345-192.168.203.39@tcp:3:dd.0 00000100:00080000:0.0:1789429626.379791:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429626.379973:0:25958:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635187072:12345-192.168.203.39@tcp:3:dd.0 Request processed in 490us (4054924us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789429626.379984:0:25958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11898 00002000:00100000:1.0:1789429626.379995:0:25958:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_016: refresh rw locks for [0x240000400:0x3a:0x0] (0->4095) req@ffff946e0d980700 x1876351635187072/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:358/0 lens 488/4536 e 0 to 0 dl 1789429633 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789429626.380005:0:25958:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946e0d980700 with x1876351635187072 ext(0->4095) 00002000:00010000:1.0:1789429626.380012:0:25958:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946e0d980700 00000100:00100000:3.0:1789429626.389497:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429626.389693:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635188096 00000100:00100000:0.0:1789429626.389703:0:19372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635188096 00002000:00100000:0.0:1789429626.389754:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a:0x0] (4096->53247) req@ffff946f3221ed80 x1876351635188096/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:362/0 lens 488/0 e 0 to 0 dl 1789429637 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789429626.389765:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221ed80 with x1876351635188096 ext(4096->53247) 00002000:00010000:0.0:1789429626.389770:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3221ed80 00000100:00100000:0.0:1789429626.389804:0:19372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11899 00000100:02000000:0.0:1789429626.389809:0:19372:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429626.389813:0:19372:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000001:00020000:0.0:1789429626.604583:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429626.604650:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635187328:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429626.604747:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635187328:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 133us (4054672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429626.604755:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1007 00000100:00080000:2.0:1789429626.605039:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789429626.605776:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429626.605818:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635187712:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429626.605883:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635187712:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 98us (4055610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429626.605890:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1008 00000100:00080000:2.0:1789429626.605954:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:1.0:1789429626.612493:0:20745:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429626.612538:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635187840:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429626.612646:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2368:x1876351635187840:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 139us (4062479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429626.612655:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1041 00000100:00080000:2.0:1789429626.612818:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:2.0:1789429626.613451:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429626.613478:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0d980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351635187584:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429626.613529:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0d980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351635187584:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (4063397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429626.613536:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1040 00000100:00080000:0.0:1789429626.613700:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:2.0:1789429627.019363:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429627.019467:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648431488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429627.019755:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648431488:12345-0@lo:400:kworker.0 Request processed in 378us (4064496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429627.019765:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1789429627.020255:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648431488:0@lo:400:kworker.0 00000100:00080000:0.0:1789429627.024836:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789429627.027341:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429627.027371:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648431104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429627.027617:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648431104:12345-0@lo:400:kworker.0 Request processed in 263us (4064763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429627.027627:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1789429627.027817:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648431104:0@lo:400:kworker.0 00000001:00020000:2.0:1789429627.028628:0:6680:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429627.028669:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648431360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429627.028738:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648431360:12345-0@lo:400:kworker.0 Request processed in 100us (4068922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429627.028745:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1789429627.028830:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648431360:0@lo:400:kworker.0 00000100:00080000:0.0:1789429627.029082:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:1.0:1789429627.035876:0:5841:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429627.035936:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648431232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429627.036049:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648431232:12345-0@lo:400:kworker.0 Request processed in 150us (4076017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429627.036058:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:3.0:1789429627.036245:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648431232:0@lo:400:kworker.0 00000100:00080000:0.0:1789429627.037018:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789429627.037523:0:27100:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429627.037554:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648431616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429627.037630:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648431616:12345-0@lo:400:kworker.0 Request processed in 98us (4074677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429627.037637:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:0.0:1789429627.037771:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789429627.038084:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648431616:0@lo:400:kworker.0 00010000:00010000:0.0:1789429627.112116:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789429627.144387:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000001:00100000:3.0:1789429627.144414:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:3.0:1789429627.144738:0:6707:0:(genops.c:885:class_export_put()) final put ffff946e03782800/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:0.0:1789429627.144803:0:17042:0:(genops.c:844:class_export_destroy()) destroying export ffff946e03782800/12e09781-3d24-4c67-9972-bb781900e20d for lustre-OST0000 00000020:00000080:0.0:1789429627.144850:0:17042:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946e03781000 for lustre-OST0000 00000100:00100000:3.0:1789429627.669437:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429627.669476:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429627.669515:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429627.669522:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635188608 00000100:00100000:2.0:1789429627.669534:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635188608 00000100:00100000:3.0:1789429627.669546:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429627.669577:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429627.669589:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635188992 00000100:00100000:2.0:1789429627.669604:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635188992 00000100:00100000:3.0:1789429627.669618:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429627.669628:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635188480 00000100:00100000:2.0:1789429627.669633:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635188480 00000100:00100000:3.0:1789429627.669652:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429627.669668:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635188864 00000100:00100000:2.0:1789429627.669672:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635188864 00000100:00100000:3.0:1789429627.669685:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1044 00000100:02000000:3.0:1789429627.669752:0:6682:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429627.669756:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429627.669787:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635188224 00000100:00100000:0.0:1789429627.669801:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635188224 00000100:00100000:0.0:1789429627.669835:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 655 00000100:02000000:0.0:1789429627.669838:0:5834:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:0.0:1789429627.669847:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635188224:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429627.669922:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635188224:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 77us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429627.669930:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 655 00000100:00080000:0.0:1789429627.669961:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429627.677563:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1045 00000100:02000000:2.0:1789429627.677572:0:13238:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:2.0:1789429627.677575:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:2.0:1789429627.677612:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5939 00000100:02000000:2.0:1789429627.677615:0:27100:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:2.0:1789429627.677635:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:12e09781-3d24-4c67-9972-bb781900e20d+5:2367:x1876351635188608:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:2.0:1789429627.677670:0:27100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad726362225 00000100:00080000:2.0:1789429627.677680:0:27100:0:(import.c:65:import_set_state_nolock()) ffff946f3f20f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789429627.677732:0:27100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969608 00000100:00100000:2.0:1789429627.678405:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:12e09781-3d24-4c67-9972-bb781900e20d+2:2367:x1876351635188608:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 780us (8975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429627.678415:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5939 00000100:00100000:2.0:1789429627.678548:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5940 00000100:02000000:2.0:1789429627.678552:0:27100:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:2.0:1789429627.678559:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2367:x1876351635188992:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:2.0:1789429627.678575:0:27100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad72636221e 00000100:00080000:2.0:1789429627.678582:0:27100:0:(import.c:65:import_set_state_nolock()) ffff946f416d9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789429627.678625:0:27100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969608 00000100:00100000:2.0:1789429627.678708:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+2:2367:x1876351635188992:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 149us (9230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429627.678715:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5940 00000100:00100000:2.0:1789429627.679260:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635188352 00000100:00100000:2.0:1789429627.679269:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635188352 00000100:00100000:2.0:1789429627.679305:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635188736 00000100:00100000:2.0:1789429627.679309:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635188736 00000100:00100000:2.0:1789429627.679331:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1012 00000100:02000000:2.0:1789429627.679334:0:5840:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:2.0:1789429627.679336:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:2.0:1789429627.679350:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1013 00000100:02000000:2.0:1789429627.679352:0:15700:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:2.0:1789429627.679354:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00010000:00010000:2.0:1789429627.679399:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429627.679411:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429628.069852:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648432000:0@lo:400:kworker.0 00000100:00100000:3.0:1789429628.069886:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648432256:0@lo:400:kworker.0 00000100:00100000:0.0:1789429628.069954:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648432128:0@lo:400:kworker.0 00000100:00100000:2.0:1789429628.069999:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648432384:0@lo:400:kworker.0 00000100:00100000:3.0:1789429628.076453:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429628.076811:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648432256 00000100:00100000:3.0:1789429628.076820:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648432256 00000100:00100000:3.0:1789429628.076868:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:02000000:3.0:1789429628.076873:0:26938:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429628.076876:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429628.079057:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429628.079130:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648432512:0@lo:400:kworker.0 00000100:00100000:0.0:1789429628.079166:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429628.079197:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648432640:0@lo:400:kworker.0 00000100:00100000:1.0:1789429628.079223:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648432128 00000100:00100000:1.0:1789429628.079231:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648432128 00000100:00100000:0.0:1789429628.079245:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429628.079282:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:02000000:1.0:1789429628.079287:0:26936:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429628.079291:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429628.079294:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429628.079314:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648432512 00000100:00100000:1.0:1789429628.079319:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648432512 00000100:00100000:1.0:1789429628.079348:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:02000000:1.0:1789429628.079351:0:15669:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429628.079353:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429628.079378:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648432640 00000100:00100000:1.0:1789429628.079381:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648432640 00000100:00100000:1.0:1789429628.079402:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:02000000:1.0:1789429628.079404:0:27100:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429628.079406:0:27100:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:2.0:1789429628.079676:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429628.079846:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648432000 00000100:00100000:3.0:1789429628.079851:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648432000 00000100:00100000:0.0:1789429628.079871:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648432384 00000100:00100000:0.0:1789429628.079877:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648432384 00000100:00100000:3.0:1789429628.079903:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:02000000:3.0:1789429628.079909:0:5831:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:3.0:1789429628.079919:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648432000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429628.079950:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:02000000:0.0:1789429628.079954:0:8085:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429628.079957:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:3.0:1789429628.079976:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648432000:12345-0@lo:400:kworker.0 Request processed in 60us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429628.079986:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1789429628.080004:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648432000:0@lo:400:kworker.0 00010000:00010000:2.0:1789429628.131485:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429628.582742:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789429628.582769:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c1a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648432768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429628.582844:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429628.583166:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648432768 00000100:00100000:0.0:1789429628.583176:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648432768 00000100:00100000:0.0:1789429628.583255:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:02000000:0.0:1789429628.583260:0:6683:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:0.0:1789429628.583268:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648432768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429628.583301:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 46071808 pending 0 free 3855613952 avail 3853516800 00000100:00100000:0.0:1789429628.583352:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648432768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429628.583359:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1789429628.583412:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c1a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648432768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429628.583812:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648432896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429628.584032:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429628.584350:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648432896 00000100:00100000:1.0:1789429628.584355:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648432896 00000100:00100000:1.0:1789429628.584393:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:02000000:1.0:1789429628.584397:0:6684:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:1.0:1789429628.584403:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648432896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429628.584428:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429628.584474:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648432896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429628.584481:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1789429628.584515:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648432896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789429629.155436:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429630.179499:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:3.0:1789429630.467386:0:19372:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429630.467442:0:19372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635188096:12345-192.168.203.39@tcp:3:dd.0 00000100:00080000:0.0:1789429630.468293:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429630.495365:0:19372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+7:2368:x1876351635188096:12345-192.168.203.39@tcp:3:dd.0 Request processed in 27953us (4105867us total) trans 0 rc 49152/49152 00000100:00100000:3.0:1789429630.495379:0:19372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11899 00002000:00100000:3.0:1789429630.495393:0:19372:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3a:0x0] (4096->53247) req@ffff946f3221ed80 x1876351635188096/t0(0) o3->217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp:362/0 lens 488/440 e 0 to 0 dl 1789429637 ref 1 fl Complete:/600/0 rc 49152/49152 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789429630.495403:0:19372:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff946f3221ed80 with x1876351635188096 ext(4096->53247) 00002000:00010000:3.0:1789429630.495409:0:19372:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946f3221ed80 00000100:00100000:0.0:1789429630.508344:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429630.508669:0:21208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635189248 00000100:00100000:2.0:1789429630.508679:0:21208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635189248 00000100:00100000:2.0:1789429630.508747:0:21208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 297 00000100:02000000:2.0:1789429630.508753:0:21208:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00080000:0.0:1789429630.509688:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429630.518649:0:21208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+23:47011:x1876351635189248:12345-192.168.203.39@tcp:35:dd.0 00000100:00100000:2.0:1789429630.519037:0:21208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+24:47011:x1876351635189248:12345-192.168.203.39@tcp:35:dd.0 Request processed in 414us (10700us total) trans 4294977269 rc 0/0 00000100:00100000:2.0:1789429630.519046:0:21208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 297 00000001:00100000:0.0:1789429630.663939:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000020:00000080:0.0:1789429630.663948:0:7635:0:(genops.c:885:class_export_put()) final put ffff946f04e08800/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 00000001:00100000:0.0:1789429630.663976:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:0.0:1789429630.663979:0:7635:0:(genops.c:885:class_export_put()) final put ffff946f3f3d0800/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:3.0:1789429630.664030:0:22526:0:(genops.c:844:class_export_destroy()) destroying export ffff946f04e08800/217af837-ec0e-4ad4-94fa-9fc2e0e9f711 for lustre-OST0001 00000020:00000080:3.0:1789429630.664082:0:22526:0:(genops.c:844:class_export_destroy()) destroying export ffff946f3f3d0800/12e09781-3d24-4c67-9972-bb781900e20d for lustre-OST0001 00000020:00000080:3.0:1789429630.664101:0:22526:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946f416d9000 for lustre-OST0001 00000020:00000080:3.0:1789429630.664105:0:22526:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946f3f20f000 for lustre-OST0001 00010000:00010000:1.0:1789429631.203383:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789429631.705238:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977269 is committed 00000001:00020000:2.0:1789429631.723323:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429631.723360:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635188736:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429631.723465:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635188736:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 127us (4053812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429631.723475:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1013 00000001:00020000:3.0:1789429631.724254:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429631.724272:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635188864:12345-192.168.203.39@tcp:400:kworker.0 00000001:00020000:1.0:1789429631.724378:0:6682:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429631.724411:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351635188480:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:2.0:1789429631.724478:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429631.724750:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635188864:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 485us (4055170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429631.724759:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1045 00000100:00100000:1.0:1789429631.727041:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2368:x1876351635188480:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 2645us (4057484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429631.727054:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1044 00000001:00020000:2.0:1789429631.739283:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429631.739338:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635188352:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429631.739439:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635188352:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 143us (4069822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429631.739521:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1012 00000100:00080000:0.0:1789429631.741625:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789429632.131311:0:26938:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429632.131360:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648432256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429632.131793:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648432256:12345-0@lo:400:kworker.0 Request processed in 467us (4055343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429632.131801:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1789429632.131935:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648432256:0@lo:400:kworker.0 00000100:00080000:2.0:1789429632.134980:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789429632.145556:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429632.145625:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648432384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429632.145751:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29de8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648432384:12345-0@lo:400:kworker.0 Request processed in 170us (4066075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429632.145760:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1789429632.146275:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648432384:0@lo:400:kworker.0 00000100:00080000:2.0:1789429632.146534:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:0.0:1789429632.147632:0:15669:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429632.147683:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648432512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429632.147772:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648432512:12345-0@lo:400:kworker.0 Request processed in 129us (4068479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429632.147783:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1789429632.147921:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648432512:0@lo:400:kworker.0 00000100:00080000:2.0:1789429632.148004:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789429632.149727:0:27100:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429632.149771:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648432640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429632.149864:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648432640:12345-0@lo:400:kworker.0 Request processed in 126us (4070618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429632.149872:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00080000:2.0:1789429632.149961:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429632.150539:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648432640:0@lo:400:kworker.0 00000001:00020000:1.0:1789429632.166750:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429632.166784:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648432128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429632.166894:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c1a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648432128:12345-0@lo:400:kworker.0 Request processed in 130us (4087787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429632.166902:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1789429632.167063:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648432128:0@lo:400:kworker.0 00010000:00010000:2.0:1789429632.229299:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429632.797308:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429632.797338:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429632.797373:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429632.797408:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429632.797435:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429632.797463:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635189504 00000100:00100000:3.0:1789429632.797474:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635189504 00000100:00100000:3.0:1789429632.797519:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635189760 00000100:00100000:3.0:1789429632.797522:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635189760 00000100:00100000:3.0:1789429632.797580:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1017 00000100:02000000:3.0:1789429632.797585:0:5839:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:3.0:1789429632.797588:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429632.797644:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635189632 00000100:00100000:1.0:1789429632.797649:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635189632 00000100:00100000:1.0:1789429632.797681:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635189888 00000100:00100000:1.0:1789429632.797684:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635189888 00000100:00100000:1.0:1789429632.797705:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1048 00000100:02000000:1.0:1789429632.797708:0:20745:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429632.797709:0:20745:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429632.797724:0:26937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1018 00000100:02000000:1.0:1789429632.797726:0:26937:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429632.797728:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429632.797739:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1049 00000100:02000000:1.0:1789429632.797742:0:20986:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429632.797743:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00080000:1.0:1789429632.797768:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429632.797773:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429632.797963:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635189376 00000100:00100000:0.0:1789429632.797969:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635189376 00000100:00100000:0.0:1789429632.797999:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 657 00000100:02000000:0.0:1789429632.798002:0:5833:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:0.0:1789429632.798010:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635189376:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429632.798079:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635189376:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429632.798087:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 657 00000100:00100000:3.0:1789429633.188835:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648433152:0@lo:400:kworker.0 00000100:00100000:3.0:1789429633.188905:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429633.189032:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648433024:0@lo:400:kworker.0 00000100:00100000:1.0:1789429633.189068:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429633.189107:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648433024 00000100:00100000:1.0:1789429633.189115:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648433024 00000100:00100000:1.0:1789429633.189155:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:02000000:1.0:1789429633.189160:0:5834:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:1.0:1789429633.189167:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648433024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429633.189228:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648433024:12345-0@lo:400:kworker.0 Request processed in 61us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429633.189235:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1789429633.189278:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648433024:0@lo:400:kworker.0 00000100:00100000:1.0:1789429633.189312:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648433280:0@lo:400:kworker.0 00000100:00100000:1.0:1789429633.189336:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429633.189371:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648433152 00000100:00100000:2.0:1789429633.189377:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648433152 00000100:00100000:1.0:1789429633.189399:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648433280 00000100:00100000:1.0:1789429633.189402:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648433280 00000100:00100000:2.0:1789429633.189405:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:02000000:2.0:1789429633.189408:0:5840:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:2.0:1789429633.189411:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429633.189423:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:02000000:1.0:1789429633.189426:0:15700:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:1.0:1789429633.189428:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429633.196188:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789429633.196218:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648433664:0@lo:400:kworker.0 00000100:00100000:0.0:1789429633.196283:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429633.196328:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648433664 00000100:00100000:0.0:1789429633.196335:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648433664 00000100:00100000:0.0:1789429633.196499:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:02000000:0.0:1789429633.196505:0:13238:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429633.196508:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:1.0:1789429633.196583:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648433536:0@lo:400:kworker.0 00000100:00100000:1.0:1789429633.196615:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429633.196651:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789429633.196658:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648433408:0@lo:400:kworker.0 00000100:00100000:1.0:1789429633.196680:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429633.198538:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648433408 00000100:00100000:0.0:1789429633.198558:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648433408 00000100:00100000:0.0:1789429633.198622:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:02000000:0.0:1789429633.198627:0:8085:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429633.198630:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00000100:00100000:0.0:1789429633.198646:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648433536 00000100:00100000:0.0:1789429633.198650:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648433536 00000100:00100000:0.0:1789429633.198681:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:02000000:0.0:1789429633.198684:0:26936:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000001:00020000:0.0:1789429633.198686:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 sleeping for 4000ms 00010000:00010000:1.0:1789429633.251991:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429633.699423:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429633.699447:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648433792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429633.699517:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429633.699632:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648433792 00000100:00100000:1.0:1789429633.699641:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648433792 00000100:00100000:1.0:1789429633.699737:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:02000000:1.0:1789429633.699742:0:9195:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:1.0:1789429633.699751:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648433792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429633.699785:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 46071808 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1789429633.699845:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1876351648433792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429633.699852:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1789429633.699920:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648433920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429633.699931:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648433792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429633.699957:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429633.704683:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648433920 00000100:00100000:0.0:1789429633.704699:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648433920 00000100:00100000:1.0:1789429633.704838:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:02000000:1.0:1789429633.704845:0:9195:0:(service.c:2497:ptlrpc_server_handle_request()) *** cfs_fail_loc=511, val=0*** 00000100:00100000:1.0:1789429633.704855:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648433920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429633.704891:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429633.704966:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1876351648433920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (5009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429633.704973:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1789429633.705057:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29deaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648433920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789429634.275496:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429635.303056:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429636.323414:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:1.0:1789429636.803340:0:5839:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:1.0:1789429636.832437:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635189504:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:0.0:1789429636.832536:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429636.832537:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635189504:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 137us (4035127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429636.832546:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1017 00000001:00020000:2.0:1789429636.859373:0:26937:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429636.859425:0:26937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635189760:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429636.859514:0:26937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635189760:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 127us (4062077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429636.859532:0:26937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1018 00000100:00080000:0.0:1789429636.860961:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789429636.868364:0:20986:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429636.868422:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635189888:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429636.868538:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635189888:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 160us (4071163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429636.868547:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1049 00000100:00080000:0.0:1789429636.871316:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:0.0:1789429636.899295:0:20745:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429636.899349:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635189632:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429636.899454:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:12e09781-3d24-4c67-9972-bb781900e20d+5:2370:x1876351635189632:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 145us (4102115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429636.899464:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1048 00000100:00080000:1.0:1789429636.899592:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:3.0:1789429637.261012:0:5840:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429637.261036:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648433152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429637.261147:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648433152:12345-0@lo:400:kworker.0 Request processed in 123us (4072242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429637.261156:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1789429637.262741:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648433152:0@lo:400:kworker.0 00000001:00020000:3.0:1789429637.267516:0:26936:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:3.0:1789429637.267563:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648433536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429637.267663:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648433536:12345-0@lo:400:kworker.0 Request processed in 126us (4071047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429637.267772:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648433536:0@lo:400:kworker.0 00000100:00100000:3.0:1789429637.267826:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00080000:1.0:1789429637.267879:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789429637.275656:0:15700:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429637.275709:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648433280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429637.275803:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648433280:12345-0@lo:400:kworker.0 Request processed in 134us (4086465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429637.275813:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000001:00020000:2.0:1789429637.275859:0:8085:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:0.0:1789429637.275878:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648433280:0@lo:400:kworker.0 00000100:00100000:2.0:1789429637.275878:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648433408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429637.275947:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648433408:0@lo:400:kworker.0 00000100:00080000:3.0:1789429637.278185:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429637.278195:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429637.279443:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648433408:12345-0@lo:400:kworker.0 Request processed in 62us (4079247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429637.279467:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000001:00020000:2.0:1789429637.293418:0:13238:0:(service.c:2502:ptlrpc_server_handle_request()) cfs_fail_timeout id 511 awake 00000100:00100000:2.0:1789429637.293460:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648433664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429637.293568:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648433664:12345-0@lo:400:kworker.0 Request processed in 135us (4097284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429637.293577:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1789429637.293636:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648433664:0@lo:400:kworker.0 00000100:00080000:3.0:1789429637.294545:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789429637.350168:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429637.913437:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429637.913539:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429637.913575:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429637.913603:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429637.913630:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429637.913654:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635190144 00000100:00100000:2.0:1789429637.913664:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635190144 00000100:00100000:2.0:1789429637.913708:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635190400 00000100:00100000:2.0:1789429637.913711:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635190400 00000100:00100000:2.0:1789429637.913732:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1022 00000100:00100000:2.0:1789429637.913741:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635190144:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429637.913810:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f17aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635190144:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429637.913817:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1022 00000100:00100000:2.0:1789429637.913834:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1023 00000100:00100000:2.0:1789429637.913841:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635190400:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429637.913866:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635190400:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429637.913871:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1023 00000100:00100000:0.0:1789429637.914030:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635190272 00000100:00100000:0.0:1789429637.914035:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635190272 00000100:00100000:0.0:1789429637.914072:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635190528 00000100:00100000:0.0:1789429637.914075:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635190528 00000100:00100000:0.0:1789429637.914093:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1052 00000100:00100000:0.0:1789429637.914098:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635190272:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429637.914131:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:12e09781-3d24-4c67-9972-bb781900e20d+5:2369:x1876351635190272:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 33us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429637.914137:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1052 00000100:00100000:0.0:1789429637.914150:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1053 00000100:00100000:0.0:1789429637.914156:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635190528:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429637.914176:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635190528:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429637.914181:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1053 00000100:00100000:1.0:1789429637.916339:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635190016 00000100:00100000:1.0:1789429637.916351:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635190016 00000100:00100000:1.0:1789429637.916407:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 659 00000100:00100000:1.0:1789429637.916416:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635190016:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429637.916633:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635190016:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 216us (3204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429637.916641:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 659 00000100:00100000:3.0:1789429638.312472:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648434176:0@lo:400:kworker.0 00000100:00100000:3.0:1789429638.312556:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429638.312602:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648434688:0@lo:400:kworker.0 00000100:00100000:3.0:1789429638.312624:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429638.312645:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429638.312651:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648434304:0@lo:400:kworker.0 00000100:00100000:3.0:1789429638.312671:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429638.312704:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648434176 00000100:00100000:3.0:1789429638.312711:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648434176 00000100:00100000:3.0:1789429638.312747:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648434304 00000100:00100000:3.0:1789429638.312750:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648434304 00000100:00100000:3.0:1789429638.312770:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1789429638.312779:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648434176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429638.312828:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648434176:12345-0@lo:400:kworker.0 Request processed in 50us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429638.312836:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1789429638.312865:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1789429638.312871:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648434304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429638.312899:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648434304:12345-0@lo:400:kworker.0 Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429638.312904:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1789429638.312922:0:20986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648434688 00000100:00100000:3.0:1789429638.312926:0:20986:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648434688 00000100:00100000:3.0:1789429638.312949:0:20986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1789429638.315335:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648434048:0@lo:400:kworker.0 00000100:00100000:0.0:1789429638.315408:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429638.315455:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648434560:0@lo:400:kworker.0 00000100:00100000:0.0:1789429638.315480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429638.315509:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429638.315528:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648434432:0@lo:400:kworker.0 00000100:00100000:0.0:1789429638.315554:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429638.315591:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648434432 00000100:00100000:0.0:1789429638.315600:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648434432 00000100:00100000:0.0:1789429638.315646:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1789429638.315653:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648434432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429638.315668:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648434048 00000100:00100000:1.0:1789429638.315675:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648434048 00000100:00100000:0.0:1789429638.315703:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648434432:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429638.315711:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:1.0:1789429638.315715:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1789429638.315726:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648434048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429638.315735:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648434560 00000100:00100000:0.0:1789429638.315740:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648434560 00000100:00100000:0.0:1789429638.315769:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1789429638.315771:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648434048:12345-0@lo:400:kworker.0 Request processed in 46us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429638.315779:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648434560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429638.315784:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1789429638.315925:0:20986:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648434688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429638.317783:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648434560:12345-0@lo:400:kworker.0 Request processed in 2000us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429638.317795:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1789429638.318337:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648434304:0@lo:400:kworker.0 00000100:00100000:2.0:1789429638.318355:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648434176:0@lo:400:kworker.0 00000100:00100000:3.0:1789429638.319023:0:20986:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648434688:12345-0@lo:400:kworker.0 Request processed in 6064us (6393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429638.319034:0:20986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1789429638.319059:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648434432:0@lo:400:kworker.0 00000100:00100000:2.0:1789429638.319072:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648434688:0@lo:400:kworker.0 00000100:00100000:1.0:1789429638.319078:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648434048:0@lo:400:kworker.0 00000100:00100000:1.0:1789429638.319094:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648434560:0@lo:400:kworker.0 00010000:00010000:2.0:1789429638.371694:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429638.820521:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429638.820543:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648434816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429638.820618:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429638.820685:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648434816 00000100:00100000:2.0:1789429638.820691:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648434816 00000100:00100000:2.0:1789429638.820736:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1789429638.820745:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648434816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429638.820776:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 46071808 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429638.820814:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648434816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429638.820820:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1789429638.820863:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648434816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429638.824439:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789429638.824460:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648434944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429638.824533:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429638.824588:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648434944 00000100:00100000:3.0:1789429638.824596:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648434944 00000100:00100000:3.0:1789429638.824652:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1789429638.824660:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648434944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429638.824691:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429638.824731:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648434944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429638.824737:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1789429638.824778:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648434944:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789429639.396382:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429640.421235:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429641.446333:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429642.467675:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429643.033348:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429643.033408:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429643.033560:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635191040 00000100:00100000:3.0:1789429643.033572:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635191040 00000100:00080000:0.0:1789429643.033651:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429643.033667:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1027 00000100:00100000:3.0:1789429643.033679:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635191040:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429643.033771:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635190656 00000100:00100000:1.0:1789429643.033777:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635190656 00000100:00100000:1.0:1789429643.033822:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 661 00000100:00100000:1.0:1789429643.033830:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635190656:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429643.036831:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635191040:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 3139us (3406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429643.036848:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1027 00000100:00100000:1.0:1789429643.043628:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635190656:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 9777us (10273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429643.043649:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 661 00000100:00100000:2.0:1789429643.045399:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429643.045655:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429643.045735:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635191168 00000100:00100000:0.0:1789429643.045749:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635191168 00000100:00100000:0.0:1789429643.045831:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1056 00000100:00100000:0.0:1789429643.045842:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635191168:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429643.045929:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635191168:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 88us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429643.045936:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1056 00000100:00100000:1.0:1789429643.045987:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635190784 00000100:00100000:1.0:1789429643.045993:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635190784 00000100:00100000:1.0:1789429643.046030:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1028 00000100:00100000:1.0:1789429643.046037:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635190784:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429643.046068:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635190784:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429643.046074:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1028 00000100:00100000:2.0:1789429643.046186:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1789429643.046220:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429643.046227:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429643.046233:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635190912 00000100:00100000:2.0:1789429643.046237:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635190912 00000100:00080000:3.0:1789429643.046262:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429643.046438:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5941 00000100:00100000:2.0:1789429643.046449:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+5:2367:x1876351635190912:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:2.0:1789429643.046476:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xb4c3dad7263622aa 00000100:00080000:2.0:1789429643.046496:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946f416f0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789429643.046544:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969583 00000100:00100000:2.0:1789429643.046833:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c08f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:12e09781-3d24-4c67-9972-bb781900e20d+2:2367:x1876351635190912:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 385us (645us total) trans 0 rc 0/0 00010000:00010000:3.0:1789429643.048925:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429643.049188:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5941 00000001:02000400:3.0:1789429643.173488:0:27511:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9943c54b6000.ost_server_uuid 50 00000100:00100000:0.0:1789429643.427559:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648435328:0@lo:400:kworker.0 00000100:00100000:0.0:1789429643.427640:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429643.427735:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789429643.427748:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648435200:0@lo:400:kworker.0 00000100:00100000:2.0:1789429643.427748:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648435456:0@lo:400:kworker.0 00000100:00100000:3.0:1789429643.427867:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648435072:0@lo:400:kworker.0 00000100:00100000:1.0:1789429643.427964:0:26937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648435328 00000100:00100000:1.0:1789429643.427972:0:26937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648435328 00000100:00100000:1.0:1789429643.428026:0:26937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1789429643.428035:0:26937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648435328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429643.429845:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429643.430165:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429643.430241:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648435200 00000100:00100000:2.0:1789429643.430249:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648435200 00000100:00100000:2.0:1789429643.430290:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1789429643.430299:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648435200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429643.430837:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648435200:12345-0@lo:400:kworker.0 Request processed in 537us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429643.430845:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00080000:2.0:1789429643.430901:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429643.431829:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648435200:0@lo:400:kworker.0 00000100:00100000:0.0:1789429643.431843:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648435712:0@lo:400:kworker.0 00000100:00100000:0.0:1789429643.431893:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429643.431945:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648435456 00000100:00100000:0.0:1789429643.431962:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648435456 00000100:00100000:0.0:1789429643.432012:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648435712 00000100:00100000:0.0:1789429643.432016:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648435712 00000100:00100000:0.0:1789429643.432047:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1789429643.432055:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648435456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429643.432104:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648435456:12345-0@lo:400:kworker.0 Request processed in 50us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429643.432110:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1789429643.432124:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1789429643.432130:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648435712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429643.432162:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648435712:12345-0@lo:400:kworker.0 Request processed in 32us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429643.432168:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00080000:0.0:1789429643.432184:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429643.432188:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429643.432225:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648435712:0@lo:400:kworker.0 00000100:00100000:0.0:1789429643.432250:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648435456:0@lo:400:kworker.0 00000100:00100000:3.0:1789429643.433093:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429643.433141:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648435584:0@lo:400:kworker.0 00000100:00100000:3.0:1789429643.433171:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429643.433578:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648435584 00000100:00100000:0.0:1789429643.433584:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648435584 00000100:00100000:0.0:1789429643.433639:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1789429643.433646:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648435584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429643.433697:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648435584:12345-0@lo:400:kworker.0 Request processed in 52us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429643.433702:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1789429643.434434:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648435072 00000100:00100000:2.0:1789429643.434443:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648435072 00000100:00100000:2.0:1789429643.434494:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1789429643.434503:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648435072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429643.434556:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648435072:12345-0@lo:400:kworker.0 Request processed in 54us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429643.434563:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00080000:3.0:1789429643.435061:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429643.435093:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648435072:0@lo:400:kworker.0 00000100:00100000:3.0:1789429643.435108:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648435584:0@lo:400:kworker.0 00000100:00100000:1.0:1789429643.436602:0:26937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648435328:12345-0@lo:400:kworker.0 Request processed in 8563us (8957us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429643.436614:0:26937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1789429643.436689:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f054dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648435328:0@lo:400:kworker.0 00010000:00010000:1.0:1789429643.491585:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429643.940036:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648435840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429643.940114:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429643.940258:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648435840 00000100:00100000:1.0:1789429643.940267:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648435840 00000100:00100000:1.0:1789429643.940317:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1789429643.940326:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648435840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429643.940376:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429643.940436:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648435840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429643.940443:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:3.0:1789429643.940529:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648435840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429643.948146:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648435968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429643.948251:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429643.948676:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648435968 00000100:00100000:3.0:1789429643.948685:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648435968 00000100:00100000:3.0:1789429643.948742:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1789429643.948752:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648435968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429643.948788:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00000100:00100000:3.0:1789429643.948845:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648435968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429643.948852:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:0.0:1789429643.948934:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648435968:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789429644.442318:0:27559:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-ffff9943c54b6000.ost_server_uuid in FULL state after 0 sec 00010000:00010000:3.0:1789429644.516431:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429645.540054:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429646.563293:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429647.587438:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789429647.604808:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:3.0:1789429647.604817:0:6707:0:(genops.c:885:class_export_put()) final put ffff946f416f3800/12e09781-3d24-4c67-9972-bb781900e20d 00000020:00000080:0.0:1789429647.605348:0:17042:0:(genops.c:844:class_export_destroy()) destroying export ffff946f416f3800/12e09781-3d24-4c67-9972-bb781900e20d for lustre-OST0000 00000020:00000080:0.0:1789429647.605401:0:17042:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff946f416f0000 for lustre-OST0000 00000100:00100000:3.0:1789429648.150681:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429648.150725:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429648.150760:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429648.150787:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429648.150895:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635191296 00000100:00100000:1.0:1789429648.150906:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635191296 00000100:00100000:2.0:1789429648.150909:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635191552 00000100:00100000:2.0:1789429648.150916:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635191552 00000100:00100000:1.0:1789429648.150966:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 663 00000100:00100000:1.0:1789429648.150976:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f112b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635191296:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429648.150982:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635191424 00000100:00100000:2.0:1789429648.150987:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635191424 00000100:00100000:2.0:1789429648.151014:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1032 00000100:00100000:2.0:1789429648.151023:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2371:x1876351635191552:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429648.151052:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f112b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635191296:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 76us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429648.151062:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 663 00000100:00100000:2.0:1789429648.151067:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2371:x1876351635191552:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 43us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429648.151076:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1032 00000100:00100000:2.0:1789429648.151096:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1033 00000100:00100000:2.0:1789429648.151103:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351635191424:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429648.151131:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351635191424:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429648.151137:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1033 00000100:00100000:0.0:1789429648.151229:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635191680 00000100:00100000:0.0:1789429648.151234:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635191680 00000100:00100000:0.0:1789429648.151282:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1059 00000100:00100000:0.0:1789429648.151291:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635191680:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429648.151334:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635191680:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 46us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429648.151341:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1059 00000100:00080000:3.0:1789429648.151464:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429648.151469:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429648.551862:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648436096:0@lo:400:kworker.0 00000100:00100000:2.0:1789429648.551944:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429648.552017:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648436096 00000100:00100000:1.0:1789429648.552025:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648436096 00000100:00100000:1.0:1789429648.552076:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1789429648.552087:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648436096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.552126:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648436480:0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.553699:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429648.553782:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648436352:0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.553813:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429648.553835:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429648.553842:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648436224:0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.553863:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429648.553902:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648436352 00000100:00100000:3.0:1789429648.553908:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648436352 00000100:00100000:3.0:1789429648.553954:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648436224 00000100:00100000:3.0:1789429648.553957:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648436224 00000100:00100000:3.0:1789429648.553976:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1789429648.553984:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648436352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.554030:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648436352:12345-0@lo:400:kworker.0 Request processed in 47us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429648.554038:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:3.0:1789429648.554052:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1789429648.554057:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648436224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.554083:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648436224:12345-0@lo:400:kworker.0 Request processed in 26us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429648.554089:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00080000:3.0:1789429648.554107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429648.554136:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648436224:0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.554146:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648436352:0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.554190:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648436480 00000100:00100000:3.0:1789429648.554194:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648436480 00000100:00100000:3.0:1789429648.554241:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1789429648.554246:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648436480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.554291:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648436480:12345-0@lo:400:kworker.0 Request processed in 44us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429648.554298:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00080000:3.0:1789429648.554318:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429648.554332:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648436480:0@lo:400:kworker.0 00000100:00100000:1.0:1789429648.566719:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648436096:12345-0@lo:400:kworker.0 Request processed in 14623us (14764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429648.566736:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1789429648.569399:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789429648.569399:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789429648.569424:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648436736:0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.569425:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648436608:0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.573056:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429648.574191:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429648.575243:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648436096:0@lo:400:kworker.0 00000100:00100000:1.0:1789429648.576715:0:26937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648436608 00000100:00100000:1.0:1789429648.576728:0:26937:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648436608 00000100:00100000:1.0:1789429648.576879:0:26937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1789429648.576889:0:26937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648436608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429648.576979:0:26937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648436608:12345-0@lo:400:kworker.0 Request processed in 91us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429648.576986:0:26937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1789429648.577035:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648436608:0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.580068:0:20745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648436736 00000100:00100000:3.0:1789429648.580083:0:20745:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648436736 00000100:00080000:2.0:1789429648.584326:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429648.584336:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429648.585374:0:20745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1789429648.585391:0:20745:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648436736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429648.585829:0:20745:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648436736:12345-0@lo:400:kworker.0 Request processed in 443us (11639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429648.585837:0:20745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1789429648.589460:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648436736:0@lo:400:kworker.0 00010000:00010000:0.0:1789429648.615180:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429649.059490:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429649.059516:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648436864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429649.059588:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429649.059799:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648436864 00000100:00100000:1.0:1789429649.059809:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648436864 00000100:00100000:1.0:1789429649.059865:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1789429649.059874:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648436864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429649.059910:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429649.059978:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648436864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429649.059985:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1789429649.060082:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648436864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429649.060404:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789429649.060415:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648436992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429649.060461:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429649.060567:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648436992 00000100:00100000:2.0:1789429649.060573:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648436992 00000100:00100000:2.0:1789429649.060618:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1789429649.060796:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648436992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429649.060819:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429649.060867:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648436992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429649.060923:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648436992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429649.064515:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00010000:00010000:1.0:1789429649.636289:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789429649.952721:0:27753:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9943c54b6000.ost_server_uuid 50 00010000:00010000:0.0:1789429650.660804:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789429651.435620:0:27801:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0001-osc-ffff9943c54b6000.ost_server_uuid in IDLE state after 0 sec 00010000:00010000:1.0:1789429651.683547:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429652.707754:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429653.269610:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429653.269650:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429653.269682:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635191936 00000100:00100000:3.0:1789429653.269686:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429653.269692:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635191936 00000100:00100000:3.0:1789429653.269740:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429653.269935:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635191808 00000100:00100000:0.0:1789429653.269940:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635191808 00000100:00100000:0.0:1789429653.270009:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 665 00000100:00100000:0.0:1789429653.270020:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635191808:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429653.270086:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635191808:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429653.270093:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 665 00000100:00100000:2.0:1789429653.270168:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635192192 00000100:00100000:2.0:1789429653.270173:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635192192 00000100:00100000:1.0:1789429653.270257:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635192064 00000100:00100000:1.0:1789429653.270261:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635192064 00000100:00100000:0.0:1789429653.270335:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1037 00000100:00100000:0.0:1789429653.270342:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635191936:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429653.270382:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635191936:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 37us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429653.270388:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1037 00000100:00100000:2.0:1789429653.272188:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1062 00000100:00100000:2.0:1789429653.272213:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635192192:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429653.272282:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635192192:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 85us (2630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429653.272299:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1062 00000100:00080000:2.0:1789429653.272323:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429653.272327:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429653.272929:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1038 00000100:00100000:1.0:1789429653.272938:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635192064:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429653.272972:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635192064:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 35us (3241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429653.272978:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1038 00000100:00100000:0.0:1789429653.668694:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648437504:0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.668820:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429653.668874:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789429653.668882:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648437120:0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.668913:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429653.668938:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648437632:0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.668962:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429653.668986:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648437248:0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.669006:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429653.669020:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648437760:0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.669039:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429653.669052:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429653.669057:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3221f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648437376:0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.669076:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429653.669107:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648437504 00000100:00100000:0.0:1789429653.669115:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648437504 00000100:00100000:0.0:1789429653.669166:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648437760 00000100:00100000:0.0:1789429653.669169:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648437760 00000100:00100000:0.0:1789429653.669190:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1789429653.669217:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648437504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.669266:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648437504:12345-0@lo:400:kworker.0 Request processed in 68us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429653.670389:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1789429653.670504:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1789429653.670520:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648437760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.670593:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648437760:12345-0@lo:400:kworker.0 Request processed in 79us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429653.670600:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1789429653.670626:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648437120 00000100:00100000:0.0:1789429653.670631:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648437120 00000100:00100000:0.0:1789429653.670662:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1789429653.670668:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648437120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.670697:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3298:x1876351648437120:12345-0@lo:400:kworker.0 Request processed in 31us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429653.670703:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1789429653.670780:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648437760:0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.670811:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3298:1876351648437120:0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.670823:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648437504:0@lo:400:kworker.0 00000100:00080000:2.0:1789429653.670974:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429653.670980:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429653.670983:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648437632 00000100:00100000:3.0:1789429653.670990:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648437632 00000100:00100000:2.0:1789429653.671008:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648437248 00000100:00100000:2.0:1789429653.671014:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648437248 00000100:00100000:2.0:1789429653.671049:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648437376 00000100:00100000:2.0:1789429653.671053:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648437376 00000100:00100000:3.0:1789429653.671075:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1789429653.671085:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648437248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429653.671090:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1789429653.671100:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648437632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.672353:0:26937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1789429653.672367:0:26937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648437376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429653.675738:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648437632:12345-0@lo:400:kworker.0 Request processed in 4631us (6765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429653.675753:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1789429653.675830:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648437632:0@lo:400:kworker.0 00000100:00100000:3.0:1789429653.675853:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648437248:12345-0@lo:400:kworker.0 Request processed in 4767us (6842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429653.675862:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1789429653.676068:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648437248:0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.680429:0:26937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648437376:12345-0@lo:400:kworker.0 Request processed in 8058us (11343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429653.680489:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3221f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648437376:0@lo:400:kworker.0 00000100:00100000:0.0:1789429653.681252:0:26937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00080000:0.0:1789429653.681298:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789429653.731729:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429654.180797:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648437888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429654.180867:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429654.181642:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648437888 00000100:00100000:1.0:1789429654.181652:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648437888 00000100:00100000:1.0:1789429654.181713:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1789429654.181723:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648437888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429654.181800:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429654.181865:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648437888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429654.181872:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1789429654.182033:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648437888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429654.183066:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429654.183082:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648438016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429654.183126:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429654.183253:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648438016 00000100:00100000:1.0:1789429654.183260:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648438016 00000100:00100000:1.0:1789429654.183293:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789429654.183302:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648438016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429654.183329:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1789429654.183374:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648438016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429654.183380:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1789429654.183411:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648438016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789429654.760017:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429655.780550:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429656.803523:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429657.827564:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429658.390727:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429658.390766:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429658.390788:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429658.390834:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429658.390860:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635192576 00000100:00100000:0.0:1789429658.390868:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635192576 00000100:00100000:0.0:1789429658.390939:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635192448 00000100:00100000:0.0:1789429658.390943:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635192448 00000100:00100000:2.0:1789429658.390962:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635192320 00000100:00100000:2.0:1789429658.390970:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635192320 00000100:00100000:0.0:1789429658.390977:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1042 00000100:00100000:0.0:1789429658.390988:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635192576:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429658.391020:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 667 00000100:00100000:2.0:1789429658.391030:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635192320:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429658.391053:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635192576:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 67us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429658.391061:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1042 00000100:00100000:2.0:1789429658.391066:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635192320:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 37us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429658.391075:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 667 00000100:00100000:0.0:1789429658.391079:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1043 00000100:00100000:0.0:1789429658.391088:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635192448:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429658.391110:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635192448:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429658.391116:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1043 00000100:00100000:0.0:1789429658.391135:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635192704 00000100:00100000:0.0:1789429658.391138:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635192704 00000100:00100000:0.0:1789429658.391159:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1065 00000100:00100000:0.0:1789429658.391165:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635192704:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429658.391184:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635192704:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 20us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429658.391215:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1065 00000100:00080000:2.0:1789429658.391321:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429658.391327:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789429658.781584:0:28044:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9943c54b6000.ost_server_uuid 50 00000100:00100000:3.0:1789429658.795790:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648438144:0@lo:400:kworker.0 00000100:00100000:3.0:1789429658.795968:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429658.796025:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648438656:0@lo:400:kworker.0 00000100:00100000:3.0:1789429658.796054:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429658.796081:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789429658.796086:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648438528:0@lo:400:kworker.0 00000100:00100000:3.0:1789429658.796108:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429658.796132:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648438272:0@lo:400:kworker.0 00000100:00100000:3.0:1789429658.796149:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429658.796163:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648438784:0@lo:400:kworker.0 00000100:00100000:3.0:1789429658.796179:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429658.796224:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429658.796229:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648438400:0@lo:400:kworker.0 00000100:00100000:3.0:1789429658.796246:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429658.796488:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648438144 00000100:00100000:0.0:1789429658.796498:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648438144 00000100:00100000:0.0:1789429658.796543:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:0.0:1789429658.796554:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648438144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429658.796605:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648438144:12345-0@lo:400:kworker.0 Request processed in 53us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429658.796612:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:3.0:1789429658.797154:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648438656 00000100:00100000:3.0:1789429658.797160:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648438656 00000100:00100000:3.0:1789429658.797285:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648438272 00000100:00100000:3.0:1789429658.797289:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648438272 00000100:00100000:3.0:1789429658.797314:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648438400 00000100:00100000:3.0:1789429658.797317:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648438400 00000100:00100000:3.0:1789429658.797340:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1789429658.797347:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648438656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429658.798266:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648438528 00000100:00100000:1.0:1789429658.798275:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648438528 00000100:00100000:1.0:1789429658.798316:0:8085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648438784 00000100:00100000:1.0:1789429658.798319:0:8085:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648438784 00000100:00100000:2.0:1789429658.798324:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1789429658.798341:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648438272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429658.798348:0:8085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1789429658.798358:0:8085:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648438528:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789429658.802315:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429658.802324:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429658.802327:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429658.802352:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1789429658.802379:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648438400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429658.802454:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648438400:12345-0@lo:400:kworker.0 Request processed in 93us (6206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429658.802461:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1789429658.802581:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648438656:12345-0@lo:400:kworker.0 Request processed in 5233us (6526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429658.802587:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1789429658.802635:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648438272:12345-0@lo:400:kworker.0 Request processed in 4296us (6482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429658.802642:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1789429658.802669:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1789429658.802677:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648438784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429658.802714:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648438784:12345-0@lo:400:kworker.0 Request processed in 40us (6534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429658.802719:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1789429658.802760:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648438400:0@lo:400:kworker.0 00000100:00100000:2.0:1789429658.802772:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648438272:0@lo:400:kworker.0 00000100:00100000:2.0:1789429658.802781:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648438784:0@lo:400:kworker.0 00000100:00100000:2.0:1789429658.804594:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648438528:0@lo:400:kworker.0 00000100:00100000:2.0:1789429658.804612:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648438144:0@lo:400:kworker.0 00000100:00100000:2.0:1789429658.804623:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648438656:0@lo:400:kworker.0 00000100:00100000:1.0:1789429658.806952:0:8085:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648438528:12345-0@lo:400:kworker.0 Request processed in 8586us (10832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429658.806967:0:8085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00010000:00010000:2.0:1789429658.855598:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429659.299557:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429659.299578:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648438912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429659.299644:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429659.300393:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429659.300405:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648439040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429659.300439:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429659.300617:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648438912 00000100:00100000:1.0:1789429659.300626:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648438912 00000100:00100000:1.0:1789429659.300672:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648439040 00000100:00100000:1.0:1789429659.300676:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648439040 00000100:00100000:1.0:1789429659.300694:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1789429659.300702:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648438912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789429659.300734:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1789429659.300783:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648438912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429659.300790:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:1.0:1789429659.300804:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1789429659.300809:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648439040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789429659.300826:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:1.0:1789429659.300851:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648439040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429659.300856:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1789429659.300891:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648439040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429659.300987:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648438912:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789429659.876254:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429660.444041:0:28093:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-ffff9943c54b6000.ost_server_uuid in FULL state after 0 sec 00010000:00010000:2.0:1789429660.899443:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429661.925313:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429662.947530:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429663.508995:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429663.509040:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429663.509071:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429663.509101:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429663.509130:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635193088 00000100:00100000:0.0:1789429663.509139:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635193088 00000100:00100000:0.0:1789429663.509191:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635192960 00000100:00100000:0.0:1789429663.509194:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635192960 00000100:00100000:0.0:1789429663.509247:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1047 00000100:00100000:0.0:1789429663.509257:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635193088:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429663.509344:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2368:x1876351635193088:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 88us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429663.509352:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1047 00000100:00100000:0.0:1789429663.509371:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1048 00000100:00100000:0.0:1789429663.509379:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635192960:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429663.509403:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635192960:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429663.509409:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1048 00000100:00100000:0.0:1789429663.509427:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635193216 00000100:00100000:0.0:1789429663.509431:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635193216 00000100:00100000:0.0:1789429663.509458:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1068 00000100:00100000:0.0:1789429663.509465:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635193216:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429663.509490:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2368:x1876351635193216:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429663.509496:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1068 00000100:00100000:1.0:1789429663.509722:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635192832 00000100:00100000:1.0:1789429663.509727:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635192832 00000100:00100000:1.0:1789429663.509763:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 669 00000100:00100000:1.0:1789429663.509771:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635192832:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429663.509807:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635192832:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 37us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429663.509813:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 669 00000100:00080000:3.0:1789429663.510542:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429663.510548:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789429663.909128:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648439168:0@lo:400:kworker.0 00000100:00100000:1.0:1789429663.909195:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429663.909248:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648439168 00000100:00100000:0.0:1789429663.909256:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648439168 00000100:00100000:0.0:1789429663.909312:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1789429663.909321:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648439168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429663.909346:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789429663.909353:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648439552:0@lo:400:kworker.0 00000100:00100000:1.0:1789429663.909377:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429663.909378:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648439168:12345-0@lo:400:kworker.0 Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429663.909385:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1789429663.909405:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648439168:0@lo:400:kworker.0 00000100:00100000:0.0:1789429663.909417:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648439552 00000100:00100000:0.0:1789429663.909421:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648439552 00000100:00080000:1.0:1789429663.909445:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789429663.909452:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1789429663.909470:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648439552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429663.909764:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648439552:12345-0@lo:400:kworker.0 Request processed in 295us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429663.909771:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1789429663.909794:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789429663.909843:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648439680:0@lo:400:kworker.0 00000100:00100000:2.0:1789429663.909874:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429663.910041:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648439296:0@lo:400:kworker.0 00000100:00100000:2.0:1789429663.910069:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429663.910096:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648439808:0@lo:400:kworker.0 00000100:00100000:2.0:1789429663.910115:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429663.910134:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429663.910139:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648439424:0@lo:400:kworker.0 00000100:00100000:2.0:1789429663.910156:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429663.910183:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648439808 00000100:00100000:2.0:1789429663.910187:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648439808 00000100:00100000:2.0:1789429663.910245:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1789429663.910253:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648439808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429663.910291:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648439808:12345-0@lo:400:kworker.0 Request processed in 39us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429663.910297:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00080000:2.0:1789429663.910315:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789429663.910344:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648439808:0@lo:400:kworker.0 00000100:00100000:0.0:1789429663.910941:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648439680 00000100:00100000:0.0:1789429663.910946:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648439680 00000100:00100000:0.0:1789429663.911004:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648439296 00000100:00100000:0.0:1789429663.911007:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648439296 00000100:00100000:0.0:1789429663.911023:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648439424 00000100:00100000:0.0:1789429663.911026:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648439424 00000100:00100000:0.0:1789429663.911047:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1789429663.911054:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648439680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429663.911102:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1876351648439680:12345-0@lo:400:kworker.0 Request processed in 48us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429663.911108:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1789429663.911120:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1789429663.911126:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648439296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429663.911157:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648439296:12345-0@lo:400:kworker.0 Request processed in 32us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429663.911162:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1789429663.911174:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1789429663.911179:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648439424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429663.911225:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648439424:12345-0@lo:400:kworker.0 Request processed in 46us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429663.911230:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00080000:2.0:1789429663.911688:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429663.911890:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3298:1876351648439680:0@lo:400:kworker.0 00000100:00100000:0.0:1789429663.911930:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648439424:0@lo:400:kworker.0 00000100:00100000:0.0:1789429663.911941:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648439296:0@lo:400:kworker.0 00000100:00100000:1.0:1789429663.912012:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648439552:0@lo:400:kworker.0 00010000:00010000:3.0:1789429663.972773:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429664.419512:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429664.419534:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648439936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429664.419537:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429664.419546:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648440064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429664.419597:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429664.419627:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648440064 00000100:00100000:0.0:1789429664.419635:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648440064 00000100:00100000:2.0:1789429664.419660:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429664.419676:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648439936 00000100:00100000:0.0:1789429664.419679:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648439936 00000100:00100000:2.0:1789429664.419686:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:0.0:1789429664.419694:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1789429664.419695:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648440064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429664.419699:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648439936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789429664.419727:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00002000:00000024:2.0:1789429664.419727:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429664.419767:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648439936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429664.419767:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648440064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429664.419774:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1789429664.419818:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648440064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789429664.419848:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648439936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429664.430348:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00010000:00010000:2.0:1789429665.000960:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789429666.019415:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789429666.090947:0:28285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9943c54b6000.ost_server_uuid 50 00010000:00010000:1.0:1789429667.045396:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789429667.483612:0:28334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0001-osc-ffff9943c54b6000.ost_server_uuid in IDLE state after 0 sec 00010000:00010000:2.0:1789429668.067852:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429668.632699:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429668.632763:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429668.632798:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429668.632840:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429668.632883:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635193728 00000100:00100000:0.0:1789429668.632896:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635193728 00000100:00100000:0.0:1789429668.632969:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1071 00000100:00100000:0.0:1789429668.632983:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635193728:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429668.633063:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635193728:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429668.633071:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1071 00000100:00080000:0.0:1789429668.633092:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789429668.633746:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635193600 00000100:00100000:1.0:1789429668.633754:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635193600 00000100:00100000:1.0:1789429668.633807:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635193472 00000100:00100000:1.0:1789429668.633810:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635193472 00000100:00100000:1.0:1789429668.633831:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1052 00000100:00100000:1.0:1789429668.633838:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2371:x1876351635193600:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429668.633887:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2371:x1876351635193600:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 50us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429668.633894:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1052 00000100:00100000:1.0:1789429668.633908:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1053 00000100:00100000:1.0:1789429668.633913:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351635193472:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429668.633932:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:2371:x1876351635193472:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 19us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429668.633938:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1053 00000100:00100000:2.0:1789429668.634194:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635193344 00000100:00100000:2.0:1789429668.634227:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635193344 00000100:00100000:2.0:1789429668.634258:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 671 00000100:00100000:2.0:1789429668.634264:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635193344:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429668.634312:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635193344:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 49us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429668.634319:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 671 00000100:00080000:0.0:1789429668.634914:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429669.036480:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648440192:0@lo:400:kworker.0 00000100:00100000:3.0:1789429669.036525:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648440448:0@lo:400:kworker.0 00000100:00100000:1.0:1789429669.036667:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648440576:0@lo:400:kworker.0 00000100:00100000:3.0:1789429669.038323:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429669.038387:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648440448 00000100:00100000:0.0:1789429669.038401:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648440448 00000100:00100000:3.0:1789429669.038419:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789429669.038433:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648440320:0@lo:400:kworker.0 00000100:00100000:3.0:1789429669.038476:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429669.038483:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1789429669.038499:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648440448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429669.038503:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648440832:0@lo:400:kworker.0 00000100:00100000:3.0:1789429669.038542:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429669.038579:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648440320 00000100:00100000:3.0:1789429669.038584:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648440320 00000100:00100000:0.0:1789429669.038593:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648440448:12345-0@lo:400:kworker.0 Request processed in 98us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429669.038603:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1789429669.038653:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1789429669.038661:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648440320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429669.038698:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648440320:12345-0@lo:400:kworker.0 Request processed in 37us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429669.038707:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00080000:0.0:1789429669.038709:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429669.038732:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648440832 00000100:00100000:0.0:1789429669.038736:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648440832 00000100:00100000:0.0:1789429669.038773:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:0.0:1789429669.038780:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648440832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429669.038820:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648440832:12345-0@lo:400:kworker.0 Request processed in 41us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429669.038827:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00080000:0.0:1789429669.038846:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789429669.038885:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648440320:0@lo:400:kworker.0 00000100:00100000:0.0:1789429669.038899:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648440832:0@lo:400:kworker.0 00000100:00100000:0.0:1789429669.038909:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648440448:0@lo:400:kworker.0 00000100:00100000:2.0:1789429669.039605:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429669.039672:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648440192 00000100:00100000:3.0:1789429669.039679:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648440192 00000100:00100000:3.0:1789429669.039727:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1789429669.039738:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648440192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429669.039799:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648440192:12345-0@lo:400:kworker.0 Request processed in 62us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429669.039807:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1789429669.039849:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648440704:0@lo:400:kworker.0 00000100:00100000:2.0:1789429669.039891:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429669.039931:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648440192:0@lo:400:kworker.0 00000100:00100000:3.0:1789429669.040634:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648440704 00000100:00100000:3.0:1789429669.040643:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648440704 00000100:00080000:0.0:1789429669.040699:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429669.040714:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1789429669.040723:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648440704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429669.040817:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648440704:12345-0@lo:400:kworker.0 Request processed in 95us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429669.040824:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:1.0:1789429669.041562:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429669.043007:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648440576 00000100:00100000:0.0:1789429669.043093:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648440576 00000100:00100000:0.0:1789429669.043415:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1789429669.043428:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648440576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429669.043540:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648440576:12345-0@lo:400:kworker.0 Request processed in 116us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429669.043548:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1789429669.043638:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648440704:0@lo:400:kworker.0 00000100:00100000:0.0:1789429669.043683:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648440576:0@lo:400:kworker.0 00000100:00080000:1.0:1789429669.043866:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789429669.094070:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429669.540431:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789429669.540461:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648440960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429669.540564:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429669.540650:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648440960 00000100:00100000:2.0:1789429669.540661:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648440960 00000100:00100000:2.0:1789429669.540721:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1789429669.540733:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f418ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648440960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429669.540779:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429669.540837:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f418ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648440960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429669.540845:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1789429669.541429:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648440960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429669.541556:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648441088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429669.541602:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429669.541669:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648441088 00000100:00100000:2.0:1789429669.541675:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648441088 00000100:00100000:2.0:1789429669.541708:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1789429669.541716:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648441088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429669.541743:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429669.545749:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648441088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4019us (4132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429669.545771:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1789429669.547179:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648441088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789429670.123478:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429671.139706:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789429672.164737:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429673.189357:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429673.755477:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429673.755512:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429673.755574:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635193984 00000100:00100000:0.0:1789429673.755581:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429673.755584:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635193984 00000100:00100000:0.0:1789429673.755614:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429673.755639:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635194112 00000100:00100000:3.0:1789429673.755643:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635194112 00000100:00100000:0.0:1789429673.755659:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1057 00000100:00100000:3.0:1789429673.755666:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1058 00000100:00100000:3.0:1789429673.755672:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635194112:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429673.755702:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635193984:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429673.755789:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635194240 00000100:00100000:2.0:1789429673.755793:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635194240 00000100:00100000:2.0:1789429673.755872:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1074 00000100:00100000:2.0:1789429673.755881:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635194240:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429673.755978:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635193984:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 309us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429673.755986:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1057 00000100:00100000:1.0:1789429673.756120:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635193856 00000100:00100000:1.0:1789429673.756125:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635193856 00000100:00100000:1.0:1789429673.756175:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 673 00000100:00100000:1.0:1789429673.756183:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635193856:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:0.0:1789429673.757081:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429673.757088:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789429673.760049:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635194112:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 4366us (4455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429673.760064:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1058 00000100:00100000:2.0:1789429673.760418:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2370:x1876351635194240:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 4535us (4799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429673.760428:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1074 00000100:00100000:1.0:1789429673.762027:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2370:x1876351635193856:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 5835us (6551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429673.762040:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 673 00000100:00100000:0.0:1789429674.147815:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648441472:0@lo:400:kworker.0 00000100:00100000:0.0:1789429674.147884:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429674.147942:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789429674.147948:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648441344:0@lo:400:kworker.0 00000100:00100000:0.0:1789429674.147970:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429674.147988:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648441856:0@lo:400:kworker.0 00000100:00100000:0.0:1789429674.148011:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429674.148041:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648441472 00000100:00100000:0.0:1789429674.148049:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648441472 00000100:00100000:0.0:1789429674.148100:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648441344 00000100:00100000:0.0:1789429674.148103:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648441344 00000100:00100000:0.0:1789429674.148129:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1789429674.148137:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648441472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429674.148186:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648441472:12345-0@lo:400:kworker.0 Request processed in 50us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429674.148194:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1789429674.148238:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1789429674.148244:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648441344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429674.148284:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648441344:12345-0@lo:400:kworker.0 Request processed in 40us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429674.148290:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1789429674.148312:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648441856 00000100:00100000:0.0:1789429674.148316:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648441856 00000100:00100000:0.0:1789429674.148344:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1789429674.148350:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648441856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429674.148379:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648441856:12345-0@lo:400:kworker.0 Request processed in 29us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429674.148385:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00080000:0.0:1789429674.148401:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429674.148405:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429674.154437:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648441344:0@lo:400:kworker.0 00000100:00100000:0.0:1789429674.154456:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648441856:0@lo:400:kworker.0 00000100:00100000:0.0:1789429674.154469:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648441472:0@lo:400:kworker.0 00000100:00100000:3.0:1789429674.155782:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f2f090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648441216:0@lo:400:kworker.0 00000100:00100000:3.0:1789429674.155861:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429674.155913:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648441728:0@lo:400:kworker.0 00000100:00100000:3.0:1789429674.155938:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429674.155974:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789429674.155981:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648441600:0@lo:400:kworker.0 00000100:00100000:3.0:1789429674.156004:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429674.156053:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648441600 00000100:00100000:3.0:1789429674.156060:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648441600 00000100:00100000:3.0:1789429674.156116:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1789429674.156126:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648441600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429674.156177:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648441600:12345-0@lo:400:kworker.0 Request processed in 52us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429674.156185:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00080000:3.0:1789429674.156227:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789429674.156263:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648441600:0@lo:400:kworker.0 00000100:00100000:2.0:1789429674.157913:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648441216 00000100:00100000:2.0:1789429674.157924:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648441216 00000100:00100000:2.0:1789429674.157978:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1789429674.157987:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648441216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429674.158064:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648441216:12345-0@lo:400:kworker.0 Request processed in 77us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429674.158070:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1789429674.158117:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f2f090000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648441216:0@lo:400:kworker.0 00000100:00100000:0.0:1789429674.158364:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648441728 00000100:00100000:0.0:1789429674.158369:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648441728 00000100:00100000:0.0:1789429674.158421:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1789429674.158428:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648441728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429674.158471:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648441728:12345-0@lo:400:kworker.0 Request processed in 43us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429674.158489:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00080000:1.0:1789429674.158657:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429674.158723:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648441728:0@lo:400:kworker.0 00010000:00010000:0.0:1789429674.211958:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429674.663769:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429674.663791:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648441984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789429674.663859:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429674.663925:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648441984 00000100:00100000:3.0:1789429674.663933:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648441984 00000100:00100000:3.0:1789429674.663983:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1789429674.663991:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648441984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429674.664026:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429674.664083:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648441984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429674.664091:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1789429674.664138:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648441984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429674.668940:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648442112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429674.669012:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429674.669162:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648442112 00000100:00100000:3.0:1789429674.669170:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648442112 00000100:00100000:3.0:1789429674.669255:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1789429674.669265:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648442112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429674.669298:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00000100:00100000:3.0:1789429674.669348:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648442112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429674.669354:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:3.0:1789429674.669398:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648442112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789429675.238143:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429676.259423:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429677.283501:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429678.308349:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789429678.871876:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429678.871922:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429678.871960:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429678.871992:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429678.872020:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635194752 00000100:00100000:2.0:1789429678.872030:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635194752 00000100:00100000:2.0:1789429678.872098:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1077 00000100:00100000:2.0:1789429678.872108:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635194752:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429678.872173:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635194752:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 66us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429678.872181:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1077 00000100:00100000:2.0:1789429678.872232:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635194368 00000100:00100000:2.0:1789429678.872238:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635194368 00000100:00100000:2.0:1789429678.872262:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 675 00000100:00100000:2.0:1789429678.872269:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635194368:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429678.872295:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635194368:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429678.872301:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 675 00000100:00100000:2.0:1789429678.872328:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635194496 00000100:00100000:2.0:1789429678.872331:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635194496 00000100:00100000:2.0:1789429678.872371:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635194624 00000100:00100000:2.0:1789429678.872374:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635194624 00000100:00100000:2.0:1789429678.872397:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1062 00000100:00100000:2.0:1789429678.872404:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635194496:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429678.872432:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635194496:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429678.872437:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1062 00000100:00100000:2.0:1789429678.872449:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1063 00000100:00100000:2.0:1789429678.872455:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635194624:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429678.872476:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635194624:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429678.872482:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1063 00000100:00080000:2.0:1789429678.872499:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429678.872503:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789429679.245631:0:28722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9943c54b6000.ost_server_uuid 50 00000100:00100000:0.0:1789429679.267747:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648442496:0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.267817:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429679.267871:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789429679.267878:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648442368:0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.267903:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429679.267919:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648442880:0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.267949:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429679.267979:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648442496 00000100:00100000:0.0:1789429679.267986:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648442496 00000100:00100000:0.0:1789429679.268035:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648442368 00000100:00100000:0.0:1789429679.268039:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648442368 00000100:00100000:0.0:1789429679.268063:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1789429679.268071:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648442496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.268121:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f29d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648442496:12345-0@lo:400:kworker.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429679.268127:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1789429679.268144:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1789429679.268151:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648442368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.268179:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648442368:12345-0@lo:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429679.268185:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1789429679.268245:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648442880 00000100:00100000:0.0:1789429679.268249:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648442880 00000100:00100000:0.0:1789429679.268278:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1789429679.268285:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648442880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.268313:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648442880:12345-0@lo:400:kworker.0 Request processed in 30us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429679.268320:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00080000:0.0:1789429679.268336:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429679.268417:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429679.268461:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648442368:0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.268472:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648442880:0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.268479:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648442496:0@lo:400:kworker.0 00000100:00100000:1.0:1789429679.268560:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648442240:0@lo:400:kworker.0 00000100:00100000:1.0:1789429679.268598:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429679.268631:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648442752:0@lo:400:kworker.0 00000100:00100000:1.0:1789429679.268651:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429679.268668:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789429679.268674:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f29d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648442624:0@lo:400:kworker.0 00000100:00100000:1.0:1789429679.268694:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429679.268857:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648442240 00000100:00100000:0.0:1789429679.268862:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648442240 00000100:00100000:0.0:1789429679.268898:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1789429679.268905:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648442240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.268942:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18253c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648442240:12345-0@lo:400:kworker.0 Request processed in 38us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429679.268948:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1789429679.268973:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648442752 00000100:00100000:0.0:1789429679.268977:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648442752 00000100:00100000:0.0:1789429679.269004:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:0.0:1789429679.269010:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648442752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.269037:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648442752:12345-0@lo:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429679.269042:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:0.0:1789429679.269058:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648442624 00000100:00100000:0.0:1789429679.269062:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648442624 00000100:00100000:0.0:1789429679.269085:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1789429679.269092:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648442624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.269120:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648442624:12345-0@lo:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429679.269125:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:0.0:1789429679.269146:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429679.269150:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429679.269165:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648442624:0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.269173:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648442240:0@lo:400:kworker.0 00000100:00100000:0.0:1789429679.269180:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f29d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648442752:0@lo:400:kworker.0 00010000:00010000:1.0:1789429679.334414:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429679.779432:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f340cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648443008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429679.779506:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429679.779604:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789429679.779615:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648443136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429679.779641:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429679.779916:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648443008 00000100:00100000:2.0:1789429679.779925:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648443008 00000100:00100000:2.0:1789429679.779972:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648443136 00000100:00100000:2.0:1789429679.779976:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648443136 00000100:00100000:2.0:1789429679.779991:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1789429679.779999:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648443008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429679.780035:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429679.780094:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648443008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429679.780100:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1789429679.780114:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1789429679.780120:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648443136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429679.780137:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429679.780165:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648443136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429679.780170:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1789429679.780350:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648443136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429679.781143:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f340cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648443008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789429680.355704:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789429680.465764:0:28770:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-ffff9943c54b6000.ost_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1789429681.379496:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429682.413708:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429683.427337:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429683.988538:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429683.988586:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429683.988764:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635195008 00000100:00100000:0.0:1789429683.988775:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635195008 00000100:00100000:0.0:1789429683.988850:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1067 00000100:00100000:0.0:1789429683.988862:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635195008:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429683.988938:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+31:2368:x1876351635195008:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 79us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429683.988946:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1067 00000100:00080000:1.0:1789429683.989218:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429683.989301:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635194880 00000100:00100000:2.0:1789429683.989306:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635194880 00000100:00100000:2.0:1789429683.989342:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 677 00000100:00100000:2.0:1789429683.989350:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635194880:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429683.989396:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18252c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2368:x1876351635194880:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 47us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429683.989403:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 677 00000100:00100000:3.0:1789429683.995577:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429683.995625:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429683.995766:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635195136 00000100:00100000:1.0:1789429683.995778:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635195136 00000100:00100000:1.0:1789429683.995857:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1068 00000100:00100000:1.0:1789429683.995867:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635195136:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1789429683.995947:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635195136:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 80us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429683.995955:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1068 00000100:00100000:0.0:1789429683.995967:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635195264 00000100:00100000:0.0:1789429683.995973:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635195264 00000100:00080000:2.0:1789429683.996225:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429683.996230:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429683.997227:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1080 00000100:00100000:0.0:1789429683.997324:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635195264:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429683.997439:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f340cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635195264:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 202us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429683.997448:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1080 00000100:00100000:3.0:1789429684.387603:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648443392:0@lo:400:kworker.0 00000100:00100000:3.0:1789429684.387673:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429684.387729:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648443904:0@lo:400:kworker.0 00000100:00100000:3.0:1789429684.387753:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429684.387777:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429684.387783:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648443520:0@lo:400:kworker.0 00000100:00100000:3.0:1789429684.387802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429684.387840:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648443392 00000100:00100000:3.0:1789429684.387847:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648443392 00000100:00100000:3.0:1789429684.387885:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648443520 00000100:00100000:3.0:1789429684.387888:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648443520 00000100:00100000:3.0:1789429684.387912:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1789429684.387920:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648443392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429684.387969:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648443392:12345-0@lo:400:kworker.0 Request processed in 49us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429684.387975:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1789429684.387992:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1789429684.387998:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648443520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429684.388024:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648443520:12345-0@lo:400:kworker.0 Request processed in 27us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429684.388030:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1789429684.388082:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648443520:0@lo:400:kworker.0 00000100:00100000:3.0:1789429684.388094:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648443392:0@lo:400:kworker.0 00000100:00100000:2.0:1789429684.388366:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648443264:0@lo:400:kworker.0 00000100:00100000:2.0:1789429684.388404:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429684.388427:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648443776:0@lo:400:kworker.0 00000100:00100000:2.0:1789429684.388448:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429684.388467:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429684.388472:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648443648:0@lo:400:kworker.0 00000100:00100000:2.0:1789429684.388493:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429684.388518:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648443904 00000100:00100000:2.0:1789429684.388522:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648443904 00000100:00100000:2.0:1789429684.388555:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648443648 00000100:00100000:2.0:1789429684.388558:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648443648 00000100:00100000:2.0:1789429684.388590:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1789429684.388597:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648443904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429684.388632:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648443904:12345-0@lo:400:kworker.0 Request processed in 36us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429684.388638:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1789429684.388650:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1789429684.388656:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648443648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429684.388695:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648443648:12345-0@lo:400:kworker.0 Request processed in 39us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429684.388701:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1789429684.388731:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648443776 00000100:00100000:2.0:1789429684.388734:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648443776 00000100:00100000:2.0:1789429684.388760:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1789429684.388765:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648443776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429684.388792:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648443776:12345-0@lo:400:kworker.0 Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429684.388796:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00080000:2.0:1789429684.388821:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429684.388824:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429684.388827:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429684.388845:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648443648:0@lo:400:kworker.0 00000100:00100000:2.0:1789429684.388853:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648443776:0@lo:400:kworker.0 00000100:00100000:3.0:1789429684.388983:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648443264 00000100:00100000:3.0:1789429684.388988:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648443264 00000100:00100000:3.0:1789429684.389019:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1789429684.389026:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648443264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789429684.389078:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18250450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648443264:12345-0@lo:400:kworker.0 Request processed in 52us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429684.389084:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1789429684.389117:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648443904:0@lo:400:kworker.0 00000100:00100000:0.0:1789429684.389296:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648443264:0@lo:400:kworker.0 00010000:00010000:1.0:1789429684.456416:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429684.899530:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429684.899551:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e05046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648444032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429684.899612:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429684.899778:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648444032 00000100:00100000:2.0:1789429684.899787:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648444032 00000100:00100000:2.0:1789429684.899839:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1789429684.899848:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648444032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789429684.899880:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:2.0:1789429684.900068:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648444032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429684.900074:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1789429684.900397:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429684.900415:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648444160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789429684.900445:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429684.900621:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648444160 00000100:00100000:3.0:1789429684.900626:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648444160 00000100:00100000:3.0:1789429684.900663:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1789429684.900671:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648444160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429684.900694:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00000100:00100000:3.0:1789429684.900741:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648444160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429684.900748:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1789429684.900852:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648444160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429684.903106:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e05046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648444032:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789429685.478489:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429685.530176:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429685.530936:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635195392 00000100:00100000:1.0:1789429685.530946:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635195392 00000100:00100000:1.0:1789429685.531018:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21371 00000100:00100000:1.0:1789429685.531029:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635195392:12345-192.168.203.39@tcp:17:kworker.0 00000100:00100000:1.0:1789429685.531197:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:12e09781-3d24-4c67-9972-bb781900e20d+31:2370:x1876351635195392:12345-192.168.203.39@tcp:17:kworker.0 Request processed in 168us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429685.531232:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21371 00000100:00080000:3.0:1789429685.536339:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789429685.867877:0:28963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9943c54b6000.ost_server_uuid 50 00010000:00010000:1.0:1789429686.500670:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789429687.272889:0:29011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0001-osc-ffff9943c54b6000.ost_server_uuid in IDLE state after 0 sec 00010000:00010000:2.0:1789429687.523573:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789429688.552160:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789429689.087017:0:29060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 19:48:08 (1789429688) 00000100:00100000:2.0:1789429689.110508:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429689.110553:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429689.110584:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429689.110609:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429689.110705:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635195648 00000100:00100000:3.0:1789429689.110716:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635195648 00000100:00100000:0.0:1789429689.110744:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635195904 00000100:00100000:0.0:1789429689.110750:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635195904 00000100:00100000:3.0:1789429689.110795:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635195776 00000100:00100000:3.0:1789429689.110799:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635195776 00000100:00100000:0.0:1789429689.110810:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1083 00000100:00100000:0.0:1789429689.110823:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635195904:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429689.110832:0:15669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1072 00000100:00100000:3.0:1789429689.110842:0:15669:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e05045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635195648:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:2.0:1789429689.110904:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429689.110909:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429689.110910:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05046d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2369:x1876351635195904:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 90us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429689.110917:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1083 00000100:00100000:0.0:1789429689.110951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635195520 00000100:00100000:0.0:1789429689.110955:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635195520 00000100:00100000:0.0:1789429689.110995:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 679 00000100:00100000:0.0:1789429689.111002:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f18251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635195520:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429689.115299:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1073 00000100:00100000:2.0:1789429689.115320:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f2f090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635195776:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429689.116401:0:15669:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e05045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12e09781-3d24-4c67-9972-bb781900e20d+31:2369:x1876351635195648:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 5554us (5894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429689.116415:0:15669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1072 00000100:00100000:0.0:1789429689.116702:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f18251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2369:x1876351635195520:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 5696us (6113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429689.116718:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 679 00000100:00100000:2.0:1789429689.118348:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f2f090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2369:x1876351635195776:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 3029us (7730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429689.118360:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1073 00000100:00100000:0.0:1789429689.507764:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648444416:0@lo:400:kworker.0 00000100:00100000:0.0:1789429689.507835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429689.507890:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648444928:0@lo:400:kworker.0 00000100:00100000:0.0:1789429689.507917:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429689.507942:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789429689.507948:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648444544:0@lo:400:kworker.0 00000100:00100000:0.0:1789429689.507972:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429689.508022:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648444416 00000100:00100000:0.0:1789429689.508030:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648444416 00000100:00100000:0.0:1789429689.508074:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648444544 00000100:00100000:0.0:1789429689.508077:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648444544 00000100:00100000:0.0:1789429689.508111:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1789429689.508120:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648444416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429689.508179:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1876351648444416:12345-0@lo:400:kworker.0 Request processed in 59us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429689.508186:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1789429689.508236:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1789429689.508244:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648444544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429689.508273:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1876351648444544:12345-0@lo:400:kworker.0 Request processed in 31us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429689.508278:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1789429689.508298:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648444928 00000100:00100000:0.0:1789429689.508301:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648444928 00000100:00100000:0.0:1789429689.508327:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1789429689.508334:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648444928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429689.508362:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648444928:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429689.508367:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00080000:0.0:1789429689.508387:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429689.508391:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429689.508421:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3300:1876351648444544:0@lo:400:kworker.0 00000100:00100000:0.0:1789429689.508444:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3300:1876351648444416:0@lo:400:kworker.0 00000100:00100000:0.0:1789429689.508453:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648444928:0@lo:400:kworker.0 00000100:00100000:2.0:1789429689.508762:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648444288:0@lo:400:kworker.0 00000100:00100000:2.0:1789429689.508801:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429689.508840:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648444800:0@lo:400:kworker.0 00000100:00100000:2.0:1789429689.508863:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429689.508884:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429689.508890:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648444672:0@lo:400:kworker.0 00000100:00100000:2.0:1789429689.508913:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429689.508941:0:26936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648444800 00000100:00100000:2.0:1789429689.508945:0:26936:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648444800 00000100:00100000:2.0:1789429689.508976:0:26936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1789429689.508982:0:26936:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648444800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429689.509030:0:26936:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648444800:12345-0@lo:400:kworker.0 Request processed in 47us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429689.509037:0:26936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1789429689.509056:0:13238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648444672 00000100:00100000:2.0:1789429689.509059:0:13238:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648444672 00000100:00100000:2.0:1789429689.509083:0:13238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1789429689.509089:0:13238:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648444672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429689.509118:0:13238:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648444672:12345-0@lo:400:kworker.0 Request processed in 29us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429689.509124:0:13238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00080000:2.0:1789429689.509151:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429689.509155:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429689.509173:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648444672:0@lo:400:kworker.0 00000100:00100000:2.0:1789429689.509181:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648444800:0@lo:400:kworker.0 00000100:00100000:0.0:1789429689.509903:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648444288 00000100:00100000:0.0:1789429689.509909:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648444288 00000100:00100000:0.0:1789429689.509953:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1789429689.509962:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648444288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429689.510026:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648444288:12345-0@lo:400:kworker.0 Request processed in 65us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429689.510032:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:1.0:1789429689.510171:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648444288:0@lo:400:kworker.0 00000100:00100000:2.0:1789429689.536278:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429689.536470:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635196032 00000100:00100000:3.0:1789429689.536480:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635196032 00000100:00100000:3.0:1789429689.536539:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21372 00000100:00100000:3.0:1789429689.536550:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3221e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+31:50295:x1876351635196032:12345-192.168.203.39@tcp:101:mkdir.0 00010000:00010000:3.0:1789429689.536569:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429689.536591:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31cc00/0xb4c3dad7263622b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ccb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789429689.537623:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 964us 00010000:00010000:1.0:1789429689.572751:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad7263622b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.572774:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad7263622b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.572788:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad7263622b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789429689.572825:0:5840:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789429689.572828:0:5840:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789429689.572848:0:5840:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad7263622b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.572876:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31cc00/0xb4c3dad7263622b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccb1 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.572892:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad7263622b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccb1 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.572900:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c100) 00010000:00010000:1.0:1789429689.572903:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789429689.572906:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f344c5e00, rc 0) 00000100:00100000:1.0:1789429689.572969:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3221e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+32:50295:x1876351635196032:12345-192.168.203.39@tcp:101:mkdir.0 Request processed in 36420us (36699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429689.572978:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21372 00010000:00010000:1.0:1789429689.574367:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789429689.579406:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429689.579462:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429689.579535:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635196416 00000100:00100000:0.0:1789429689.579550:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635196416 00000100:00100000:0.0:1789429689.579624:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635196160 00000100:00100000:0.0:1789429689.579628:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635196160 00000100:00100000:0.0:1789429689.579667:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21373 00000100:00100000:0.0:1789429689.579678:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+33:50295:x1876351635196416:12345-192.168.203.39@tcp:36:mkdir.0 00010000:00010000:0.0:1789429689.579729:0:15700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429689.579755:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5e00/0xb4c3dad7263622b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccb1 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.579778:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c100) 00010000:00010000:0.0:1789429689.579783:0:15700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789429689.579982:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.579998:0:15700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc9c expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429689.580380:0:26937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21374 00000100:00100000:1.0:1789429689.580392:0:26937:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:12e09781-3d24-4c67-9972-bb781900e20d+32:2368:x1876351635196160:12345-192.168.203.39@tcp:41:mkdir.0 00000004:00000024:1.0:1789429689.580423:0:26937:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789429689.580508:0:26937:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:12e09781-3d24-4c67-9972-bb781900e20d+32:2368:x1876351635196160:12345-192.168.203.39@tcp:41:mkdir.0 Request processed in 118us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429689.580515:0:26937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21374 00010000:00010000:0.0:1789429689.580741:0:15700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.580774:0:15700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc9c expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.580787:0:15700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc9c expref: 21 pid: 5841 timeout: 1487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429689.580799:0:15700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648445056:192.168.203.39@tcp:104: 00000100:00100000:0.0:1789429689.580863:0:15700:0:(client.c:2716:ptlrpc_set_wait()) set ffff946f03f2f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789429689.584677:0:15700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:15700:1876351648445056:192.168.203.39@tcp:104: 00010000:00010000:0.0:1789429689.584706:0:15700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789429689.586706:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429689.586788:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635196544 00000100:00100000:0.0:1789429689.586801:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635196544 00010000:00010000:0.0:1789429689.586850:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc9c expref: 22 pid: 5841 timeout: 1487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429689.586900:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6274 00000100:00100000:0.0:1789429689.586910:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+22:2370:x1876351635196544:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429689.586925:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789429689.586932:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc9c expref: 22 pid: 5841 timeout: 1487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.586945:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc9c expref: 22 pid: 5841 timeout: 1487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.586966:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5200/0xb4c3dad726362272 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc9c expref: 22 pid: 5841 timeout: 1487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.586981:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c100) 00010000:00010000:0.0:1789429689.586986:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.586996:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.587012:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.587051:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429689.587112:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:2370:x1876351635196544:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 204us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429689.587121:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6274 00010000:00010000:1.0:1789429689.587522:0:15700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.587532:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.587619:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad7263622c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb40376bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.587630:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad7263622c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.587640:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad7263622c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429689.592871:0:15700:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x90:0x0]: returning size 16384 00010000:00010000:0.0:1789429689.592892:0:15700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.592903:0:15700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.592910:0:15700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.592916:0:15700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ade00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429689.592921:0:15700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.592929:0:15700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.592945:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f0970c100) 00010000:00010000:0.0:1789429689.592948:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429689.592953:0:15700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.592959:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789429689.592979:0:15700:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000f384c4a reply state 0000000074ea4f7c transno 4294977270 ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad7263622c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789429689.592989:0:15700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789429689.594612:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+33:50295:x1876351635196416:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 14919us (15204us total) trans 4294977270 rc 0/0 00000100:00100000:0.0:1789429689.594625:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21373 00010000:00010000:3.0:1789429689.607757:0:3285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad7263622c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429689.607774:0:3285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad7263622c6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429689.607782:0:3285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad7263622c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429689.607787:0:3285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f344c5a00 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:3.0:1789429689.607792:0:3285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad7263622c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429689.607799:0:3285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad7263622c6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429689.607813:0:3285:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb40376bb (ffff946f0970ce00) 00010000:00010000:3.0:1789429689.607816:0:3285:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789429689.607820:0:3285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad7263622c6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429689.607826:0:3285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c5a00/0xb4c3dad7263622c6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789429689.647516:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429689.648603:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635196672 00000100:00100000:1.0:1789429689.648618:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635196672 00000100:00100000:1.0:1789429689.648710:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 274 00000100:00100000:1.0:1789429689.648722:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+21:44697:x1876351635196672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789429689.648739:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0 00010000:00010000:1.0:1789429689.648806:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a200/0xb4c3dad72636228e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cca3 expref: 21 pid: 26936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.648829:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8f:0x0].0x0 (ffff946f120fda00) 00010000:00010000:1.0:1789429689.648841:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad200/0xb4c3dad726361d32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c946 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.648851:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8a:0x0].0x0 (ffff946f120fd300) 00010000:00010000:1.0:1789429689.648881:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652800/0xb4c3dad726361c36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8eb expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.648897:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1000/0xb4c3dad726361c0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8dd expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.648906:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff946f08640100) 00010000:00010000:1.0:1789429689.648915:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547200/0xb4c3dad726361616 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c701 expref: 17 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.648923:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f2076a900) 00010000:00010000:1.0:1789429689.648930:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030000/0xb4c3dad7263615fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x83:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6fa expref: 16 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.648939:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x83:0x0].0x0 (ffff946f2076a600) 00010000:00010000:1.0:1789429689.648947:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad000/0xb4c3dad7263614f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c69f expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.648957:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x82:0x0].0x0 (ffff946f2076a800) 00010000:00010000:1.0:1789429689.648965:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ace00/0xb4c3dad7263614db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x81:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c698 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.648973:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x81:0x0].0x0 (ffff946f08640000) 00010000:00010000:1.0:1789429689.648981:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7400/0xb4c3dad72636142c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c660 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.648991:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x26:0x0].0x0 (ffff946f2076ae00) 00010000:00010000:1.0:1789429689.649014:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6e00/0xb4c3dad7263613b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c63d expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.649023:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:1.0:1789429689.649031:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac000/0xb4c3dad7263612d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5f0 expref: 11 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.649043:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0400/0xb4c3dad72636126c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5bf expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.649053:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7e:0x0].0x0 (ffff946f08640500) 00010000:00010000:1.0:1789429689.649060:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7600/0xb4c3dad726361203 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c59c expref: 9 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.649073:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2aca00/0xb4c3dad7263611bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c587 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.649087:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:1.0:1789429689.649096:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7000/0xb4c3dad726361107 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c548 expref: 7 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.649104:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7b:0x0].0x0 (ffff946f2076ad00) 00010000:00010000:1.0:1789429689.649112:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7c00/0xb4c3dad726360d80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c44c expref: 6 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789429689.649119:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x77:0x0].0x0 (ffff946f2076a300) 00010000:00010000:1.0:1789429689.649122:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789429689.649192:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:44697:x1876351635196672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 472us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429689.649258:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 274 00000100:00100000:1.0:1789429689.653343:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429689.653432:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635196800 00000100:00100000:0.0:1789429689.653443:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635196800 00000100:00100000:0.0:1789429689.653509:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 275 00000100:00100000:0.0:1789429689.653519:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+32:5607:x1876351635196800:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789429689.653534:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 26 locks, starting at 0 00010000:00010000:0.0:1789429689.653559:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031200/0xb4c3dad7263619ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x87:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c827 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653578:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x87:0x0].0x0 (ffff946f0970c400) 00010000:00010000:0.0:1789429689.653594:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad72636224f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cc8e expref: 31 pid: 26937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653607:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8f:0x0].0x0 (ffff946f120fda00) 00010000:00010000:0.0:1789429689.653619:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652200/0xb4c3dad726361c75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c907 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653631:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x28:0x0].0x0 (ffff946f08640100) 00010000:00010000:0.0:1789429689.653642:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0000/0xb4c3dad726361c44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x89:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8f2 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653655:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031000/0xb4c3dad726361b41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x89:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c8a5 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653664:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x89:0x0].0x0 (ffff946f0970c000) 00010000:00010000:0.0:1789429689.653674:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652000/0xb4c3dad726361b02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c890 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653682:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x27:0x0].0x0 (ffff946f120fd000) 00010000:00010000:0.0:1789429689.653692:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1400/0xb4c3dad726361893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x88:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7d3 expref: 26 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653703:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547e00/0xb4c3dad726361815 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x88:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c7a9 expref: 25 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653712:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x88:0x0].0x0 (ffff946f051ef100) 00010000:00010000:0.0:1789429689.653722:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f01652c00/0xb4c3dad726361789 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x86:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c77f expref: 24 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653730:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:0.0:1789429689.653735:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad726361663 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x85:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c71d expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653744:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x85:0x0].0x0 (ffff946f120fde00) 00010000:00010000:0.0:1789429689.653753:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263616a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x86:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c732 expref: 22 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653761:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x86:0x0].0x0 (ffff946f120fdb00) 00010000:00010000:0.0:1789429689.653769:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0600/0xb4c3dad7263615d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x84:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6ec expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653780:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00030400/0xb4c3dad72636157c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x84:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6c9 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653790:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x84:0x0].0x0 (ffff946f2076a900) 00010000:00010000:0.0:1789429689.653800:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f00031600/0xb4c3dad72636153d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x83:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c6b4 expref: 19 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653808:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x83:0x0].0x0 (ffff946f2076a600) 00010000:00010000:0.0:1789429689.653817:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7e00/0xb4c3dad7263614a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x82:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c683 expref: 18 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653826:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x82:0x0].0x0 (ffff946f2076a800) 00010000:00010000:0.0:1789429689.653836:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c0200/0xb4c3dad726361487 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x81:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c67c expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653845:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x81:0x0].0x0 (ffff946f08640000) 00010000:00010000:0.0:1789429689.653854:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f119c1a00/0xb4c3dad72636138b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x80:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c62f expref: 16 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653862:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x80:0x0].0x0 (ffff946f08640b00) 00010000:00010000:0.0:1789429689.653874:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac600/0xb4c3dad72636130d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5fe expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653882:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7f:0x0].0x0 (ffff946f120fd400) 00010000:00010000:0.0:1789429689.653892:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7800/0xb4c3dad72636129d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c5d4 expref: 14 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653901:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7e:0x0].0x0 (ffff946f08640500) 00010000:00010000:0.0:1789429689.653911:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f546a00/0xb4c3dad7263611e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c595 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653923:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac200/0xb4c3dad726361138 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c556 expref: 12 pid: 15669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653933:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7c:0x0].0x0 (ffff946f2076ac00) 00010000:00010000:0.0:1789429689.653942:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6a00/0xb4c3dad7263610eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c541 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653954:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c6400/0xb4c3dad7263610cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c53a expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653961:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7b:0x0].0x0 (ffff946f2076ad00) 00010000:00010000:0.0:1789429689.653970:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f547600/0xb4c3dad726360db8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x78:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c461 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653978:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x78:0x0].0x0 (ffff946f051efb00) 00010000:00010000:0.0:1789429689.653988:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7a00/0xb4c3dad726360d5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x77:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c43e expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.653999:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f344c7200/0xb4c3dad726360d10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x77:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1c429 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429689.654019:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x77:0x0].0x0 (ffff946f2076a300) 00010000:00010000:0.0:1789429689.654026:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789429689.654086:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:5607:x1876351635196800:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 567us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429689.654094:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 275 00000100:00100000:3.0:1789429690.019617:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789429690.019641:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648445184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789429690.019709:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429690.020499:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648445184 00000100:00100000:2.0:1789429690.020508:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648445184 00000100:00100000:2.0:1789429690.020565:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1789429690.020575:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648445184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789429690.020610:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1789429690.020673:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1876351648445184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429690.020680:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1789429690.020726:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3300:1876351648445184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789429690.026417:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648445312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789429690.026504:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429690.028120:0:9195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648445312 00000100:00100000:0.0:1789429690.028146:0:9195:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648445312 00000100:00100000:0.0:1789429690.028232:0:9195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1789429690.028243:0:9195:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648445312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789429690.028285:0:9195:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:0.0:1789429690.028356:0:9195:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648445312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429690.028363:0:9195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1789429690.029011:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648445312:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789429690.599182:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789429691.619873:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789429692.286605:0:29157:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Race attempt 0 00010000:00010000:1.0:1789429692.643396:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789429693.205019:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977270 is committed 00000100:00100000:2.0:1789429693.623843:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1789429693.623875:0:26938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635196928 00000100:00100000:2.0:1789429693.623884:0:26938:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635196928 00000100:00100000:2.0:1789429693.623937:0:26938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21375 00000100:00100000:2.0:1789429693.623947:0:26938:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:12e09781-3d24-4c67-9972-bb781900e20d+5:50472:x1876351635196928:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:2.0:1789429693.623970:0:26938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789429693.623992:0:26938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a000/0xb4c3dad7263622cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ccb8 expref: -99 pid: 26938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429693.624050:0:26938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b800/0xb4c3dad7263622d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429693.624064:0:26938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b800/0xb4c3dad7263622d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429693.624076:0:26938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b800/0xb4c3dad7263622d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26938 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789429693.624121:0:26938:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789429693.624125:0:26938:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789429693.624143:0:26938:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b800/0xb4c3dad7263622d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26938 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429693.624167:0:26938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31a000/0xb4c3dad7263622cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccb8 expref: 7 pid: 26938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429693.624183:0:26938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31b800/0xb4c3dad7263622d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccb8 expref: 6 pid: 26938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789429693.624224:0:26938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:2.0:1789429693.624226:0:26938:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789429693.624230:0:26938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31b800, rc 0) 00000100:00100000:2.0:1789429693.624284:0:26938:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:12e09781-3d24-4c67-9972-bb781900e20d+6:50472:x1876351635196928:12345-192.168.203.39@tcp:101:ls.0 Request processed in 339us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429693.624292:0:26938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21375 00000100:00080000:2.0:1789429693.624312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789429693.670741:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789429693.671172:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429693.672288:0:15669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635197056 00000100:00100000:3.0:1789429693.672300:0:15669:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635197056 00000100:00100000:0.0:1789429693.672614:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21376 00000100:00100000:0.0:1789429693.672630:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+6:50472:x1876351635197056:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:0.0:1789429693.672652:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429693.672671:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263622db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ccbf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.672731:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263622e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.672745:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263622e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.672756:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263622e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.672770:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb40376bb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.672777:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.672784:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673030:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x90:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673039:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x90:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673046:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x90:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789429693.673075:0:5839:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x90:0x0]: returning size 16384 00000004:00200000:0.0:1789429693.673079:0:5839:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789429693.673096:0:5839:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x90:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673116:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263622e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673123:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263622e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673130:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263622e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673135:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ad800 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429693.673139:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263622e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673146:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263622e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673157:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:0.0:1789429693.673160:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429693.673165:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263622e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673171:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad7263622e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673181:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673187:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673193:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673227:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946f3f2ac400 already unused, calling callback (ffffffffc21f74f0) 00010000:00010000:0.0:1789429693.673230:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673236:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673243:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb40376bb (ffff946f120fd400) 00010000:00010000:0.0:1789429693.673245:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789429693.673248:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673253:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb40376bb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673284:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263622db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccbf expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673302:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ade00/0xb4c3dad7263622f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x90:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccbf expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.673309:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x90:0x0].0x0 (ffff946f120fde00) 00010000:00010000:0.0:1789429693.673311:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789429693.673314:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ade00, rc 0) 00000100:00100000:0.0:1789429693.673780:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+7:50472:x1876351635197056:12345-192.168.203.39@tcp:101:ls.0 Request processed in 1153us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429693.673788:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21376 00000100:00100000:1.0:1789429693.693528:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429693.694821:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635197184 00000100:00100000:0.0:1789429693.694833:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635197184 00000100:00100000:0.0:1789429693.694982:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21377 00000100:00100000:0.0:1789429693.694993:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+7:50472:x1876351635197184:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:0.0:1789429693.695015:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429693.695036:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263622f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ccc6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.695071:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x90:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.695084:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x90:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.695095:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x90:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.695195:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad7263622f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x90:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccc6 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.695235:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac400/0xb4c3dad7263622fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x90:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccc6 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.695243:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x90:0x0].0x0 (ffff946f120fde00) 00010000:00010000:0.0:1789429693.695246:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789429693.695249:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ac400, rc 0) 00000100:00100000:0.0:1789429693.695306:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12e09781-3d24-4c67-9972-bb781900e20d+8:50472:x1876351635197184:12345-192.168.203.39@tcp:101:ls.0 Request processed in 315us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429693.695313:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21377 00000100:00100000:1.0:1789429693.711139:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429693.711470:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635197440 00000100:00100000:3.0:1789429693.711480:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635197440 00000100:00100000:3.0:1789429693.711543:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21378 00000100:00100000:3.0:1789429693.711553:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+8:50472:x1876351635197440:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:3.0:1789429693.711573:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789429693.711602:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ca00/0xb4c3dad726362305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1cccd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789429693.711907:0:5841:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x90:0x0]: returning size 16384 00010000:00010000:3.0:1789429693.712145:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ca00/0xb4c3dad726362305 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cccd expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429693.713024:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:3.0:1789429693.713027:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789429693.713034:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f2f31ca00/0xb4c3dad726362305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1cccd expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789429693.713054:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f2f31ca00, rc 0) 00000100:00100000:3.0:1789429693.713164:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12e09781-3d24-4c67-9972-bb781900e20d+9:50472:x1876351635197440:12345-192.168.203.39@tcp:101:ls.0 Request processed in 1612us (2034us total) trans 4294977271 rc 301/301 00000100:00100000:3.0:1789429693.713172:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21378 00000100:00100000:3.0:1789429693.744732:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429693.745189:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635197568 00000100:00100000:1.0:1789429693.745218:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635197568 00000100:00100000:1.0:1789429693.745267:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 298 00000100:00100000:1.0:1789429693.745277:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946e0265df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:50472:x1876351635197568:12345-192.168.203.39@tcp:37:ls.0 00000100:00100000:3.0:1789429693.755662:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946e0265df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12e09781-3d24-4c67-9972-bb781900e20d+9:50472:x1876351635197568:12345-192.168.203.39@tcp:37:ls.0 Request processed in 10376us (10928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429693.755676:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 298 00000100:00100000:1.0:1789429693.779295:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1789429693.779424:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635197696 00000100:00100000:0.0:1789429693.779435:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635197696 00000100:00100000:0.0:1789429693.779496:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21379 00000100:00100000:0.0:1789429693.779508:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+9:50472:x1876351635197696:12345-192.168.203.39@tcp:101:ls.0 00010000:00010000:0.0:1789429693.779528:0:15700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789429693.779547:0:15700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726362313 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2feb8b2bbe1ccd4 expref: -99 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.779581:0:15700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636231a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.779595:0:15700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636231a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.779607:0:15700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636231a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.779693:0:15700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ac800/0xb4c3dad726362313 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccd4 expref: 11 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.779710:0:15700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946f3f2ad800/0xb4c3dad72636231a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xb2feb8b2bbe1ccd4 expref: 10 pid: 15700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789429693.779718:0:15700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946f051eff00) 00010000:00010000:0.0:1789429693.779722:0:15700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789429693.779725:0:15700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946f3f2ad800, rc 0) 00000100:00100000:0.0:1789429693.779786:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12e09781-3d24-4c67-9972-bb781900e20d+10:50472:x1876351635197696:12345-192.168.203.39@tcp:101:ls.0 Request processed in 281us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429693.779794:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21379 00000100:00100000:2.0:1789429693.790812:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429693.790925:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635197952 00000100:00100000:1.0:1789429693.790935:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635197952 00000100:00100000:1.0:1789429693.790989:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 299 00000100:00100000:1.0:1789429693.790999:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+10:50472:x1876351635197952:12345-192.168.203.39@tcp:35:ls.0 00000100:00100000:1.0:1789429693.791248:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:12e09781-3d24-4c67-9972-bb781900e20d+11:50472:x1876351635197952:12345-192.168.203.39@tcp:35:ls.0 Request processed in 249us (443us total) trans 4294977272 rc 0/0 00000100:00100000:1.0:1789429693.791256:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 299 00000100:00100000:1.0:1789429694.233599:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429694.233637:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429694.233667:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1789429694.233706:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1789429694.233794:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635198336 00000100:00100000:3.0:1789429694.233804:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635198336 00000100:00100000:3.0:1789429694.233860:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635198208 00000100:00100000:3.0:1789429694.233862:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635198208 00000100:00100000:3.0:1789429694.233881:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1077 00000100:00100000:3.0:1789429694.233889:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635198336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429694.233970:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+5:2371:x1876351635198336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 82us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429694.233977:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1077 00000100:00100000:3.0:1789429694.233991:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1078 00000100:00100000:3.0:1789429694.233996:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351635198208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1789429694.234017:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:12e09781-3d24-4c67-9972-bb781900e20d+11:2371:x1876351635198208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429694.234022:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1078 00000100:00080000:1.0:1789429694.234076:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429694.234396:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635198464 00000100:00100000:2.0:1789429694.234401:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635198464 00000100:00100000:2.0:1789429694.234452:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1086 00000100:00080000:1.0:1789429694.234453:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789429694.234462:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635198464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1789429694.234497:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c0ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:217af837-ec0e-4ad4-94fa-9fc2e0e9f711+6:2371:x1876351635198464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 38us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429694.234505:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1086 00000100:00100000:0.0:1789429694.234952:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351635198080 00000100:00100000:0.0:1789429694.234957:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351635198080 00000100:00100000:0.0:1789429694.235008:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 681 00000100:00100000:0.0:1789429694.235016:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635198080:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1789429694.235060:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a53c0ec7-b7fd-49b8-a62f-d965af6e7f71+13:2371:x1876351635198080:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 40us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429694.235068:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 681 00000100:00100000:1.0:1789429694.627525:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648445696:0@lo:400:kworker.0 00000100:00100000:1.0:1789429694.627592:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429694.627645:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789429694.627652:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648445568:0@lo:400:kworker.0 00000100:00100000:1.0:1789429694.627675:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429694.627692:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648446080:0@lo:400:kworker.0 00000100:00100000:1.0:1789429694.627715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789429694.627745:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648445696 00000100:00100000:1.0:1789429694.627752:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648445696 00000100:00100000:1.0:1789429694.627799:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648445568 00000100:00100000:1.0:1789429694.627803:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648445568 00000100:00100000:1.0:1789429694.627825:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1789429694.627833:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648445696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789429694.627881:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876351648445696:12345-0@lo:400:kworker.0 Request processed in 48us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429694.627888:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1789429694.627905:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:1.0:1789429694.627910:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648445568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429694.628020:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648446080 00000100:00100000:0.0:1789429694.628025:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648446080 00000100:00100000:0.0:1789429694.628056:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1789429694.628062:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f415c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648446080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429694.628106:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648446080:12345-0@lo:400:kworker.0 Request processed in 34us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429694.628112:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00080000:0.0:1789429694.628134:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429694.628138:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789429694.628174:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648446080:0@lo:400:kworker.0 00000100:00100000:0.0:1789429694.628184:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3301:1876351648445696:0@lo:400:kworker.0 00000100:00100000:2.0:1789429694.628295:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648445440:0@lo:400:kworker.0 00000100:00100000:2.0:1789429694.628329:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429694.628365:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648445952:0@lo:400:kworker.0 00000100:00100000:2.0:1789429694.628388:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429694.628408:0:3299:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789429694.628414:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f0879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648445824:0@lo:400:kworker.0 00000100:00100000:2.0:1789429694.628434:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789429694.628460:0:15700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648445952 00000100:00100000:2.0:1789429694.628464:0:15700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648445952 00000100:00100000:2.0:1789429694.628494:0:15700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1789429694.628500:0:15700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648445952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429694.628534:0:15700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1876351648445952:12345-0@lo:400:kworker.0 Request processed in 34us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429694.628540:0:15700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1789429694.628559:0:27100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648445824 00000100:00100000:2.0:1789429694.628562:0:27100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648445824 00000100:00100000:2.0:1789429694.628587:0:27100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1789429694.628593:0:27100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648445824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789429694.628621:0:27100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f054d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3299:x1876351648445824:12345-0@lo:400:kworker.0 Request processed in 29us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789429694.628626:0:27100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00080000:2.0:1789429694.628642:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429694.628645:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789429694.628660:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3299:1876351648445824:0@lo:400:kworker.0 00000100:00100000:2.0:1789429694.628669:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3299:1876351648445952:0@lo:400:kworker.0 00000100:00100000:1.0:1789429694.628765:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f415c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876351648445568:12345-0@lo:400:kworker.0 Request processed in 854us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789429694.628771:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1789429694.628826:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648445440 00000100:00100000:0.0:1789429694.628830:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648445440 00000100:00100000:0.0:1789429694.628862:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1789429694.628869:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f1c3a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648445440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789429694.628901:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f1c3a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f707fd14-3f5b-497f-8cdc-5c28f42c6a66+19:3299:x1876351648445440:12345-0@lo:400:kworker.0 Request processed in 33us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789429694.628908:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1789429694.629164:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f1c0a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f707fd14-3f5b-497f-8cdc-5c28f42c6a66:3299:1876351648445440:0@lo:400:kworker.0 00000100:00100000:2.0:1789429694.629191:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f0879ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876351648445568:0@lo:400:kworker.0 00010000:00010000:0.0:1789429694.692127:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789429695.139924:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946f3f2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648446208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789429695.139994:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789429695.143031:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff946e0265e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648446336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429695.143110:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789429695.143627:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648446208 00000100:00100000:3.0:1789429695.143637:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648446208 00000100:00100000:3.0:1789429695.143681:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876351648446336 00000100:00100000:3.0:1789429695.143684:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876351648446336 00000100:00100000:3.0:1789429695.143701:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1789429695.143710:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648446208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789429695.143744:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43974656 pending 0 free 3855613952 avail 3853516800 00000100:00100000:3.0:1789429695.143797:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1876351648446208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (3802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429695.143804:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1789429695.143821:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1789429695.143827:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff946f3f2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648446336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789429695.143845:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40566784 pending 0 free 3828350976 avail 3826253824 00000100:00100000:3.0:1789429695.152278:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff946f3f2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1876351648446336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8442us (9160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789429695.152291:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789429695.158877:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946e0265e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3298:1876351648446336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789429695.163937:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff946f3f2e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3301:1876351648446208:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789429695.699802:0:29293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Wait for 50453 50472 for 60 sec... 00000100:00080000:2.0:1789429696.030004:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429696.057027:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429696.058269:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x37:0x0], index 1: 0 00000004:00080000:0.0:1789429696.083359:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3b:0x0], index 0: 0 00000004:00080000:2.0:1789429696.110707:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x38:0x0], index 1: 0 00000004:00080000:3.0:1789429696.128998:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3c:0x0], index 0: 0 00000004:00080000:2.0:1789429696.152849:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x39:0x0], index 1: 0 00000004:00080000:2.0:1789429696.161752:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3d:0x0], index 0: 0 00000004:00080000:3.0:1789429696.174731:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3a:0x0], index 1: 0 00000004:00080000:2.0:1789429696.192863:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3e:0x0], index 0: 0 00000004:00080000:0.0:1789429696.225625:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3b:0x0], index 1: 0 00000004:00080000:0.0:1789429696.254814:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3f:0x0], index 0: 0 00000004:00080000:2.0:1789429696.289316:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3c:0x0], index 1: 0 00000004:00080000:3.0:1789429696.297757:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x40:0x0], index 0: 0 00000004:00080000:2.0:1789429696.326247:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3d:0x0], index 1: 0 00000004:00080000:2.0:1789429696.350376:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41:0x0], index 0: 0 00000004:00080000:1.0:1789429696.366895:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3e:0x0], index 1: 0 00000004:00080000:2.0:1789429696.390600:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00000004:00080000:3.0:1789429696.410566:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3f:0x0], index 1: 0 00000004:00080000:2.0:1789429696.422154:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x43:0x0], index 0: 0 00000004:00080000:2.0:1789429696.435818:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x40:0x0], index 1: 0 00000004:00080000:3.0:1789429696.454098:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x44:0x0], index 0: 0 00000004:00080000:2.0:1789429696.471126:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41:0x0], index 1: 0 00000004:00080000:2.0:1789429696.489975:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x45:0x0], index 0: 0 00000004:00080000:2.0:1789429696.530956:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42:0x0], index 1: 0 00000004:00080000:1.0:1789429696.561101:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46:0x0], index 0: 0 00000004:00080000:0.0:1789429696.584952:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x43:0x0], index 1: 0 00000004:00080000:0.0:1789429696.613842:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x47:0x0], index 0: 0 00000004:00080000:2.0:1789429696.630134:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x44:0x0], index 1: 0 00000004:00080000:2.0:1789429696.642053:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x48:0x0], index 0: 0 00000004:00080000:1.0:1789429696.652009:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x45:0x0], index 1: 0 00000004:00080000:1.0:1789429696.671655:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x49:0x0], index 0: 0 00000004:00080000:0.0:1789429696.686379:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46:0x0], index 1: 0 00000004:00080000:0.0:1789429696.702635:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a:0x0], index 0: 0 00000004:00080000:2.0:1789429696.722827:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x47:0x0], index 1: 0 00000004:00080000:0.0:1789429696.764787:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4b:0x0], index 0: 0 00000004:00080000:2.0:1789429696.784590:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x48:0x0], index 1: 0 00000004:00080000:0.0:1789429696.822809:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c:0x0], index 0: 0 00000004:00080000:0.0:1789429696.841583:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x49:0x0], index 1: 0 00000004:00080000:1.0:1789429696.853601:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d:0x0], index 0: 0 00000004:00080000:2.0:1789429696.866060:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a:0x0], index 1: 0 00000004:00080000:1.0:1789429696.878478:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e:0x0], index 0: 0 00000004:00080000:2.0:1789429696.897950:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b:0x0], index 1: 0 00000004:00080000:0.0:1789429696.911325:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f:0x0], index 0: 0 00000004:00080000:1.0:1789429696.929432:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c:0x0], index 1: 0 00000004:00080000:2.0:1789429696.943023:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50:0x0], index 0: 0 00000004:00080000:2.0:1789429696.959844:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d:0x0], index 1: 0 00000004:00080000:0.0:1789429696.975683:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51:0x0], index 0: 0 00000004:00080000:0.0:1789429696.988049:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e:0x0], index 1: 0 00000004:00080000:1.0:1789429696.997699:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x52:0x0], index 0: 0 00002000:00080000:1.0:1789429697.000156:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 98 00000100:00080000:2.0:1789429697.003640:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789429697.026436:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f:0x0], index 1: 0 00000004:00080000:2.0:1789429697.038522:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x53:0x0], index 0: 0 00000004:00080000:0.0:1789429697.045257:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x53:0x0]-[0x240000400:0x81:0x0] 00000004:00080000:1.0:1789429697.051395:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50:0x0], index 1: 0 00000004:00080000:0.0:1789429697.061884:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x54:0x0], index 0: 0 00000004:00080000:1.0:1789429697.075859:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51:0x0], index 1: 0 00000004:00080000:1.0:1789429697.086633:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x55:0x0], index 0: 0 00000004:00080000:1.0:1789429697.106056:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x52:0x0], index 1: 0 00002000:00080000:3.0:1789429697.112607:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 98 00000100:00080000:2.0:1789429697.118937:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429697.128299:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x56:0x0], index 0: 0 00000004:00080000:3.0:1789429697.148608:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x52:0x0]-[0x280000400:0x81:0x0] 00000004:00080000:2.0:1789429697.150514:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x53:0x0], index 1: 0 00000004:00080000:0.0:1789429697.163612:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x57:0x0], index 0: 0 00000004:00080000:0.0:1789429697.174415:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x54:0x0], index 1: 0 00000004:00080000:2.0:1789429697.184561:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x58:0x0], index 0: 0 00000004:00080000:3.0:1789429697.199986:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x55:0x0], index 1: 0 00000004:00080000:0.0:1789429697.241805:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x59:0x0], index 0: 0 00000004:00080000:3.0:1789429697.258673:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x56:0x0], index 1: 0 00000004:00080000:3.0:1789429697.275054:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a:0x0], index 0: 0 00000004:00080000:3.0:1789429697.291663:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x57:0x0], index 1: 0 00000004:00080000:3.0:1789429697.301956:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b:0x0], index 0: 0 00000004:00080000:2.0:1789429697.313560:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x58:0x0], index 1: 0 00000001:00080000:3.0:1789429697.316667:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969609 is committed 00000004:00080000:1.0:1789429697.327058:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c:0x0], index 0: 0 00000004:00080000:3.0:1789429697.336464:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x59:0x0], index 1: 0 00000004:00080000:3.0:1789429697.354705:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d:0x0], index 0: 0 00000004:00080000:1.0:1789429697.378566:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a:0x0], index 1: 0 00000004:00080000:2.0:1789429697.394692:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e:0x0], index 0: 0 00000004:00080000:3.0:1789429697.418639:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b:0x0], index 1: 0 00000004:00080000:3.0:1789429697.426744:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f:0x0], index 0: 0 00000004:00080000:1.0:1789429697.461670:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c:0x0], index 1: 0 00000004:00080000:2.0:1789429697.474869:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60:0x0], index 0: 0 00000004:00080000:0.0:1789429697.513286:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d:0x0], index 1: 0 00000004:00080000:0.0:1789429697.524811:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x61:0x0], index 0: 0 00000004:00080000:3.0:1789429697.540797:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e:0x0], index 1: 0 00000004:00080000:1.0:1789429697.556856:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x62:0x0], index 0: 0 00000004:00080000:2.0:1789429697.582071:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f:0x0], index 1: 0 00000004:00080000:0.0:1789429697.596973:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x63:0x0], index 0: 0 00000004:00080000:3.0:1789429697.607713:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60:0x0], index 1: 0 00000004:00080000:2.0:1789429697.627196:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x64:0x0], index 0: 0 00000004:00080000:1.0:1789429697.642800:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x61:0x0], index 1: 0 00000004:00080000:0.0:1789429697.658352:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x65:0x0], index 0: 0 00000004:00080000:2.0:1789429697.669374:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x62:0x0], index 1: 0 00000004:00080000:0.0:1789429697.679819:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x66:0x0], index 0: 0 00000004:00080000:2.0:1789429697.691526:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x63:0x0], index 1: 0 00000004:00080000:1.0:1789429697.703603:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x67:0x0], index 0: 0 00000004:00080000:0.0:1789429697.712632:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x64:0x0], index 1: 0 00000004:00080000:0.0:1789429697.730862:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x68:0x0], index 0: 0 00000004:00080000:1.0:1789429697.747498:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x65:0x0], index 1: 0 00000004:00080000:2.0:1789429697.763367:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x69:0x0], index 0: 0 00000004:00080000:1.0:1789429697.786827:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x66:0x0], index 1: 0 00000004:00080000:0.0:1789429697.804890:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6a:0x0], index 0: 0 00000004:00080000:1.0:1789429697.818068:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x67:0x0], index 1: 0 00000004:00080000:0.0:1789429697.849581:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6b:0x0], index 0: 0 00000004:00080000:2.0:1789429697.863103:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x68:0x0], index 1: 0 00000004:00080000:3.0:1789429697.878289:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6c:0x0], index 0: 0 00000004:00080000:1.0:1789429697.907884:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x69:0x0], index 1: 0 00000004:00080000:2.0:1789429697.924957:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6d:0x0], index 0: 0 00000004:00080000:3.0:1789429697.945631:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6a:0x0], index 1: 0 00000004:00080000:3.0:1789429697.964768:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6e:0x0], index 0: 0 00000004:00080000:0.0:1789429697.989572:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6b:0x0], index 1: 0 00000004:00080000:1.0:1789429698.016016:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6f:0x0], index 0: 0 00000100:00080000:2.0:1789429698.017044:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429698.029889:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6c:0x0], index 1: 0 00000004:00080000:1.0:1789429698.078385:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x70:0x0], index 0: 0 00000004:00080000:2.0:1789429698.100591:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6d:0x0], index 1: 0 00000004:00080000:1.0:1789429698.129724:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x71:0x0], index 0: 0 00000004:00080000:3.0:1789429698.141786:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6e:0x0], index 1: 0 00000004:00080000:3.0:1789429698.161419:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x72:0x0], index 0: 0 00002000:00080000:1.0:1789429698.162022:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 130 00000100:00080000:2.0:1789429698.164613:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429698.165845:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x72:0x0]-[0x240000400:0xa1:0x0] 00000004:00080000:1.0:1789429698.174040:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6f:0x0], index 1: 0 00000004:00080000:0.0:1789429698.191345:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73:0x0], index 0: 0 00000004:00080000:1.0:1789429698.202609:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x70:0x0], index 1: 0 00000004:00080000:3.0:1789429698.228449:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x74:0x0], index 0: 0 00000004:00080000:0.0:1789429698.243645:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71:0x0], index 1: 0 00000001:00080000:1.0:1789429698.258698:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977499 is committed 00000001:00080000:1.0:1789429698.258830:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977502 is committed 00000001:00080000:1.0:1789429698.259192:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294977272 is committed 00000004:00080000:2.0:1789429698.268691:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x75:0x0], index 0: 0 00002000:00080000:2.0:1789429698.293450:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 130 00000004:00080000:3.0:1789429698.298839:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x72:0x0], index 1: 0 00000004:00080000:2.0:1789429698.314114:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x76:0x0], index 0: 0 00000004:00080000:0.0:1789429698.326852:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x72:0x0]-[0x280000400:0xa1:0x0] 00000004:00080000:3.0:1789429698.339471:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x73:0x0], index 1: 0 00000004:00080000:3.0:1789429698.368337:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x77:0x0], index 0: 0 00000004:00080000:0.0:1789429698.382026:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x74:0x0], index 1: 0 00000004:00080000:3.0:1789429698.400705:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x78:0x0], index 0: 0 00000004:00080000:3.0:1789429698.413839:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x75:0x0], index 1: 0 00000004:00080000:3.0:1789429698.427726:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x79:0x0], index 0: 0 00000004:00080000:0.0:1789429698.442389:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x76:0x0], index 1: 0 00000004:00080000:0.0:1789429698.452863:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7a:0x0], index 0: 0 00000004:00080000:2.0:1789429698.465505:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x77:0x0], index 1: 0 00000004:00080000:3.0:1789429698.477825:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7b:0x0], index 0: 0 00000004:00080000:3.0:1789429698.489586:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x78:0x0], index 1: 0 00000004:00080000:2.0:1789429698.514047:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7c:0x0], index 0: 0 00000004:00080000:1.0:1789429698.526677:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x79:0x0], index 1: 0 00000004:00080000:0.0:1789429698.553830:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7d:0x0], index 0: 0 00000004:00080000:3.0:1789429698.573927:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7a:0x0], index 1: 0 00000004:00080000:2.0:1789429698.598849:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7e:0x0], index 0: 0 00000004:00080000:2.0:1789429698.613777:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7b:0x0], index 1: 0 00000004:00080000:2.0:1789429698.629087:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7f:0x0], index 0: 0 00000004:00080000:0.0:1789429698.637341:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7c:0x0], index 1: 0 00000004:00080000:3.0:1789429698.644975:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x80:0x0], index 0: 0 00000004:00080000:2.0:1789429698.652275:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7d:0x0], index 1: 0 00000004:00080000:2.0:1789429698.658927:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81:0x0], index 0: 0 00000004:00080000:1.0:1789429698.668312:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7e:0x0], index 1: 0 00000004:00080000:2.0:1789429698.680790:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x82:0x0], index 0: 0 00000004:00080000:3.0:1789429698.699137:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7f:0x0], index 1: 0 00000004:00080000:2.0:1789429698.711050:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x83:0x0], index 0: 0 00000004:00080000:1.0:1789429698.718842:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x80:0x0], index 1: 0 00000004:00080000:3.0:1789429698.725163:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x84:0x0], index 0: 0 00000004:00080000:1.0:1789429698.741931:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x81:0x0], index 1: 0 00000004:00080000:1.0:1789429698.751718:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x85:0x0], index 0: 0 00000004:00080000:1.0:1789429698.758843:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x82:0x0], index 1: 0 00000004:00080000:2.0:1789429698.771840:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x86:0x0], index 0: 0 00000004:00080000:3.0:1789429698.783355:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x83:0x0], index 1: 0 00000004:00080000:1.0:1789429698.802300:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x87:0x0], index 0: 0 00000001:00080000:0.0:1789429698.805326:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969584 is committed 00000001:00080000:0.0:1789429698.805355:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969585 is committed 00000004:00080000:2.0:1789429698.820714:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x84:0x0], index 1: 0 00000004:00080000:1.0:1789429698.839555:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x88:0x0], index 0: 0 00000004:00080000:1.0:1789429698.851077:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x85:0x0], index 1: 0 00000004:00080000:3.0:1789429698.867250:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x89:0x0], index 0: 0 00000004:00080000:1.0:1789429698.882906:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x86:0x0], index 1: 0 00000004:00080000:2.0:1789429698.918119:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8a:0x0], index 0: 0 00000004:00080000:2.0:1789429698.940545:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x87:0x0], index 1: 0 00000004:00080000:1.0:1789429698.960575:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8b:0x0], index 0: 0 00000004:00080000:1.0:1789429698.977600:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x88:0x0], index 1: 0 00000004:00080000:1.0:1789429698.988704:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8c:0x0], index 0: 0 00000004:00080000:1.0:1789429699.008742:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x89:0x0], index 1: 0 00000004:00080000:2.0:1789429699.026912:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8d:0x0], index 0: 0 00000004:00080000:2.0:1789429699.050687:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8a:0x0], index 1: 0 00000004:00080000:1.0:1789429699.078416:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8e:0x0], index 0: 0 00000004:00080000:2.0:1789429699.086776:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8b:0x0], index 1: 0 00000004:00080000:1.0:1789429699.095493:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x8f:0x0], index 0: 0 00000004:00080000:2.0:1789429699.102003:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8c:0x0], index 1: 0 00000004:00080000:2.0:1789429699.119459:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x90:0x0], index 0: 0 00000004:00080000:0.0:1789429699.131756:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8d:0x0], index 1: 0 00000004:00080000:1.0:1789429699.142252:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x91:0x0], index 0: 0 00000004:00080000:1.0:1789429699.177533:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8e:0x0], index 1: 0 00000004:00080000:1.0:1789429699.194381:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x92:0x0], index 0: 0 00002000:00080000:3.0:1789429699.195695:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 162 00000004:00080000:2.0:1789429699.217130:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x8f:0x0], index 1: 0 00000004:00080000:0.0:1789429699.226447:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x92:0x0]-[0x240000400:0xc1:0x0] 00000004:00080000:0.0:1789429699.232172:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x93:0x0], index 0: 0 00000004:00080000:1.0:1789429699.251393:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x90:0x0], index 1: 0 00000004:00080000:1.0:1789429699.264652:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x94:0x0], index 0: 0 00000004:00080000:2.0:1789429699.278720:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x91:0x0], index 1: 0 00000004:00080000:0.0:1789429699.299571:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x95:0x0], index 0: 0 00000004:00080000:1.0:1789429699.310676:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x92:0x0], index 1: 0 00002000:00080000:2.0:1789429699.311303:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 162 00000100:00080000:0.0:1789429699.312173:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789429699.314131:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x92:0x0]-[0x280000400:0xc1:0x0] 00000004:00080000:1.0:1789429699.328244:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x96:0x0], index 0: 0 00000004:00080000:1.0:1789429699.336163:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x93:0x0], index 1: 0 00000004:00080000:2.0:1789429699.348685:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x97:0x0], index 0: 0 00000100:00080000:2.0:1789429699.352015:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429699.352417:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429699.361500:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x94:0x0], index 1: 0 00000004:00080000:1.0:1789429699.374075:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x98:0x0], index 0: 0 00000004:00080000:2.0:1789429699.385588:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x95:0x0], index 1: 0 00000004:00080000:2.0:1789429699.398124:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x99:0x0], index 0: 0 00000004:00080000:1.0:1789429699.409161:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x96:0x0], index 1: 0 00000004:00080000:2.0:1789429699.430436:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x9a:0x0], index 0: 0 00000004:00080000:2.0:1789429699.442944:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x97:0x0], index 1: 0 00000004:00080000:1.0:1789429699.452313:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x9b:0x0], index 0: 0 00000004:00080000:0.0:1789429699.467163:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x98:0x0], index 1: 0 00000004:00080000:1.0:1789429699.480554:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x9c:0x0], index 0: 0 00000004:00080000:2.0:1789429699.491073:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x99:0x0], index 1: 0 00000004:00080000:2.0:1789429699.500902:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x9d:0x0], index 0: 0 00000004:00080000:2.0:1789429699.512821:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x9a:0x0], index 1: 0 00000004:00080000:2.0:1789429699.531434:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x9e:0x0], index 0: 0 00000004:00080000:0.0:1789429699.548252:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x9b:0x0], index 1: 0 00000004:00080000:1.0:1789429699.572922:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x9f:0x0], index 0: 0 00000004:00080000:1.0:1789429699.585613:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x9c:0x0], index 1: 0 00000004:00080000:0.0:1789429699.594861:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa0:0x0], index 0: 0 00000004:00080000:1.0:1789429699.610832:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x9d:0x0], index 1: 0 00000004:00080000:1.0:1789429699.636252:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa1:0x0], index 0: 0 00000004:00080000:1.0:1789429699.651123:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x9e:0x0], index 1: 0 00000004:00080000:2.0:1789429699.682509:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa2:0x0], index 0: 0 00000004:00080000:2.0:1789429699.694155:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x9f:0x0], index 1: 0 00000004:00080000:1.0:1789429699.708595:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa3:0x0], index 0: 0 00000004:00080000:2.0:1789429699.726151:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa0:0x0], index 1: 0 00000004:00080000:1.0:1789429699.736021:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa4:0x0], index 0: 0 00000004:00080000:2.0:1789429699.747699:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa1:0x0], index 1: 0 00000100:00080000:1.0:1789429699.750051:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429699.766379:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa5:0x0], index 0: 0 00000004:00080000:0.0:1789429699.776760:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa2:0x0], index 1: 0 00000004:00080000:3.0:1789429699.789539:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa6:0x0], index 0: 0 00000004:00080000:0.0:1789429699.803842:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa3:0x0], index 1: 0 00000004:00080000:1.0:1789429699.816407:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa7:0x0], index 0: 0 00000004:00080000:3.0:1789429699.832823:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa4:0x0], index 1: 0 00000004:00080000:2.0:1789429699.843362:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa8:0x0], index 0: 0 00000004:00080000:3.0:1789429699.857725:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa5:0x0], index 1: 0 00000004:00080000:0.0:1789429699.868831:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa9:0x0], index 0: 0 00000004:00080000:2.0:1789429699.881368:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa6:0x0], index 1: 0 00000004:00080000:3.0:1789429699.889443:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xaa:0x0], index 0: 0 00000004:00080000:3.0:1789429699.898732:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa7:0x0], index 1: 0 00000004:00080000:0.0:1789429699.909398:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xab:0x0], index 0: 0 00000004:00080000:2.0:1789429699.920048:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa8:0x0], index 1: 0 00000004:00080000:2.0:1789429699.934437:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xac:0x0], index 0: 0 00000004:00080000:3.0:1789429699.947717:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa9:0x0], index 1: 0 00000004:00080000:3.0:1789429699.965088:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xad:0x0], index 0: 0 00000004:00080000:2.0:1789429699.997074:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xaa:0x0], index 1: 0 00000100:00080000:2.0:1789429700.015484:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429700.049432:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xae:0x0], index 0: 0 00000004:00080000:2.0:1789429700.085618:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xab:0x0], index 1: 0 00000004:00080000:2.0:1789429700.116873:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xaf:0x0], index 0: 0 00000004:00080000:2.0:1789429700.139245:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xac:0x0], index 1: 0 00000004:00080000:0.0:1789429700.159138:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb0:0x0], index 0: 0 00000004:00080000:2.0:1789429700.189710:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xad:0x0], index 1: 0 00000004:00080000:2.0:1789429700.218539:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb1:0x0], index 0: 0 00000004:00080000:1.0:1789429700.238763:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xae:0x0], index 1: 0 00000004:00080000:2.0:1789429700.255333:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb2:0x0], index 0: 0 00000100:00080000:2.0:1789429700.255652:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1789429700.255689:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 194 00000004:00080000:0.0:1789429700.263394:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0xb2:0x0]-[0x240000400:0xe1:0x0] 00000004:00080000:2.0:1789429700.271813:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xaf:0x0], index 1: 0 00000004:00080000:0.0:1789429700.282831:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb3:0x0], index 0: 0 00000004:00080000:0.0:1789429700.309900:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb0:0x0], index 1: 0 00000004:00080000:0.0:1789429700.330696:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb4:0x0], index 0: 0 00000004:00080000:1.0:1789429700.345356:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb1:0x0], index 1: 0 00000004:00080000:0.0:1789429700.364978:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb5:0x0], index 0: 0 00000004:00080000:2.0:1789429700.384719:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb2:0x0], index 1: 0 00002000:00080000:1.0:1789429700.385349:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 194 00000004:00080000:0.0:1789429700.395936:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0xb2:0x0]-[0x280000400:0xe1:0x0] 00000004:00080000:0.0:1789429700.418194:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb6:0x0], index 0: 0 00000004:00080000:0.0:1789429700.441390:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb3:0x0], index 1: 0 00000004:00080000:0.0:1789429700.457007:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb7:0x0], index 0: 0 00000004:00080000:0.0:1789429700.466468:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb4:0x0], index 1: 0 00000004:00080000:2.0:1789429700.479102:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb8:0x0], index 0: 0 00000004:00080000:0.0:1789429700.497602:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb5:0x0], index 1: 0 00000004:00080000:1.0:1789429700.506046:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xb9:0x0], index 0: 0 00000004:00080000:0.0:1789429700.524914:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb6:0x0], index 1: 0 00000004:00080000:1.0:1789429700.545840:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xba:0x0], index 0: 0 00000004:00080000:2.0:1789429700.566012:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb7:0x0], index 1: 0 00000004:00080000:2.0:1789429700.583001:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xbb:0x0], index 0: 0 00000004:00080000:2.0:1789429700.597618:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb8:0x0], index 1: 0 00000004:00080000:0.0:1789429700.625168:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xbc:0x0], index 0: 0 00000004:00080000:3.0:1789429700.640506:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xb9:0x0], index 1: 0 00000004:00080000:2.0:1789429700.660457:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xbd:0x0], index 0: 0 00000004:00080000:0.0:1789429700.678105:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xba:0x0], index 1: 0 00000004:00080000:2.0:1789429700.694790:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xbe:0x0], index 0: 0 00000004:00080000:1.0:1789429700.710564:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xbb:0x0], index 1: 0 00000004:00080000:1.0:1789429700.723885:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xbf:0x0], index 0: 0 00000004:00080000:2.0:1789429700.739079:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xbc:0x0], index 1: 0 00000004:00080000:2.0:1789429700.765822:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc0:0x0], index 0: 0 00000004:00080000:0.0:1789429700.780922:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xbd:0x0], index 1: 0 00000004:00080000:2.0:1789429700.792749:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc1:0x0], index 0: 0 00000004:00080000:2.0:1789429700.804583:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xbe:0x0], index 1: 0 00000004:00080000:0.0:1789429700.826580:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc2:0x0], index 0: 0 00000004:00080000:0.0:1789429700.841884:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xbf:0x0], index 1: 0 00000004:00080000:2.0:1789429700.857018:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc3:0x0], index 0: 0 00000004:00080000:1.0:1789429700.875844:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc0:0x0], index 1: 0 00000004:00080000:0.0:1789429700.889809:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc4:0x0], index 0: 0 00000004:00080000:3.0:1789429700.917932:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc1:0x0], index 1: 0 00000004:00080000:1.0:1789429700.928916:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc5:0x0], index 0: 0 00000004:00080000:3.0:1789429700.945809:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc2:0x0], index 1: 0 00000004:00080000:0.0:1789429700.956351:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc6:0x0], index 0: 0 00000004:00080000:0.0:1789429700.965856:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc3:0x0], index 1: 0 00000004:00080000:0.0:1789429700.975041:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc7:0x0], index 0: 0 00000004:00080000:2.0:1789429700.986138:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc4:0x0], index 1: 0 00000004:00080000:0.0:1789429700.999701:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc8:0x0], index 0: 0 00000004:00080000:0.0:1789429701.008469:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc5:0x0], index 1: 0 00000004:00080000:1.0:1789429701.032812:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc9:0x0], index 0: 0 00000004:00080000:0.0:1789429701.063309:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc6:0x0], index 1: 0 00000004:00080000:3.0:1789429701.081304:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xca:0x0], index 0: 0 00000004:00080000:0.0:1789429701.090755:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc7:0x0], index 1: 0 00000004:00080000:0.0:1789429701.120027:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcb:0x0], index 0: 0 00000004:00080000:2.0:1789429701.131628:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc8:0x0], index 1: 0 00000004:00080000:0.0:1789429701.152118:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcc:0x0], index 0: 0 00000004:00080000:3.0:1789429701.162726:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc9:0x0], index 1: 0 00000004:00080000:2.0:1789429701.181128:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcd:0x0], index 0: 0 00000004:00080000:0.0:1789429701.207007:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xca:0x0], index 1: 0 00000004:00080000:0.0:1789429701.245512:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xce:0x0], index 0: 0 00000004:00080000:0.0:1789429701.262060:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcb:0x0], index 1: 0 00000004:00080000:3.0:1789429701.271920:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcf:0x0], index 0: 0 00000004:00080000:2.0:1789429701.287697:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcc:0x0], index 1: 0 00000004:00080000:0.0:1789429701.298620:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd0:0x0], index 0: 0 00000004:00080000:0.0:1789429701.308701:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcd:0x0], index 1: 0 00000004:00080000:2.0:1789429701.323756:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd1:0x0], index 0: 0 00000004:00080000:1.0:1789429701.337797:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xce:0x0], index 1: 0 00000004:00080000:3.0:1789429701.350306:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd2:0x0], index 0: 0 00002000:00080000:1.0:1789429701.350959:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 226 00000004:00080000:2.0:1789429701.363135:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0xd2:0x0]-[0x240000400:0x101:0x0] 00000004:00080000:2.0:1789429701.371570:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcf:0x0], index 1: 0 00000004:00080000:0.0:1789429701.382548:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd3:0x0], index 0: 0 00000004:00080000:2.0:1789429701.392099:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd0:0x0], index 1: 0 00000004:00080000:1.0:1789429701.402671:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd4:0x0], index 0: 0 00000004:00080000:0.0:1789429701.414728:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd1:0x0], index 1: 0 00000004:00080000:2.0:1789429701.426630:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd5:0x0], index 0: 0 00000004:00080000:3.0:1789429701.442139:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd2:0x0], index 1: 0 00002000:00080000:1.0:1789429701.443316:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 226 00000100:00080000:2.0:1789429701.444055:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789429701.456919:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0xd2:0x0]-[0x280000400:0x101:0x0] 00000004:00080000:0.0:1789429701.459794:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd6:0x0], index 0: 0 00000004:00080000:1.0:1789429701.478441:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd3:0x0], index 1: 0 00000004:00080000:0.0:1789429701.491029:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd7:0x0], index 0: 0 00000004:00080000:0.0:1789429701.511716:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd4:0x0], index 1: 0 00000004:00080000:3.0:1789429701.529818:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd8:0x0], index 0: 0 00000004:00080000:2.0:1789429701.541425:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd5:0x0], index 1: 0 00000004:00080000:3.0:1789429701.558329:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xd9:0x0], index 0: 0 00000004:00080000:1.0:1789429701.570689:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd6:0x0], index 1: 0 00000004:00080000:3.0:1789429701.590275:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xda:0x0], index 0: 0 00000004:00080000:3.0:1789429701.626392:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd7:0x0], index 1: 0 00000004:00080000:2.0:1789429701.638638:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xdb:0x0], index 0: 0 00000004:00080000:3.0:1789429701.651834:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd8:0x0], index 1: 0 00000004:00080000:1.0:1789429701.664983:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xdc:0x0], index 0: 0 00000004:00080000:2.0:1789429701.681540:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xd9:0x0], index 1: 0 00000004:00080000:3.0:1789429701.701295:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xdd:0x0], index 0: 0 00000004:00080000:2.0:1789429701.717537:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xda:0x0], index 1: 0 00000004:00080000:1.0:1789429701.744430:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xde:0x0], index 0: 0 00000004:00080000:2.0:1789429701.768338:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xdb:0x0], index 1: 0 00000004:00080000:2.0:1789429701.797556:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xdf:0x0], index 0: 0 00000004:00080000:3.0:1789429701.815484:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xdc:0x0], index 1: 0 00000004:00080000:2.0:1789429701.832009:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe0:0x0], index 0: 0 00000004:00080000:2.0:1789429701.844569:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xdd:0x0], index 1: 0 00000004:00080000:0.0:1789429701.856519:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe1:0x0], index 0: 0 00000004:00080000:0.0:1789429701.870519:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xde:0x0], index 1: 0 00000004:00080000:0.0:1789429701.887528:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe2:0x0], index 0: 0 00000004:00080000:3.0:1789429701.899848:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xdf:0x0], index 1: 0 00000004:00080000:2.0:1789429701.909879:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe3:0x0], index 0: 0 00000004:00080000:1.0:1789429701.937197:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe0:0x0], index 1: 0 00000004:00080000:2.0:1789429701.945369:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe4:0x0], index 0: 0 00000004:00080000:0.0:1789429701.958193:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe1:0x0], index 1: 0 00000004:00080000:2.0:1789429701.974876:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe5:0x0], index 0: 0 00000004:00080000:2.0:1789429701.990092:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe2:0x0], index 1: 0 00000100:00080000:2.0:1789429702.005825:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429702.006127:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe6:0x0], index 0: 0 00000004:00080000:2.0:1789429702.028139:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe3:0x0], index 1: 0 00000004:00080000:0.0:1789429702.037493:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe7:0x0], index 0: 0 00000004:00080000:1.0:1789429702.049661:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe4:0x0], index 1: 0 00000004:00080000:1.0:1789429702.057923:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe8:0x0], index 0: 0 00000004:00080000:1.0:1789429702.066193:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe5:0x0], index 1: 0 00000004:00080000:0.0:1789429702.074549:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe9:0x0], index 0: 0 00000004:00080000:0.0:1789429702.087182:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe6:0x0], index 1: 0 00000004:00080000:1.0:1789429702.098995:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xea:0x0], index 0: 0 00000004:00080000:1.0:1789429702.111066:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe7:0x0], index 1: 0 00000004:00080000:1.0:1789429702.136859:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xeb:0x0], index 0: 0 00000004:00080000:1.0:1789429702.147811:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe8:0x0], index 1: 0 00000004:00080000:0.0:1789429702.166014:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xec:0x0], index 0: 0 00000004:00080000:2.0:1789429702.179879:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xe9:0x0], index 1: 0 00000004:00080000:1.0:1789429702.199821:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xed:0x0], index 0: 0 00000004:00080000:0.0:1789429702.215771:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xea:0x0], index 1: 0 00000004:00080000:1.0:1789429702.232408:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xee:0x0], index 0: 0 00000004:00080000:0.0:1789429702.248670:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xeb:0x0], index 1: 0 00000004:00080000:2.0:1789429702.272760:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xef:0x0], index 0: 0 00000004:00080000:1.0:1789429702.286508:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xec:0x0], index 1: 0 00000004:00080000:2.0:1789429702.295880:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf0:0x0], index 0: 0 00000004:00080000:3.0:1789429702.319867:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xed:0x0], index 1: 0 00000004:00080000:0.0:1789429702.350416:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf1:0x0], index 0: 0 00000004:00080000:3.0:1789429702.377572:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xee:0x0], index 1: 0 00002000:00080000:1.0:1789429702.401034:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 258 00000004:00080000:0.0:1789429702.401229:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf2:0x0], index 0: 0 00000100:00080000:2.0:1789429702.401855:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429702.412419:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0xf2:0x0]-[0x240000400:0x121:0x0] 00000004:00080000:0.0:1789429702.427687:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xef:0x0], index 1: 0 00000001:00080000:2.0:1789429702.431124:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969613 is committed 00000004:00080000:2.0:1789429702.461668:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf3:0x0], index 0: 0 00000004:00080000:1.0:1789429702.479447:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf0:0x0], index 1: 0 00000004:00080000:3.0:1789429702.505760:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf4:0x0], index 0: 0 00000004:00080000:0.0:1789429702.513265:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf1:0x0], index 1: 0 00000004:00080000:2.0:1789429702.534275:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf5:0x0], index 0: 0 00002000:00080000:2.0:1789429702.544507:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 258 00000004:00080000:3.0:1789429702.547104:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf2:0x0], index 1: 0 00000004:00080000:1.0:1789429702.560017:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0xf2:0x0]-[0x280000400:0x121:0x0] 00000004:00080000:0.0:1789429702.563246:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf6:0x0], index 0: 0 00000004:00080000:2.0:1789429702.571589:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf3:0x0], index 1: 0 00000004:00080000:3.0:1789429702.582541:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf7:0x0], index 0: 0 00000004:00080000:0.0:1789429702.590408:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf4:0x0], index 1: 0 00000004:00080000:3.0:1789429702.597134:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf8:0x0], index 0: 0 00000004:00080000:1.0:1789429702.610057:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf5:0x0], index 1: 0 00000004:00080000:2.0:1789429702.620660:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf9:0x0], index 0: 0 00000004:00080000:3.0:1789429702.631633:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf6:0x0], index 1: 0 00000004:00080000:0.0:1789429702.640025:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xfa:0x0], index 0: 0 00000004:00080000:0.0:1789429702.648093:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf7:0x0], index 1: 0 00000004:00080000:2.0:1789429702.660418:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xfb:0x0], index 0: 0 00000004:00080000:2.0:1789429702.671713:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf8:0x0], index 1: 0 00000004:00080000:3.0:1789429702.690872:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xfc:0x0], index 0: 0 00000004:00080000:3.0:1789429702.723665:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf9:0x0], index 1: 0 00000004:00080000:1.0:1789429702.733686:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xfd:0x0], index 0: 0 00000004:00080000:2.0:1789429702.744300:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xfa:0x0], index 1: 0 00000004:00080000:2.0:1789429702.758800:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xfe:0x0], index 0: 0 00000004:00080000:3.0:1789429702.771275:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xfb:0x0], index 1: 0 00000004:00080000:3.0:1789429702.781924:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xff:0x0], index 0: 0 00000004:00080000:1.0:1789429702.797516:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xfc:0x0], index 1: 0 00000004:00080000:0.0:1789429702.808878:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x100:0x0], index 0: 0 00000004:00080000:2.0:1789429702.819703:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xfd:0x0], index 1: 0 00000004:00080000:0.0:1789429702.832964:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x101:0x0], index 0: 0 00000004:00080000:0.0:1789429702.849850:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xfe:0x0], index 1: 0 00000004:00080000:0.0:1789429702.857792:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x102:0x0], index 0: 0 00000004:00080000:0.0:1789429702.867423:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xff:0x0], index 1: 0 00000004:00080000:3.0:1789429702.881368:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x103:0x0], index 0: 0 00000004:00080000:0.0:1789429702.891191:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x100:0x0], index 1: 0 00000004:00080000:2.0:1789429702.905775:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x104:0x0], index 0: 0 00000004:00080000:0.0:1789429702.915904:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x101:0x0], index 1: 0 00000004:00080000:0.0:1789429702.926409:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x105:0x0], index 0: 0 00000004:00080000:3.0:1789429702.933651:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x102:0x0], index 1: 0 00000004:00080000:0.0:1789429702.943024:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x106:0x0], index 0: 0 00000004:00080000:1.0:1789429702.953720:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x103:0x0], index 1: 0 00000004:00080000:2.0:1789429702.967113:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x107:0x0], index 0: 0 00000004:00080000:1.0:1789429702.976748:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x104:0x0], index 1: 0 00000004:00080000:3.0:1789429702.986095:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x108:0x0], index 0: 0 00000004:00080000:2.0:1789429702.995193:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x105:0x0], index 1: 0 00000004:00080000:1.0:1789429703.004118:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x109:0x0], index 0: 0 00000004:00080000:2.0:1789429703.014304:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x106:0x0], index 1: 0 00000004:00080000:2.0:1789429703.023463:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10a:0x0], index 0: 0 00000004:00080000:2.0:1789429703.036451:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x107:0x0], index 1: 0 00000004:00080000:1.0:1789429703.046386:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10b:0x0], index 0: 0 00000004:00080000:2.0:1789429703.055038:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x108:0x0], index 1: 0 00000004:00080000:2.0:1789429703.064023:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10c:0x0], index 0: 0 00000004:00080000:2.0:1789429703.077695:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x109:0x0], index 1: 0 00000004:00080000:2.0:1789429703.088335:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10d:0x0], index 0: 0 00000004:00080000:1.0:1789429703.097250:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10a:0x0], index 1: 0 00000004:00080000:2.0:1789429703.107061:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10e:0x0], index 0: 0 00000004:00080000:0.0:1789429703.115855:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10b:0x0], index 1: 0 00000004:00080000:2.0:1789429703.122705:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10f:0x0], index 0: 0 00000004:00080000:3.0:1789429703.131486:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10c:0x0], index 1: 0 00000004:00080000:0.0:1789429703.138996:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x110:0x0], index 0: 0 00000004:00080000:1.0:1789429703.148175:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10d:0x0], index 1: 0 00000004:00080000:0.0:1789429703.157318:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x111:0x0], index 0: 0 00000004:00080000:2.0:1789429703.165444:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10e:0x0], index 1: 0 00000004:00080000:3.0:1789429703.174685:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x112:0x0], index 0: 0 00002000:00080000:1.0:1789429703.183574:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 290 00000004:00080000:0.0:1789429703.186337:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x112:0x0]-[0x240000400:0x141:0x0] 00000004:00080000:0.0:1789429703.189992:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10f:0x0], index 1: 0 00000004:00080000:0.0:1789429703.200401:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x113:0x0], index 0: 0 00000004:00080000:2.0:1789429703.216047:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x110:0x0], index 1: 0 00000004:00080000:2.0:1789429703.228955:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x114:0x0], index 0: 0 00000004:00080000:0.0:1789429703.241496:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x111:0x0], index 1: 0 00000004:00080000:2.0:1789429703.260512:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x115:0x0], index 0: 0 00000004:00080000:0.0:1789429703.277577:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x112:0x0], index 1: 0 00002000:00080000:3.0:1789429703.278339:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 290 00000100:00080000:1.0:1789429703.280298:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429703.286079:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x112:0x0]-[0x280000400:0x141:0x0] 00000004:00080000:2.0:1789429703.291250:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x116:0x0], index 0: 0 00000004:00080000:3.0:1789429703.301116:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x113:0x0], index 1: 0 00000004:00080000:1.0:1789429703.310148:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x117:0x0], index 0: 0 00000004:00080000:2.0:1789429703.320504:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x114:0x0], index 1: 0 00000004:00080000:0.0:1789429703.331678:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x118:0x0], index 0: 0 00000004:00080000:0.0:1789429703.353902:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x115:0x0], index 1: 0 00000004:00080000:0.0:1789429703.379355:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x119:0x0], index 0: 0 00000004:00080000:1.0:1789429703.391326:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x116:0x0], index 1: 0 00000004:00080000:3.0:1789429703.404327:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11a:0x0], index 0: 0 00000001:00080000:3.0:1789429703.416820:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294978159 is committed 00000004:00080000:0.0:1789429703.426659:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x117:0x0], index 1: 0 00000004:00080000:0.0:1789429703.435431:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11b:0x0], index 0: 0 00000004:00080000:0.0:1789429703.444973:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x118:0x0], index 1: 0 00000004:00080000:3.0:1789429703.456429:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11c:0x0], index 0: 0 00000004:00080000:3.0:1789429703.465500:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x119:0x0], index 1: 0 00000004:00080000:0.0:1789429703.474273:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11d:0x0], index 0: 0 00000004:00080000:0.0:1789429703.483013:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11a:0x0], index 1: 0 00000004:00080000:1.0:1789429703.493536:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11e:0x0], index 0: 0 00000004:00080000:2.0:1789429703.502760:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11b:0x0], index 1: 0 00000004:00080000:3.0:1789429703.512495:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11f:0x0], index 0: 0 00000004:00080000:3.0:1789429703.522712:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11c:0x0], index 1: 0 00000004:00080000:3.0:1789429703.534657:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x120:0x0], index 0: 0 00000004:00080000:1.0:1789429703.543981:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11d:0x0], index 1: 0 00000004:00080000:0.0:1789429703.553800:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x121:0x0], index 0: 0 00000004:00080000:0.0:1789429703.563707:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11e:0x0], index 1: 0 00000004:00080000:3.0:1789429703.572770:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x122:0x0], index 0: 0 00000004:00080000:0.0:1789429703.586018:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11f:0x0], index 1: 0 00000004:00080000:3.0:1789429703.602086:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x123:0x0], index 0: 0 00000004:00080000:0.0:1789429703.611547:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x120:0x0], index 1: 0 00000004:00080000:0.0:1789429703.622755:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x124:0x0], index 0: 0 00000004:00080000:3.0:1789429703.633396:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x121:0x0], index 1: 0 00000004:00080000:0.0:1789429703.642236:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x125:0x0], index 0: 0 00000004:00080000:2.0:1789429703.650997:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x122:0x0], index 1: 0 00000004:00080000:1.0:1789429703.662051:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x126:0x0], index 0: 0 00000004:00080000:1.0:1789429703.671667:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x123:0x0], index 1: 0 00000004:00080000:0.0:1789429703.681133:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x127:0x0], index 0: 0 00000004:00080000:2.0:1789429703.695381:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x124:0x0], index 1: 0 00000004:00080000:0.0:1789429703.709390:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x128:0x0], index 0: 0 00000004:00080000:0.0:1789429703.720172:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x125:0x0], index 1: 0 00000004:00080000:1.0:1789429703.732309:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x129:0x0], index 0: 0 00000004:00080000:1.0:1789429703.751364:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x126:0x0], index 1: 0 00000004:00080000:2.0:1789429703.760357:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12a:0x0], index 0: 0 00000004:00080000:2.0:1789429703.771846:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x127:0x0], index 1: 0 00000004:00080000:1.0:1789429703.782196:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12b:0x0], index 0: 0 00000004:00080000:1.0:1789429703.792811:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x128:0x0], index 1: 0 00000004:00080000:3.0:1789429703.801824:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12c:0x0], index 0: 0 00000004:00080000:3.0:1789429703.812593:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x129:0x0], index 1: 0 00000004:00080000:2.0:1789429703.821741:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12d:0x0], index 0: 0 00000004:00080000:1.0:1789429703.831529:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12a:0x0], index 1: 0 00000004:00080000:1.0:1789429703.844661:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12e:0x0], index 0: 0 00000004:00080000:3.0:1789429703.878366:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12b:0x0], index 1: 0 00000004:00080000:0.0:1789429703.894404:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12f:0x0], index 0: 0 00000004:00080000:2.0:1789429703.911702:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12c:0x0], index 1: 0 00000001:00080000:0.0:1789429703.919714:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969590 is committed 00000004:00080000:0.0:1789429703.926418:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x130:0x0], index 0: 0 00000004:00080000:1.0:1789429703.938763:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12d:0x0], index 1: 0 00000004:00080000:1.0:1789429703.948641:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x131:0x0], index 0: 0 00000004:00080000:0.0:1789429703.958109:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12e:0x0], index 1: 0 00000004:00080000:2.0:1789429703.967646:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x132:0x0], index 0: 0 00002000:00080000:2.0:1789429703.968747:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 322 00000004:00080000:1.0:1789429703.982274:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12f:0x0], index 1: 0 00000100:00080000:0.0:1789429704.001635:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429704.003144:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x132:0x0]-[0x240000400:0x161:0x0] 00000004:00080000:2.0:1789429704.004477:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x133:0x0], index 0: 0 00000004:00080000:1.0:1789429704.014402:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x130:0x0], index 1: 0 00000004:00080000:2.0:1789429704.028186:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x134:0x0], index 0: 0 00000004:00080000:0.0:1789429704.038977:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x131:0x0], index 1: 0 00000004:00080000:0.0:1789429704.048788:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x135:0x0], index 0: 0 00000004:00080000:2.0:1789429704.057450:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x132:0x0], index 1: 0 00002000:00080000:1.0:1789429704.058149:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 322 00000004:00080000:3.0:1789429704.060681:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x132:0x0]-[0x280000400:0x161:0x0] 00000004:00080000:2.0:1789429704.069275:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x136:0x0], index 0: 0 00000004:00080000:2.0:1789429704.079643:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x133:0x0], index 1: 0 00000004:00080000:2.0:1789429704.092179:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x137:0x0], index 0: 0 00000004:00080000:3.0:1789429704.101976:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x134:0x0], index 1: 0 00000004:00080000:1.0:1789429704.112882:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x138:0x0], index 0: 0 00000004:00080000:2.0:1789429704.121394:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x135:0x0], index 1: 0 00000004:00080000:3.0:1789429704.130089:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x139:0x0], index 0: 0 00000004:00080000:1.0:1789429704.139772:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x136:0x0], index 1: 0 00000004:00080000:2.0:1789429704.151367:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13a:0x0], index 0: 0 00000004:00080000:0.0:1789429704.160119:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x137:0x0], index 1: 0 00000004:00080000:3.0:1789429704.168987:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13b:0x0], index 0: 0 00000004:00080000:2.0:1789429704.179629:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x138:0x0], index 1: 0 00000004:00080000:2.0:1789429704.189677:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13c:0x0], index 0: 0 00000004:00080000:2.0:1789429704.200151:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x139:0x0], index 1: 0 00000004:00080000:0.0:1789429704.209954:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13d:0x0], index 0: 0 00000004:00080000:0.0:1789429704.219609:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13a:0x0], index 1: 0 00000004:00080000:0.0:1789429704.234553:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13e:0x0], index 0: 0 00000004:00080000:1.0:1789429704.243568:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13b:0x0], index 1: 0 00000004:00080000:3.0:1789429704.256438:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13f:0x0], index 0: 0 00000004:00080000:0.0:1789429704.266575:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13c:0x0], index 1: 0 00000004:00080000:0.0:1789429704.276906:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x140:0x0], index 0: 0 00000004:00080000:0.0:1789429704.288337:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13d:0x0], index 1: 0 00000004:00080000:3.0:1789429704.297716:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x141:0x0], index 0: 0 00000004:00080000:0.0:1789429704.308766:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13e:0x0], index 1: 0 00000004:00080000:1.0:1789429704.317270:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x142:0x0], index 0: 0 00000004:00080000:1.0:1789429704.324740:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13f:0x0], index 1: 0 00000004:00080000:3.0:1789429704.333803:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x143:0x0], index 0: 0 00000004:00080000:3.0:1789429704.342745:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x140:0x0], index 1: 0 00000004:00080000:1.0:1789429704.353765:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x144:0x0], index 0: 0 00000004:00080000:1.0:1789429704.361647:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x141:0x0], index 1: 0 00000004:00080000:1.0:1789429704.373336:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x145:0x0], index 0: 0 00000004:00080000:3.0:1789429704.382690:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x142:0x0], index 1: 0 00000004:00080000:0.0:1789429704.391685:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x146:0x0], index 0: 0 00000004:00080000:1.0:1789429704.401100:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x143:0x0], index 1: 0 00000004:00080000:3.0:1789429704.412344:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x147:0x0], index 0: 0 00000004:00080000:1.0:1789429704.424083:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x144:0x0], index 1: 0 00000004:00080000:3.0:1789429704.434848:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x148:0x0], index 0: 0 00000004:00080000:3.0:1789429704.454506:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x145:0x0], index 1: 0 00000004:00080000:0.0:1789429704.463952:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x149:0x0], index 0: 0 00000100:00080000:2.0:1789429704.470600:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429704.470609:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789429704.474668:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x146:0x0], index 1: 0 00000004:00080000:0.0:1789429704.484826:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14a:0x0], index 0: 0 00000004:00080000:0.0:1789429704.499608:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x147:0x0], index 1: 0 00000004:00080000:2.0:1789429704.514983:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14b:0x0], index 0: 0 00000004:00080000:0.0:1789429704.524635:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x148:0x0], index 1: 0 00000004:00080000:3.0:1789429704.536053:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14c:0x0], index 0: 0 00000004:00080000:2.0:1789429704.545655:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x149:0x0], index 1: 0 00000004:00080000:1.0:1789429704.555971:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14d:0x0], index 0: 0 00000004:00080000:0.0:1789429704.570521:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14a:0x0], index 1: 0 00000004:00080000:0.0:1789429704.583495:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14e:0x0], index 0: 0 00000004:00080000:1.0:1789429704.593612:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14b:0x0], index 1: 0 00000004:00080000:0.0:1789429704.604571:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14f:0x0], index 0: 0 00000004:00080000:1.0:1789429704.616462:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14c:0x0], index 1: 0 00000004:00080000:2.0:1789429704.627732:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x150:0x0], index 0: 0 00000004:00080000:0.0:1789429704.639700:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14d:0x0], index 1: 0 00000004:00080000:1.0:1789429704.649734:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x151:0x0], index 0: 0 00000004:00080000:2.0:1789429704.660060:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14e:0x0], index 1: 0 00000004:00080000:3.0:1789429704.670031:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x152:0x0], index 0: 0 00002000:00080000:1.0:1789429704.670538:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 354 00000004:00080000:0.0:1789429704.673340:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x152:0x0]-[0x240000400:0x181:0x0] 00000100:00080000:2.0:1789429704.673500:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429704.683099:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14f:0x0], index 1: 0 00000004:00080000:3.0:1789429704.693011:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x153:0x0], index 0: 0 00000004:00080000:0.0:1789429704.704878:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x150:0x0], index 1: 0 00000004:00080000:1.0:1789429704.715632:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x154:0x0], index 0: 0 00000004:00080000:0.0:1789429704.724752:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x151:0x0], index 1: 0 00000004:00080000:2.0:1789429704.733730:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x155:0x0], index 0: 0 00000004:00080000:1.0:1789429704.743345:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x152:0x0], index 1: 0 00002000:00080000:1.0:1789429704.744674:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 354 00000004:00080000:2.0:1789429704.759992:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x156:0x0], index 0: 0 00000004:00080000:3.0:1789429704.761812:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x152:0x0]-[0x280000400:0x181:0x0] 00000004:00080000:1.0:1789429704.782193:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x153:0x0], index 1: 0 00000004:00080000:3.0:1789429704.801621:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x157:0x0], index 0: 0 00000004:00080000:0.0:1789429704.816625:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x154:0x0], index 1: 0 00000004:00080000:2.0:1789429704.830416:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x158:0x0], index 0: 0 00000004:00080000:0.0:1789429704.838195:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x155:0x0], index 1: 0 00000004:00080000:3.0:1789429704.863403:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x159:0x0], index 0: 0 00000100:00080000:3.0:1789429704.876107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429704.884932:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429704.890805:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x156:0x0], index 1: 0 00000004:00080000:3.0:1789429704.912750:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15a:0x0], index 0: 0 00000004:00080000:0.0:1789429704.929968:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x157:0x0], index 1: 0 00000004:00080000:2.0:1789429704.943880:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15b:0x0], index 0: 0 00000004:00080000:0.0:1789429704.967709:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x158:0x0], index 1: 0 00000004:00080000:0.0:1789429704.979783:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15c:0x0], index 0: 0 00000004:00080000:3.0:1789429704.999550:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x159:0x0], index 1: 0 00000004:00080000:2.0:1789429705.011674:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15d:0x0], index 0: 0 00000004:00080000:2.0:1789429705.021959:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15a:0x0], index 1: 0 00000004:00080000:0.0:1789429705.033859:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15e:0x0], index 0: 0 00000004:00080000:2.0:1789429705.049103:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15b:0x0], index 1: 0 00000004:00080000:3.0:1789429705.064633:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15f:0x0], index 0: 0 00000004:00080000:1.0:1789429705.100739:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15c:0x0], index 1: 0 00000004:00080000:2.0:1789429705.112864:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x160:0x0], index 0: 0 00000004:00080000:0.0:1789429705.132932:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15d:0x0], index 1: 0 00000004:00080000:0.0:1789429705.147818:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x161:0x0], index 0: 0 00000004:00080000:2.0:1789429705.171961:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15e:0x0], index 1: 0 00000004:00080000:2.0:1789429705.184696:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x162:0x0], index 0: 0 00000004:00080000:3.0:1789429705.199137:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15f:0x0], index 1: 0 00000004:00080000:0.0:1789429705.211768:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x163:0x0], index 0: 0 00000004:00080000:2.0:1789429705.223568:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x160:0x0], index 1: 0 00000004:00080000:2.0:1789429705.241108:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x164:0x0], index 0: 0 00000004:00080000:1.0:1789429705.256616:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x161:0x0], index 1: 0 00000004:00080000:2.0:1789429705.269750:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x165:0x0], index 0: 0 00000004:00080000:2.0:1789429705.280793:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x162:0x0], index 1: 0 00000004:00080000:2.0:1789429705.293823:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x166:0x0], index 0: 0 00000004:00080000:2.0:1789429705.311546:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x163:0x0], index 1: 0 00000004:00080000:3.0:1789429705.324803:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x167:0x0], index 0: 0 00000004:00080000:2.0:1789429705.336637:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x164:0x0], index 1: 0 00000004:00080000:3.0:1789429705.348282:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x168:0x0], index 0: 0 00000004:00080000:0.0:1789429705.362193:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x165:0x0], index 1: 0 00000004:00080000:0.0:1789429705.374038:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x169:0x0], index 0: 0 00000004:00080000:3.0:1789429705.384691:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x166:0x0], index 1: 0 00000100:00080000:2.0:1789429705.385149:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789429705.392774:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16a:0x0], index 0: 0 00000004:00080000:1.0:1789429705.400750:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x167:0x0], index 1: 0 00000004:00080000:2.0:1789429705.413886:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16b:0x0], index 0: 0 00000004:00080000:0.0:1789429705.428171:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x168:0x0], index 1: 0 00000004:00080000:3.0:1789429705.453512:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16c:0x0], index 0: 0 00000004:00080000:3.0:1789429705.472433:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x169:0x0], index 1: 0 00000004:00080000:2.0:1789429705.488316:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16d:0x0], index 0: 0 00000004:00080000:1.0:1789429705.501155:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16a:0x0], index 1: 0 00000004:00080000:3.0:1789429705.514153:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16e:0x0], index 0: 0 00000004:00080000:0.0:1789429705.531145:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16b:0x0], index 1: 0 00000004:00080000:3.0:1789429705.551178:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16f:0x0], index 0: 0 00000004:00080000:1.0:1789429705.561702:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16c:0x0], index 1: 0 00000004:00080000:1.0:1789429705.571935:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x170:0x0], index 0: 0 00000004:00080000:3.0:1789429705.584117:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16d:0x0], index 1: 0 00000004:00080000:1.0:1789429705.602289:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x171:0x0], index 0: 0 00000004:00080000:0.0:1789429705.614649:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16e:0x0], index 1: 0 00000004:00080000:2.0:1789429705.628914:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x172:0x0], index 0: 0 00002000:00080000:1.0:1789429705.629571:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 386 00000004:00080000:1.0:1789429705.640993:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x172:0x0]-[0x240000400:0x1a1:0x0] 00000004:00080000:2.0:1789429705.649428:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16f:0x0], index 1: 0 00000004:00080000:2.0:1789429705.666516:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x173:0x0], index 0: 0 00000004:00080000:1.0:1789429705.677168:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x170:0x0], index 1: 0 00000004:00080000:0.0:1789429705.687530:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x174:0x0], index 0: 0 00000004:00080000:2.0:1789429705.698824:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x171:0x0], index 1: 0 00000004:00080000:2.0:1789429705.712904:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x175:0x0], index 0: 0 00000004:00080000:3.0:1789429705.724141:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x172:0x0], index 1: 0 00002000:00080000:0.0:1789429705.724704:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 386 00000004:00080000:1.0:1789429705.739172:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x172:0x0]-[0x280000400:0x1a1:0x0] 00000004:00080000:2.0:1789429705.749598:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x176:0x0], index 0: 0 00000004:00080000:0.0:1789429705.761298:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x173:0x0], index 1: 0 00000004:00080000:0.0:1789429705.777493:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x177:0x0], index 0: 0 00000004:00080000:2.0:1789429705.787569:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x174:0x0], index 1: 0 00000004:00080000:2.0:1789429705.799306:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x178:0x0], index 0: 0 00000004:00080000:3.0:1789429705.810434:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x175:0x0], index 1: 0 00000004:00080000:2.0:1789429705.823722:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x179:0x0], index 0: 0 00000004:00080000:2.0:1789429705.837341:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x176:0x0], index 1: 0 00000004:00080000:1.0:1789429705.854595:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17a:0x0], index 0: 0 00000004:00080000:2.0:1789429705.867306:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x177:0x0], index 1: 0 00000004:00080000:2.0:1789429705.878587:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17b:0x0], index 0: 0 00000004:00080000:2.0:1789429705.888321:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x178:0x0], index 1: 0 00000004:00080000:1.0:1789429705.900103:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17c:0x0], index 0: 0 00000004:00080000:1.0:1789429705.917644:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x179:0x0], index 1: 0 00000004:00080000:2.0:1789429705.930467:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17d:0x0], index 0: 0 00000004:00080000:2.0:1789429705.939729:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17a:0x0], index 1: 0 00000004:00080000:2.0:1789429705.953792:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17e:0x0], index 0: 0 00000004:00080000:2.0:1789429705.971913:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17b:0x0], index 1: 0 00000004:00080000:3.0:1789429705.987820:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17f:0x0], index 0: 0 00000004:00080000:2.0:1789429705.998812:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17c:0x0], index 1: 0 00000100:00080000:2.0:1789429706.005168:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429706.012683:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x180:0x0], index 0: 0 00000004:00080000:2.0:1789429706.033794:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17d:0x0], index 1: 0 00000004:00080000:2.0:1789429706.046447:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x181:0x0], index 0: 0 00000004:00080000:0.0:1789429706.058817:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17e:0x0], index 1: 0 00000004:00080000:2.0:1789429706.080096:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x182:0x0], index 0: 0 00000004:00080000:1.0:1789429706.119677:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17f:0x0], index 1: 0 00000004:00080000:1.0:1789429706.143687:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x183:0x0], index 0: 0 00000004:00080000:1.0:1789429706.165347:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x180:0x0], index 1: 0 00000004:00080000:3.0:1789429706.209069:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x184:0x0], index 0: 0 00000004:00080000:0.0:1789429706.228532:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x181:0x0], index 1: 0 00000004:00080000:2.0:1789429706.246171:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x185:0x0], index 0: 0 00000004:00080000:2.0:1789429706.265981:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x182:0x0], index 1: 0 00000004:00080000:1.0:1789429706.298723:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x186:0x0], index 0: 0 00000004:00080000:2.0:1789429706.323487:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x183:0x0], index 1: 0 00000004:00080000:3.0:1789429706.344380:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x187:0x0], index 0: 0 00000004:00080000:2.0:1789429706.376521:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x184:0x0], index 1: 0 00000004:00080000:3.0:1789429706.409651:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x188:0x0], index 0: 0 00000004:00080000:1.0:1789429706.432358:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x185:0x0], index 1: 0 00000004:00080000:1.0:1789429706.448520:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x189:0x0], index 0: 0 00000004:00080000:3.0:1789429706.471259:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x186:0x0], index 1: 0 00000004:00080000:2.0:1789429706.479290:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18a:0x0], index 0: 0 00000004:00080000:3.0:1789429706.501115:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x187:0x0], index 1: 0 00000004:00080000:2.0:1789429706.518398:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18b:0x0], index 0: 0 00000004:00080000:1.0:1789429706.527661:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x188:0x0], index 1: 0 00000004:00080000:3.0:1789429706.567488:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18c:0x0], index 0: 0 00000004:00080000:2.0:1789429706.582912:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x189:0x0], index 1: 0 00000004:00080000:3.0:1789429706.611152:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18d:0x0], index 0: 0 00000004:00080000:2.0:1789429706.647645:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18a:0x0], index 1: 0 00000004:00080000:3.0:1789429706.664243:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18e:0x0], index 0: 0 00000004:00080000:0.0:1789429706.674535:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18b:0x0], index 1: 0 00000004:00080000:0.0:1789429706.683484:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18f:0x0], index 0: 0 00000004:00080000:0.0:1789429706.692684:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18c:0x0], index 1: 0 00000004:00080000:2.0:1789429706.703122:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x190:0x0], index 0: 0 00000004:00080000:1.0:1789429706.716664:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18d:0x0], index 1: 0 00000004:00080000:3.0:1789429706.726103:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x191:0x0], index 0: 0 00000004:00080000:2.0:1789429706.741790:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18e:0x0], index 1: 0 00000004:00080000:3.0:1789429706.753248:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x192:0x0], index 0: 0 00002000:00080000:3.0:1789429706.754143:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 418 00000100:00080000:2.0:1789429706.757707:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429706.761730:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x192:0x0]-[0x240000400:0x1c1:0x0] 00000004:00080000:2.0:1789429706.768250:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18f:0x0], index 1: 0 00000004:00080000:0.0:1789429706.785192:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x193:0x0], index 0: 0 00000004:00080000:2.0:1789429706.794915:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x190:0x0], index 1: 0 00000004:00080000:2.0:1789429706.805342:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x194:0x0], index 0: 0 00000004:00080000:2.0:1789429706.816599:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x191:0x0], index 1: 0 00000004:00080000:2.0:1789429706.831160:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x195:0x0], index 0: 0 00000004:00080000:1.0:1789429706.843309:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x192:0x0], index 1: 0 00002000:00080000:3.0:1789429706.844427:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 418 00000004:00080000:1.0:1789429706.850981:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x192:0x0]-[0x280000400:0x1c1:0x0] 00000004:00080000:0.0:1789429706.858492:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x196:0x0], index 0: 0 00000004:00080000:2.0:1789429706.868434:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x193:0x0], index 1: 0 00000004:00080000:3.0:1789429706.876609:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x197:0x0], index 0: 0 00000004:00080000:0.0:1789429706.885635:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x194:0x0], index 1: 0 00000004:00080000:1.0:1789429706.894270:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x198:0x0], index 0: 0 00000004:00080000:0.0:1789429706.904676:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x195:0x0], index 1: 0 00000004:00080000:0.0:1789429706.913398:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x199:0x0], index 0: 0 00000004:00080000:2.0:1789429706.922607:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x196:0x0], index 1: 0 00000004:00080000:0.0:1789429706.933757:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19a:0x0], index 0: 0 00000004:00080000:0.0:1789429706.941895:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x197:0x0], index 1: 0 00000004:00080000:2.0:1789429706.950566:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19b:0x0], index 0: 0 00000004:00080000:0.0:1789429706.958589:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x198:0x0], index 1: 0 00000004:00080000:0.0:1789429706.966240:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19c:0x0], index 0: 0 00000004:00080000:0.0:1789429706.979162:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x199:0x0], index 1: 0 00000004:00080000:2.0:1789429706.988555:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19d:0x0], index 0: 0 00000004:00080000:2.0:1789429706.997153:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19a:0x0], index 1: 0 00000004:00080000:2.0:1789429707.009982:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19e:0x0], index 0: 0 00000004:00080000:1.0:1789429707.021687:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19b:0x0], index 1: 0 00000004:00080000:0.0:1789429707.044298:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19f:0x0], index 0: 0 00000004:00080000:3.0:1789429707.065419:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19c:0x0], index 1: 0 00000004:00080000:2.0:1789429707.080728:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a0:0x0], index 0: 0 00000004:00080000:2.0:1789429707.102450:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19d:0x0], index 1: 0 00000004:00080000:1.0:1789429707.114040:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a1:0x0], index 0: 0 00000004:00080000:2.0:1789429707.136762:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19e:0x0], index 1: 0 00000004:00080000:2.0:1789429707.151641:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a2:0x0], index 0: 0 00000004:00080000:2.0:1789429707.160285:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19f:0x0], index 1: 0 00000004:00080000:0.0:1789429707.174157:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a3:0x0], index 0: 0 00000004:00080000:2.0:1789429707.186405:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a0:0x0], index 1: 0 00000004:00080000:2.0:1789429707.209840:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a4:0x0], index 0: 0 00000004:00080000:0.0:1789429707.222117:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a1:0x0], index 1: 0 00000004:00080000:3.0:1789429707.235811:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a5:0x0], index 0: 0 00000004:00080000:0.0:1789429707.250711:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a2:0x0], index 1: 0 00000004:00080000:2.0:1789429707.278220:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a6:0x0], index 0: 0 00000004:00080000:2.0:1789429707.297138:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a3:0x0], index 1: 0 00000004:00080000:2.0:1789429707.312522:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a7:0x0], index 0: 0 00000004:00080000:1.0:1789429707.326834:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a4:0x0], index 1: 0 00000004:00080000:0.0:1789429707.347938:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a8:0x0], index 0: 0 00000004:00080000:0.0:1789429707.367385:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a5:0x0], index 1: 0 00000004:00080000:2.0:1789429707.381490:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a9:0x0], index 0: 0 00000004:00080000:3.0:1789429707.395783:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a6:0x0], index 1: 0 00000004:00080000:1.0:1789429707.408736:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1aa:0x0], index 0: 0 00000004:00080000:0.0:1789429707.419832:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a7:0x0], index 1: 0 00000004:00080000:1.0:1789429707.466590:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ab:0x0], index 0: 0 00000004:00080000:3.0:1789429707.490531:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a8:0x0], index 1: 0 00000001:00080000:1.0:1789429707.500070:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969618 is committed 00000001:00080000:1.0:1789429707.500105:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969619 is committed 00000004:00080000:2.0:1789429707.505835:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ac:0x0], index 0: 0 00000004:00080000:2.0:1789429707.529767:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a9:0x0], index 1: 0 00000004:00080000:2.0:1789429707.540551:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ad:0x0], index 0: 0 00000004:00080000:1.0:1789429707.552875:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1aa:0x0], index 1: 0 00000004:00080000:0.0:1789429707.562781:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ae:0x0], index 0: 0 00000004:00080000:2.0:1789429707.572341:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ab:0x0], index 1: 0 00000004:00080000:1.0:1789429707.590141:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1af:0x0], index 0: 0 00000004:00080000:3.0:1789429707.611789:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ac:0x0], index 1: 0 00000004:00080000:0.0:1789429707.627667:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b0:0x0], index 0: 0 00000004:00080000:0.0:1789429707.647834:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ad:0x0], index 1: 0 00000004:00080000:3.0:1789429707.668914:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b1:0x0], index 0: 0 00000004:00080000:1.0:1789429707.687657:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ae:0x0], index 1: 0 00000004:00080000:3.0:1789429707.706916:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b2:0x0], index 0: 0 00002000:00080000:3.0:1789429707.711290:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 450 00000004:00080000:2.0:1789429707.714437:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1b2:0x0]-[0x240000400:0x1e1:0x0] 00000004:00080000:2.0:1789429707.719191:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1af:0x0], index 1: 0 00000004:00080000:3.0:1789429707.731083:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b3:0x0], index 0: 0 00000004:00080000:2.0:1789429707.745703:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b0:0x0], index 1: 0 00000004:00080000:1.0:1789429707.756681:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b4:0x0], index 0: 0 00000004:00080000:3.0:1789429707.770177:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b1:0x0], index 1: 0 00000004:00080000:2.0:1789429707.786161:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b5:0x0], index 0: 0 00000004:00080000:2.0:1789429707.801982:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b2:0x0], index 1: 0 00000100:00080000:2.0:1789429707.804688:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1789429707.804728:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 450 00000004:00080000:1.0:1789429707.817125:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b6:0x0], index 0: 0 00000004:00080000:2.0:1789429707.826342:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b3:0x0], index 1: 0 00000004:00080000:0.0:1789429707.839135:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b7:0x0], index 0: 0 00000004:00080000:3.0:1789429707.843088:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1b3:0x0]-[0x280000400:0x1e1:0x0] 00000004:00080000:2.0:1789429707.853193:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b4:0x0], index 1: 0 00000004:00080000:0.0:1789429707.876838:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b8:0x0], index 0: 0 00000004:00080000:2.0:1789429707.897859:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b5:0x0], index 1: 0 00000004:00080000:2.0:1789429707.919029:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b9:0x0], index 0: 0 00000004:00080000:0.0:1789429707.927668:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b6:0x0], index 1: 0 00000004:00080000:1.0:1789429707.937971:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ba:0x0], index 0: 0 00000004:00080000:0.0:1789429707.952372:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b7:0x0], index 1: 0 00000004:00080000:0.0:1789429707.960669:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1bb:0x0], index 0: 0 00000004:00080000:0.0:1789429707.969597:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b8:0x0], index 1: 0 00000004:00080000:2.0:1789429707.980292:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1bc:0x0], index 0: 0 00000004:00080000:1.0:1789429707.990615:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b9:0x0], index 1: 0 00000004:00080000:2.0:1789429708.000534:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1bd:0x0], index 0: 0 00000100:00080000:0.0:1789429708.006012:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429708.009445:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ba:0x0], index 1: 0 00000004:00080000:0.0:1789429708.022487:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1be:0x0], index 0: 0 00000004:00080000:1.0:1789429708.034449:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1bb:0x0], index 1: 0 00000004:00080000:1.0:1789429708.042246:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1bf:0x0], index 0: 0 00000004:00080000:0.0:1789429708.051358:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1bc:0x0], index 1: 0 00000004:00080000:3.0:1789429708.062168:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c0:0x0], index 0: 0 00000004:00080000:0.0:1789429708.072289:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1bd:0x0], index 1: 0 00000004:00080000:3.0:1789429708.084895:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c1:0x0], index 0: 0 00000004:00080000:2.0:1789429708.095710:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1be:0x0], index 1: 0 00000004:00080000:2.0:1789429708.105582:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c2:0x0], index 0: 0 00000004:00080000:2.0:1789429708.116614:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1bf:0x0], index 1: 0 00000004:00080000:1.0:1789429708.141777:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c3:0x0], index 0: 0 00000004:00080000:0.0:1789429708.153933:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c0:0x0], index 1: 0 00000004:00080000:0.0:1789429708.165956:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c4:0x0], index 0: 0 00000004:00080000:0.0:1789429708.178106:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c1:0x0], index 1: 0 00000004:00080000:0.0:1789429708.192551:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c5:0x0], index 0: 0 00000004:00080000:1.0:1789429708.201252:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c2:0x0], index 1: 0 00000004:00080000:2.0:1789429708.210691:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c6:0x0], index 0: 0 00000004:00080000:2.0:1789429708.223353:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c3:0x0], index 1: 0 00000004:00080000:2.0:1789429708.236670:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c7:0x0], index 0: 0 00000004:00080000:3.0:1789429708.245408:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c4:0x0], index 1: 0 00000004:00080000:3.0:1789429708.257595:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c8:0x0], index 0: 0 00000004:00080000:3.0:1789429708.269554:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c5:0x0], index 1: 0 00000004:00080000:2.0:1789429708.279022:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c9:0x0], index 0: 0 00000004:00080000:2.0:1789429708.290682:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c6:0x0], index 1: 0 00000004:00080000:1.0:1789429708.300367:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ca:0x0], index 0: 0 00000004:00080000:3.0:1789429708.314292:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c7:0x0], index 1: 0 00000004:00080000:2.0:1789429708.329187:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1cb:0x0], index 0: 0 00000004:00080000:2.0:1789429708.350677:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c8:0x0], index 1: 0 00000004:00080000:2.0:1789429708.358719:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1cc:0x0], index 0: 0 00000004:00080000:0.0:1789429708.378357:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c9:0x0], index 1: 0 00000004:00080000:3.0:1789429708.399360:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1cd:0x0], index 0: 0 00000004:00080000:0.0:1789429708.426677:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ca:0x0], index 1: 0 00000004:00080000:2.0:1789429708.444406:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ce:0x0], index 0: 0 00000004:00080000:0.0:1789429708.471092:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1cb:0x0], index 1: 0 00000004:00080000:3.0:1789429708.515104:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1cf:0x0], index 0: 0 00000001:00080000:3.0:1789429708.526165:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294978886 is committed 00000001:00080000:3.0:1789429708.526897:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294978887 is committed 00000004:00080000:2.0:1789429708.550172:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1cc:0x0], index 1: 0 00000004:00080000:1.0:1789429708.573753:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d0:0x0], index 0: 0 00000004:00080000:2.0:1789429708.598050:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1cd:0x0], index 1: 0 00000004:00080000:2.0:1789429708.610380:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d1:0x0], index 0: 0 00000004:00080000:2.0:1789429708.620985:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ce:0x0], index 1: 0 00000004:00080000:2.0:1789429708.642170:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d2:0x0], index 0: 0 00002000:00080000:0.0:1789429708.642920:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 482 00000100:00080000:2.0:1789429708.643628:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789429708.659168:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1d2:0x0]-[0x240000400:0x201:0x0] 00000004:00080000:1.0:1789429708.676185:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1cf:0x0], index 1: 0 00000004:00080000:0.0:1789429708.695140:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d3:0x0], index 0: 0 00000004:00080000:2.0:1789429708.717188:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d0:0x0], index 1: 0 00000004:00080000:3.0:1789429708.732167:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d4:0x0], index 0: 0 00000004:00080000:1.0:1789429708.754864:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d1:0x0], index 1: 0 00000004:00080000:1.0:1789429708.776612:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d5:0x0], index 0: 0 00000004:00080000:0.0:1789429708.790646:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d2:0x0], index 1: 0 00002000:00080000:2.0:1789429708.791447:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 482 00000004:00080000:0.0:1789429708.794711:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1d2:0x0]-[0x280000400:0x201:0x0] 00000004:00080000:2.0:1789429708.807761:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d6:0x0], index 0: 0 00000004:00080000:3.0:1789429708.815124:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d3:0x0], index 1: 0 00000004:00080000:0.0:1789429708.832191:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d7:0x0], index 0: 0 00000004:00080000:3.0:1789429708.841921:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d4:0x0], index 1: 0 00000004:00080000:0.0:1789429708.859020:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d8:0x0], index 0: 0 00000004:00080000:2.0:1789429708.896792:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d5:0x0], index 1: 0 00000004:00080000:2.0:1789429708.910827:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d9:0x0], index 0: 0 00000004:00080000:0.0:1789429708.923641:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d6:0x0], index 1: 0 00000004:00080000:0.0:1789429708.940965:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1da:0x0], index 0: 0 00000004:00080000:0.0:1789429708.962573:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d7:0x0], index 1: 0 00000004:00080000:3.0:1789429709.013436:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1db:0x0], index 0: 0 00000004:00080000:3.0:1789429709.025767:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d8:0x0], index 1: 0 00000004:00080000:0.0:1789429709.036437:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1dc:0x0], index 0: 0 00000004:00080000:2.0:1789429709.075055:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d9:0x0], index 1: 0 00000004:00080000:1.0:1789429709.095622:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1dd:0x0], index 0: 0 00000001:00080000:0.0:1789429709.101050:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969596 is committed 00000004:00080000:2.0:1789429709.104806:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1da:0x0], index 1: 0 00000004:00080000:0.0:1789429709.124366:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1de:0x0], index 0: 0 00000004:00080000:1.0:1789429709.132690:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1db:0x0], index 1: 0 00000004:00080000:0.0:1789429709.140688:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1df:0x0], index 0: 0 00000004:00080000:0.0:1789429709.150002:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1dc:0x0], index 1: 0 00000004:00080000:3.0:1789429709.158556:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e0:0x0], index 0: 0 00000004:00080000:3.0:1789429709.166050:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1dd:0x0], index 1: 0 00000004:00080000:0.0:1789429709.181729:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e1:0x0], index 0: 0 00000004:00080000:3.0:1789429709.197524:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1de:0x0], index 1: 0 00000004:00080000:0.0:1789429709.211144:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e2:0x0], index 0: 0 00000004:00080000:3.0:1789429709.229257:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1df:0x0], index 1: 0 00000004:00080000:0.0:1789429709.243152:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e3:0x0], index 0: 0 00000004:00080000:0.0:1789429709.256195:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e0:0x0], index 1: 0 00000004:00080000:3.0:1789429709.263686:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e4:0x0], index 0: 0 00000004:00080000:0.0:1789429709.275449:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e1:0x0], index 1: 0 00000004:00080000:3.0:1789429709.300935:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e5:0x0], index 0: 0 00000004:00080000:1.0:1789429709.320851:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e2:0x0], index 1: 0 00000004:00080000:1.0:1789429709.342740:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e6:0x0], index 0: 0 00000004:00080000:0.0:1789429709.352872:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e3:0x0], index 1: 0 00000004:00080000:0.0:1789429709.363711:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e7:0x0], index 0: 0 00000004:00080000:2.0:1789429709.374835:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e4:0x0], index 1: 0 00000004:00080000:1.0:1789429709.386825:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e8:0x0], index 0: 0 00000004:00080000:1.0:1789429709.401741:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e5:0x0], index 1: 0 00000004:00080000:0.0:1789429709.426110:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e9:0x0], index 0: 0 00000004:00080000:0.0:1789429709.440661:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e6:0x0], index 1: 0 00000004:00080000:1.0:1789429709.455035:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ea:0x0], index 0: 0 00000004:00080000:1.0:1789429709.470028:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e7:0x0], index 1: 0 00000004:00080000:1.0:1789429709.479530:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1eb:0x0], index 0: 0 00000004:00080000:2.0:1789429709.494344:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e8:0x0], index 1: 0 00000004:00080000:2.0:1789429709.509301:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ec:0x0], index 0: 0 00000004:00080000:1.0:1789429709.521376:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e9:0x0], index 1: 0 00000004:00080000:1.0:1789429709.539620:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ed:0x0], index 0: 0 00000004:00080000:1.0:1789429709.553147:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ea:0x0], index 1: 0 00000004:00080000:2.0:1789429709.568187:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ee:0x0], index 0: 0 00000004:00080000:3.0:1789429709.577341:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1eb:0x0], index 1: 0 00000100:00080000:0.0:1789429709.596755:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429709.611849:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429709.617359:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ef:0x0], index 0: 0 00000004:00080000:1.0:1789429709.642522:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ec:0x0], index 1: 0 00000004:00080000:0.0:1789429709.660309:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f0:0x0], index 0: 0 00000004:00080000:3.0:1789429709.672742:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ed:0x0], index 1: 0 00000004:00080000:2.0:1789429709.687250:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f1:0x0], index 0: 0 00000004:00080000:2.0:1789429709.720615:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ee:0x0], index 1: 0 00000004:00080000:1.0:1789429709.749379:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f2:0x0], index 0: 0 00002000:00080000:1.0:1789429709.751695:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 514 00000004:00080000:2.0:1789429709.768685:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ef:0x0], index 1: 0 00000004:00080000:1.0:1789429709.784443:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1f2:0x0]-[0x240000400:0x221:0x0] 00000004:00080000:3.0:1789429709.792164:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f3:0x0], index 0: 0 00000004:00080000:3.0:1789429709.801775:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f0:0x0], index 1: 0 00000004:00080000:3.0:1789429709.828790:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f4:0x0], index 0: 0 00000004:00080000:1.0:1789429709.859338:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f1:0x0], index 1: 0 00000004:00080000:1.0:1789429709.867140:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f5:0x0], index 0: 0 00000004:00080000:3.0:1789429709.893278:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f2:0x0], index 1: 0 00000100:00080000:0.0:1789429709.898751:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1789429709.899440:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 514 00000004:00080000:3.0:1789429709.914594:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f6:0x0], index 0: 0 00000004:00080000:0.0:1789429709.914711:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1f2:0x0]-[0x280000400:0x221:0x0] 00000004:00080000:3.0:1789429709.941678:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f3:0x0], index 1: 0 00000004:00080000:1.0:1789429709.973646:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f7:0x0], index 0: 0 00000100:00080000:0.0:1789429709.989661:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429709.991751:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f4:0x0], index 1: 0 00000004:00080000:1.0:1789429710.004516:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f8:0x0], index 0: 0 00000100:00080000:0.0:1789429710.005396:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429710.022429:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f5:0x0], index 1: 0 00000004:00080000:1.0:1789429710.033102:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f9:0x0], index 0: 0 00000004:00080000:0.0:1789429710.076576:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f6:0x0], index 1: 0 00000004:00080000:2.0:1789429710.084243:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1fa:0x0], index 0: 0 00000004:00080000:3.0:1789429710.102125:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f7:0x0], index 1: 0 00000004:00080000:3.0:1789429710.117306:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1fb:0x0], index 0: 0 00000004:00080000:2.0:1789429710.129805:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f8:0x0], index 1: 0 00000004:00080000:2.0:1789429710.143465:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1fc:0x0], index 0: 0 00000004:00080000:2.0:1789429710.158694:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f9:0x0], index 1: 0 00000004:00080000:0.0:1789429710.167464:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1fd:0x0], index 0: 0 00000004:00080000:1.0:1789429710.180702:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1fa:0x0], index 1: 0 00000004:00080000:2.0:1789429710.188434:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1fe:0x0], index 0: 0 00000004:00080000:1.0:1789429710.210072:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1fb:0x0], index 1: 0 00000004:00080000:1.0:1789429710.218351:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ff:0x0], index 0: 0 00000004:00080000:0.0:1789429710.230178:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1fc:0x0], index 1: 0 00000004:00080000:1.0:1789429710.239444:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x200:0x0], index 0: 0 00000004:00080000:0.0:1789429710.253444:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1fd:0x0], index 1: 0 00000004:00080000:3.0:1789429710.264301:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x201:0x0], index 0: 0 00000004:00080000:1.0:1789429710.273058:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1fe:0x0], index 1: 0 00000004:00080000:0.0:1789429710.285704:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x202:0x0], index 0: 0 00000004:00080000:1.0:1789429710.301442:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1ff:0x0], index 1: 0 00000004:00080000:1.0:1789429710.315686:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x203:0x0], index 0: 0 00000004:00080000:0.0:1789429710.332759:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x200:0x0], index 1: 0 00000004:00080000:3.0:1789429710.351669:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x204:0x0], index 0: 0 00000004:00080000:3.0:1789429710.360886:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x201:0x0], index 1: 0 00000004:00080000:2.0:1789429710.380517:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x205:0x0], index 0: 0 00000004:00080000:3.0:1789429710.398786:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x202:0x0], index 1: 0 00000004:00080000:0.0:1789429710.420330:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x206:0x0], index 0: 0 00000004:00080000:0.0:1789429710.429860:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x203:0x0], index 1: 0 00000004:00080000:1.0:1789429710.442657:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x207:0x0], index 0: 0 00000004:00080000:2.0:1789429710.454511:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x204:0x0], index 1: 0 00000004:00080000:2.0:1789429710.466461:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x208:0x0], index 0: 0 00000004:00080000:2.0:1789429710.478489:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x205:0x0], index 1: 0 00000004:00080000:0.0:1789429710.489188:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x209:0x0], index 0: 0 00000100:00080000:1.0:1789429710.499607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429710.513753:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x206:0x0], index 1: 0 00000004:00080000:3.0:1789429710.528741:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20a:0x0], index 0: 0 00000004:00080000:2.0:1789429710.539763:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x207:0x0], index 1: 0 00000004:00080000:2.0:1789429710.552073:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20b:0x0], index 0: 0 00000004:00080000:0.0:1789429710.564938:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x208:0x0], index 1: 0 00000004:00080000:1.0:1789429710.577281:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20c:0x0], index 0: 0 00000004:00080000:2.0:1789429710.587134:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x209:0x0], index 1: 0 00000004:00080000:2.0:1789429710.597062:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20d:0x0], index 0: 0 00000004:00080000:0.0:1789429710.608813:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20a:0x0], index 1: 0 00000004:00080000:0.0:1789429710.620578:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20e:0x0], index 0: 0 00000004:00080000:3.0:1789429710.630490:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20b:0x0], index 1: 0 00000004:00080000:1.0:1789429710.642350:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20f:0x0], index 0: 0 00000004:00080000:2.0:1789429710.651168:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20c:0x0], index 1: 0 00000004:00080000:2.0:1789429710.662086:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x210:0x0], index 0: 0 00000004:00080000:1.0:1789429710.676099:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20d:0x0], index 1: 0 00000004:00080000:0.0:1789429710.688520:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x211:0x0], index 0: 0 00000004:00080000:2.0:1789429710.698361:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20e:0x0], index 1: 0 00000004:00080000:2.0:1789429710.709102:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x212:0x0], index 0: 0 00000004:00080000:2.0:1789429710.716708:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20f:0x0], index 1: 0 00002000:00080000:3.0:1789429710.719871:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 546 00000004:00080000:1.0:1789429710.722614:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x212:0x0]-[0x240000400:0x241:0x0] 00000004:00080000:0.0:1789429710.728133:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x213:0x0], index 0: 0 00000004:00080000:0.0:1789429710.737521:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x210:0x0], index 1: 0 00000004:00080000:2.0:1789429710.747318:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x214:0x0], index 0: 0 00000004:00080000:2.0:1789429710.755854:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x211:0x0], index 1: 0 00000004:00080000:0.0:1789429710.772450:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x215:0x0], index 0: 0 00000004:00080000:2.0:1789429710.785065:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x212:0x0], index 1: 0 00002000:00080000:2.0:1789429710.790662:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 546 00000004:00080000:3.0:1789429710.796897:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x212:0x0]-[0x280000400:0x241:0x0] 00000004:00080000:2.0:1789429710.798153:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x216:0x0], index 0: 0 00000004:00080000:3.0:1789429710.808121:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x213:0x0], index 1: 0 00000004:00080000:0.0:1789429710.816672:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x217:0x0], index 0: 0 00000004:00080000:1.0:1789429710.839344:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x214:0x0], index 1: 0 00000004:00080000:0.0:1789429710.849127:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x218:0x0], index 0: 0 00000004:00080000:2.0:1789429710.858479:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x215:0x0], index 1: 0 00000004:00080000:1.0:1789429710.868775:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x219:0x0], index 0: 0 00000004:00080000:2.0:1789429710.881162:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x216:0x0], index 1: 0 00000004:00080000:3.0:1789429710.892915:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21a:0x0], index 0: 0 00000004:00080000:0.0:1789429710.907718:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x217:0x0], index 1: 0 00000004:00080000:1.0:1789429710.925959:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21b:0x0], index 0: 0 00000004:00080000:0.0:1789429710.941309:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x218:0x0], index 1: 0 00000004:00080000:2.0:1789429710.954063:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21c:0x0], index 0: 0 00000004:00080000:2.0:1789429710.966894:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x219:0x0], index 1: 0 00000004:00080000:2.0:1789429710.979423:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21d:0x0], index 0: 0 00000004:00080000:1.0:1789429710.999119:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21a:0x0], index 1: 0 00000004:00080000:0.0:1789429711.015361:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21e:0x0], index 0: 0 00000004:00080000:1.0:1789429711.023435:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21b:0x0], index 1: 0 00000004:00080000:2.0:1789429711.041813:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21f:0x0], index 0: 0 00000004:00080000:2.0:1789429711.052063:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21c:0x0], index 1: 0 00000004:00080000:3.0:1789429711.065187:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x220:0x0], index 0: 0 00000004:00080000:0.0:1789429711.076161:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21d:0x0], index 1: 0 00000004:00080000:1.0:1789429711.087425:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x221:0x0], index 0: 0 00000004:00080000:2.0:1789429711.097546:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21e:0x0], index 1: 0 00000004:00080000:3.0:1789429711.107412:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x222:0x0], index 0: 0 00000004:00080000:0.0:1789429711.116262:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21f:0x0], index 1: 0 00000004:00080000:0.0:1789429711.126387:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x223:0x0], index 0: 0 00000004:00080000:1.0:1789429711.134539:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x220:0x0], index 1: 0 00000004:00080000:1.0:1789429711.143035:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x224:0x0], index 0: 0 00000004:00080000:3.0:1789429711.152827:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x221:0x0], index 1: 0 00000004:00080000:2.0:1789429711.161948:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x225:0x0], index 0: 0 00000004:00080000:1.0:1789429711.169768:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x222:0x0], index 1: 0 00000004:00080000:0.0:1789429711.177062:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x226:0x0], index 0: 0 00000004:00080000:1.0:1789429711.189928:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x223:0x0], index 1: 0 00000004:00080000:3.0:1789429711.205795:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x227:0x0], index 0: 0 00000004:00080000:3.0:1789429711.215657:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x224:0x0], index 1: 0 00000004:00080000:3.0:1789429711.225655:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x228:0x0], index 0: 0 00000004:00080000:2.0:1789429711.236620:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x225:0x0], index 1: 0 00000004:00080000:1.0:1789429711.252398:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x229:0x0], index 0: 0 00000004:00080000:0.0:1789429711.276501:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x226:0x0], index 1: 0 00000004:00080000:2.0:1789429711.287779:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22a:0x0], index 0: 0 00000004:00080000:1.0:1789429711.300423:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x227:0x0], index 1: 0 00000004:00080000:3.0:1789429711.314058:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22b:0x0], index 0: 0 00000004:00080000:1.0:1789429711.338167:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x228:0x0], index 1: 0 00000004:00080000:2.0:1789429711.363505:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22c:0x0], index 0: 0 00000004:00080000:3.0:1789429711.381443:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x229:0x0], index 1: 0 00000004:00080000:1.0:1789429711.400984:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22d:0x0], index 0: 0 00000004:00080000:3.0:1789429711.430602:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22a:0x0], index 1: 0 00000004:00080000:3.0:1789429711.450938:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22e:0x0], index 0: 0 00000004:00080000:2.0:1789429711.460831:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22b:0x0], index 1: 0 00000004:00080000:2.0:1789429711.479052:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22f:0x0], index 0: 0 00000004:00080000:2.0:1789429711.488921:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22c:0x0], index 1: 0 00000004:00080000:3.0:1789429711.498364:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x230:0x0], index 0: 0 00000004:00080000:2.0:1789429711.509366:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22d:0x0], index 1: 0 00000004:00080000:2.0:1789429711.518151:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x231:0x0], index 0: 0 00000004:00080000:3.0:1789429711.532702:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22e:0x0], index 1: 0 00000004:00080000:1.0:1789429711.542003:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x232:0x0], index 0: 0 00002000:00080000:0.0:1789429711.546412:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 578 00000004:00080000:2.0:1789429711.549274:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x232:0x0]-[0x240000400:0x261:0x0] 00000004:00080000:1.0:1789429711.555543:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22f:0x0], index 1: 0 00000004:00080000:2.0:1789429711.568914:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x233:0x0], index 0: 0 00000004:00080000:2.0:1789429711.578447:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x230:0x0], index 1: 0 00000004:00080000:2.0:1789429711.588992:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x234:0x0], index 0: 0 00000004:00080000:1.0:1789429711.598168:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x231:0x0], index 1: 0 00000004:00080000:1.0:1789429711.607745:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x235:0x0], index 0: 0 00000004:00080000:2.0:1789429711.618095:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x232:0x0], index 1: 0 00002000:00080000:2.0:1789429711.622665:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 578 00000004:00080000:1.0:1789429711.628756:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x236:0x0], index 0: 0 00000004:00080000:2.0:1789429711.629939:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x232:0x0]-[0x280000400:0x261:0x0] 00000100:00080000:0.0:1789429711.630268:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429711.638191:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x233:0x0], index 1: 0 00000004:00080000:2.0:1789429711.646249:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x237:0x0], index 0: 0 00000004:00080000:0.0:1789429711.658989:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x234:0x0], index 1: 0 00000004:00080000:0.0:1789429711.670534:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x238:0x0], index 0: 0 00000004:00080000:1.0:1789429711.684784:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x235:0x0], index 1: 0 00000004:00080000:2.0:1789429711.701374:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x239:0x0], index 0: 0 00000004:00080000:0.0:1789429711.719173:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x236:0x0], index 1: 0 00000004:00080000:0.0:1789429711.746530:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23a:0x0], index 0: 0 00000004:00080000:0.0:1789429711.765462:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x237:0x0], index 1: 0 00000004:00080000:2.0:1789429711.777707:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23b:0x0], index 0: 0 00000004:00080000:2.0:1789429711.795737:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x238:0x0], index 1: 0 00000004:00080000:3.0:1789429711.809610:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23c:0x0], index 0: 0 00000004:00080000:2.0:1789429711.827694:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x239:0x0], index 1: 0 00000004:00080000:0.0:1789429711.841279:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23d:0x0], index 0: 0 00000004:00080000:2.0:1789429711.855912:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23a:0x0], index 1: 0 00000004:00080000:2.0:1789429711.882656:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23e:0x0], index 0: 0 00000004:00080000:0.0:1789429711.895776:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23b:0x0], index 1: 0 00000004:00080000:2.0:1789429711.903811:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23f:0x0], index 0: 0 00000004:00080000:3.0:1789429711.915892:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23c:0x0], index 1: 0 00000004:00080000:2.0:1789429711.924777:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x240:0x0], index 0: 0 00000004:00080000:2.0:1789429711.932634:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23d:0x0], index 1: 0 00000004:00080000:1.0:1789429711.946368:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x241:0x0], index 0: 0 00000004:00080000:0.0:1789429711.954341:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23e:0x0], index 1: 0 00000004:00080000:2.0:1789429711.981535:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x242:0x0], index 0: 0 00000004:00080000:2.0:1789429711.999326:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23f:0x0], index 1: 0 00000100:00080000:0.0:1789429712.017008:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429712.020629:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x243:0x0], index 0: 0 00000004:00080000:1.0:1789429712.027425:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x240:0x0], index 1: 0 00000004:00080000:1.0:1789429712.039314:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x244:0x0], index 0: 0 00000004:00080000:0.0:1789429712.050562:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x241:0x0], index 1: 0 00000004:00080000:3.0:1789429712.058693:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x245:0x0], index 0: 0 00000004:00080000:0.0:1789429712.070912:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x242:0x0], index 1: 0 00000004:00080000:1.0:1789429712.082760:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x246:0x0], index 0: 0 00000004:00080000:2.0:1789429712.096804:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x243:0x0], index 1: 0 00000004:00080000:0.0:1789429712.107397:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x247:0x0], index 0: 0 00000004:00080000:2.0:1789429712.115244:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x244:0x0], index 1: 0 00000004:00080000:0.0:1789429712.125238:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x248:0x0], index 0: 0 00000004:00080000:1.0:1789429712.132312:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x245:0x0], index 1: 0 00000004:00080000:2.0:1789429712.141006:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x249:0x0], index 0: 0 00000004:00080000:0.0:1789429712.155923:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x246:0x0], index 1: 0 00000004:00080000:0.0:1789429712.171679:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24a:0x0], index 0: 0 00000004:00080000:3.0:1789429712.184083:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x247:0x0], index 1: 0 00000004:00080000:2.0:1789429712.197349:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24b:0x0], index 0: 0 00000004:00080000:2.0:1789429712.207582:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x248:0x0], index 1: 0 00000004:00080000:0.0:1789429712.218749:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24c:0x0], index 0: 0 00000004:00080000:1.0:1789429712.240703:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x249:0x0], index 1: 0 00000004:00080000:3.0:1789429712.252511:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24d:0x0], index 0: 0 00000004:00080000:2.0:1789429712.264414:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24a:0x0], index 1: 0 00000004:00080000:2.0:1789429712.273160:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24e:0x0], index 0: 0 00000004:00080000:2.0:1789429712.299857:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24b:0x0], index 1: 0 00000004:00080000:1.0:1789429712.316407:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24f:0x0], index 0: 0 00000004:00080000:3.0:1789429712.326338:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24c:0x0], index 1: 0 00000004:00080000:2.0:1789429712.347858:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x250:0x0], index 0: 0 00000004:00080000:3.0:1789429712.359317:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24d:0x0], index 1: 0 00000004:00080000:0.0:1789429712.369678:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x251:0x0], index 0: 0 00000004:00080000:2.0:1789429712.378829:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24e:0x0], index 1: 0 00000004:00080000:2.0:1789429712.387478:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x252:0x0], index 0: 0 00002000:00080000:3.0:1789429712.388270:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 610 00000100:00080000:0.0:1789429712.389481:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429712.400427:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x252:0x0]-[0x240000400:0x281:0x0] 00000004:00080000:3.0:1789429712.409471:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24f:0x0], index 1: 0 00000004:00080000:1.0:1789429712.427138:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x253:0x0], index 0: 0 00000004:00080000:2.0:1789429712.438687:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x250:0x0], index 1: 0 00000004:00080000:2.0:1789429712.455823:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x254:0x0], index 0: 0 00000004:00080000:2.0:1789429712.473195:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x251:0x0], index 1: 0 00000004:00080000:0.0:1789429712.491183:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x255:0x0], index 0: 0 00000004:00080000:3.0:1789429712.502751:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x252:0x0], index 1: 0 00002000:00080000:1.0:1789429712.503274:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 610 00000004:00080000:2.0:1789429712.512049:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x252:0x0]-[0x280000400:0x281:0x0] 00000004:00080000:0.0:1789429712.522244:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x256:0x0], index 0: 0 00000004:00080000:2.0:1789429712.536049:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x253:0x0], index 1: 0 00000004:00080000:0.0:1789429712.551071:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x257:0x0], index 0: 0 00000004:00080000:2.0:1789429712.594717:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x254:0x0], index 1: 0 00000004:00080000:0.0:1789429712.605367:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x258:0x0], index 0: 0 00000004:00080000:0.0:1789429712.620465:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x255:0x0], index 1: 0 00000001:00080000:0.0:1789429712.626738:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969620 is committed 00000001:00080000:0.0:1789429712.626814:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969625 is committed 00000004:00080000:1.0:1789429712.640135:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x259:0x0], index 0: 0 00000004:00080000:1.0:1789429712.646755:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x256:0x0], index 1: 0 00000004:00080000:2.0:1789429712.660656:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25a:0x0], index 0: 0 00000004:00080000:0.0:1789429712.667096:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x257:0x0], index 1: 0 00000004:00080000:2.0:1789429712.681618:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25b:0x0], index 0: 0 00000004:00080000:0.0:1789429712.695868:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x258:0x0], index 1: 0 00000004:00080000:1.0:1789429712.725075:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25c:0x0], index 0: 0 00000004:00080000:3.0:1789429712.738671:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x259:0x0], index 1: 0 00000004:00080000:3.0:1789429712.749714:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25d:0x0], index 0: 0 00000004:00080000:2.0:1789429712.776271:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25a:0x0], index 1: 0 00000004:00080000:2.0:1789429712.790993:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25e:0x0], index 0: 0 00000004:00080000:2.0:1789429712.809027:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25b:0x0], index 1: 0 00000004:00080000:3.0:1789429712.827161:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25f:0x0], index 0: 0 00000004:00080000:3.0:1789429712.842479:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25c:0x0], index 1: 0 00000004:00080000:1.0:1789429712.857179:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x260:0x0], index 0: 0 00000004:00080000:1.0:1789429712.878930:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25d:0x0], index 1: 0 00000004:00080000:2.0:1789429712.891112:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x261:0x0], index 0: 0 00000004:00080000:3.0:1789429712.904928:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25e:0x0], index 1: 0 00000004:00080000:3.0:1789429712.924164:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x262:0x0], index 0: 0 00000004:00080000:0.0:1789429712.933240:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25f:0x0], index 1: 0 00000004:00080000:1.0:1789429712.953013:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x263:0x0], index 0: 0 00000004:00080000:0.0:1789429712.971483:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x260:0x0], index 1: 0 00000004:00080000:1.0:1789429712.979004:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x264:0x0], index 0: 0 00000004:00080000:0.0:1789429712.993422:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x261:0x0], index 1: 0 00000004:00080000:0.0:1789429713.012248:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x265:0x0], index 0: 0 00000004:00080000:2.0:1789429713.024858:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x262:0x0], index 1: 0 00000004:00080000:1.0:1789429713.037336:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x266:0x0], index 0: 0 00000004:00080000:1.0:1789429713.053611:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x263:0x0], index 1: 0 00000004:00080000:0.0:1789429713.065027:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x267:0x0], index 0: 0 00000004:00080000:2.0:1789429713.075557:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x264:0x0], index 1: 0 00000004:00080000:0.0:1789429713.093359:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x268:0x0], index 0: 0 00000004:00080000:3.0:1789429713.106323:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x265:0x0], index 1: 0 00000004:00080000:3.0:1789429713.114380:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x269:0x0], index 0: 0 00000004:00080000:0.0:1789429713.122643:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x266:0x0], index 1: 0 00000004:00080000:3.0:1789429713.130400:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26a:0x0], index 0: 0 00000004:00080000:0.0:1789429713.139071:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x267:0x0], index 1: 0 00000004:00080000:0.0:1789429713.152086:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26b:0x0], index 0: 0 00000004:00080000:3.0:1789429713.161387:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x268:0x0], index 1: 0 00000004:00080000:0.0:1789429713.174858:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26c:0x0], index 0: 0 00000004:00080000:1.0:1789429713.184705:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x269:0x0], index 1: 0 00000004:00080000:0.0:1789429713.193479:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26d:0x0], index 0: 0 00000004:00080000:3.0:1789429713.202614:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26a:0x0], index 1: 0 00000004:00080000:2.0:1789429713.212368:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26e:0x0], index 0: 0 00000004:00080000:3.0:1789429713.223474:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26b:0x0], index 1: 0 00000004:00080000:1.0:1789429713.232606:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26f:0x0], index 0: 0 00000004:00080000:3.0:1789429713.241443:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26c:0x0], index 1: 0 00000004:00080000:2.0:1789429713.250167:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x270:0x0], index 0: 0 00000004:00080000:3.0:1789429713.257547:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26d:0x0], index 1: 0 00000004:00080000:2.0:1789429713.268571:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x271:0x0], index 0: 0 00000004:00080000:2.0:1789429713.277302:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26e:0x0], index 1: 0 00000004:00080000:0.0:1789429713.285916:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x272:0x0], index 0: 0 00002000:00080000:0.0:1789429713.287154:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 642 00000004:00080000:0.0:1789429713.293681:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x272:0x0]-[0x240000400:0x2a1:0x0] 00000004:00080000:0.0:1789429713.301294:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26f:0x0], index 1: 0 00000004:00080000:2.0:1789429713.307863:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x273:0x0], index 0: 0 00000004:00080000:3.0:1789429713.319772:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x270:0x0], index 1: 0 00000004:00080000:0.0:1789429713.330945:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x274:0x0], index 0: 0 00000004:00080000:2.0:1789429713.350256:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x271:0x0], index 1: 0 00000004:00080000:0.0:1789429713.363099:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x275:0x0], index 0: 0 00000004:00080000:2.0:1789429713.379846:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x272:0x0], index 1: 0 00002000:00080000:1.0:1789429713.380457:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 642 00000100:00080000:2.0:1789429713.383365:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429713.394564:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x272:0x0]-[0x280000400:0x2a1:0x0] 00000004:00080000:1.0:1789429713.400177:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x276:0x0], index 0: 0 00000004:00080000:2.0:1789429713.418721:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x273:0x0], index 1: 0 00000004:00080000:2.0:1789429713.434827:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x277:0x0], index 0: 0 00000004:00080000:2.0:1789429713.447998:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x274:0x0], index 1: 0 00000004:00080000:2.0:1789429713.467887:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x278:0x0], index 0: 0 00000004:00080000:0.0:1789429713.488066:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x275:0x0], index 1: 0 00000004:00080000:2.0:1789429713.511298:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x279:0x0], index 0: 0 00000004:00080000:2.0:1789429713.525727:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x276:0x0], index 1: 0 00000004:00080000:2.0:1789429713.540563:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27a:0x0], index 0: 0 00000004:00080000:2.0:1789429713.554102:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x277:0x0], index 1: 0 00000004:00080000:0.0:1789429713.569508:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27b:0x0], index 0: 0 00000004:00080000:3.0:1789429713.612185:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x278:0x0], index 1: 0 00000004:00080000:0.0:1789429713.638385:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27c:0x0], index 0: 0 00000004:00080000:2.0:1789429713.650379:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x279:0x0], index 1: 0 00000001:00080000:3.0:1789429713.654888:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294979579 is committed 00000004:00080000:0.0:1789429713.689626:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27d:0x0], index 0: 0 00000004:00080000:1.0:1789429713.708162:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27a:0x0], index 1: 0 00000004:00080000:3.0:1789429713.739151:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27e:0x0], index 0: 0 00000004:00080000:3.0:1789429713.753123:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27b:0x0], index 1: 0 00000004:00080000:2.0:1789429713.775182:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27f:0x0], index 0: 0 00000004:00080000:1.0:1789429713.808394:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27c:0x0], index 1: 0 00000004:00080000:2.0:1789429713.828003:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x280:0x0], index 0: 0 00000004:00080000:3.0:1789429713.839894:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27d:0x0], index 1: 0 00000004:00080000:0.0:1789429713.853850:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x281:0x0], index 0: 0 00000004:00080000:2.0:1789429713.867501:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27e:0x0], index 1: 0 00000004:00080000:1.0:1789429713.883615:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x282:0x0], index 0: 0 00000004:00080000:2.0:1789429713.897330:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27f:0x0], index 1: 0 00000004:00080000:1.0:1789429713.906751:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x283:0x0], index 0: 0 00000004:00080000:2.0:1789429713.923044:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x280:0x0], index 1: 0 00000004:00080000:0.0:1789429713.932042:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x284:0x0], index 0: 0 00000004:00080000:1.0:1789429713.943639:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x281:0x0], index 1: 0 00000004:00080000:0.0:1789429713.961574:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x285:0x0], index 0: 0 00000004:00080000:1.0:1789429713.972589:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x282:0x0], index 1: 0 00000004:00080000:0.0:1789429713.981845:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x286:0x0], index 0: 0 00000004:00080000:2.0:1789429713.992679:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x283:0x0], index 1: 0 00000100:00080000:0.0:1789429714.004059:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429714.007505:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x287:0x0], index 0: 0 00000004:00080000:0.0:1789429714.031690:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x284:0x0], index 1: 0 00000004:00080000:1.0:1789429714.050854:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x288:0x0], index 0: 0 00000004:00080000:2.0:1789429714.075357:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x285:0x0], index 1: 0 00000004:00080000:2.0:1789429714.088417:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x289:0x0], index 0: 0 00000004:00080000:0.0:1789429714.124376:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x286:0x0], index 1: 0 00000004:00080000:3.0:1789429714.139128:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x28a:0x0], index 0: 0 00000001:00080000:2.0:1789429714.161399:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969599 is committed 00000001:00080000:2.0:1789429714.161607:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969601 is committed 00000004:00080000:2.0:1789429714.167716:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x287:0x0], index 1: 0 00000004:00080000:3.0:1789429714.177987:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x28b:0x0], index 0: 0 00000004:00080000:1.0:1789429714.186974:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x288:0x0], index 1: 0 00000004:00080000:3.0:1789429714.196389:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x28c:0x0], index 0: 0 00000004:00080000:1.0:1789429714.205443:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x289:0x0], index 1: 0 00000004:00080000:2.0:1789429714.219270:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x28d:0x0], index 0: 0 00000004:00080000:2.0:1789429714.231123:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x28a:0x0], index 1: 0 00000004:00080000:1.0:1789429714.240138:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x28e:0x0], index 0: 0 00000004:00080000:2.0:1789429714.248409:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x28b:0x0], index 1: 0 00000004:00080000:2.0:1789429714.262350:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x28f:0x0], index 0: 0 00000004:00080000:2.0:1789429714.270317:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x28c:0x0], index 1: 0 00000004:00080000:1.0:1789429714.279529:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x290:0x0], index 0: 0 00000004:00080000:1.0:1789429714.294006:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x28d:0x0], index 1: 0 00000004:00080000:2.0:1789429714.308760:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x291:0x0], index 0: 0 00000004:00080000:1.0:1789429714.322740:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x28e:0x0], index 1: 0 00000004:00080000:1.0:1789429714.336385:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x292:0x0], index 0: 0 00002000:00080000:2.0:1789429714.336414:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 674 00000100:00080000:0.0:1789429714.336974:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429714.348056:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x28f:0x0], index 1: 0 00000004:00080000:1.0:1789429714.366928:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x293:0x0], index 0: 0 00000004:00080000:1.0:1789429714.371194:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x293:0x0]-[0x240000400:0x2c1:0x0] 00000004:00080000:2.0:1789429714.381705:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x290:0x0], index 1: 0 00000004:00080000:1.0:1789429714.402707:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x294:0x0], index 0: 0 00000004:00080000:1.0:1789429714.426451:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x291:0x0], index 1: 0 00000004:00080000:3.0:1789429714.445453:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x295:0x0], index 0: 0 00002000:00080000:0.0:1789429714.465684:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 674 00000004:00080000:1.0:1789429714.466059:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x292:0x0], index 1: 0 00000004:00080000:3.0:1789429714.474506:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x292:0x0]-[0x280000400:0x2c1:0x0] 00000004:00080000:0.0:1789429714.478299:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x296:0x0], index 0: 0 00000004:00080000:1.0:1789429714.486453:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x293:0x0], index 1: 0 00000004:00080000:1.0:1789429714.496586:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x297:0x0], index 0: 0 00000004:00080000:0.0:1789429714.530475:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x294:0x0], index 1: 0 00000004:00080000:1.0:1789429714.550057:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x298:0x0], index 0: 0 00000004:00080000:0.0:1789429714.562284:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x295:0x0], index 1: 0 00000004:00080000:1.0:1789429714.575062:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x299:0x0], index 0: 0 00000004:00080000:1.0:1789429714.592420:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x296:0x0], index 1: 0 00000004:00080000:2.0:1789429714.604537:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x29a:0x0], index 0: 0 00000004:00080000:0.0:1789429714.617905:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x297:0x0], index 1: 0 00000004:00080000:2.0:1789429714.634226:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x29b:0x0], index 0: 0 00000004:00080000:2.0:1789429714.652994:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x298:0x0], index 1: 0 00000004:00080000:3.0:1789429714.691795:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x29c:0x0], index 0: 0 00000100:00080000:3.0:1789429714.709971:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429714.709979:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429714.713828:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x299:0x0], index 1: 0 00000004:00080000:1.0:1789429714.729600:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x29d:0x0], index 0: 0 00000004:00080000:3.0:1789429714.747497:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x29a:0x0], index 1: 0 00000004:00080000:2.0:1789429714.762825:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x29e:0x0], index 0: 0 00000004:00080000:0.0:1789429714.784860:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x29b:0x0], index 1: 0 00000004:00080000:2.0:1789429714.804443:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x29f:0x0], index 0: 0 00000004:00080000:2.0:1789429714.826313:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x29c:0x0], index 1: 0 00000004:00080000:3.0:1789429714.846846:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2a0:0x0], index 0: 0 00000004:00080000:2.0:1789429714.860119:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x29d:0x0], index 1: 0 00000004:00080000:2.0:1789429714.874400:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2a1:0x0], index 0: 0 00000004:00080000:2.0:1789429714.883413:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x29e:0x0], index 1: 0 00000004:00080000:2.0:1789429714.893600:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2a2:0x0], index 0: 0 00000004:00080000:2.0:1789429714.906386:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x29f:0x0], index 1: 0 00000004:00080000:2.0:1789429714.918192:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2a3:0x0], index 0: 0 00000004:00080000:2.0:1789429714.929412:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2a0:0x0], index 1: 0 00000004:00080000:0.0:1789429714.940457:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2a4:0x0], index 0: 0 00000004:00080000:2.0:1789429714.957608:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2a1:0x0], index 1: 0 00000004:00080000:1.0:1789429714.978112:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2a5:0x0], index 0: 0 00000004:00080000:2.0:1789429715.003154:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2a2:0x0], index 1: 0 00000004:00080000:0.0:1789429715.019110:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2a6:0x0], index 0: 0 00000004:00080000:1.0:1789429715.030598:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2a3:0x0], index 1: 0 00000004:00080000:2.0:1789429715.055102:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2a7:0x0], index 0: 0 00000004:00080000:1.0:1789429715.081152:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2a4:0x0], index 1: 0 00000004:00080000:2.0:1789429715.093318:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2a8:0x0], index 0: 0 00000004:00080000:2.0:1789429715.102716:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2a5:0x0], index 1: 0 00000100:00080000:0.0:1789429715.108903:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429715.110042:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429715.113701:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2a9:0x0], index 0: 0 00000004:00080000:0.0:1789429715.125186:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2a6:0x0], index 1: 0 00000004:00080000:3.0:1789429715.139758:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2aa:0x0], index 0: 0 00000004:00080000:3.0:1789429715.153126:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2a7:0x0], index 1: 0 00000004:00080000:3.0:1789429715.167027:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ab:0x0], index 0: 0 00000004:00080000:0.0:1789429715.177435:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2a8:0x0], index 1: 0 00000004:00080000:2.0:1789429715.189123:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ac:0x0], index 0: 0 00000004:00080000:3.0:1789429715.202569:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2a9:0x0], index 1: 0 00000004:00080000:3.0:1789429715.219281:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ad:0x0], index 0: 0 00000004:00080000:3.0:1789429715.246169:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2aa:0x0], index 1: 0 00000004:00080000:2.0:1789429715.272134:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ae:0x0], index 0: 0 00000004:00080000:3.0:1789429715.281453:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ab:0x0], index 1: 0 00000004:00080000:2.0:1789429715.296002:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2af:0x0], index 0: 0 00000004:00080000:3.0:1789429715.315513:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ac:0x0], index 1: 0 00000004:00080000:3.0:1789429715.331138:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2b0:0x0], index 0: 0 00000004:00080000:0.0:1789429715.348041:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ad:0x0], index 1: 0 00000004:00080000:3.0:1789429715.368491:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2b1:0x0], index 0: 0 00000004:00080000:2.0:1789429715.378276:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ae:0x0], index 1: 0 00002000:00080000:1.0:1789429715.391026:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 706 00000004:00080000:3.0:1789429715.393090:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2b2:0x0], index 0: 0 00000004:00080000:2.0:1789429715.398702:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x2b2:0x0]-[0x240000400:0x2e1:0x0] 00000004:00080000:1.0:1789429715.408188:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2af:0x0], index 1: 0 00000004:00080000:2.0:1789429715.418484:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2b3:0x0], index 0: 0 00000004:00080000:2.0:1789429715.429316:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2b0:0x0], index 1: 0 00000004:00080000:2.0:1789429715.444081:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2b4:0x0], index 0: 0 00000004:00080000:2.0:1789429715.459065:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2b1:0x0], index 1: 0 00000004:00080000:1.0:1789429715.472180:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2b5:0x0], index 0: 0 00000004:00080000:0.0:1789429715.488045:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2b2:0x0], index 1: 0 00002000:00080000:1.0:1789429715.489999:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 706 00000004:00080000:2.0:1789429715.506747:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2b6:0x0], index 0: 0 00000004:00080000:3.0:1789429715.510593:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x2b2:0x0]-[0x280000400:0x2e1:0x0] 00000004:00080000:2.0:1789429715.519477:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2b3:0x0], index 1: 0 00000004:00080000:1.0:1789429715.534443:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2b7:0x0], index 0: 0 00000004:00080000:1.0:1789429715.564297:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2b4:0x0], index 1: 0 00000004:00080000:3.0:1789429715.585067:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2b8:0x0], index 0: 0 00000004:00080000:0.0:1789429715.597588:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2b5:0x0], index 1: 0 00000004:00080000:2.0:1789429715.607696:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2b9:0x0], index 0: 0 00000004:00080000:2.0:1789429715.619253:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2b6:0x0], index 1: 0 00000004:00080000:3.0:1789429715.631997:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ba:0x0], index 0: 0 00000004:00080000:2.0:1789429715.645335:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2b7:0x0], index 1: 0 00000004:00080000:0.0:1789429715.656624:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2bb:0x0], index 0: 0 00000004:00080000:0.0:1789429715.667344:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2b8:0x0], index 1: 0 00000004:00080000:2.0:1789429715.679747:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2bc:0x0], index 0: 0 00000004:00080000:1.0:1789429715.690710:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2b9:0x0], index 1: 0 00000004:00080000:1.0:1789429715.702096:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2bd:0x0], index 0: 0 00000004:00080000:0.0:1789429715.710191:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ba:0x0], index 1: 0 00000004:00080000:1.0:1789429715.719710:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2be:0x0], index 0: 0 00000004:00080000:1.0:1789429715.730420:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2bb:0x0], index 1: 0 00000004:00080000:2.0:1789429715.744733:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2bf:0x0], index 0: 0 00000004:00080000:0.0:1789429715.755121:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2bc:0x0], index 1: 0 00000004:00080000:1.0:1789429715.764287:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2c0:0x0], index 0: 0 00000004:00080000:1.0:1789429715.774860:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2bd:0x0], index 1: 0 00000004:00080000:0.0:1789429715.785143:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2c1:0x0], index 0: 0 00000004:00080000:2.0:1789429715.798153:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2be:0x0], index 1: 0 00000004:00080000:1.0:1789429715.814970:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2c2:0x0], index 0: 0 00000004:00080000:1.0:1789429715.824537:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2bf:0x0], index 1: 0 00000004:00080000:0.0:1789429715.835178:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2c3:0x0], index 0: 0 00000004:00080000:0.0:1789429715.846120:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c0:0x0], index 1: 0 00000004:00080000:1.0:1789429715.858441:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2c4:0x0], index 0: 0 00000004:00080000:0.0:1789429715.871712:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c1:0x0], index 1: 0 00000004:00080000:0.0:1789429715.880496:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2c5:0x0], index 0: 0 00000004:00080000:0.0:1789429715.888181:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c2:0x0], index 1: 0 00000004:00080000:0.0:1789429715.897550:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2c6:0x0], index 0: 0 00000004:00080000:0.0:1789429715.910709:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c3:0x0], index 1: 0 00000004:00080000:0.0:1789429715.921064:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2c7:0x0], index 0: 0 00000004:00080000:2.0:1789429715.931998:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c4:0x0], index 1: 0 00000004:00080000:3.0:1789429715.943026:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2c8:0x0], index 0: 0 00000004:00080000:2.0:1789429715.951131:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c5:0x0], index 1: 0 00000004:00080000:0.0:1789429715.963480:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2c9:0x0], index 0: 0 00000004:00080000:0.0:1789429715.971616:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c6:0x0], index 1: 0 00000004:00080000:2.0:1789429715.984422:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ca:0x0], index 0: 0 00000004:00080000:3.0:1789429715.998871:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c7:0x0], index 1: 0 00000100:00080000:2.0:1789429716.008108:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429716.011925:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2cb:0x0], index 0: 0 00000004:00080000:0.0:1789429716.025517:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c8:0x0], index 1: 0 00000004:00080000:0.0:1789429716.043157:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2cc:0x0], index 0: 0 00000004:00080000:0.0:1789429716.062464:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2c9:0x0], index 1: 0 00000004:00080000:2.0:1789429716.082034:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2cd:0x0], index 0: 0 00000004:00080000:0.0:1789429716.097379:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ca:0x0], index 1: 0 00000004:00080000:0.0:1789429716.114348:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ce:0x0], index 0: 0 00000004:00080000:1.0:1789429716.143097:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2cb:0x0], index 1: 0 00000004:00080000:0.0:1789429716.171350:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2cf:0x0], index 0: 0 00000004:00080000:2.0:1789429716.201040:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2cc:0x0], index 1: 0 00000004:00080000:0.0:1789429716.221575:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d0:0x0], index 0: 0 00000004:00080000:0.0:1789429716.241305:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2cd:0x0], index 1: 0 00000004:00080000:2.0:1789429716.262083:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d1:0x0], index 0: 0 00000004:00080000:0.0:1789429716.273250:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ce:0x0], index 1: 0 00000004:00080000:2.0:1789429716.295396:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d2:0x0], index 0: 0 00002000:00080000:2.0:1789429716.296527:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 738 00000004:00080000:0.0:1789429716.299409:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x2d2:0x0]-[0x240000400:0x301:0x0] 00000100:00080000:3.0:1789429716.299494:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429716.306251:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2cf:0x0], index 1: 0 00000004:00080000:0.0:1789429716.315417:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d3:0x0], index 0: 0 00000004:00080000:2.0:1789429716.326621:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2d0:0x0], index 1: 0 00000004:00080000:1.0:1789429716.348555:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d4:0x0], index 0: 0 00000004:00080000:1.0:1789429716.373144:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2d1:0x0], index 1: 0 00000004:00080000:2.0:1789429716.394313:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d5:0x0], index 0: 0 00002000:00080000:0.0:1789429716.414047:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 738 00000004:00080000:2.0:1789429716.420004:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2d2:0x0], index 1: 0 00000004:00080000:3.0:1789429716.420694:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x2d2:0x0]-[0x280000400:0x301:0x0] 00000004:00080000:0.0:1789429716.433002:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d6:0x0], index 0: 0 00000004:00080000:2.0:1789429716.450426:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2d3:0x0], index 1: 0 00000004:00080000:0.0:1789429716.465580:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d7:0x0], index 0: 0 00000004:00080000:3.0:1789429716.484754:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2d4:0x0], index 1: 0 00000004:00080000:2.0:1789429716.504457:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d8:0x0], index 0: 0 00000004:00080000:0.0:1789429716.526095:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2d5:0x0], index 1: 0 00000004:00080000:0.0:1789429716.536900:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2d9:0x0], index 0: 0 00000004:00080000:2.0:1789429716.546647:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2d6:0x0], index 1: 0 00000004:00080000:2.0:1789429716.556250:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2da:0x0], index 0: 0 00000004:00080000:2.0:1789429716.565387:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2d7:0x0], index 1: 0 00000004:00080000:0.0:1789429716.577491:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2db:0x0], index 0: 0 00000004:00080000:0.0:1789429716.584760:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2d8:0x0], index 1: 0 00000004:00080000:2.0:1789429716.595455:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2dc:0x0], index 0: 0 00000004:00080000:2.0:1789429716.605057:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2d9:0x0], index 1: 0 00000004:00080000:0.0:1789429716.630279:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2dd:0x0], index 0: 0 00000004:00080000:0.0:1789429716.645771:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2da:0x0], index 1: 0 00000004:00080000:0.0:1789429716.667635:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2de:0x0], index 0: 0 00000004:00080000:0.0:1789429716.687341:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2db:0x0], index 1: 0 00000004:00080000:2.0:1789429716.702922:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2df:0x0], index 0: 0 00000004:00080000:0.0:1789429716.713489:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2dc:0x0], index 1: 0 00000004:00080000:0.0:1789429716.731117:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e0:0x0], index 0: 0 00000004:00080000:1.0:1789429716.752710:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2dd:0x0], index 1: 0 00000004:00080000:2.0:1789429716.779439:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e1:0x0], index 0: 0 00000004:00080000:2.0:1789429716.797257:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2de:0x0], index 1: 0 00000004:00080000:0.0:1789429716.811162:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e2:0x0], index 0: 0 00000004:00080000:0.0:1789429716.824910:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2df:0x0], index 1: 0 00000004:00080000:1.0:1789429716.859418:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e3:0x0], index 0: 0 00000004:00080000:2.0:1789429716.883705:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e0:0x0], index 1: 0 00000004:00080000:0.0:1789429716.895779:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e4:0x0], index 0: 0 00000004:00080000:0.0:1789429716.906378:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e1:0x0], index 1: 0 00000004:00080000:1.0:1789429716.912645:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e5:0x0], index 0: 0 00000004:00080000:1.0:1789429716.918959:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e2:0x0], index 1: 0 00000004:00080000:2.0:1789429716.927022:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e6:0x0], index 0: 0 00000004:00080000:0.0:1789429716.934374:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e3:0x0], index 1: 0 00000004:00080000:0.0:1789429716.952187:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e7:0x0], index 0: 0 00000004:00080000:1.0:1789429716.983213:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e4:0x0], index 1: 0 00000004:00080000:1.0:1789429717.013353:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e8:0x0], index 0: 0 00000004:00080000:3.0:1789429717.037231:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e5:0x0], index 1: 0 00000004:00080000:0.0:1789429717.057384:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2e9:0x0], index 0: 0 00000004:00080000:0.0:1789429717.076473:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e6:0x0], index 1: 0 00000004:00080000:1.0:1789429717.086914:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ea:0x0], index 0: 0 00000004:00080000:1.0:1789429717.115005:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e7:0x0], index 1: 0 00000004:00080000:2.0:1789429717.132049:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2eb:0x0], index 0: 0 00000004:00080000:0.0:1789429717.152597:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e8:0x0], index 1: 0 00000004:00080000:1.0:1789429717.162617:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ec:0x0], index 0: 0 00000004:00080000:1.0:1789429717.174768:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2e9:0x0], index 1: 0 00000004:00080000:1.0:1789429717.192562:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ed:0x0], index 0: 0 00000004:00080000:3.0:1789429717.203323:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ea:0x0], index 1: 0 00000004:00080000:0.0:1789429717.217735:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ee:0x0], index 0: 0 00000004:00080000:1.0:1789429717.230496:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2eb:0x0], index 1: 0 00000004:00080000:0.0:1789429717.245317:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ef:0x0], index 0: 0 00000004:00080000:0.0:1789429717.262394:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ec:0x0], index 1: 0 00000004:00080000:2.0:1789429717.277340:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f0:0x0], index 0: 0 00000004:00080000:1.0:1789429717.289187:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ed:0x0], index 1: 0 00000004:00080000:1.0:1789429717.314389:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f1:0x0], index 0: 0 00000004:00080000:1.0:1789429717.333195:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ee:0x0], index 1: 0 00000004:00080000:3.0:1789429717.347412:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f2:0x0], index 0: 0 00002000:00080000:0.0:1789429717.354086:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 770 00000004:00080000:3.0:1789429717.364729:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ef:0x0], index 1: 0 00000004:00080000:0.0:1789429717.366061:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x2f2:0x0]-[0x240000400:0x321:0x0] 00000004:00080000:0.0:1789429717.374071:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f3:0x0], index 0: 0 00000004:00080000:1.0:1789429717.387248:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f0:0x0], index 1: 0 00000004:00080000:0.0:1789429717.397827:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f4:0x0], index 0: 0 00000004:00080000:3.0:1789429717.421295:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f1:0x0], index 1: 0 00000004:00080000:2.0:1789429717.433583:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f5:0x0], index 0: 0 00000004:00080000:1.0:1789429717.448687:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f2:0x0], index 1: 0 00000100:00080000:3.0:1789429717.452223:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1789429717.452382:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 770 00000004:00080000:3.0:1789429717.461577:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x2f2:0x0]-[0x280000400:0x321:0x0] 00000004:00080000:1.0:1789429717.465763:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f6:0x0], index 0: 0 00000004:00080000:2.0:1789429717.479449:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f3:0x0], index 1: 0 00000004:00080000:2.0:1789429717.491734:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f7:0x0], index 0: 0 00000004:00080000:0.0:1789429717.500006:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f4:0x0], index 1: 0 00000004:00080000:1.0:1789429717.510478:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f8:0x0], index 0: 0 00000004:00080000:3.0:1789429717.524437:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f5:0x0], index 1: 0 00000004:00080000:2.0:1789429717.548232:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2f9:0x0], index 0: 0 00000004:00080000:2.0:1789429717.561260:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f6:0x0], index 1: 0 00000004:00080000:2.0:1789429717.572531:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2fa:0x0], index 0: 0 00000004:00080000:1.0:1789429717.577326:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f7:0x0], index 1: 0 00000004:00080000:3.0:1789429717.584884:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2fb:0x0], index 0: 0 00000004:00080000:0.0:1789429717.593271:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f8:0x0], index 1: 0 00000004:00080000:0.0:1789429717.605851:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2fc:0x0], index 0: 0 00000004:00080000:0.0:1789429717.626967:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2f9:0x0], index 1: 0 00000004:00080000:0.0:1789429717.637723:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2fd:0x0], index 0: 0 00000004:00080000:3.0:1789429717.649146:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2fa:0x0], index 1: 0 00000004:00080000:0.0:1789429717.660340:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2fe:0x0], index 0: 0 00000004:00080000:3.0:1789429717.677479:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2fb:0x0], index 1: 0 00000004:00080000:0.0:1789429717.696573:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2ff:0x0], index 0: 0 00000004:00080000:2.0:1789429717.715123:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2fc:0x0], index 1: 0 00000004:00080000:1.0:1789429717.736729:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x300:0x0], index 0: 0 00000001:00080000:1.0:1789429717.745598:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969629 is committed 00000001:00080000:1.0:1789429717.745624:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969630 is committed 00000004:00080000:0.0:1789429717.749599:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2fd:0x0], index 1: 0 00000004:00080000:3.0:1789429717.762141:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x301:0x0], index 0: 0 00000004:00080000:0.0:1789429717.776783:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2fe:0x0], index 1: 0 00000004:00080000:1.0:1789429717.787116:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x302:0x0], index 0: 0 00000004:00080000:1.0:1789429717.793403:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2ff:0x0], index 1: 0 00000004:00080000:0.0:1789429717.801294:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x303:0x0], index 0: 0 00000004:00080000:0.0:1789429717.810038:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x300:0x0], index 1: 0 00000004:00080000:1.0:1789429717.817613:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x304:0x0], index 0: 0 00000004:00080000:1.0:1789429717.825005:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x301:0x0], index 1: 0 00000004:00080000:1.0:1789429717.832455:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x305:0x0], index 0: 0 00000004:00080000:2.0:1789429717.852055:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x302:0x0], index 1: 0 00000004:00080000:0.0:1789429717.861880:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x306:0x0], index 0: 0 00000004:00080000:1.0:1789429717.876078:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x303:0x0], index 1: 0 00000004:00080000:3.0:1789429717.888531:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x307:0x0], index 0: 0 00000004:00080000:1.0:1789429717.909565:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x304:0x0], index 1: 0 00000004:00080000:0.0:1789429717.926348:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x308:0x0], index 0: 0 00000004:00080000:0.0:1789429717.937950:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x305:0x0], index 1: 0 00000004:00080000:1.0:1789429717.955607:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x309:0x0], index 0: 0 00000004:00080000:3.0:1789429717.969343:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x306:0x0], index 1: 0 00000004:00080000:1.0:1789429717.985846:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x30a:0x0], index 0: 0 00000004:00080000:3.0:1789429718.000510:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x307:0x0], index 1: 0 00000100:00080000:2.0:1789429718.005840:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429718.013391:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x30b:0x0], index 0: 0 00000004:00080000:1.0:1789429718.021961:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x308:0x0], index 1: 0 00000004:00080000:0.0:1789429718.043184:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x30c:0x0], index 0: 0 00000004:00080000:1.0:1789429718.065920:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x309:0x0], index 1: 0 00000004:00080000:3.0:1789429718.082886:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x30d:0x0], index 0: 0 00000004:00080000:0.0:1789429718.091808:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x30a:0x0], index 1: 0 00000004:00080000:2.0:1789429718.115808:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x30e:0x0], index 0: 0 00000004:00080000:1.0:1789429718.135965:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x30b:0x0], index 1: 0 00000004:00080000:1.0:1789429718.148698:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x30f:0x0], index 0: 0 00000004:00080000:2.0:1789429718.164021:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x30c:0x0], index 1: 0 00000004:00080000:0.0:1789429718.178369:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x310:0x0], index 0: 0 00000004:00080000:2.0:1789429718.194624:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x30d:0x0], index 1: 0 00000004:00080000:1.0:1789429718.210948:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x311:0x0], index 0: 0 00000004:00080000:2.0:1789429718.231058:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x30e:0x0], index 1: 0 00000004:00080000:2.0:1789429718.238663:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x312:0x0], index 0: 0 00002000:00080000:3.0:1789429718.239098:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 802 00000100:00080000:0.0:1789429718.239430:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789429718.243271:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x312:0x0]-[0x240000400:0x341:0x0] 00000004:00080000:0.0:1789429718.252140:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x30f:0x0], index 1: 0 00000004:00080000:2.0:1789429718.259702:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x313:0x0], index 0: 0 00000004:00080000:1.0:1789429718.268241:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x310:0x0], index 1: 0 00000004:00080000:2.0:1789429718.286555:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x314:0x0], index 0: 0 00000004:00080000:2.0:1789429718.303024:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x311:0x0], index 1: 0 00000004:00080000:1.0:1789429718.324343:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x315:0x0], index 0: 0 00000004:00080000:1.0:1789429718.343660:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x312:0x0], index 1: 0 00002000:00080000:2.0:1789429718.348408:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 802 00000004:00080000:0.0:1789429718.363147:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x316:0x0], index 0: 0 00000004:00080000:3.0:1789429718.366130:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x312:0x0]-[0x280000400:0x341:0x0] 00000004:00080000:2.0:1789429718.374422:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x313:0x0], index 1: 0 00000004:00080000:1.0:1789429718.389378:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x317:0x0], index 0: 0 00000004:00080000:1.0:1789429718.415662:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x314:0x0], index 1: 0 00000004:00080000:1.0:1789429718.425118:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x318:0x0], index 0: 0 00000004:00080000:1.0:1789429718.435371:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x315:0x0], index 1: 0 00000004:00080000:2.0:1789429718.450875:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x319:0x0], index 0: 0 00000004:00080000:1.0:1789429718.462346:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x316:0x0], index 1: 0 00000004:00080000:1.0:1789429718.475927:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x31a:0x0], index 0: 0 00000004:00080000:1.0:1789429718.486365:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x317:0x0], index 1: 0 00000004:00080000:1.0:1789429718.497289:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x31b:0x0], index 0: 0 00000004:00080000:2.0:1789429718.507403:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x318:0x0], index 1: 0 00000004:00080000:1.0:1789429718.525259:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x31c:0x0], index 0: 0 00000004:00080000:3.0:1789429718.534724:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x319:0x0], index 1: 0 00000004:00080000:2.0:1789429718.547064:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x31d:0x0], index 0: 0 00000004:00080000:3.0:1789429718.561591:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x31a:0x0], index 1: 0 00000004:00080000:2.0:1789429718.576458:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x31e:0x0], index 0: 0 00000004:00080000:0.0:1789429718.589071:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x31b:0x0], index 1: 0 00000004:00080000:3.0:1789429718.603626:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x31f:0x0], index 0: 0 00000004:00080000:0.0:1789429718.620563:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x31c:0x0], index 1: 0 00000004:00080000:3.0:1789429718.637368:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x320:0x0], index 0: 0 00000004:00080000:2.0:1789429718.654646:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x31d:0x0], index 1: 0 00000004:00080000:1.0:1789429718.664899:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x321:0x0], index 0: 0 00000004:00080000:2.0:1789429718.680490:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x31e:0x0], index 1: 0 00000004:00080000:1.0:1789429718.693336:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x322:0x0], index 0: 0 00000004:00080000:0.0:1789429718.734520:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x31f:0x0], index 1: 0 00000004:00080000:0.0:1789429718.754383:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x323:0x0], index 0: 0 00000004:00080000:3.0:1789429718.776968:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x320:0x0], index 1: 0 00000004:00080000:3.0:1789429718.800574:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x324:0x0], index 0: 0 00000004:00080000:2.0:1789429718.812769:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x321:0x0], index 1: 0 00000001:00080000:1.0:1789429718.820450:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294980237 is committed 00000001:00080000:1.0:1789429718.820898:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294980244 is committed 00000001:00080000:1.0:1789429718.821821:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294980245 is committed 00000001:00080000:1.0:1789429718.823554:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294980246 is committed 00000004:00080000:0.0:1789429718.826716:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x325:0x0], index 0: 0 00000004:00080000:0.0:1789429718.839976:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x322:0x0], index 1: 0 00000004:00080000:1.0:1789429718.851279:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x326:0x0], index 0: 0 00000004:00080000:3.0:1789429718.867862:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x323:0x0], index 1: 0 00000004:00080000:1.0:1789429718.884701:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x327:0x0], index 0: 0 00000004:00080000:1.0:1789429718.897002:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x324:0x0], index 1: 0 00000004:00080000:3.0:1789429718.910376:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x328:0x0], index 0: 0 00000004:00080000:2.0:1789429718.921973:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x325:0x0], index 1: 0 00000004:00080000:2.0:1789429718.938659:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x329:0x0], index 0: 0 00000004:00080000:2.0:1789429718.952235:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x326:0x0], index 1: 0 00000004:00080000:0.0:1789429718.968444:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x32a:0x0], index 0: 0 00000004:00080000:2.0:1789429718.980025:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x327:0x0], index 1: 0 00000004:00080000:2.0:1789429718.998275:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x32b:0x0], index 0: 0 00000004:00080000:2.0:1789429719.027796:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x328:0x0], index 1: 0 00000004:00080000:3.0:1789429719.060169:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x32c:0x0], index 0: 0 00000004:00080000:1.0:1789429719.107769:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x329:0x0], index 1: 0 00000004:00080000:2.0:1789429719.143700:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x32d:0x0], index 0: 0 00000004:00080000:1.0:1789429719.170568:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x32a:0x0], index 1: 0 00000004:00080000:2.0:1789429719.189963:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x32e:0x0], index 0: 0 00000004:00080000:1.0:1789429719.216231:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x32b:0x0], index 1: 0 00000004:00080000:1.0:1789429719.259563:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x32f:0x0], index 0: 0 00000004:00080000:0.0:1789429719.276929:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x32c:0x0], index 1: 0 00000004:00080000:3.0:1789429719.302351:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x330:0x0], index 0: 0 00000004:00080000:3.0:1789429719.337030:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x32d:0x0], index 1: 0 00000001:00080000:0.0:1789429719.338460:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969605 is committed 00000001:00080000:0.0:1789429719.338496:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969606 is committed 00000004:00080000:1.0:1789429719.361500:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x331:0x0], index 0: 0 00000004:00080000:0.0:1789429719.384505:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x32e:0x0], index 1: 0 00000004:00080000:0.0:1789429719.417726:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x332:0x0], index 0: 0 00002000:00080000:1.0:1789429719.418324:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 834 00000004:00080000:2.0:1789429719.432322:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x332:0x0]-[0x240000400:0x361:0x0] 00000004:00080000:2.0:1789429719.441022:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x32f:0x0], index 1: 0 00000004:00080000:2.0:1789429719.467659:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x333:0x0], index 0: 0 00000004:00080000:2.0:1789429719.482320:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x330:0x0], index 1: 0 00000004:00080000:2.0:1789429719.494406:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x334:0x0], index 0: 0 00000004:00080000:1.0:1789429719.508518:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x331:0x0], index 1: 0 00000004:00080000:2.0:1789429719.523294:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x335:0x0], index 0: 0 00000004:00080000:1.0:1789429719.548693:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x332:0x0], index 1: 0 00002000:00080000:1.0:1789429719.551465:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 834 00000100:00080000:0.0:1789429719.554032:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429719.567985:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x336:0x0], index 0: 0 00000004:00080000:2.0:1789429719.570053:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x332:0x0]-[0x280000400:0x361:0x0] 00000004:00080000:1.0:1789429719.585506:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x333:0x0], index 1: 0 00000004:00080000:0.0:1789429719.611006:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x337:0x0], index 0: 0 00000004:00080000:2.0:1789429719.626358:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x334:0x0], index 1: 0 00000004:00080000:0.0:1789429719.667697:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x338:0x0], index 0: 0 00000004:00080000:2.0:1789429719.689009:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x335:0x0], index 1: 0 00000004:00080000:2.0:1789429719.698122:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x339:0x0], index 0: 0 00000004:00080000:0.0:1789429719.705956:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x336:0x0], index 1: 0 00000004:00080000:2.0:1789429719.717043:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x33a:0x0], index 0: 0 00000004:00080000:0.0:1789429719.726975:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x337:0x0], index 1: 0 00000004:00080000:0.0:1789429719.739080:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x33b:0x0], index 0: 0 00000004:00080000:0.0:1789429719.747359:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x338:0x0], index 1: 0 00000004:00080000:1.0:1789429719.756404:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x33c:0x0], index 0: 0 00000004:00080000:3.0:1789429719.774298:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x339:0x0], index 1: 0 00000004:00080000:2.0:1789429719.786537:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x33d:0x0], index 0: 0 00000004:00080000:2.0:1789429719.803593:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x33a:0x0], index 1: 0 00000004:00080000:1.0:1789429719.820732:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x33e:0x0], index 0: 0 00000100:00080000:0.0:1789429719.836837:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429719.843222:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429719.847677:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x33b:0x0], index 1: 0 00000004:00080000:0.0:1789429719.858121:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x33f:0x0], index 0: 0 00000004:00080000:2.0:1789429719.869325:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x33c:0x0], index 1: 0 00000004:00080000:1.0:1789429719.880832:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x340:0x0], index 0: 0 00000004:00080000:2.0:1789429719.894668:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x33d:0x0], index 1: 0 00000004:00080000:3.0:1789429719.906824:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x341:0x0], index 0: 0 00000004:00080000:2.0:1789429719.918177:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x33e:0x0], index 1: 0 00000004:00080000:2.0:1789429719.932665:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x342:0x0], index 0: 0 00000004:00080000:1.0:1789429719.944901:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x33f:0x0], index 1: 0 00000004:00080000:2.0:1789429719.958432:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x343:0x0], index 0: 0 00000004:00080000:2.0:1789429719.975387:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x340:0x0], index 1: 0 00000004:00080000:2.0:1789429719.986507:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x344:0x0], index 0: 0 00000100:00080000:0.0:1789429720.001441:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429720.001875:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x341:0x0], index 1: 0 00000004:00080000:1.0:1789429720.028862:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x345:0x0], index 0: 0 00000004:00080000:2.0:1789429720.041700:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x342:0x0], index 1: 0 00000004:00080000:2.0:1789429720.077288:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x346:0x0], index 0: 0 00000004:00080000:2.0:1789429720.094750:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x343:0x0], index 1: 0 00000004:00080000:2.0:1789429720.108123:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x347:0x0], index 0: 0 00000004:00080000:1.0:1789429720.127012:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x344:0x0], index 1: 0 00000004:00080000:2.0:1789429720.137587:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x348:0x0], index 0: 0 00000004:00080000:3.0:1789429720.165759:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x345:0x0], index 1: 0 00000004:00080000:2.0:1789429720.179022:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x349:0x0], index 0: 0 00000004:00080000:0.0:1789429720.203625:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x346:0x0], index 1: 0 00000004:00080000:1.0:1789429720.214149:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x34a:0x0], index 0: 0 00000004:00080000:1.0:1789429720.227866:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x347:0x0], index 1: 0 00000100:00080000:2.0:1789429720.229577:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429720.229586:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429720.254589:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x34b:0x0], index 0: 0 00000004:00080000:2.0:1789429720.280164:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x348:0x0], index 1: 0 00000004:00080000:0.0:1789429720.290343:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x34c:0x0], index 0: 0 00000004:00080000:2.0:1789429720.300777:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x349:0x0], index 1: 0 00000004:00080000:1.0:1789429720.310509:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x34d:0x0], index 0: 0 00000004:00080000:0.0:1789429720.321708:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x34a:0x0], index 1: 0 00000004:00080000:3.0:1789429720.349285:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x34e:0x0], index 0: 0 00000004:00080000:2.0:1789429720.369084:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x34b:0x0], index 1: 0 00000004:00080000:3.0:1789429720.384174:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x34f:0x0], index 0: 0 00000004:00080000:1.0:1789429720.395510:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x34c:0x0], index 1: 0 00000004:00080000:0.0:1789429720.414154:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x350:0x0], index 0: 0 00000004:00080000:3.0:1789429720.433436:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x34d:0x0], index 1: 0 00000004:00080000:3.0:1789429720.443853:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x351:0x0], index 0: 0 00000004:00080000:2.0:1789429720.463083:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x34e:0x0], index 1: 0 00000004:00080000:0.0:1789429720.476987:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x352:0x0], index 0: 0 00002000:00080000:0.0:1789429720.478684:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 866 00000004:00080000:2.0:1789429720.491956:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x34f:0x0], index 1: 0 00000004:00080000:1.0:1789429720.492189:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x352:0x0]-[0x240000400:0x381:0x0] 00000004:00080000:2.0:1789429720.505990:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x353:0x0], index 0: 0 00000004:00080000:0.0:1789429720.527502:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x350:0x0], index 1: 0 00000004:00080000:2.0:1789429720.543711:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x354:0x0], index 0: 0 00000004:00080000:0.0:1789429720.556510:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x351:0x0], index 1: 0 00000004:00080000:2.0:1789429720.571125:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x355:0x0], index 0: 0 00000004:00080000:0.0:1789429720.589195:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x352:0x0], index 1: 0 00002000:00080000:3.0:1789429720.590171:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 866 00000004:00080000:2.0:1789429720.605403:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x352:0x0]-[0x280000400:0x381:0x0] 00000004:00080000:0.0:1789429720.609637:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x356:0x0], index 0: 0 00000004:00080000:3.0:1789429720.620665:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x353:0x0], index 1: 0 00000004:00080000:0.0:1789429720.637675:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x357:0x0], index 0: 0 00000004:00080000:2.0:1789429720.648790:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x354:0x0], index 1: 0 00000004:00080000:0.0:1789429720.670365:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x358:0x0], index 0: 0 00000004:00080000:0.0:1789429720.685152:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x355:0x0], index 1: 0 00000004:00080000:2.0:1789429720.694168:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x359:0x0], index 0: 0 00000004:00080000:3.0:1789429720.702673:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x356:0x0], index 1: 0 00000004:00080000:2.0:1789429720.712131:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x35a:0x0], index 0: 0 00000004:00080000:0.0:1789429720.732416:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x357:0x0], index 1: 0 00000004:00080000:2.0:1789429720.752802:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x35b:0x0], index 0: 0 00000004:00080000:2.0:1789429720.767079:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x358:0x0], index 1: 0 00000004:00080000:1.0:1789429720.789026:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x35c:0x0], index 0: 0 00000004:00080000:0.0:1789429720.802172:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x359:0x0], index 1: 0 00000004:00080000:0.0:1789429720.814637:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x35d:0x0], index 0: 0 00000004:00080000:2.0:1789429720.821407:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x35a:0x0], index 1: 0 00000004:00080000:3.0:1789429720.828675:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x35e:0x0], index 0: 0 00000004:00080000:1.0:1789429720.840372:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x35b:0x0], index 1: 0 00000004:00080000:3.0:1789429720.852877:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x35f:0x0], index 0: 0 00000004:00080000:2.0:1789429720.863819:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x35c:0x0], index 1: 0 00000004:00080000:3.0:1789429720.870014:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x360:0x0], index 0: 0 00000004:00080000:3.0:1789429720.877343:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x35d:0x0], index 1: 0 00000004:00080000:1.0:1789429720.892557:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x361:0x0], index 0: 0 00000004:00080000:3.0:1789429720.900696:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x35e:0x0], index 1: 0 00000004:00080000:3.0:1789429720.908380:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x362:0x0], index 0: 0 00000004:00080000:2.0:1789429720.917663:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x35f:0x0], index 1: 0 00000004:00080000:3.0:1789429720.929042:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x363:0x0], index 0: 0 00000004:00080000:1.0:1789429720.938408:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x360:0x0], index 1: 0 00000004:00080000:3.0:1789429720.948520:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x364:0x0], index 0: 0 00000004:00080000:2.0:1789429720.962058:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x361:0x0], index 1: 0 00000004:00080000:2.0:1789429720.973108:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x365:0x0], index 0: 0 00000004:00080000:1.0:1789429720.997173:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x362:0x0], index 1: 0 00000004:00080000:2.0:1789429721.012094:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x366:0x0], index 0: 0 00000004:00080000:2.0:1789429721.023938:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x363:0x0], index 1: 0 00000004:00080000:2.0:1789429721.057441:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x367:0x0], index 0: 0 00000004:00080000:2.0:1789429721.083730:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x364:0x0], index 1: 0 00000004:00080000:2.0:1789429721.096652:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x368:0x0], index 0: 0 00000004:00080000:2.0:1789429721.106819:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x365:0x0], index 1: 0 00000004:00080000:2.0:1789429721.115635:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x369:0x0], index 0: 0 00000004:00080000:2.0:1789429721.124988:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x366:0x0], index 1: 0 00000004:00080000:2.0:1789429721.135801:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x36a:0x0], index 0: 0 00000004:00080000:2.0:1789429721.145066:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x367:0x0], index 1: 0 00000004:00080000:2.0:1789429721.152036:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x36b:0x0], index 0: 0 00000004:00080000:2.0:1789429721.160129:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x368:0x0], index 1: 0 00000004:00080000:2.0:1789429721.170521:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x36c:0x0], index 0: 0 00000004:00080000:2.0:1789429721.178012:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x369:0x0], index 1: 0 00000004:00080000:2.0:1789429721.184624:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x36d:0x0], index 0: 0 00000004:00080000:2.0:1789429721.192399:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x36a:0x0], index 1: 0 00000004:00080000:2.0:1789429721.201833:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x36e:0x0], index 0: 0 00000004:00080000:1.0:1789429721.209375:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x36b:0x0], index 1: 0 00000004:00080000:2.0:1789429721.218177:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x36f:0x0], index 0: 0 00000004:00080000:2.0:1789429721.227538:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x36c:0x0], index 1: 0 00000004:00080000:2.0:1789429721.240460:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x370:0x0], index 0: 0 00000004:00080000:2.0:1789429721.251453:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x36d:0x0], index 1: 0 00000004:00080000:2.0:1789429721.269304:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x371:0x0], index 0: 0 00000004:00080000:2.0:1789429721.282367:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x36e:0x0], index 1: 0 00000004:00080000:2.0:1789429721.292996:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x372:0x0], index 0: 0 00002000:00080000:3.0:1789429721.294137:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 898 00000004:00080000:2.0:1789429721.309888:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x36f:0x0], index 1: 0 00000004:00080000:1.0:1789429721.310934:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x372:0x0]-[0x240000400:0x3a1:0x0] 00000004:00080000:0.0:1789429721.321242:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x373:0x0], index 0: 0 00000004:00080000:2.0:1789429721.330087:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x370:0x0], index 1: 0 00000004:00080000:0.0:1789429721.341564:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x374:0x0], index 0: 0 00000004:00080000:0.0:1789429721.354002:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x371:0x0], index 1: 0 00000004:00080000:2.0:1789429721.375531:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x375:0x0], index 0: 0 00000004:00080000:3.0:1789429721.391507:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x372:0x0], index 1: 0 00002000:00080000:3.0:1789429721.395885:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 898 00000100:00080000:2.0:1789429721.400843:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429721.406174:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x376:0x0], index 0: 0 00000004:00080000:2.0:1789429721.417647:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x372:0x0]-[0x280000400:0x3a1:0x0] 00000004:00080000:3.0:1789429721.421923:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x373:0x0], index 1: 0 00000004:00080000:1.0:1789429721.434127:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x377:0x0], index 0: 0 00000004:00080000:3.0:1789429721.450567:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x374:0x0], index 1: 0 00000004:00080000:2.0:1789429721.460243:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x378:0x0], index 0: 0 00000004:00080000:1.0:1789429721.486041:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x375:0x0], index 1: 0 00000004:00080000:0.0:1789429721.514519:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x379:0x0], index 0: 0 00000004:00080000:3.0:1789429721.533671:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x376:0x0], index 1: 0 00000004:00080000:1.0:1789429721.556663:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x37a:0x0], index 0: 0 00000004:00080000:2.0:1789429721.587409:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x377:0x0], index 1: 0 00000004:00080000:3.0:1789429721.599722:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x37b:0x0], index 0: 0 00000004:00080000:0.0:1789429721.615424:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x378:0x0], index 1: 0 00000004:00080000:3.0:1789429721.635989:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x37c:0x0], index 0: 0 00000004:00080000:1.0:1789429721.652438:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x379:0x0], index 1: 0 00000004:00080000:0.0:1789429721.678276:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x37d:0x0], index 0: 0 00000004:00080000:0.0:1789429721.699429:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x37a:0x0], index 1: 0 00000004:00080000:2.0:1789429721.715029:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x37e:0x0], index 0: 0 00000004:00080000:0.0:1789429721.731904:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x37b:0x0], index 1: 0 00000004:00080000:1.0:1789429721.753858:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x37f:0x0], index 0: 0 00000004:00080000:2.0:1789429721.767084:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x37c:0x0], index 1: 0 00000004:00080000:1.0:1789429721.803287:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x380:0x0], index 0: 0 00000004:00080000:2.0:1789429721.820296:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x37d:0x0], index 1: 0 00000004:00080000:0.0:1789429721.843697:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x381:0x0], index 0: 0 00000004:00080000:3.0:1789429721.860656:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x37e:0x0], index 1: 0 00000004:00080000:0.0:1789429721.878286:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x382:0x0], index 0: 0 00000004:00080000:1.0:1789429721.897310:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x37f:0x0], index 1: 0 00000004:00080000:1.0:1789429721.914842:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x383:0x0], index 0: 0 00000004:00080000:0.0:1789429721.929337:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x380:0x0], index 1: 0 00000004:00080000:3.0:1789429721.952702:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x384:0x0], index 0: 0 00000004:00080000:2.0:1789429721.977710:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x381:0x0], index 1: 0 00000004:00080000:1.0:1789429721.990399:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x385:0x0], index 0: 0 00000100:00080000:2.0:1789429722.006652:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429722.007483:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x382:0x0], index 1: 0 00000004:00080000:1.0:1789429722.023637:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x386:0x0], index 0: 0 00000004:00080000:3.0:1789429722.066662:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x383:0x0], index 1: 0 00000004:00080000:2.0:1789429722.094960:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x387:0x0], index 0: 0 00000004:00080000:1.0:1789429722.106176:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x384:0x0], index 1: 0 00000004:00080000:1.0:1789429722.131169:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x388:0x0], index 0: 0 00000004:00080000:1.0:1789429722.148423:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x385:0x0], index 1: 0 00000004:00080000:0.0:1789429722.175647:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x389:0x0], index 0: 0 00000004:00080000:2.0:1789429722.198486:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x386:0x0], index 1: 0 00000004:00080000:0.0:1789429722.213732:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x38a:0x0], index 0: 0 00000004:00080000:1.0:1789429722.237701:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x387:0x0], index 1: 0 00000004:00080000:1.0:1789429722.261814:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x38b:0x0], index 0: 0 00000004:00080000:0.0:1789429722.277188:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x388:0x0], index 1: 0 00000004:00080000:2.0:1789429722.294058:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x38c:0x0], index 0: 0 00000004:00080000:0.0:1789429722.309640:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x389:0x0], index 1: 0 00000004:00080000:1.0:1789429722.328446:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x38d:0x0], index 0: 0 00000004:00080000:0.0:1789429722.343305:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x38a:0x0], index 1: 0 00000004:00080000:1.0:1789429722.362421:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x38e:0x0], index 0: 0 00000004:00080000:3.0:1789429722.389676:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x38b:0x0], index 1: 0 00000004:00080000:0.0:1789429722.404103:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x38f:0x0], index 0: 0 00000004:00080000:1.0:1789429722.416656:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x38c:0x0], index 1: 0 00000004:00080000:0.0:1789429722.428759:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x390:0x0], index 0: 0 00000004:00080000:1.0:1789429722.461103:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x38d:0x0], index 1: 0 00000004:00080000:0.0:1789429722.481117:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x391:0x0], index 0: 0 00000004:00080000:2.0:1789429722.501421:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x38e:0x0], index 1: 0 00000004:00080000:1.0:1789429722.514395:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x392:0x0], index 0: 0 00002000:00080000:2.0:1789429722.516580:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 930 00000100:00080000:0.0:1789429722.516656:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429722.522099:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x392:0x0]-[0x240000400:0x3c1:0x0] 00000004:00080000:3.0:1789429722.530559:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x38f:0x0], index 1: 0 00000004:00080000:1.0:1789429722.545325:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x393:0x0], index 0: 0 00000004:00080000:0.0:1789429722.553800:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x390:0x0], index 1: 0 00000004:00080000:2.0:1789429722.562595:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x394:0x0], index 0: 0 00000004:00080000:1.0:1789429722.570276:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x391:0x0], index 1: 0 00000004:00080000:3.0:1789429722.590179:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x395:0x0], index 0: 0 00000004:00080000:1.0:1789429722.606047:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x392:0x0], index 1: 0 00002000:00080000:0.0:1789429722.606972:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 930 00000004:00080000:3.0:1789429722.620664:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x392:0x0]-[0x280000400:0x3c1:0x0] 00000004:00080000:1.0:1789429722.621121:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x396:0x0], index 0: 0 00000004:00080000:1.0:1789429722.631899:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x393:0x0], index 1: 0 00000004:00080000:1.0:1789429722.645654:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x397:0x0], index 0: 0 00000004:00080000:3.0:1789429722.656153:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x394:0x0], index 1: 0 00000004:00080000:1.0:1789429722.672132:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x398:0x0], index 0: 0 00000004:00080000:1.0:1789429722.682614:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x395:0x0], index 1: 0 00000004:00080000:2.0:1789429722.693233:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x399:0x0], index 0: 0 00000004:00080000:3.0:1789429722.702584:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x396:0x0], index 1: 0 00000004:00080000:2.0:1789429722.715920:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x39a:0x0], index 0: 0 00000004:00080000:1.0:1789429722.733280:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x397:0x0], index 1: 0 00000004:00080000:1.0:1789429722.745331:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x39b:0x0], index 0: 0 00000004:00080000:1.0:1789429722.754722:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x398:0x0], index 1: 0 00000004:00080000:3.0:1789429722.765191:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x39c:0x0], index 0: 0 00000004:00080000:2.0:1789429722.774669:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x399:0x0], index 1: 0 00000004:00080000:1.0:1789429722.785788:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x39d:0x0], index 0: 0 00000004:00080000:0.0:1789429722.800600:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x39a:0x0], index 1: 0 00000004:00080000:3.0:1789429722.816592:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x39e:0x0], index 0: 0 00000004:00080000:3.0:1789429722.831260:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x39b:0x0], index 1: 0 00000004:00080000:0.0:1789429722.848484:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x39f:0x0], index 0: 0 00000001:00080000:1.0:1789429722.851652:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969635 is committed 00000004:00080000:1.0:1789429722.855818:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x39c:0x0], index 1: 0 00000004:00080000:3.0:1789429722.869477:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3a0:0x0], index 0: 0 00000004:00080000:3.0:1789429722.883503:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x39d:0x0], index 1: 0 00000004:00080000:0.0:1789429722.894263:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3a1:0x0], index 0: 0 00000004:00080000:0.0:1789429722.904319:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x39e:0x0], index 1: 0 00000004:00080000:3.0:1789429722.912845:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3a2:0x0], index 0: 0 00000004:00080000:1.0:1789429722.922002:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x39f:0x0], index 1: 0 00000004:00080000:2.0:1789429722.933691:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3a3:0x0], index 0: 0 00000004:00080000:2.0:1789429722.946948:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3a0:0x0], index 1: 0 00000004:00080000:0.0:1789429722.960000:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3a4:0x0], index 0: 0 00000004:00080000:1.0:1789429722.980585:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3a1:0x0], index 1: 0 00000004:00080000:0.0:1789429722.992576:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3a5:0x0], index 0: 0 00000004:00080000:3.0:1789429723.009427:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3a2:0x0], index 1: 0 00000004:00080000:0.0:1789429723.021116:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3a6:0x0], index 0: 0 00000004:00080000:0.0:1789429723.035983:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3a3:0x0], index 1: 0 00000004:00080000:3.0:1789429723.048718:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3a7:0x0], index 0: 0 00000004:00080000:1.0:1789429723.060158:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3a4:0x0], index 1: 0 00000004:00080000:3.0:1789429723.074129:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3a8:0x0], index 0: 0 00000004:00080000:1.0:1789429723.082290:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3a5:0x0], index 1: 0 00000004:00080000:1.0:1789429723.091073:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3a9:0x0], index 0: 0 00000004:00080000:0.0:1789429723.110587:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3a6:0x0], index 1: 0 00000004:00080000:0.0:1789429723.125567:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3aa:0x0], index 0: 0 00000004:00080000:3.0:1789429723.136176:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3a7:0x0], index 1: 0 00000004:00080000:0.0:1789429723.148789:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ab:0x0], index 0: 0 00000004:00080000:1.0:1789429723.161178:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3a8:0x0], index 1: 0 00000004:00080000:0.0:1789429723.172314:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ac:0x0], index 0: 0 00000004:00080000:0.0:1789429723.183783:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3a9:0x0], index 1: 0 00000004:00080000:3.0:1789429723.193489:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ad:0x0], index 0: 0 00000004:00080000:3.0:1789429723.205446:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3aa:0x0], index 1: 0 00000004:00080000:1.0:1789429723.216177:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ae:0x0], index 0: 0 00000004:00080000:0.0:1789429723.224512:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ab:0x0], index 1: 0 00000004:00080000:1.0:1789429723.239120:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3af:0x0], index 0: 0 00000004:00080000:3.0:1789429723.248999:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ac:0x0], index 1: 0 00000004:00080000:2.0:1789429723.268144:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3b0:0x0], index 0: 0 00000004:00080000:2.0:1789429723.282016:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ad:0x0], index 1: 0 00000004:00080000:0.0:1789429723.294017:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3b1:0x0], index 0: 0 00000004:00080000:2.0:1789429723.314817:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ae:0x0], index 1: 0 00000004:00080000:3.0:1789429723.322121:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3b2:0x0], index 0: 0 00002000:00080000:3.0:1789429723.326697:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 962 00000004:00080000:2.0:1789429723.333504:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3af:0x0], index 1: 0 00000004:00080000:0.0:1789429723.335422:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x3b2:0x0]-[0x240000400:0x3e1:0x0] 00000004:00080000:2.0:1789429723.355663:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3b3:0x0], index 0: 0 00000004:00080000:3.0:1789429723.369583:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3b0:0x0], index 1: 0 00000004:00080000:3.0:1789429723.381081:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3b4:0x0], index 0: 0 00000004:00080000:1.0:1789429723.388799:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3b1:0x0], index 1: 0 00000004:00080000:2.0:1789429723.396178:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3b5:0x0], index 0: 0 00002000:00080000:0.0:1789429723.407097:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 962 00000004:00080000:2.0:1789429723.407169:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3b2:0x0], index 1: 0 00000100:00080000:1.0:1789429723.409424:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789429723.418189:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3b6:0x0], index 0: 0 00000004:00080000:3.0:1789429723.423847:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x3b2:0x0]-[0x280000400:0x3e1:0x0] 00000004:00080000:3.0:1789429723.433476:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3b3:0x0], index 1: 0 00000004:00080000:1.0:1789429723.446165:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3b7:0x0], index 0: 0 00000004:00080000:2.0:1789429723.453612:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3b4:0x0], index 1: 0 00000004:00080000:2.0:1789429723.468261:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3b8:0x0], index 0: 0 00000004:00080000:2.0:1789429723.478475:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3b5:0x0], index 1: 0 00000004:00080000:3.0:1789429723.485862:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3b9:0x0], index 0: 0 00000004:00080000:0.0:1789429723.495676:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3b6:0x0], index 1: 0 00000004:00080000:0.0:1789429723.504318:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ba:0x0], index 0: 0 00000004:00080000:2.0:1789429723.512631:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3b7:0x0], index 1: 0 00000004:00080000:2.0:1789429723.523154:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3bb:0x0], index 0: 0 00000004:00080000:2.0:1789429723.533412:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3b8:0x0], index 1: 0 00000004:00080000:1.0:1789429723.542728:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3bc:0x0], index 0: 0 00000004:00080000:2.0:1789429723.561587:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3b9:0x0], index 1: 0 00000004:00080000:2.0:1789429723.573666:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3bd:0x0], index 0: 0 00000004:00080000:2.0:1789429723.585014:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ba:0x0], index 1: 0 00000004:00080000:2.0:1789429723.601112:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3be:0x0], index 0: 0 00000004:00080000:0.0:1789429723.613194:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3bb:0x0], index 1: 0 00000004:00080000:2.0:1789429723.633682:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3bf:0x0], index 0: 0 00000004:00080000:1.0:1789429723.642027:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3bc:0x0], index 1: 0 00000004:00080000:2.0:1789429723.650680:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3c0:0x0], index 0: 0 00000004:00080000:2.0:1789429723.657770:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3bd:0x0], index 1: 0 00000004:00080000:1.0:1789429723.664559:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3c1:0x0], index 0: 0 00000004:00080000:2.0:1789429723.672667:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3be:0x0], index 1: 0 00000004:00080000:1.0:1789429723.681730:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3c2:0x0], index 0: 0 00000004:00080000:2.0:1789429723.690862:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3bf:0x0], index 1: 0 00000004:00080000:2.0:1789429723.698735:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3c3:0x0], index 0: 0 00000004:00080000:2.0:1789429723.713132:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3c0:0x0], index 1: 0 00000004:00080000:2.0:1789429723.720784:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3c4:0x0], index 0: 0 00000004:00080000:0.0:1789429723.737324:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3c1:0x0], index 1: 0 00000004:00080000:2.0:1789429723.745603:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3c5:0x0], index 0: 0 00000004:00080000:2.0:1789429723.756821:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3c2:0x0], index 1: 0 00000004:00080000:2.0:1789429723.764629:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3c6:0x0], index 0: 0 00000004:00080000:2.0:1789429723.770681:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3c3:0x0], index 1: 0 00000004:00080000:1.0:1789429723.778598:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3c7:0x0], index 0: 0 00000004:00080000:2.0:1789429723.788841:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3c4:0x0], index 1: 0 00000004:00080000:2.0:1789429723.796570:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3c8:0x0], index 0: 0 00000004:00080000:2.0:1789429723.804355:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3c5:0x0], index 1: 0 00000004:00080000:2.0:1789429723.814510:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3c9:0x0], index 0: 0 00000004:00080000:1.0:1789429723.839066:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3c6:0x0], index 1: 0 00000004:00080000:3.0:1789429723.847125:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ca:0x0], index 0: 0 00000001:00080000:0.0:1789429723.855825:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294980897 is committed 00000001:00080000:0.0:1789429723.856093:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294980914 is committed 00000004:00080000:2.0:1789429723.857381:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3c7:0x0], index 1: 0 00000004:00080000:2.0:1789429723.866825:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3cb:0x0], index 0: 0 00000004:00080000:2.0:1789429723.872467:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3c8:0x0], index 1: 0 00000004:00080000:1.0:1789429723.882648:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3cc:0x0], index 0: 0 00000004:00080000:1.0:1789429723.893544:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3c9:0x0], index 1: 0 00000004:00080000:2.0:1789429723.903660:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3cd:0x0], index 0: 0 00000004:00080000:2.0:1789429723.912411:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ca:0x0], index 1: 0 00000004:00080000:0.0:1789429723.930060:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ce:0x0], index 0: 0 00000004:00080000:1.0:1789429723.949525:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3cb:0x0], index 1: 0 00000004:00080000:0.0:1789429723.970008:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3cf:0x0], index 0: 0 00000004:00080000:0.0:1789429723.994602:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3cc:0x0], index 1: 0 00000100:00080000:0.0:1789429724.005935:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429724.007052:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3d0:0x0], index 0: 0 00000004:00080000:2.0:1789429724.017621:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3cd:0x0], index 1: 0 00000004:00080000:1.0:1789429724.026045:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3d1:0x0], index 0: 0 00000004:00080000:2.0:1789429724.041121:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ce:0x0], index 1: 0 00000004:00080000:0.0:1789429724.050337:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3d2:0x0], index 0: 0 00002000:00080000:0.0:1789429724.051711:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 994 00000100:00080000:1.0:1789429724.054574:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789429724.056974:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x3d2:0x0]-[0x240000400:0x401:0x0] 00000004:00080000:1.0:1789429724.063111:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3cf:0x0], index 1: 0 00000004:00080000:2.0:1789429724.073075:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3d3:0x0], index 0: 0 00000004:00080000:1.0:1789429724.092969:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3d0:0x0], index 1: 0 00000004:00080000:1.0:1789429724.101662:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3d4:0x0], index 0: 0 00000004:00080000:2.0:1789429724.127592:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3d1:0x0], index 1: 0 00000004:00080000:2.0:1789429724.148523:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3d5:0x0], index 0: 0 00000004:00080000:2.0:1789429724.156520:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3d2:0x0], index 1: 0 00002000:00080000:1.0:1789429724.157035:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 994 00000004:00080000:3.0:1789429724.161098:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x3d2:0x0]-[0x280000400:0x401:0x0] 00000004:00080000:2.0:1789429724.164780:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3d6:0x0], index 0: 0 00000004:00080000:0.0:1789429724.174789:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3d3:0x0], index 1: 0 00000004:00080000:2.0:1789429724.184551:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3d7:0x0], index 0: 0 00000004:00080000:2.0:1789429724.193056:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3d4:0x0], index 1: 0 00000004:00080000:2.0:1789429724.201260:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3d8:0x0], index 0: 0 00000004:00080000:0.0:1789429724.214893:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3d5:0x0], index 1: 0 00000004:00080000:2.0:1789429724.235751:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3d9:0x0], index 0: 0 00000004:00080000:2.0:1789429724.250086:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3d6:0x0], index 1: 0 00000004:00080000:2.0:1789429724.262696:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3da:0x0], index 0: 0 00000004:00080000:0.0:1789429724.272776:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3d7:0x0], index 1: 0 00000004:00080000:0.0:1789429724.282309:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3db:0x0], index 0: 0 00000004:00080000:2.0:1789429724.294927:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3d8:0x0], index 1: 0 00000004:00080000:2.0:1789429724.307166:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3dc:0x0], index 0: 0 00000004:00080000:2.0:1789429724.329859:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3d9:0x0], index 1: 0 00000004:00080000:0.0:1789429724.340423:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3dd:0x0], index 0: 0 00000004:00080000:3.0:1789429724.368590:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3da:0x0], index 1: 0 00000004:00080000:2.0:1789429724.390848:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3de:0x0], index 0: 0 00000001:00080000:3.0:1789429724.393098:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969612 is committed 00000004:00080000:0.0:1789429724.406869:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3db:0x0], index 1: 0 00000004:00080000:2.0:1789429724.415086:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3df:0x0], index 0: 0 00000004:00080000:0.0:1789429724.424730:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3dc:0x0], index 1: 0 00000004:00080000:1.0:1789429724.439794:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3e0:0x0], index 0: 0 00000004:00080000:3.0:1789429724.458074:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3dd:0x0], index 1: 0 00000004:00080000:0.0:1789429724.468933:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3e1:0x0], index 0: 0 00000004:00080000:2.0:1789429724.478514:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3de:0x0], index 1: 0 00000004:00080000:0.0:1789429724.489254:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3e2:0x0], index 0: 0 00000004:00080000:2.0:1789429724.499432:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3df:0x0], index 1: 0 00000004:00080000:3.0:1789429724.512692:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3e3:0x0], index 0: 0 00000004:00080000:2.0:1789429724.521055:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3e0:0x0], index 1: 0 00000004:00080000:3.0:1789429724.529573:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3e4:0x0], index 0: 0 00000004:00080000:2.0:1789429724.539490:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3e1:0x0], index 1: 0 00000004:00080000:2.0:1789429724.556772:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3e5:0x0], index 0: 0 00000004:00080000:3.0:1789429724.569099:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3e2:0x0], index 1: 0 00000004:00080000:1.0:1789429724.579337:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3e6:0x0], index 0: 0 00000004:00080000:3.0:1789429724.584764:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3e3:0x0], index 1: 0 00000004:00080000:2.0:1789429724.594932:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3e7:0x0], index 0: 0 00000004:00080000:2.0:1789429724.602589:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3e4:0x0], index 1: 0 00000004:00080000:3.0:1789429724.618155:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3e8:0x0], index 0: 0 00000004:00080000:1.0:1789429724.641194:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3e5:0x0], index 1: 0 00000004:00080000:3.0:1789429724.676472:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3e9:0x0], index 0: 0 00000004:00080000:2.0:1789429724.694294:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3e6:0x0], index 1: 0 00000004:00080000:0.0:1789429724.739961:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ea:0x0], index 0: 0 00000004:00080000:1.0:1789429724.783067:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3e7:0x0], index 1: 0 00000004:00080000:1.0:1789429724.812928:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3eb:0x0], index 0: 0 00000004:00080000:2.0:1789429724.832676:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3e8:0x0], index 1: 0 00000004:00080000:2.0:1789429724.844696:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ec:0x0], index 0: 0 00000004:00080000:0.0:1789429724.857856:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3e9:0x0], index 1: 0 00000004:00080000:1.0:1789429724.868723:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ed:0x0], index 0: 0 00000004:00080000:1.0:1789429724.879625:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ea:0x0], index 1: 0 00000004:00080000:0.0:1789429724.892757:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ee:0x0], index 0: 0 00000004:00080000:3.0:1789429724.904553:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3eb:0x0], index 1: 0 00000004:00080000:3.0:1789429724.915638:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ef:0x0], index 0: 0 00000004:00080000:3.0:1789429724.930411:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ec:0x0], index 1: 0 00000004:00080000:0.0:1789429724.949034:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3f0:0x0], index 0: 0 00000100:00080000:1.0:1789429724.950849:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429724.952599:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429724.982496:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ed:0x0], index 1: 0 00000004:00080000:1.0:1789429724.992347:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3f1:0x0], index 0: 0 00000004:00080000:2.0:1789429725.006521:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ee:0x0], index 1: 0 00000004:00080000:2.0:1789429725.021794:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3f2:0x0], index 0: 0 00002000:00080000:3.0:1789429725.023302:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1026 00000004:00080000:0.0:1789429725.049250:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ef:0x0], index 1: 0 00000004:00080000:1.0:1789429725.061594:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x3f2:0x0]-[0x240000400:0x421:0x0] 00000004:00080000:3.0:1789429725.067982:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3f3:0x0], index 0: 0 00000004:00080000:1.0:1789429725.079195:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3f0:0x0], index 1: 0 00000004:00080000:0.0:1789429725.089237:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3f4:0x0], index 0: 0 00000004:00080000:0.0:1789429725.100570:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3f1:0x0], index 1: 0 00000004:00080000:0.0:1789429725.111576:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3f5:0x0], index 0: 0 00000004:00080000:3.0:1789429725.123149:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3f2:0x0], index 1: 0 00002000:00080000:1.0:1789429725.123359:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1026 00000100:00080000:0.0:1789429725.125650:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429725.128276:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x3f2:0x0]-[0x280000400:0x421:0x0] 00000004:00080000:1.0:1789429725.142183:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3f6:0x0], index 0: 0 00000004:00080000:0.0:1789429725.157133:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3f3:0x0], index 1: 0 00000004:00080000:2.0:1789429725.173576:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3f7:0x0], index 0: 0 00000004:00080000:2.0:1789429725.186438:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3f4:0x0], index 1: 0 00000004:00080000:1.0:1789429725.198485:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3f8:0x0], index 0: 0 00000004:00080000:1.0:1789429725.212841:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3f5:0x0], index 1: 0 00000004:00080000:1.0:1789429725.225041:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3f9:0x0], index 0: 0 00000004:00080000:2.0:1789429725.240576:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3f6:0x0], index 1: 0 00000004:00080000:2.0:1789429725.251266:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3fa:0x0], index 0: 0 00000004:00080000:0.0:1789429725.261297:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3f7:0x0], index 1: 0 00000004:00080000:0.0:1789429725.270631:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3fb:0x0], index 0: 0 00000004:00080000:1.0:1789429725.283395:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3f8:0x0], index 1: 0 00000004:00080000:1.0:1789429725.294768:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3fc:0x0], index 0: 0 00000004:00080000:1.0:1789429725.305685:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3f9:0x0], index 1: 0 00000004:00080000:1.0:1789429725.313511:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3fd:0x0], index 0: 0 00000004:00080000:1.0:1789429725.336014:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3fa:0x0], index 1: 0 00000004:00080000:0.0:1789429725.346683:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3fe:0x0], index 0: 0 00000100:00080000:2.0:1789429725.348024:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429725.373557:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3fb:0x0], index 1: 0 00000004:00080000:1.0:1789429725.407816:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3ff:0x0], index 0: 0 00000004:00080000:1.0:1789429725.424623:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3fc:0x0], index 1: 0 00000004:00080000:0.0:1789429725.440168:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x400:0x0], index 0: 0 00000004:00080000:0.0:1789429725.458098:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3fd:0x0], index 1: 0 00000004:00080000:0.0:1789429725.466119:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x401:0x0], index 0: 0 00000004:00080000:2.0:1789429725.480747:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3fe:0x0], index 1: 0 00000004:00080000:1.0:1789429725.489562:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x402:0x0], index 0: 0 00000004:00080000:0.0:1789429725.504543:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3ff:0x0], index 1: 0 00000004:00080000:1.0:1789429725.514497:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x403:0x0], index 0: 0 00000004:00080000:0.0:1789429725.525011:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x400:0x0], index 1: 0 00000004:00080000:2.0:1789429725.533860:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x404:0x0], index 0: 0 00000004:00080000:2.0:1789429725.546944:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x401:0x0], index 1: 0 00000004:00080000:0.0:1789429725.565826:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x405:0x0], index 0: 0 00000004:00080000:0.0:1789429725.575139:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x402:0x0], index 1: 0 00000004:00080000:0.0:1789429725.584560:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x406:0x0], index 0: 0 00000004:00080000:0.0:1789429725.593993:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x403:0x0], index 1: 0 00000004:00080000:0.0:1789429725.608586:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x407:0x0], index 0: 0 00000004:00080000:0.0:1789429725.620948:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x404:0x0], index 1: 0 00000004:00080000:2.0:1789429725.633073:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x408:0x0], index 0: 0 00000004:00080000:2.0:1789429725.648564:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x405:0x0], index 1: 0 00000004:00080000:2.0:1789429725.662444:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x409:0x0], index 0: 0 00000004:00080000:2.0:1789429725.671881:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x406:0x0], index 1: 0 00000004:00080000:1.0:1789429725.683784:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x40a:0x0], index 0: 0 00000004:00080000:1.0:1789429725.699795:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x407:0x0], index 1: 0 00000004:00080000:0.0:1789429725.716690:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x40b:0x0], index 0: 0 00000004:00080000:0.0:1789429725.732147:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x408:0x0], index 1: 0 00000004:00080000:2.0:1789429725.743043:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x40c:0x0], index 0: 0 00000004:00080000:2.0:1789429725.754754:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x409:0x0], index 1: 0 00000004:00080000:2.0:1789429725.764711:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x40d:0x0], index 0: 0 00000004:00080000:0.0:1789429725.777857:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x40a:0x0], index 1: 0 00000004:00080000:0.0:1789429725.787491:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x40e:0x0], index 0: 0 00000004:00080000:0.0:1789429725.796787:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x40b:0x0], index 1: 0 00000004:00080000:2.0:1789429725.815328:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x40f:0x0], index 0: 0 00000004:00080000:2.0:1789429725.828113:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x40c:0x0], index 1: 0 00000004:00080000:0.0:1789429725.838691:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x410:0x0], index 0: 0 00000004:00080000:0.0:1789429725.852977:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x40d:0x0], index 1: 0 00000004:00080000:0.0:1789429725.864084:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x411:0x0], index 0: 0 00000004:00080000:2.0:1789429725.873195:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x40e:0x0], index 1: 0 00000004:00080000:2.0:1789429725.887796:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x412:0x0], index 0: 0 00002000:00080000:3.0:1789429725.889135:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1058 00000004:00080000:1.0:1789429725.900751:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x40f:0x0], index 1: 0 00000004:00080000:2.0:1789429725.902453:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x412:0x0]-[0x240000400:0x441:0x0] 00000004:00080000:0.0:1789429725.923570:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x413:0x0], index 0: 0 00000004:00080000:0.0:1789429725.941727:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x410:0x0], index 1: 0 00000004:00080000:0.0:1789429725.958757:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x414:0x0], index 0: 0 00000004:00080000:2.0:1789429725.981260:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x411:0x0], index 1: 0 00000004:00080000:1.0:1789429725.996189:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x415:0x0], index 0: 0 00000100:00080000:2.0:1789429726.014300:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429726.019812:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x412:0x0], index 1: 0 00002000:00080000:0.0:1789429726.026595:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1058 00000004:00080000:2.0:1789429726.039293:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x412:0x0]-[0x280000400:0x441:0x0] 00000004:00080000:0.0:1789429726.044889:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x416:0x0], index 0: 0 00000004:00080000:1.0:1789429726.066502:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x413:0x0], index 1: 0 00000004:00080000:3.0:1789429726.079607:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x417:0x0], index 0: 0 00000004:00080000:1.0:1789429726.095974:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x414:0x0], index 1: 0 00000004:00080000:2.0:1789429726.112614:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x418:0x0], index 0: 0 00000004:00080000:2.0:1789429726.126890:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x415:0x0], index 1: 0 00000004:00080000:0.0:1789429726.142247:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x419:0x0], index 0: 0 00000004:00080000:3.0:1789429726.158543:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x416:0x0], index 1: 0 00000004:00080000:1.0:1789429726.171484:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41a:0x0], index 0: 0 00000004:00080000:2.0:1789429726.192747:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x417:0x0], index 1: 0 00000004:00080000:0.0:1789429726.205313:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41b:0x0], index 0: 0 00000004:00080000:3.0:1789429726.220370:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x418:0x0], index 1: 0 00000004:00080000:3.0:1789429726.242140:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41c:0x0], index 0: 0 00000004:00080000:0.0:1789429726.261443:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x419:0x0], index 1: 0 00000004:00080000:2.0:1789429726.276124:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41d:0x0], index 0: 0 00000004:00080000:2.0:1789429726.289426:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41a:0x0], index 1: 0 00000004:00080000:2.0:1789429726.315344:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41e:0x0], index 0: 0 00000004:00080000:3.0:1789429726.346498:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41b:0x0], index 1: 0 00000004:00080000:0.0:1789429726.375434:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x41f:0x0], index 0: 0 00000004:00080000:0.0:1789429726.402843:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41c:0x0], index 1: 0 00000004:00080000:0.0:1789429726.438482:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x420:0x0], index 0: 0 00000004:00080000:0.0:1789429726.457875:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41d:0x0], index 1: 0 00000004:00080000:0.0:1789429726.494349:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x421:0x0], index 0: 0 00000004:00080000:0.0:1789429726.507023:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41e:0x0], index 1: 0 00000004:00080000:0.0:1789429726.532811:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x422:0x0], index 0: 0 00000004:00080000:1.0:1789429726.579182:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x41f:0x0], index 1: 0 00000004:00080000:2.0:1789429726.590364:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x423:0x0], index 0: 0 00000004:00080000:0.0:1789429726.615120:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x420:0x0], index 1: 0 00000004:00080000:1.0:1789429726.629751:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x424:0x0], index 0: 0 00000004:00080000:1.0:1789429726.646314:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x421:0x0], index 1: 0 00000004:00080000:1.0:1789429726.656676:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x425:0x0], index 0: 0 00000004:00080000:3.0:1789429726.670681:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x422:0x0], index 1: 0 00000004:00080000:0.0:1789429726.691688:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x426:0x0], index 0: 0 00000004:00080000:1.0:1789429726.708310:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x423:0x0], index 1: 0 00000004:00080000:1.0:1789429726.722365:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x427:0x0], index 0: 0 00000004:00080000:1.0:1789429726.736614:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x424:0x0], index 1: 0 00000004:00080000:3.0:1789429726.758141:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x428:0x0], index 0: 0 00000004:00080000:0.0:1789429726.772129:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x425:0x0], index 1: 0 00000004:00080000:1.0:1789429726.784623:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x429:0x0], index 0: 0 00000004:00080000:0.0:1789429726.797590:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x426:0x0], index 1: 0 00000004:00080000:1.0:1789429726.815658:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42a:0x0], index 0: 0 00000004:00080000:2.0:1789429726.846330:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x427:0x0], index 1: 0 00000004:00080000:0.0:1789429726.863041:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42b:0x0], index 0: 0 00000004:00080000:1.0:1789429726.874296:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x428:0x0], index 1: 0 00000004:00080000:0.0:1789429726.894578:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42c:0x0], index 0: 0 00000004:00080000:0.0:1789429726.942416:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x429:0x0], index 1: 0 00000004:00080000:3.0:1789429726.963387:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42d:0x0], index 0: 0 00000004:00080000:0.0:1789429726.980538:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42a:0x0], index 1: 0 00000004:00080000:2.0:1789429727.039322:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42e:0x0], index 0: 0 00000004:00080000:1.0:1789429727.068050:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42b:0x0], index 1: 0 00000004:00080000:0.0:1789429727.084740:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42f:0x0], index 0: 0 00000004:00080000:3.0:1789429727.107439:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42c:0x0], index 1: 0 00000004:00080000:2.0:1789429727.157589:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x430:0x0], index 0: 0 00000004:00080000:2.0:1789429727.179662:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42d:0x0], index 1: 0 00000004:00080000:0.0:1789429727.197153:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x431:0x0], index 0: 0 00000004:00080000:0.0:1789429727.205935:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42e:0x0], index 1: 0 00002000:00080000:0.0:1789429727.214818:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1090 00000100:00080000:3.0:1789429727.218020:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429727.222580:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x431:0x0]-[0x240000400:0x461:0x0] 00000004:00080000:2.0:1789429727.223288:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x432:0x0], index 0: 0 00000004:00080000:3.0:1789429727.233048:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42f:0x0], index 1: 0 00000004:00080000:2.0:1789429727.242093:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x433:0x0], index 0: 0 00000004:00080000:2.0:1789429727.252548:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x430:0x0], index 1: 0 00000004:00080000:0.0:1789429727.261831:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x434:0x0], index 0: 0 00000004:00080000:1.0:1789429727.271929:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x431:0x0], index 1: 0 00000004:00080000:3.0:1789429727.282733:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x435:0x0], index 0: 0 00000004:00080000:0.0:1789429727.297786:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x432:0x0], index 1: 0 00002000:00080000:1.0:1789429727.299330:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1090 00000100:00080000:3.0:1789429727.303412:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429727.307708:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x432:0x0]-[0x280000400:0x461:0x0] 00000004:00080000:0.0:1789429727.321077:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x436:0x0], index 0: 0 00000004:00080000:1.0:1789429727.334351:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x433:0x0], index 1: 0 00000004:00080000:1.0:1789429727.349352:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x437:0x0], index 0: 0 00000004:00080000:2.0:1789429727.368995:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x434:0x0], index 1: 0 00000004:00080000:0.0:1789429727.392648:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x438:0x0], index 0: 0 00000004:00080000:0.0:1789429727.417534:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x435:0x0], index 1: 0 00000004:00080000:1.0:1789429727.431431:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x439:0x0], index 0: 0 00000004:00080000:3.0:1789429727.456292:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x436:0x0], index 1: 0 00000004:00080000:0.0:1789429727.469405:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x43a:0x0], index 0: 0 00000004:00080000:2.0:1789429727.488085:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x437:0x0], index 1: 0 00000004:00080000:2.0:1789429727.506594:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x43b:0x0], index 0: 0 00000004:00080000:2.0:1789429727.518779:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x438:0x0], index 1: 0 00000004:00080000:3.0:1789429727.543443:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x43c:0x0], index 0: 0 00000004:00080000:0.0:1789429727.555562:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x439:0x0], index 1: 0 00000004:00080000:2.0:1789429727.564698:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x43d:0x0], index 0: 0 00000004:00080000:2.0:1789429727.576919:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x43a:0x0], index 1: 0 00000004:00080000:3.0:1789429727.592397:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x43e:0x0], index 0: 0 00000004:00080000:1.0:1789429727.609655:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x43b:0x0], index 1: 0 00000004:00080000:0.0:1789429727.629630:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x43f:0x0], index 0: 0 00000004:00080000:0.0:1789429727.640731:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x43c:0x0], index 1: 0 00000004:00080000:2.0:1789429727.656064:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x440:0x0], index 0: 0 00000004:00080000:0.0:1789429727.666040:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x43d:0x0], index 1: 0 00000004:00080000:1.0:1789429727.680739:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x441:0x0], index 0: 0 00000004:00080000:0.0:1789429727.690027:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x43e:0x0], index 1: 0 00000004:00080000:3.0:1789429727.698952:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x442:0x0], index 0: 0 00000004:00080000:3.0:1789429727.707740:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x43f:0x0], index 1: 0 00000004:00080000:0.0:1789429727.716325:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x443:0x0], index 0: 0 00000004:00080000:2.0:1789429727.725866:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x440:0x0], index 1: 0 00000004:00080000:0.0:1789429727.735926:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x444:0x0], index 0: 0 00000004:00080000:1.0:1789429727.747635:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x441:0x0], index 1: 0 00000004:00080000:0.0:1789429727.757438:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x445:0x0], index 0: 0 00000004:00080000:1.0:1789429727.768142:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x442:0x0], index 1: 0 00000004:00080000:1.0:1789429727.776846:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x446:0x0], index 0: 0 00000004:00080000:2.0:1789429727.786529:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x443:0x0], index 1: 0 00000004:00080000:1.0:1789429727.802139:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x447:0x0], index 0: 0 00000004:00080000:1.0:1789429727.810830:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x444:0x0], index 1: 0 00000004:00080000:1.0:1789429727.819751:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x448:0x0], index 0: 0 00000004:00080000:2.0:1789429727.829889:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x445:0x0], index 1: 0 00000004:00080000:2.0:1789429727.839260:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x449:0x0], index 0: 0 00000004:00080000:2.0:1789429727.851801:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x446:0x0], index 1: 0 00000004:00080000:0.0:1789429727.859895:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x44a:0x0], index 0: 0 00000004:00080000:3.0:1789429727.869195:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x447:0x0], index 1: 0 00000004:00080000:3.0:1789429727.877735:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x44b:0x0], index 0: 0 00000004:00080000:2.0:1789429727.886644:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x448:0x0], index 1: 0 00000004:00080000:2.0:1789429727.896925:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x44c:0x0], index 0: 0 00000004:00080000:2.0:1789429727.905685:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x449:0x0], index 1: 0 00000004:00080000:3.0:1789429727.928777:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x44d:0x0], index 0: 0 00000004:00080000:1.0:1789429727.971469:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x44a:0x0], index 1: 0 00000004:00080000:2.0:1789429728.002727:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x44e:0x0], index 0: 0 00000100:00080000:1.0:1789429728.015061:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429728.022918:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x44b:0x0], index 1: 0 00000001:00080000:2.0:1789429728.032682:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969639 is committed 00000001:00080000:2.0:1789429728.032739:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969640 is committed 00000004:00080000:2.0:1789429728.038603:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x44f:0x0], index 0: 0 00000004:00080000:0.0:1789429728.065251:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x44c:0x0], index 1: 0 00000004:00080000:1.0:1789429728.079994:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x450:0x0], index 0: 0 00000004:00080000:2.0:1789429728.097061:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x44d:0x0], index 1: 0 00000004:00080000:3.0:1789429728.112059:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x451:0x0], index 0: 0 00000004:00080000:2.0:1789429728.127223:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x44e:0x0], index 1: 0 00000004:00080000:0.0:1789429728.150229:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x452:0x0], index 0: 0 00000004:00080000:2.0:1789429728.164783:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x44f:0x0], index 1: 0 00002000:00080000:0.0:1789429728.166110:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1122 00000004:00080000:1.0:1789429728.174686:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x452:0x0]-[0x240000400:0x481:0x0] 00000004:00080000:2.0:1789429728.182666:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x453:0x0], index 0: 0 00000004:00080000:2.0:1789429728.211455:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x450:0x0], index 1: 0 00000004:00080000:2.0:1789429728.229103:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x454:0x0], index 0: 0 00000004:00080000:0.0:1789429728.245336:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x451:0x0], index 1: 0 00000004:00080000:2.0:1789429728.255709:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x455:0x0], index 0: 0 00002000:00080000:3.0:1789429728.266221:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1122 00000004:00080000:1.0:1789429728.266790:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x452:0x0], index 1: 0 00000004:00080000:2.0:1789429728.281232:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x456:0x0], index 0: 0 00000004:00080000:0.0:1789429728.297179:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x452:0x0]-[0x280000400:0x481:0x0] 00000004:00080000:2.0:1789429728.308430:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x453:0x0], index 1: 0 00000004:00080000:2.0:1789429728.318338:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x457:0x0], index 0: 0 00000004:00080000:2.0:1789429728.340440:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x454:0x0], index 1: 0 00000004:00080000:2.0:1789429728.355715:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x458:0x0], index 0: 0 00000004:00080000:0.0:1789429728.368478:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x455:0x0], index 1: 0 00000004:00080000:3.0:1789429728.377683:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x459:0x0], index 0: 0 00000004:00080000:1.0:1789429728.400173:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x456:0x0], index 1: 0 00000004:00080000:3.0:1789429728.416003:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x45a:0x0], index 0: 0 00000004:00080000:0.0:1789429728.428092:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x457:0x0], index 1: 0 00000004:00080000:1.0:1789429728.446060:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x45b:0x0], index 0: 0 00000004:00080000:3.0:1789429728.477073:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x458:0x0], index 1: 0 00000004:00080000:2.0:1789429728.493776:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x45c:0x0], index 0: 0 00000004:00080000:0.0:1789429728.519486:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x459:0x0], index 1: 0 00000004:00080000:1.0:1789429728.555494:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x45d:0x0], index 0: 0 00000004:00080000:1.0:1789429728.566945:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x45a:0x0], index 1: 0 00000004:00080000:3.0:1789429728.576051:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x45e:0x0], index 0: 0 00000004:00080000:1.0:1789429728.593810:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x45b:0x0], index 1: 0 00000004:00080000:3.0:1789429728.611365:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x45f:0x0], index 0: 0 00000004:00080000:1.0:1789429728.626581:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x45c:0x0], index 1: 0 00000004:00080000:2.0:1789429728.647075:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x460:0x0], index 0: 0 00000004:00080000:2.0:1789429728.661973:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x45d:0x0], index 1: 0 00000004:00080000:2.0:1789429728.678241:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x461:0x0], index 0: 0 00000004:00080000:2.0:1789429728.688098:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x45e:0x0], index 1: 0 00000004:00080000:1.0:1789429728.701985:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x462:0x0], index 0: 0 00000004:00080000:3.0:1789429728.715128:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x45f:0x0], index 1: 0 00000004:00080000:2.0:1789429728.726357:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x463:0x0], index 0: 0 00000004:00080000:0.0:1789429728.741296:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x460:0x0], index 1: 0 00000004:00080000:0.0:1789429728.752362:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x464:0x0], index 0: 0 00000004:00080000:1.0:1789429728.767045:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x461:0x0], index 1: 0 00000004:00080000:0.0:1789429728.778333:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x465:0x0], index 0: 0 00000004:00080000:0.0:1789429728.787103:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x462:0x0], index 1: 0 00000004:00080000:0.0:1789429728.805434:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x466:0x0], index 0: 0 00000004:00080000:0.0:1789429728.815619:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x463:0x0], index 1: 0 00000004:00080000:1.0:1789429728.827062:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x467:0x0], index 0: 0 00000004:00080000:0.0:1789429728.842080:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x464:0x0], index 1: 0 00000004:00080000:0.0:1789429728.854112:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x468:0x0], index 0: 0 00000004:00080000:2.0:1789429728.865110:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x465:0x0], index 1: 0 00000004:00080000:2.0:1789429728.876262:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x469:0x0], index 0: 0 00000004:00080000:2.0:1789429728.886621:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x466:0x0], index 1: 0 00000004:00080000:0.0:1789429728.898302:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46a:0x0], index 0: 0 00000004:00080000:0.0:1789429728.907987:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x467:0x0], index 1: 0 00000004:00080000:2.0:1789429728.919074:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46b:0x0], index 0: 0 00000004:00080000:0.0:1789429728.930081:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x468:0x0], index 1: 0 00000004:00080000:3.0:1789429728.981920:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46c:0x0], index 0: 0 00000004:00080000:1.0:1789429728.995117:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x469:0x0], index 1: 0 00000004:00080000:1.0:1789429729.014967:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46d:0x0], index 0: 0 00000004:00080000:2.0:1789429729.032707:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46a:0x0], index 1: 0 00000004:00080000:0.0:1789429729.049028:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46e:0x0], index 0: 0 00000001:00080000:1.0:1789429729.051455:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294981565 is committed 00000004:00080000:2.0:1789429729.067518:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46b:0x0], index 1: 0 00000004:00080000:1.0:1789429729.079613:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x46f:0x0], index 0: 0 00000004:00080000:0.0:1789429729.101054:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46c:0x0], index 1: 0 00000004:00080000:2.0:1789429729.125878:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x470:0x0], index 0: 0 00000004:00080000:0.0:1789429729.135000:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46d:0x0], index 1: 0 00000004:00080000:2.0:1789429729.145956:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x471:0x0], index 0: 0 00000004:00080000:2.0:1789429729.159849:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46e:0x0], index 1: 0 00002000:00080000:3.0:1789429729.171964:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1154 00000004:00080000:2.0:1789429729.174023:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x472:0x0], index 0: 0 00000100:00080000:1.0:1789429729.174285:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429729.189079:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x46f:0x0], index 1: 0 00000004:00080000:1.0:1789429729.198054:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x472:0x0]-[0x240000400:0x4a1:0x0] 00000004:00080000:3.0:1789429729.204773:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x473:0x0], index 0: 0 00000004:00080000:0.0:1789429729.214136:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x470:0x0], index 1: 0 00000004:00080000:3.0:1789429729.224799:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x474:0x0], index 0: 0 00000004:00080000:0.0:1789429729.237099:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x471:0x0], index 1: 0 00000004:00080000:1.0:1789429729.247917:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x475:0x0], index 0: 0 00002000:00080000:2.0:1789429729.259157:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1154 00000100:00080000:1.0:1789429729.262478:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429729.263273:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x471:0x0]-[0x280000400:0x4a1:0x0] 00000004:00080000:3.0:1789429729.263810:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x472:0x0], index 1: 0 00000004:00080000:1.0:1789429729.280952:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x476:0x0], index 0: 0 00000004:00080000:2.0:1789429729.291196:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x473:0x0], index 1: 0 00000004:00080000:0.0:1789429729.301074:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x477:0x0], index 0: 0 00000004:00080000:2.0:1789429729.310617:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x474:0x0], index 1: 0 00000004:00080000:3.0:1789429729.320085:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x478:0x0], index 0: 0 00000004:00080000:2.0:1789429729.331042:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x475:0x0], index 1: 0 00000004:00080000:1.0:1789429729.351050:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x479:0x0], index 0: 0 00000004:00080000:2.0:1789429729.357420:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x476:0x0], index 1: 0 00000004:00080000:2.0:1789429729.379891:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x47a:0x0], index 0: 0 00000004:00080000:2.0:1789429729.413601:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x477:0x0], index 1: 0 00000004:00080000:2.0:1789429729.422093:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x47b:0x0], index 0: 0 00000004:00080000:1.0:1789429729.438293:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x478:0x0], index 1: 0 00000004:00080000:3.0:1789429729.463099:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x47c:0x0], index 0: 0 00000004:00080000:0.0:1789429729.481353:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x479:0x0], index 1: 0 00000004:00080000:1.0:1789429729.498425:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x47d:0x0], index 0: 0 00000004:00080000:2.0:1789429729.509453:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x47a:0x0], index 1: 0 00000004:00080000:0.0:1789429729.520076:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x47e:0x0], index 0: 0 00000004:00080000:2.0:1789429729.532465:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x47b:0x0], index 1: 0 00000004:00080000:3.0:1789429729.542811:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x47f:0x0], index 0: 0 00000001:00080000:0.0:1789429729.543125:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969616 is committed 00000001:00080000:0.0:1789429729.543168:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969617 is committed 00000004:00080000:1.0:1789429729.550240:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x47c:0x0], index 1: 0 00000004:00080000:2.0:1789429729.560105:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x480:0x0], index 0: 0 00000004:00080000:0.0:1789429729.573476:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x47d:0x0], index 1: 0 00000004:00080000:0.0:1789429729.587380:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x481:0x0], index 0: 0 00000004:00080000:0.0:1789429729.594472:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x47e:0x0], index 1: 0 00000004:00080000:0.0:1789429729.608649:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x482:0x0], index 0: 0 00000004:00080000:2.0:1789429729.633283:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x47f:0x0], index 1: 0 00000004:00080000:2.0:1789429729.647895:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x483:0x0], index 0: 0 00000004:00080000:0.0:1789429729.674264:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x480:0x0], index 1: 0 00000004:00080000:0.0:1789429729.688977:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x484:0x0], index 0: 0 00000004:00080000:0.0:1789429729.697797:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x481:0x0], index 1: 0 00000004:00080000:1.0:1789429729.705628:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x485:0x0], index 0: 0 00000004:00080000:2.0:1789429729.712812:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x482:0x0], index 1: 0 00000004:00080000:2.0:1789429729.722804:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x486:0x0], index 0: 0 00000004:00080000:0.0:1789429729.731734:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x483:0x0], index 1: 0 00000004:00080000:2.0:1789429729.739549:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x487:0x0], index 0: 0 00000004:00080000:1.0:1789429729.750312:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x484:0x0], index 1: 0 00000004:00080000:0.0:1789429729.758804:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x488:0x0], index 0: 0 00000004:00080000:2.0:1789429729.771183:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x485:0x0], index 1: 0 00000004:00080000:2.0:1789429729.783314:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x489:0x0], index 0: 0 00000004:00080000:2.0:1789429729.801938:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x486:0x0], index 1: 0 00000004:00080000:1.0:1789429729.814041:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x48a:0x0], index 0: 0 00000004:00080000:2.0:1789429729.823902:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x487:0x0], index 1: 0 00000004:00080000:2.0:1789429729.835771:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x48b:0x0], index 0: 0 00000004:00080000:2.0:1789429729.859173:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x488:0x0], index 1: 0 00000004:00080000:2.0:1789429729.874699:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x48c:0x0], index 0: 0 00000004:00080000:2.0:1789429729.886872:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x489:0x0], index 1: 0 00000004:00080000:2.0:1789429729.913537:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x48d:0x0], index 0: 0 00000004:00080000:2.0:1789429729.938072:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x48a:0x0], index 1: 0 00000004:00080000:2.0:1789429729.968579:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x48e:0x0], index 0: 0 00000004:00080000:2.0:1789429729.990247:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x48b:0x0], index 1: 0 00000100:00080000:1.0:1789429730.017635:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429730.029273:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x48f:0x0], index 0: 0 00000004:00080000:0.0:1789429730.059067:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x48c:0x0], index 1: 0 00000100:00080000:2.0:1789429730.077367:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429730.078144:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x490:0x0], index 0: 0 00000100:00080000:2.0:1789429730.080906:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789429730.103970:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x48d:0x0], index 1: 0 00000004:00080000:3.0:1789429730.116110:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x491:0x0], index 0: 0 00000004:00080000:1.0:1789429730.133526:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x48e:0x0], index 1: 0 00000004:00080000:2.0:1789429730.158850:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x492:0x0], index 0: 0 00002000:00080000:1.0:1789429730.161777:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1186 00000004:00080000:2.0:1789429730.204767:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x48f:0x0], index 1: 0 00000004:00080000:1.0:1789429730.219152:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x493:0x0], index 0: 0 00000004:00080000:2.0:1789429730.232426:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x490:0x0], index 1: 0 00000004:00080000:0.0:1789429730.238284:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x493:0x0]-[0x240000400:0x4c1:0x0] 00000004:00080000:1.0:1789429730.240322:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x494:0x0], index 0: 0 00000004:00080000:0.0:1789429730.256190:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x491:0x0], index 1: 0 00000004:00080000:0.0:1789429730.270891:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x495:0x0], index 0: 0 00000004:00080000:1.0:1789429730.279678:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x492:0x0], index 1: 0 00002000:00080000:1.0:1789429730.280619:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1186 00000004:00080000:0.0:1789429730.287077:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x492:0x0]-[0x280000400:0x4c1:0x0] 00000004:00080000:2.0:1789429730.290848:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x496:0x0], index 0: 0 00000004:00080000:1.0:1789429730.303999:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x493:0x0], index 1: 0 00000004:00080000:1.0:1789429730.314102:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x497:0x0], index 0: 0 00000004:00080000:1.0:1789429730.323938:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x494:0x0], index 1: 0 00000004:00080000:1.0:1789429730.333823:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x498:0x0], index 0: 0 00000004:00080000:2.0:1789429730.341588:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x495:0x0], index 1: 0 00000004:00080000:2.0:1789429730.351237:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x499:0x0], index 0: 0 00000004:00080000:0.0:1789429730.360489:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x496:0x0], index 1: 0 00000004:00080000:2.0:1789429730.377616:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x49a:0x0], index 0: 0 00000004:00080000:1.0:1789429730.401477:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x497:0x0], index 1: 0 00000004:00080000:2.0:1789429730.421508:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x49b:0x0], index 0: 0 00000004:00080000:2.0:1789429730.444355:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x498:0x0], index 1: 0 00000004:00080000:0.0:1789429730.457977:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x49c:0x0], index 0: 0 00000004:00080000:0.0:1789429730.477629:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x499:0x0], index 1: 0 00000100:00080000:3.0:1789429730.480979:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429730.494461:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x49d:0x0], index 0: 0 00000004:00080000:1.0:1789429730.515675:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x49a:0x0], index 1: 0 00000004:00080000:0.0:1789429730.534344:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x49e:0x0], index 0: 0 00000004:00080000:0.0:1789429730.570647:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x49b:0x0], index 1: 0 00000004:00080000:0.0:1789429730.591724:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x49f:0x0], index 0: 0 00000004:00080000:0.0:1789429730.611949:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x49c:0x0], index 1: 0 00000004:00080000:1.0:1789429730.626167:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a0:0x0], index 0: 0 00000004:00080000:0.0:1789429730.657780:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x49d:0x0], index 1: 0 00000004:00080000:2.0:1789429730.671997:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a1:0x0], index 0: 0 00000004:00080000:1.0:1789429730.696427:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x49e:0x0], index 1: 0 00000004:00080000:1.0:1789429730.712173:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a2:0x0], index 0: 0 00000004:00080000:0.0:1789429730.742166:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x49f:0x0], index 1: 0 00000004:00080000:0.0:1789429730.796609:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a3:0x0], index 0: 0 00000004:00080000:3.0:1789429730.817300:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a0:0x0], index 1: 0 00000004:00080000:0.0:1789429730.834669:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a4:0x0], index 0: 0 00000004:00080000:0.0:1789429730.879334:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a1:0x0], index 1: 0 00000004:00080000:1.0:1789429730.909735:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a5:0x0], index 0: 0 00000004:00080000:1.0:1789429730.932588:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a2:0x0], index 1: 0 00000004:00080000:3.0:1789429730.944352:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a6:0x0], index 0: 0 00000004:00080000:1.0:1789429730.957699:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a3:0x0], index 1: 0 00000004:00080000:2.0:1789429730.984151:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a7:0x0], index 0: 0 00000004:00080000:1.0:1789429730.995724:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a4:0x0], index 1: 0 00000004:00080000:1.0:1789429731.013554:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a8:0x0], index 0: 0 00000004:00080000:2.0:1789429731.034755:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a5:0x0], index 1: 0 00000004:00080000:0.0:1789429731.051611:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4a9:0x0], index 0: 0 00000004:00080000:2.0:1789429731.061903:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a6:0x0], index 1: 0 00000004:00080000:2.0:1789429731.087072:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4aa:0x0], index 0: 0 00000004:00080000:0.0:1789429731.109639:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a7:0x0], index 1: 0 00000004:00080000:3.0:1789429731.123664:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ab:0x0], index 0: 0 00000004:00080000:2.0:1789429731.149316:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a8:0x0], index 1: 0 00000004:00080000:2.0:1789429731.157699:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ac:0x0], index 0: 0 00000004:00080000:2.0:1789429731.166516:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4a9:0x0], index 1: 0 00000004:00080000:0.0:1789429731.182048:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ad:0x0], index 0: 0 00000004:00080000:3.0:1789429731.194580:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4aa:0x0], index 1: 0 00000004:00080000:2.0:1789429731.211034:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ae:0x0], index 0: 0 00000004:00080000:1.0:1789429731.227357:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ab:0x0], index 1: 0 00000004:00080000:2.0:1789429731.238130:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4af:0x0], index 0: 0 00000004:00080000:0.0:1789429731.251402:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ac:0x0], index 1: 0 00000004:00080000:2.0:1789429731.261536:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4b0:0x0], index 0: 0 00000004:00080000:2.0:1789429731.270729:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ad:0x0], index 1: 0 00000004:00080000:3.0:1789429731.287859:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4b1:0x0], index 0: 0 00000004:00080000:1.0:1789429731.301638:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ae:0x0], index 1: 0 00000004:00080000:2.0:1789429731.313332:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4b2:0x0], index 0: 0 00002000:00080000:2.0:1789429731.317092:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1218 00000100:00080000:3.0:1789429731.317392:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429731.332802:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4af:0x0], index 1: 0 00000004:00080000:0.0:1789429731.333556:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x4b2:0x0]-[0x240000400:0x4e1:0x0] 00000004:00080000:2.0:1789429731.347244:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4b3:0x0], index 0: 0 00000004:00080000:2.0:1789429731.360781:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b0:0x0], index 1: 0 00000004:00080000:0.0:1789429731.373142:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4b4:0x0], index 0: 0 00000004:00080000:0.0:1789429731.391063:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b1:0x0], index 1: 0 00000004:00080000:2.0:1789429731.402187:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4b5:0x0], index 0: 0 00000004:00080000:2.0:1789429731.419095:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b2:0x0], index 1: 0 00002000:00080000:3.0:1789429731.419989:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1218 00000100:00080000:2.0:1789429731.421750:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429731.433715:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4b6:0x0], index 0: 0 00000004:00080000:1.0:1789429731.435911:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x4b2:0x0]-[0x280000400:0x4e1:0x0] 00000004:00080000:2.0:1789429731.450835:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b3:0x0], index 1: 0 00000004:00080000:1.0:1789429731.468697:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4b7:0x0], index 0: 0 00000004:00080000:2.0:1789429731.474684:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b4:0x0], index 1: 0 00000004:00080000:1.0:1789429731.496952:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4b8:0x0], index 0: 0 00000004:00080000:1.0:1789429731.504462:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b5:0x0], index 1: 0 00000004:00080000:0.0:1789429731.541951:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4b9:0x0], index 0: 0 00000004:00080000:2.0:1789429731.564956:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b6:0x0], index 1: 0 00000004:00080000:1.0:1789429731.577756:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ba:0x0], index 0: 0 00000004:00080000:1.0:1789429731.587191:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b7:0x0], index 1: 0 00000004:00080000:0.0:1789429731.604608:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4bb:0x0], index 0: 0 00000004:00080000:2.0:1789429731.615586:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b8:0x0], index 1: 0 00000004:00080000:1.0:1789429731.648864:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4bc:0x0], index 0: 0 00000004:00080000:1.0:1789429731.673385:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4b9:0x0], index 1: 0 00000004:00080000:1.0:1789429731.699396:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4bd:0x0], index 0: 0 00000004:00080000:1.0:1789429731.727552:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ba:0x0], index 1: 0 00000004:00080000:2.0:1789429731.737956:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4be:0x0], index 0: 0 00000004:00080000:2.0:1789429731.755120:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4bb:0x0], index 1: 0 00000004:00080000:1.0:1789429731.775175:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4bf:0x0], index 0: 0 00000004:00080000:1.0:1789429731.797038:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4bc:0x0], index 1: 0 00000004:00080000:1.0:1789429731.809095:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c0:0x0], index 0: 0 00000004:00080000:3.0:1789429731.824750:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4bd:0x0], index 1: 0 00000004:00080000:2.0:1789429731.837559:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c1:0x0], index 0: 0 00000004:00080000:2.0:1789429731.852059:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4be:0x0], index 1: 0 00000004:00080000:1.0:1789429731.867615:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c2:0x0], index 0: 0 00000004:00080000:1.0:1789429731.879745:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4bf:0x0], index 1: 0 00000004:00080000:1.0:1789429731.890277:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c3:0x0], index 0: 0 00000004:00080000:2.0:1789429731.903398:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c0:0x0], index 1: 0 00000004:00080000:1.0:1789429731.915392:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c4:0x0], index 0: 0 00000004:00080000:1.0:1789429731.928478:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c1:0x0], index 1: 0 00000004:00080000:3.0:1789429731.938627:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c5:0x0], index 0: 0 00000004:00080000:1.0:1789429731.950935:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c2:0x0], index 1: 0 00000004:00080000:2.0:1789429731.967640:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c6:0x0], index 0: 0 00000004:00080000:2.0:1789429731.998571:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c3:0x0], index 1: 0 00000100:00080000:2.0:1789429732.002983:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429732.011363:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c7:0x0], index 0: 0 00000004:00080000:2.0:1789429732.038119:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c4:0x0], index 1: 0 00000004:00080000:2.0:1789429732.056406:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c8:0x0], index 0: 0 00000004:00080000:1.0:1789429732.070689:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c5:0x0], index 1: 0 00000004:00080000:1.0:1789429732.081182:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4c9:0x0], index 0: 0 00000004:00080000:0.0:1789429732.093287:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c6:0x0], index 1: 0 00000004:00080000:2.0:1789429732.102700:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ca:0x0], index 0: 0 00000004:00080000:2.0:1789429732.113987:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c7:0x0], index 1: 0 00000004:00080000:1.0:1789429732.123624:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4cb:0x0], index 0: 0 00000004:00080000:2.0:1789429732.134805:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c8:0x0], index 1: 0 00000004:00080000:1.0:1789429732.148078:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4cc:0x0], index 0: 0 00000004:00080000:1.0:1789429732.156984:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4c9:0x0], index 1: 0 00000004:00080000:2.0:1789429732.167443:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4cd:0x0], index 0: 0 00000004:00080000:1.0:1789429732.178865:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ca:0x0], index 1: 0 00000004:00080000:2.0:1789429732.190626:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ce:0x0], index 0: 0 00000004:00080000:2.0:1789429732.200316:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4cb:0x0], index 1: 0 00000004:00080000:2.0:1789429732.207538:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4cf:0x0], index 0: 0 00000004:00080000:2.0:1789429732.216424:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4cc:0x0], index 1: 0 00000004:00080000:1.0:1789429732.225728:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d0:0x0], index 0: 0 00000004:00080000:2.0:1789429732.237325:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4cd:0x0], index 1: 0 00000004:00080000:3.0:1789429732.245672:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d1:0x0], index 0: 0 00000004:00080000:2.0:1789429732.253893:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ce:0x0], index 1: 0 00000004:00080000:2.0:1789429732.265638:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d2:0x0], index 0: 0 00002000:00080000:0.0:1789429732.266979:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1250 00000004:00080000:3.0:1789429732.278971:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x4d2:0x0]-[0x240000400:0x501:0x0] 00000004:00080000:1.0:1789429732.285131:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4cf:0x0], index 1: 0 00000004:00080000:2.0:1789429732.298089:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d3:0x0], index 0: 0 00000004:00080000:0.0:1789429732.314122:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d0:0x0], index 1: 0 00000004:00080000:0.0:1789429732.324610:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d4:0x0], index 0: 0 00000004:00080000:0.0:1789429732.330422:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d1:0x0], index 1: 0 00000004:00080000:2.0:1789429732.348596:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d5:0x0], index 0: 0 00000004:00080000:3.0:1789429732.362730:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d2:0x0], index 1: 0 00002000:00080000:2.0:1789429732.366442:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1250 00000004:00080000:1.0:1789429732.369187:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x4d2:0x0]-[0x280000400:0x501:0x0] 00000004:00080000:2.0:1789429732.380322:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d6:0x0], index 0: 0 00000004:00080000:0.0:1789429732.390106:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d3:0x0], index 1: 0 00000004:00080000:1.0:1789429732.399392:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d7:0x0], index 0: 0 00000004:00080000:2.0:1789429732.408613:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d4:0x0], index 1: 0 00000004:00080000:3.0:1789429732.416578:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d8:0x0], index 0: 0 00000004:00080000:2.0:1789429732.425018:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d5:0x0], index 1: 0 00000004:00080000:1.0:1789429732.435937:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4d9:0x0], index 0: 0 00000004:00080000:1.0:1789429732.449588:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d6:0x0], index 1: 0 00000004:00080000:2.0:1789429732.466097:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4da:0x0], index 0: 0 00000004:00080000:1.0:1789429732.476074:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d7:0x0], index 1: 0 00000004:00080000:1.0:1789429732.485439:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4db:0x0], index 0: 0 00000004:00080000:1.0:1789429732.505074:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d8:0x0], index 1: 0 00000004:00080000:1.0:1789429732.528298:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4dc:0x0], index 0: 0 00000004:00080000:2.0:1789429732.540369:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4d9:0x0], index 1: 0 00000004:00080000:0.0:1789429732.563466:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4dd:0x0], index 0: 0 00000004:00080000:3.0:1789429732.581605:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4da:0x0], index 1: 0 00000004:00080000:1.0:1789429732.597442:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4de:0x0], index 0: 0 00000004:00080000:1.0:1789429732.619538:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4db:0x0], index 1: 0 00000004:00080000:3.0:1789429732.627481:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4df:0x0], index 0: 0 00000004:00080000:0.0:1789429732.651057:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4dc:0x0], index 1: 0 00000004:00080000:3.0:1789429732.660966:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e0:0x0], index 0: 0 00000004:00080000:1.0:1789429732.700917:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4dd:0x0], index 1: 0 00000004:00080000:0.0:1789429732.718480:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e1:0x0], index 0: 0 00000004:00080000:0.0:1789429732.739109:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4de:0x0], index 1: 0 00000004:00080000:2.0:1789429732.768664:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e2:0x0], index 0: 0 00000004:00080000:2.0:1789429732.799904:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4df:0x0], index 1: 0 00000004:00080000:1.0:1789429732.823135:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e3:0x0], index 0: 0 00000004:00080000:0.0:1789429732.841498:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e0:0x0], index 1: 0 00000004:00080000:2.0:1789429732.860749:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e4:0x0], index 0: 0 00000004:00080000:2.0:1789429732.878182:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e1:0x0], index 1: 0 00000004:00080000:0.0:1789429732.899444:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e5:0x0], index 0: 0 00000004:00080000:2.0:1789429732.926138:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e2:0x0], index 1: 0 00000004:00080000:1.0:1789429732.938483:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e6:0x0], index 0: 0 00000004:00080000:3.0:1789429732.961455:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e3:0x0], index 1: 0 00000004:00080000:3.0:1789429732.983650:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e7:0x0], index 0: 0 00000004:00080000:0.0:1789429733.006688:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e4:0x0], index 1: 0 00000004:00080000:3.0:1789429733.066005:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e8:0x0], index 0: 0 00000004:00080000:3.0:1789429733.087084:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e5:0x0], index 1: 0 00000004:00080000:1.0:1789429733.122337:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4e9:0x0], index 0: 0 00000004:00080000:2.0:1789429733.132419:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e6:0x0], index 1: 0 00000004:00080000:0.0:1789429733.144890:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ea:0x0], index 0: 0 00000001:00080000:0.0:1789429733.153952:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969643 is committed 00000001:00080000:0.0:1789429733.153970:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969645 is committed 00000004:00080000:3.0:1789429733.157265:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e7:0x0], index 1: 0 00000004:00080000:2.0:1789429733.168349:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4eb:0x0], index 0: 0 00000004:00080000:2.0:1789429733.191685:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e8:0x0], index 1: 0 00000004:00080000:1.0:1789429733.211656:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ec:0x0], index 0: 0 00000004:00080000:1.0:1789429733.226431:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4e9:0x0], index 1: 0 00000004:00080000:3.0:1789429733.245918:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ed:0x0], index 0: 0 00000004:00080000:2.0:1789429733.268761:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ea:0x0], index 1: 0 00000004:00080000:2.0:1789429733.281923:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ee:0x0], index 0: 0 00000004:00080000:1.0:1789429733.297791:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4eb:0x0], index 1: 0 00000004:00080000:1.0:1789429733.313045:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ef:0x0], index 0: 0 00000004:00080000:3.0:1789429733.325406:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ec:0x0], index 1: 0 00000004:00080000:1.0:1789429733.345581:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f0:0x0], index 0: 0 00000004:00080000:2.0:1789429733.363088:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ed:0x0], index 1: 0 00000004:00080000:1.0:1789429733.377191:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f1:0x0], index 0: 0 00000004:00080000:1.0:1789429733.387601:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ee:0x0], index 1: 0 00000004:00080000:3.0:1789429733.395129:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f2:0x0], index 0: 0 00002000:00080000:1.0:1789429733.395531:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1282 00000100:00080000:0.0:1789429733.398539:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429733.398592:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x4f2:0x0]-[0x240000400:0x521:0x0] 00000004:00080000:2.0:1789429733.406827:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ef:0x0], index 1: 0 00000004:00080000:0.0:1789429733.418140:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f3:0x0], index 0: 0 00000004:00080000:1.0:1789429733.426560:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f0:0x0], index 1: 0 00000004:00080000:1.0:1789429733.435795:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f4:0x0], index 0: 0 00000004:00080000:3.0:1789429733.445921:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f1:0x0], index 1: 0 00000004:00080000:3.0:1789429733.454088:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f5:0x0], index 0: 0 00000004:00080000:1.0:1789429733.460870:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f2:0x0], index 1: 0 00002000:00080000:1.0:1789429733.461367:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1282 00000100:00080000:0.0:1789429733.464016:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429733.480387:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x4f2:0x0]-[0x280000400:0x521:0x0] 00000004:00080000:1.0:1789429733.483284:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f6:0x0], index 0: 0 00000004:00080000:1.0:1789429733.491528:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f3:0x0], index 1: 0 00000004:00080000:2.0:1789429733.498568:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f7:0x0], index 0: 0 00000004:00080000:1.0:1789429733.508578:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f4:0x0], index 1: 0 00000004:00080000:3.0:1789429733.525307:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f8:0x0], index 0: 0 00000004:00080000:1.0:1789429733.536837:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f5:0x0], index 1: 0 00000004:00080000:3.0:1789429733.551789:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4f9:0x0], index 0: 0 00000004:00080000:3.0:1789429733.559746:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f6:0x0], index 1: 0 00000004:00080000:3.0:1789429733.569472:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4fa:0x0], index 0: 0 00000004:00080000:1.0:1789429733.581301:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f7:0x0], index 1: 0 00000004:00080000:1.0:1789429733.594052:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4fb:0x0], index 0: 0 00000004:00080000:3.0:1789429733.602305:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f8:0x0], index 1: 0 00000004:00080000:3.0:1789429733.616602:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4fc:0x0], index 0: 0 00000004:00080000:3.0:1789429733.629356:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4f9:0x0], index 1: 0 00000004:00080000:3.0:1789429733.638157:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4fd:0x0], index 0: 0 00000004:00080000:0.0:1789429733.647958:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4fa:0x0], index 1: 0 00000004:00080000:0.0:1789429733.657752:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4fe:0x0], index 0: 0 00000004:00080000:3.0:1789429733.674363:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4fb:0x0], index 1: 0 00000004:00080000:2.0:1789429733.689686:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4ff:0x0], index 0: 0 00000004:00080000:3.0:1789429733.702638:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4fc:0x0], index 1: 0 00000004:00080000:1.0:1789429733.713111:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x500:0x0], index 0: 0 00000004:00080000:2.0:1789429733.722834:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4fd:0x0], index 1: 0 00000004:00080000:0.0:1789429733.766632:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x501:0x0], index 0: 0 00000004:00080000:2.0:1789429733.787899:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4fe:0x0], index 1: 0 00000004:00080000:3.0:1789429733.803128:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x502:0x0], index 0: 0 00000004:00080000:1.0:1789429733.833897:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4ff:0x0], index 1: 0 00000004:00080000:2.0:1789429733.859078:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x503:0x0], index 0: 0 00000004:00080000:0.0:1789429733.884580:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x500:0x0], index 1: 0 00000004:00080000:1.0:1789429733.900545:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x504:0x0], index 0: 0 00000004:00080000:3.0:1789429733.914441:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x501:0x0], index 1: 0 00000004:00080000:0.0:1789429733.924154:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x505:0x0], index 0: 0 00000004:00080000:0.0:1789429733.941223:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x502:0x0], index 1: 0 00000004:00080000:0.0:1789429733.957861:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x506:0x0], index 0: 0 00000004:00080000:2.0:1789429733.975829:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x503:0x0], index 1: 0 00000004:00080000:1.0:1789429734.001131:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x507:0x0], index 0: 0 00000100:00080000:2.0:1789429734.007351:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429734.011761:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x504:0x0], index 1: 0 00000004:00080000:0.0:1789429734.021280:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x508:0x0], index 0: 0 00000004:00080000:2.0:1789429734.033438:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x505:0x0], index 1: 0 00000004:00080000:3.0:1789429734.043895:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x509:0x0], index 0: 0 00000004:00080000:3.0:1789429734.051159:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x506:0x0], index 1: 0 00000004:00080000:3.0:1789429734.077083:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50a:0x0], index 0: 0 00000004:00080000:2.0:1789429734.088046:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x507:0x0], index 1: 0 00000004:00080000:3.0:1789429734.109598:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50b:0x0], index 0: 0 00000004:00080000:1.0:1789429734.122021:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x508:0x0], index 1: 0 00000004:00080000:3.0:1789429734.137192:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50c:0x0], index 0: 0 00000001:00080000:1.0:1789429734.149184:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294982191 is committed 00000001:00080000:1.0:1789429734.149501:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294982196 is committed 00000001:00080000:1.0:1789429734.150148:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294982197 is committed 00000004:00080000:0.0:1789429734.153707:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x509:0x0], index 1: 0 00000004:00080000:1.0:1789429734.168641:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50d:0x0], index 0: 0 00000004:00080000:3.0:1789429734.186899:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50a:0x0], index 1: 0 00000004:00080000:1.0:1789429734.198441:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50e:0x0], index 0: 0 00000004:00080000:3.0:1789429734.207824:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50b:0x0], index 1: 0 00000004:00080000:0.0:1789429734.219333:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x50f:0x0], index 0: 0 00000004:00080000:3.0:1789429734.230127:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50c:0x0], index 1: 0 00000004:00080000:2.0:1789429734.243798:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x510:0x0], index 0: 0 00000004:00080000:0.0:1789429734.255997:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50d:0x0], index 1: 0 00000004:00080000:0.0:1789429734.286470:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x511:0x0], index 0: 0 00000004:00080000:0.0:1789429734.305584:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50e:0x0], index 1: 0 00000004:00080000:1.0:1789429734.316389:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x512:0x0], index 0: 0 00002000:00080000:1.0:1789429734.317142:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1314 00000004:00080000:1.0:1789429734.328297:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x50f:0x0], index 1: 0 00000004:00080000:0.0:1789429734.332290:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x512:0x0]-[0x240000400:0x541:0x0] 00000004:00080000:2.0:1789429734.337469:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x513:0x0], index 0: 0 00000004:00080000:0.0:1789429734.347556:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x510:0x0], index 1: 0 00000004:00080000:0.0:1789429734.356138:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x514:0x0], index 0: 0 00000004:00080000:1.0:1789429734.365175:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x511:0x0], index 1: 0 00000004:00080000:0.0:1789429734.373610:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x515:0x0], index 0: 0 00000004:00080000:2.0:1789429734.384667:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x512:0x0], index 1: 0 00002000:00080000:2.0:1789429734.385526:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1314 00000004:00080000:1.0:1789429734.400522:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x512:0x0]-[0x280000400:0x541:0x0] 00000004:00080000:2.0:1789429734.402863:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x516:0x0], index 0: 0 00000004:00080000:2.0:1789429734.412360:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x513:0x0], index 1: 0 00000004:00080000:1.0:1789429734.425601:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x517:0x0], index 0: 0 00000004:00080000:2.0:1789429734.434987:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x514:0x0], index 1: 0 00000004:00080000:0.0:1789429734.454588:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x518:0x0], index 0: 0 00000004:00080000:3.0:1789429734.481567:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x515:0x0], index 1: 0 00000004:00080000:2.0:1789429734.493377:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x519:0x0], index 0: 0 00000004:00080000:1.0:1789429734.507234:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x516:0x0], index 1: 0 00000004:00080000:2.0:1789429734.527532:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51a:0x0], index 0: 0 00000004:00080000:2.0:1789429734.538825:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x517:0x0], index 1: 0 00000004:00080000:3.0:1789429734.550103:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51b:0x0], index 0: 0 00000004:00080000:2.0:1789429734.559144:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x518:0x0], index 1: 0 00000004:00080000:3.0:1789429734.570244:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51c:0x0], index 0: 0 00000004:00080000:0.0:1789429734.588402:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x519:0x0], index 1: 0 00000004:00080000:3.0:1789429734.613097:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51d:0x0], index 0: 0 00000004:00080000:3.0:1789429734.640405:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51a:0x0], index 1: 0 00000004:00080000:2.0:1789429734.657310:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51e:0x0], index 0: 0 00000001:00080000:0.0:1789429734.659270:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969620 is committed 00000001:00080000:0.0:1789429734.659296:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969622 is committed 00000004:00080000:3.0:1789429734.675468:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51b:0x0], index 1: 0 00000004:00080000:0.0:1789429734.688742:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x51f:0x0], index 0: 0 00000004:00080000:0.0:1789429734.709095:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51c:0x0], index 1: 0 00000004:00080000:2.0:1789429734.722136:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x520:0x0], index 0: 0 00000004:00080000:2.0:1789429734.730716:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51d:0x0], index 1: 0 00000004:00080000:3.0:1789429734.742195:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x521:0x0], index 0: 0 00000004:00080000:2.0:1789429734.755567:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51e:0x0], index 1: 0 00000004:00080000:2.0:1789429734.767379:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x522:0x0], index 0: 0 00000004:00080000:2.0:1789429734.777504:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x51f:0x0], index 1: 0 00000004:00080000:2.0:1789429734.788467:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x523:0x0], index 0: 0 00000004:00080000:2.0:1789429734.807079:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x520:0x0], index 1: 0 00000004:00080000:2.0:1789429734.818606:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x524:0x0], index 0: 0 00000004:00080000:0.0:1789429734.832507:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x521:0x0], index 1: 0 00000004:00080000:0.0:1789429734.852178:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x525:0x0], index 0: 0 00000004:00080000:2.0:1789429734.867330:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x522:0x0], index 1: 0 00000004:00080000:2.0:1789429734.887957:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x526:0x0], index 0: 0 00000004:00080000:2.0:1789429734.910948:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x523:0x0], index 1: 0 00000004:00080000:2.0:1789429734.923268:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x527:0x0], index 0: 0 00000004:00080000:2.0:1789429734.932946:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x524:0x0], index 1: 0 00000004:00080000:2.0:1789429734.941271:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x528:0x0], index 0: 0 00000004:00080000:0.0:1789429734.949404:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x525:0x0], index 1: 0 00000004:00080000:2.0:1789429734.960464:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x529:0x0], index 0: 0 00000004:00080000:2.0:1789429734.977881:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x526:0x0], index 1: 0 00000004:00080000:2.0:1789429734.996365:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x52a:0x0], index 0: 0 00000004:00080000:0.0:1789429735.009961:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x527:0x0], index 1: 0 00000004:00080000:1.0:1789429735.022249:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x52b:0x0], index 0: 0 00000004:00080000:2.0:1789429735.032007:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x528:0x0], index 1: 0 00000004:00080000:1.0:1789429735.052246:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x52c:0x0], index 0: 0 00000004:00080000:2.0:1789429735.062389:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x529:0x0], index 1: 0 00000004:00080000:2.0:1789429735.070761:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x52d:0x0], index 0: 0 00000004:00080000:1.0:1789429735.084486:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x52a:0x0], index 1: 0 00000004:00080000:1.0:1789429735.093276:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x52e:0x0], index 0: 0 00000004:00080000:1.0:1789429735.107479:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x52b:0x0], index 1: 0 00000004:00080000:0.0:1789429735.131098:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x52f:0x0], index 0: 0 00000004:00080000:2.0:1789429735.142902:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x52c:0x0], index 1: 0 00000004:00080000:1.0:1789429735.173694:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x530:0x0], index 0: 0 00000100:00080000:2.0:1789429735.193711:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429735.197406:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429735.200384:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x52d:0x0], index 1: 0 00000004:00080000:0.0:1789429735.216753:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x531:0x0], index 0: 0 00000004:00080000:1.0:1789429735.252584:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x52e:0x0], index 1: 0 00000004:00080000:1.0:1789429735.264749:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x532:0x0], index 0: 0 00002000:00080000:3.0:1789429735.265786:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1346 00000100:00080000:1.0:1789429735.268903:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789429735.282430:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x52f:0x0], index 1: 0 00000004:00080000:2.0:1789429735.299297:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x532:0x0]-[0x240000400:0x561:0x0] 00000004:00080000:0.0:1789429735.313087:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x533:0x0], index 0: 0 00000004:00080000:0.0:1789429735.334603:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x530:0x0], index 1: 0 00000004:00080000:1.0:1789429735.348154:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x534:0x0], index 0: 0 00000004:00080000:1.0:1789429735.359149:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x531:0x0], index 1: 0 00000004:00080000:0.0:1789429735.382003:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x535:0x0], index 0: 0 00000004:00080000:1.0:1789429735.407248:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x532:0x0], index 1: 0 00002000:00080000:0.0:1789429735.413308:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1346 00000100:00080000:1.0:1789429735.417496:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429735.418940:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x536:0x0], index 0: 0 00000004:00080000:1.0:1789429735.429098:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x533:0x0], index 1: 0 00000004:00080000:2.0:1789429735.430523:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x533:0x0]-[0x280000400:0x561:0x0] 00000004:00080000:1.0:1789429735.439892:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x537:0x0], index 0: 0 00000004:00080000:0.0:1789429735.450908:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x534:0x0], index 1: 0 00000004:00080000:0.0:1789429735.464024:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x538:0x0], index 0: 0 00000004:00080000:3.0:1789429735.474493:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x535:0x0], index 1: 0 00000004:00080000:1.0:1789429735.486689:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x539:0x0], index 0: 0 00000004:00080000:3.0:1789429735.502694:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x536:0x0], index 1: 0 00000004:00080000:0.0:1789429735.516572:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x53a:0x0], index 0: 0 00000004:00080000:0.0:1789429735.530990:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x537:0x0], index 1: 0 00000004:00080000:0.0:1789429735.551538:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x53b:0x0], index 0: 0 00000004:00080000:2.0:1789429735.573849:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x538:0x0], index 1: 0 00000100:00080000:1.0:1789429735.588574:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429735.601961:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x53c:0x0], index 0: 0 00000004:00080000:2.0:1789429735.623290:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x539:0x0], index 1: 0 00000004:00080000:0.0:1789429735.634439:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x53d:0x0], index 0: 0 00000004:00080000:0.0:1789429735.646416:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x53a:0x0], index 1: 0 00000004:00080000:3.0:1789429735.664083:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x53e:0x0], index 0: 0 00000004:00080000:1.0:1789429735.679123:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x53b:0x0], index 1: 0 00000004:00080000:2.0:1789429735.689175:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x53f:0x0], index 0: 0 00000004:00080000:2.0:1789429735.700420:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x53c:0x0], index 1: 0 00000004:00080000:0.0:1789429735.721942:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x540:0x0], index 0: 0 00000004:00080000:2.0:1789429735.741882:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x53d:0x0], index 1: 0 00000004:00080000:2.0:1789429735.752949:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x541:0x0], index 0: 0 00000004:00080000:2.0:1789429735.773436:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x53e:0x0], index 1: 0 00000004:00080000:2.0:1789429735.793093:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x542:0x0], index 0: 0 00000004:00080000:0.0:1789429735.803782:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x53f:0x0], index 1: 0 00000004:00080000:3.0:1789429735.816085:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x543:0x0], index 0: 0 00000004:00080000:2.0:1789429735.826041:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x540:0x0], index 1: 0 00000004:00080000:2.0:1789429735.837834:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x544:0x0], index 0: 0 00000004:00080000:0.0:1789429735.857780:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x541:0x0], index 1: 0 00000004:00080000:0.0:1789429735.868430:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x545:0x0], index 0: 0 00000004:00080000:2.0:1789429735.883964:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x542:0x0], index 1: 0 00000004:00080000:1.0:1789429735.917090:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x546:0x0], index 0: 0 00000004:00080000:2.0:1789429735.941402:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x543:0x0], index 1: 0 00000004:00080000:1.0:1789429735.965859:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x547:0x0], index 0: 0 00000004:00080000:0.0:1789429735.983438:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x544:0x0], index 1: 0 00000004:00080000:2.0:1789429736.001169:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x548:0x0], index 0: 0 00000100:00080000:1.0:1789429736.009322:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429736.019492:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x545:0x0], index 1: 0 00000004:00080000:2.0:1789429736.041393:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x549:0x0], index 0: 0 00000004:00080000:1.0:1789429736.060347:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x546:0x0], index 1: 0 00000004:00080000:0.0:1789429736.077313:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x54a:0x0], index 0: 0 00000004:00080000:2.0:1789429736.092460:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x547:0x0], index 1: 0 00000004:00080000:0.0:1789429736.107287:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x54b:0x0], index 0: 0 00000004:00080000:2.0:1789429736.119692:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x548:0x0], index 1: 0 00000004:00080000:1.0:1789429736.149054:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x54c:0x0], index 0: 0 00000004:00080000:0.0:1789429736.174905:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x549:0x0], index 1: 0 00000004:00080000:2.0:1789429736.203577:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x54d:0x0], index 0: 0 00000004:00080000:0.0:1789429736.221179:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x54a:0x0], index 1: 0 00000004:00080000:2.0:1789429736.245349:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x54e:0x0], index 0: 0 00000004:00080000:2.0:1789429736.261987:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x54b:0x0], index 1: 0 00000004:00080000:0.0:1789429736.276066:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x54f:0x0], index 0: 0 00000004:00080000:2.0:1789429736.288126:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x54c:0x0], index 1: 0 00000004:00080000:1.0:1789429736.296607:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x550:0x0], index 0: 0 00000004:00080000:2.0:1789429736.309321:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x54d:0x0], index 1: 0 00000004:00080000:0.0:1789429736.326535:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x551:0x0], index 0: 0 00000004:00080000:3.0:1789429736.351478:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x54e:0x0], index 1: 0 00002000:00080000:1.0:1789429736.365571:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1378 00000004:00080000:2.0:1789429736.368024:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x552:0x0], index 0: 0 00000004:00080000:0.0:1789429736.379282:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x552:0x0]-[0x240000400:0x581:0x0] 00000004:00080000:0.0:1789429736.390783:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x54f:0x0], index 1: 0 00000004:00080000:0.0:1789429736.403097:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x553:0x0], index 0: 0 00000004:00080000:0.0:1789429736.413363:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x550:0x0], index 1: 0 00000004:00080000:0.0:1789429736.426035:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x554:0x0], index 0: 0 00000004:00080000:3.0:1789429736.440704:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x551:0x0], index 1: 0 00000004:00080000:0.0:1789429736.453859:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x555:0x0], index 0: 0 00000004:00080000:3.0:1789429736.464440:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x552:0x0], index 1: 0 00002000:00080000:2.0:1789429736.468444:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1378 00000004:00080000:0.0:1789429736.473282:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x556:0x0], index 0: 0 00000004:00080000:1.0:1789429736.482104:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x552:0x0]-[0x280000400:0x581:0x0] 00000004:00080000:0.0:1789429736.489246:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x553:0x0], index 1: 0 00000004:00080000:3.0:1789429736.504046:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x557:0x0], index 0: 0 00000004:00080000:3.0:1789429736.512627:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x554:0x0], index 1: 0 00000004:00080000:3.0:1789429736.520385:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x558:0x0], index 0: 0 00000004:00080000:0.0:1789429736.530120:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x555:0x0], index 1: 0 00000004:00080000:3.0:1789429736.543881:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x559:0x0], index 0: 0 00000004:00080000:0.0:1789429736.553948:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x556:0x0], index 1: 0 00000004:00080000:3.0:1789429736.563480:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x55a:0x0], index 0: 0 00000004:00080000:3.0:1789429736.571762:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x557:0x0], index 1: 0 00000004:00080000:0.0:1789429736.581888:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x55b:0x0], index 0: 0 00000004:00080000:0.0:1789429736.591739:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x558:0x0], index 1: 0 00000004:00080000:0.0:1789429736.600517:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x55c:0x0], index 0: 0 00000004:00080000:1.0:1789429736.610164:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x559:0x0], index 1: 0 00000004:00080000:1.0:1789429736.620352:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x55d:0x0], index 0: 0 00000004:00080000:1.0:1789429736.636078:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x55a:0x0], index 1: 0 00000004:00080000:1.0:1789429736.652137:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x55e:0x0], index 0: 0 00000004:00080000:0.0:1789429736.662276:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x55b:0x0], index 1: 0 00000004:00080000:0.0:1789429736.678270:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x55f:0x0], index 0: 0 00000004:00080000:1.0:1789429736.698180:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x55c:0x0], index 1: 0 00000004:00080000:3.0:1789429736.713002:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x560:0x0], index 0: 0 00000004:00080000:1.0:1789429736.722971:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x55d:0x0], index 1: 0 00000004:00080000:0.0:1789429736.736277:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x561:0x0], index 0: 0 00000004:00080000:0.0:1789429736.743378:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x55e:0x0], index 1: 0 00000004:00080000:0.0:1789429736.757602:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x562:0x0], index 0: 0 00000004:00080000:1.0:1789429736.766479:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x55f:0x0], index 1: 0 00000004:00080000:1.0:1789429736.774992:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x563:0x0], index 0: 0 00000004:00080000:0.0:1789429736.789073:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x560:0x0], index 1: 0 00000004:00080000:3.0:1789429736.807304:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x564:0x0], index 0: 0 00000004:00080000:0.0:1789429736.818419:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x561:0x0], index 1: 0 00000004:00080000:1.0:1789429736.833261:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x565:0x0], index 0: 0 00000004:00080000:0.0:1789429736.845016:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x562:0x0], index 1: 0 00000004:00080000:1.0:1789429736.864125:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x566:0x0], index 0: 0 00000004:00080000:1.0:1789429736.879509:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x563:0x0], index 1: 0 00000004:00080000:1.0:1789429736.896031:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x567:0x0], index 0: 0 00000004:00080000:0.0:1789429736.910847:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x564:0x0], index 1: 0 00000004:00080000:1.0:1789429736.925673:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x568:0x0], index 0: 0 00000004:00080000:1.0:1789429736.946439:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x565:0x0], index 1: 0 00000004:00080000:1.0:1789429736.956921:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x569:0x0], index 0: 0 00000004:00080000:1.0:1789429736.974995:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x566:0x0], index 1: 0 00000004:00080000:1.0:1789429736.988450:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x56a:0x0], index 0: 0 00000004:00080000:1.0:1789429736.999521:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x567:0x0], index 1: 0 00000004:00080000:0.0:1789429737.013175:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x56b:0x0], index 0: 0 00000004:00080000:2.0:1789429737.036973:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x568:0x0], index 1: 0 00000004:00080000:1.0:1789429737.054763:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x56c:0x0], index 0: 0 00000004:00080000:0.0:1789429737.082624:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x569:0x0], index 1: 0 00000004:00080000:2.0:1789429737.106367:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x56d:0x0], index 0: 0 00000004:00080000:0.0:1789429737.133024:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x56a:0x0], index 1: 0 00000004:00080000:2.0:1789429737.170087:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x56e:0x0], index 0: 0 00000004:00080000:2.0:1789429737.189966:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x56b:0x0], index 1: 0 00000004:00080000:0.0:1789429737.204577:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x56f:0x0], index 0: 0 00000004:00080000:1.0:1789429737.218407:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x56c:0x0], index 1: 0 00000004:00080000:0.0:1789429737.242153:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x570:0x0], index 0: 0 00000004:00080000:2.0:1789429737.270089:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x56d:0x0], index 1: 0 00000004:00080000:2.0:1789429737.282548:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x571:0x0], index 0: 0 00000004:00080000:0.0:1789429737.297589:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x56e:0x0], index 1: 0 00000004:00080000:2.0:1789429737.308737:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x572:0x0], index 0: 0 00002000:00080000:2.0:1789429737.310050:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1410 00000100:00080000:1.0:1789429737.312235:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789429737.319156:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x572:0x0]-[0x240000400:0x5a1:0x0] 00000004:00080000:0.0:1789429737.327662:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x56f:0x0], index 1: 0 00000004:00080000:0.0:1789429737.339312:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x573:0x0], index 0: 0 00000004:00080000:2.0:1789429737.348850:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x570:0x0], index 1: 0 00000004:00080000:0.0:1789429737.361505:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x574:0x0], index 0: 0 00000004:00080000:0.0:1789429737.380564:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x571:0x0], index 1: 0 00000004:00080000:0.0:1789429737.397054:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x575:0x0], index 0: 0 00000004:00080000:0.0:1789429737.417808:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x572:0x0], index 1: 0 00002000:00080000:2.0:1789429737.421448:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1410 00000100:00080000:0.0:1789429737.423933:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789429737.430369:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x576:0x0], index 0: 0 00000004:00080000:1.0:1789429737.432700:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x572:0x0]-[0x280000400:0x5a1:0x0] 00000004:00080000:0.0:1789429737.441146:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x573:0x0], index 1: 0 00000004:00080000:2.0:1789429737.453388:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x577:0x0], index 0: 0 00000004:00080000:0.0:1789429737.465453:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x574:0x0], index 1: 0 00000004:00080000:1.0:1789429737.480719:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x578:0x0], index 0: 0 00000004:00080000:0.0:1789429737.499132:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x575:0x0], index 1: 0 00000004:00080000:0.0:1789429737.510747:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x579:0x0], index 0: 0 00000004:00080000:2.0:1789429737.521168:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x576:0x0], index 1: 0 00000004:00080000:1.0:1789429737.530735:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x57a:0x0], index 0: 0 00000004:00080000:2.0:1789429737.547746:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x577:0x0], index 1: 0 00000004:00080000:0.0:1789429737.563566:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x57b:0x0], index 0: 0 00000004:00080000:1.0:1789429737.579725:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x578:0x0], index 1: 0 00000004:00080000:1.0:1789429737.588439:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x57c:0x0], index 0: 0 00000004:00080000:1.0:1789429737.602639:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x579:0x0], index 1: 0 00000004:00080000:2.0:1789429737.612957:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x57d:0x0], index 0: 0 00000004:00080000:1.0:1789429737.626581:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x57a:0x0], index 1: 0 00000004:00080000:1.0:1789429737.637425:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x57e:0x0], index 0: 0 00000004:00080000:1.0:1789429737.649990:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x57b:0x0], index 1: 0 00000004:00080000:1.0:1789429737.665605:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x57f:0x0], index 0: 0 00000004:00080000:2.0:1789429737.676664:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x57c:0x0], index 1: 0 00000004:00080000:1.0:1789429737.702281:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x580:0x0], index 0: 0 00000004:00080000:0.0:1789429737.723405:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x57d:0x0], index 1: 0 00000004:00080000:2.0:1789429737.749158:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x581:0x0], index 0: 0 00000004:00080000:3.0:1789429737.777097:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x57e:0x0], index 1: 0 00000004:00080000:2.0:1789429737.793969:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x582:0x0], index 0: 0 00000004:00080000:1.0:1789429737.809493:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x57f:0x0], index 1: 0 00000004:00080000:1.0:1789429737.825563:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x583:0x0], index 0: 0 00000004:00080000:2.0:1789429737.846748:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x580:0x0], index 1: 0 00000004:00080000:2.0:1789429737.863468:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x584:0x0], index 0: 0 00000004:00080000:2.0:1789429737.873818:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x581:0x0], index 1: 0 00000004:00080000:2.0:1789429737.887377:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x585:0x0], index 0: 0 00000004:00080000:2.0:1789429737.909625:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x582:0x0], index 1: 0 00000004:00080000:2.0:1789429737.941258:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x586:0x0], index 0: 0 00000004:00080000:0.0:1789429737.950991:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x583:0x0], index 1: 0 00000004:00080000:0.0:1789429737.959878:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x587:0x0], index 0: 0 00000004:00080000:1.0:1789429737.967887:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x584:0x0], index 1: 0 00000004:00080000:1.0:1789429737.990531:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x588:0x0], index 0: 0 00000100:00080000:0.0:1789429738.004179:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429738.014652:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x585:0x0], index 1: 0 00000004:00080000:2.0:1789429738.030551:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x589:0x0], index 0: 0 00000004:00080000:0.0:1789429738.044756:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x586:0x0], index 1: 0 00000004:00080000:2.0:1789429738.055317:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x58a:0x0], index 0: 0 00000004:00080000:0.0:1789429738.069658:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x587:0x0], index 1: 0 00000004:00080000:1.0:1789429738.084469:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x58b:0x0], index 0: 0 00000004:00080000:2.0:1789429738.110184:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x588:0x0], index 1: 0 00000004:00080000:2.0:1789429738.119998:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x58c:0x0], index 0: 0 00000004:00080000:1.0:1789429738.142151:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x589:0x0], index 1: 0 00000004:00080000:1.0:1789429738.165663:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x58d:0x0], index 0: 0 00000004:00080000:2.0:1789429738.192510:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x58a:0x0], index 1: 0 00000004:00080000:3.0:1789429738.218321:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x58e:0x0], index 0: 0 00000004:00080000:2.0:1789429738.231416:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x58b:0x0], index 1: 0 00000001:00080000:0.0:1789429738.241862:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969648 is committed 00000001:00080000:0.0:1789429738.241944:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969650 is committed 00000004:00080000:2.0:1789429738.248640:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x58f:0x0], index 0: 0 00000004:00080000:1.0:1789429738.260928:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x58c:0x0], index 1: 0 00000004:00080000:2.0:1789429738.284959:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x590:0x0], index 0: 0 00000004:00080000:3.0:1789429738.316177:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x58d:0x0], index 1: 0 00000004:00080000:2.0:1789429738.338022:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x591:0x0], index 0: 0 00000004:00080000:2.0:1789429738.357048:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x58e:0x0], index 1: 0 00000004:00080000:0.0:1789429738.370113:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x592:0x0], index 0: 0 00002000:00080000:3.0:1789429738.373480:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1442 00000004:00080000:3.0:1789429738.380886:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x592:0x0]-[0x240000400:0x5c1:0x0] 00000004:00080000:0.0:1789429738.384044:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x58f:0x0], index 1: 0 00000004:00080000:3.0:1789429738.406126:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x593:0x0], index 0: 0 00000004:00080000:2.0:1789429738.421498:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x590:0x0], index 1: 0 00000004:00080000:1.0:1789429738.433917:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x594:0x0], index 0: 0 00000004:00080000:2.0:1789429738.454154:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x591:0x0], index 1: 0 00000004:00080000:0.0:1789429738.466832:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x595:0x0], index 0: 0 00000004:00080000:3.0:1789429738.479660:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x592:0x0], index 1: 0 00002000:00080000:2.0:1789429738.481749:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1442 00000004:00080000:1.0:1789429738.491857:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x596:0x0], index 0: 0 00000004:00080000:3.0:1789429738.504022:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x593:0x0], index 1: 0 00000004:00080000:3.0:1789429738.510419:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x593:0x0]-[0x280000400:0x5c1:0x0] 00000004:00080000:2.0:1789429738.520406:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x597:0x0], index 0: 0 00000004:00080000:3.0:1789429738.538534:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x594:0x0], index 1: 0 00000004:00080000:1.0:1789429738.558875:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x598:0x0], index 0: 0 00000004:00080000:0.0:1789429738.574172:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x595:0x0], index 1: 0 00000004:00080000:2.0:1789429738.613922:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x599:0x0], index 0: 0 00000004:00080000:1.0:1789429738.623750:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x596:0x0], index 1: 0 00000004:00080000:1.0:1789429738.641385:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x59a:0x0], index 0: 0 00000004:00080000:1.0:1789429738.651013:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x597:0x0], index 1: 0 00000004:00080000:3.0:1789429738.665361:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x59b:0x0], index 0: 0 00000004:00080000:2.0:1789429738.677434:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x598:0x0], index 1: 0 00000004:00080000:1.0:1789429738.688977:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x59c:0x0], index 0: 0 00000004:00080000:3.0:1789429738.703064:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x599:0x0], index 1: 0 00000004:00080000:2.0:1789429738.713948:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x59d:0x0], index 0: 0 00000004:00080000:2.0:1789429738.723892:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x59a:0x0], index 1: 0 00000004:00080000:3.0:1789429738.733752:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x59e:0x0], index 0: 0 00000004:00080000:2.0:1789429738.744849:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x59b:0x0], index 1: 0 00000004:00080000:2.0:1789429738.759933:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x59f:0x0], index 0: 0 00000004:00080000:3.0:1789429738.787094:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x59c:0x0], index 1: 0 00000004:00080000:3.0:1789429738.811972:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a0:0x0], index 0: 0 00000004:00080000:0.0:1789429738.830135:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x59d:0x0], index 1: 0 00000004:00080000:0.0:1789429738.842115:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a1:0x0], index 0: 0 00000004:00080000:0.0:1789429738.851457:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x59e:0x0], index 1: 0 00000004:00080000:0.0:1789429738.861612:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a2:0x0], index 0: 0 00000004:00080000:3.0:1789429738.872116:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x59f:0x0], index 1: 0 00000004:00080000:0.0:1789429738.885507:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a3:0x0], index 0: 0 00000004:00080000:2.0:1789429738.902342:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a0:0x0], index 1: 0 00000004:00080000:2.0:1789429738.916839:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a4:0x0], index 0: 0 00000004:00080000:2.0:1789429738.927716:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a1:0x0], index 1: 0 00000004:00080000:3.0:1789429738.941119:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a5:0x0], index 0: 0 00000004:00080000:0.0:1789429738.961646:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a2:0x0], index 1: 0 00000004:00080000:0.0:1789429738.978233:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a6:0x0], index 0: 0 00000004:00080000:2.0:1789429738.993145:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a3:0x0], index 1: 0 00000004:00080000:2.0:1789429739.017903:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a7:0x0], index 0: 0 00000004:00080000:3.0:1789429739.034569:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a4:0x0], index 1: 0 00000004:00080000:1.0:1789429739.056791:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a8:0x0], index 0: 0 00000004:00080000:0.0:1789429739.075927:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a5:0x0], index 1: 0 00000004:00080000:3.0:1789429739.094499:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5a9:0x0], index 0: 0 00000004:00080000:2.0:1789429739.106808:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a6:0x0], index 1: 0 00000004:00080000:2.0:1789429739.118352:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5aa:0x0], index 0: 0 00000004:00080000:3.0:1789429739.138776:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a7:0x0], index 1: 0 00000004:00080000:1.0:1789429739.163326:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ab:0x0], index 0: 0 00000004:00080000:1.0:1789429739.203258:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a8:0x0], index 1: 0 00000004:00080000:1.0:1789429739.223722:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ac:0x0], index 0: 0 00000004:00080000:1.0:1789429739.244316:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5a9:0x0], index 1: 0 00000004:00080000:3.0:1789429739.271493:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ad:0x0], index 0: 0 00000001:00080000:1.0:1789429739.275427:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294982842 is committed 00000001:00080000:1.0:1789429739.275984:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294982843 is committed 00000004:00080000:1.0:1789429739.300092:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5aa:0x0], index 1: 0 00000004:00080000:0.0:1789429739.312988:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ae:0x0], index 0: 0 00000004:00080000:2.0:1789429739.322364:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ab:0x0], index 1: 0 00000004:00080000:2.0:1789429739.334606:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5af:0x0], index 0: 0 00000004:00080000:0.0:1789429739.358888:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ac:0x0], index 1: 0 00000004:00080000:1.0:1789429739.376164:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b0:0x0], index 0: 0 00000004:00080000:2.0:1789429739.388078:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ad:0x0], index 1: 0 00000004:00080000:2.0:1789429739.395399:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b1:0x0], index 0: 0 00000004:00080000:3.0:1789429739.403186:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ae:0x0], index 1: 0 00002000:00080000:0.0:1789429739.414912:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1474 00000004:00080000:3.0:1789429739.415341:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b2:0x0], index 0: 0 00000100:00080000:1.0:1789429739.418135:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789429739.418626:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x5b2:0x0]-[0x240000400:0x5e1:0x0] 00000004:00080000:0.0:1789429739.423586:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5af:0x0], index 1: 0 00000004:00080000:2.0:1789429739.432347:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b3:0x0], index 0: 0 00000004:00080000:2.0:1789429739.442330:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b0:0x0], index 1: 0 00000004:00080000:0.0:1789429739.460014:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b4:0x0], index 0: 0 00000004:00080000:3.0:1789429739.474128:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b1:0x0], index 1: 0 00000004:00080000:3.0:1789429739.483571:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b5:0x0], index 0: 0 00002000:00080000:1.0:1789429739.494625:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1474 00000004:00080000:0.0:1789429739.494783:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b2:0x0], index 1: 0 00000100:00080000:2.0:1789429739.495601:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789429739.497954:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x5b2:0x0]-[0x280000400:0x5e1:0x0] 00000004:00080000:0.0:1789429739.506102:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b6:0x0], index 0: 0 00000004:00080000:0.0:1789429739.516401:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b3:0x0], index 1: 0 00000004:00080000:0.0:1789429739.526554:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b7:0x0], index 0: 0 00000004:00080000:1.0:1789429739.538637:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b4:0x0], index 1: 0 00000004:00080000:1.0:1789429739.553744:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b8:0x0], index 0: 0 00000004:00080000:0.0:1789429739.565150:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b5:0x0], index 1: 0 00000004:00080000:0.0:1789429739.575729:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5b9:0x0], index 0: 0 00000004:00080000:0.0:1789429739.585156:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b6:0x0], index 1: 0 00000004:00080000:2.0:1789429739.592320:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ba:0x0], index 0: 0 00000004:00080000:0.0:1789429739.602858:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b7:0x0], index 1: 0 00000004:00080000:0.0:1789429739.618281:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5bb:0x0], index 0: 0 00000004:00080000:2.0:1789429739.637508:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b8:0x0], index 1: 0 00000004:00080000:0.0:1789429739.651884:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5bc:0x0], index 0: 0 00000004:00080000:2.0:1789429739.667267:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5b9:0x0], index 1: 0 00000004:00080000:0.0:1789429739.681850:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5bd:0x0], index 0: 0 00000004:00080000:1.0:1789429739.736330:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ba:0x0], index 1: 0 00000004:00080000:2.0:1789429739.753852:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5be:0x0], index 0: 0 00000004:00080000:2.0:1789429739.765350:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5bb:0x0], index 1: 0 00000001:00080000:0.0:1789429739.774946:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969627 is committed 00000004:00080000:2.0:1789429739.781507:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5bf:0x0], index 0: 0 00000004:00080000:0.0:1789429739.798685:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5bc:0x0], index 1: 0 00000004:00080000:3.0:1789429739.816581:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c0:0x0], index 0: 0 00000004:00080000:3.0:1789429739.827018:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5bd:0x0], index 1: 0 00000004:00080000:2.0:1789429739.841458:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c1:0x0], index 0: 0 00000004:00080000:2.0:1789429739.855169:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5be:0x0], index 1: 0 00000004:00080000:1.0:1789429739.881386:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c2:0x0], index 0: 0 00000004:00080000:3.0:1789429739.905502:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5bf:0x0], index 1: 0 00000004:00080000:0.0:1789429739.922527:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c3:0x0], index 0: 0 00000004:00080000:2.0:1789429739.937449:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c0:0x0], index 1: 0 00000004:00080000:2.0:1789429739.950390:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c4:0x0], index 0: 0 00000004:00080000:1.0:1789429739.966500:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c1:0x0], index 1: 0 00000004:00080000:0.0:1789429739.983363:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c5:0x0], index 0: 0 00000004:00080000:0.0:1789429740.001190:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c2:0x0], index 1: 0 00000100:00080000:2.0:1789429740.010626:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429740.021393:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c6:0x0], index 0: 0 00000004:00080000:2.0:1789429740.032948:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c3:0x0], index 1: 0 00000004:00080000:1.0:1789429740.042636:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c7:0x0], index 0: 0 00000004:00080000:1.0:1789429740.052845:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c4:0x0], index 1: 0 00000004:00080000:0.0:1789429740.064962:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c8:0x0], index 0: 0 00000004:00080000:0.0:1789429740.074636:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c5:0x0], index 1: 0 00000004:00080000:1.0:1789429740.088405:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5c9:0x0], index 0: 0 00000004:00080000:3.0:1789429740.095651:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c6:0x0], index 1: 0 00000004:00080000:3.0:1789429740.110939:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ca:0x0], index 0: 0 00000004:00080000:0.0:1789429740.119718:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c7:0x0], index 1: 0 00000004:00080000:0.0:1789429740.128348:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5cb:0x0], index 0: 0 00000004:00080000:1.0:1789429740.143413:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c8:0x0], index 1: 0 00000004:00080000:0.0:1789429740.152345:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5cc:0x0], index 0: 0 00000004:00080000:3.0:1789429740.163072:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5c9:0x0], index 1: 0 00000004:00080000:1.0:1789429740.172258:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5cd:0x0], index 0: 0 00000004:00080000:2.0:1789429740.182909:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ca:0x0], index 1: 0 00000004:00080000:0.0:1789429740.194041:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ce:0x0], index 0: 0 00000004:00080000:0.0:1789429740.203613:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5cb:0x0], index 1: 0 00000004:00080000:0.0:1789429740.211585:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5cf:0x0], index 0: 0 00000004:00080000:1.0:1789429740.219676:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5cc:0x0], index 1: 0 00000004:00080000:2.0:1789429740.229290:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d0:0x0], index 0: 0 00000004:00080000:2.0:1789429740.239442:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5cd:0x0], index 1: 0 00000004:00080000:1.0:1789429740.248877:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d1:0x0], index 0: 0 00000004:00080000:0.0:1789429740.258892:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ce:0x0], index 1: 0 00000004:00080000:1.0:1789429740.270375:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d2:0x0], index 0: 0 00002000:00080000:2.0:1789429740.271361:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1506 00000004:00080000:2.0:1789429740.292050:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x5d2:0x0]-[0x240000400:0x601:0x0] 00000004:00080000:0.0:1789429740.294011:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5cf:0x0], index 1: 0 00000004:00080000:2.0:1789429740.303167:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d3:0x0], index 0: 0 00000100:00080000:1.0:1789429740.309654:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429740.310486:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429740.315369:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d0:0x0], index 1: 0 00000004:00080000:2.0:1789429740.327664:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d4:0x0], index 0: 0 00000004:00080000:0.0:1789429740.336303:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d1:0x0], index 1: 0 00000004:00080000:1.0:1789429740.345452:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d5:0x0], index 0: 0 00000004:00080000:3.0:1789429740.358663:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d2:0x0], index 1: 0 00002000:00080000:0.0:1789429740.359651:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1506 00000004:00080000:2.0:1789429740.362507:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x5d2:0x0]-[0x280000400:0x601:0x0] 00000004:00080000:2.0:1789429740.370798:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d6:0x0], index 0: 0 00000004:00080000:2.0:1789429740.383246:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d3:0x0], index 1: 0 00000004:00080000:3.0:1789429740.399936:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d7:0x0], index 0: 0 00000004:00080000:1.0:1789429740.415174:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d4:0x0], index 1: 0 00000004:00080000:3.0:1789429740.428548:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d8:0x0], index 0: 0 00000004:00080000:1.0:1789429740.437568:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d5:0x0], index 1: 0 00000004:00080000:2.0:1789429740.455245:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5d9:0x0], index 0: 0 00000004:00080000:3.0:1789429740.467271:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d6:0x0], index 1: 0 00000004:00080000:1.0:1789429740.481004:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5da:0x0], index 0: 0 00000004:00080000:3.0:1789429740.493272:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d7:0x0], index 1: 0 00000004:00080000:1.0:1789429740.508326:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5db:0x0], index 0: 0 00000004:00080000:2.0:1789429740.521820:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d8:0x0], index 1: 0 00000004:00080000:0.0:1789429740.532488:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5dc:0x0], index 0: 0 00000004:00080000:2.0:1789429740.547659:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5d9:0x0], index 1: 0 00000004:00080000:1.0:1789429740.567820:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5dd:0x0], index 0: 0 00000004:00080000:3.0:1789429740.581277:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5da:0x0], index 1: 0 00000004:00080000:1.0:1789429740.593732:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5de:0x0], index 0: 0 00000004:00080000:0.0:1789429740.618924:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5db:0x0], index 1: 0 00000004:00080000:2.0:1789429740.633159:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5df:0x0], index 0: 0 00000004:00080000:1.0:1789429740.644066:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5dc:0x0], index 1: 0 00000004:00080000:3.0:1789429740.656422:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e0:0x0], index 0: 0 00000004:00080000:2.0:1789429740.665263:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5dd:0x0], index 1: 0 00000004:00080000:0.0:1789429740.680690:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e1:0x0], index 0: 0 00000004:00080000:2.0:1789429740.693188:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5de:0x0], index 1: 0 00000100:00080000:3.0:1789429740.710670:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429740.712308:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e2:0x0], index 0: 0 00000100:00080000:0.0:1789429740.712461:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429740.724576:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5df:0x0], index 1: 0 00000004:00080000:1.0:1789429740.739311:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e3:0x0], index 0: 0 00000004:00080000:3.0:1789429740.753702:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e0:0x0], index 1: 0 00000004:00080000:2.0:1789429740.769791:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e4:0x0], index 0: 0 00000004:00080000:0.0:1789429740.789435:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e1:0x0], index 1: 0 00000004:00080000:2.0:1789429740.813283:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e5:0x0], index 0: 0 00000004:00080000:2.0:1789429740.841373:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e2:0x0], index 1: 0 00000004:00080000:1.0:1789429740.857878:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e6:0x0], index 0: 0 00000004:00080000:0.0:1789429740.880084:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e3:0x0], index 1: 0 00000004:00080000:1.0:1789429740.901884:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e7:0x0], index 0: 0 00000004:00080000:2.0:1789429740.921964:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e4:0x0], index 1: 0 00000004:00080000:0.0:1789429740.935494:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e8:0x0], index 0: 0 00000004:00080000:1.0:1789429740.952422:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e5:0x0], index 1: 0 00000004:00080000:0.0:1789429740.962859:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5e9:0x0], index 0: 0 00000004:00080000:1.0:1789429740.976275:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e6:0x0], index 1: 0 00000004:00080000:2.0:1789429740.995234:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ea:0x0], index 0: 0 00000004:00080000:0.0:1789429741.011909:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e7:0x0], index 1: 0 00000004:00080000:1.0:1789429741.033513:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5eb:0x0], index 0: 0 00000004:00080000:2.0:1789429741.044298:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e8:0x0], index 1: 0 00000004:00080000:1.0:1789429741.055976:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ec:0x0], index 0: 0 00000004:00080000:2.0:1789429741.067257:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5e9:0x0], index 1: 0 00000004:00080000:0.0:1789429741.079691:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ed:0x0], index 0: 0 00000004:00080000:2.0:1789429741.088583:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ea:0x0], index 1: 0 00000004:00080000:1.0:1789429741.107264:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ee:0x0], index 0: 0 00000004:00080000:2.0:1789429741.120284:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5eb:0x0], index 1: 0 00000004:00080000:2.0:1789429741.133170:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ef:0x0], index 0: 0 00000004:00080000:1.0:1789429741.146599:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ec:0x0], index 1: 0 00000004:00080000:0.0:1789429741.158045:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f0:0x0], index 0: 0 00000004:00080000:1.0:1789429741.168021:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ed:0x0], index 1: 0 00000004:00080000:2.0:1789429741.181288:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f1:0x0], index 0: 0 00000004:00080000:0.0:1789429741.190448:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ee:0x0], index 1: 0 00000004:00080000:3.0:1789429741.198782:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f2:0x0], index 0: 0 00002000:00080000:3.0:1789429741.202993:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1538 00000100:00080000:1.0:1789429741.206485:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429741.213680:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x5f2:0x0]-[0x240000400:0x621:0x0] 00000004:00080000:0.0:1789429741.217455:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ef:0x0], index 1: 0 00000100:00080000:1.0:1789429741.222848:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429741.226280:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f3:0x0], index 0: 0 00000004:00080000:2.0:1789429741.237464:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f0:0x0], index 1: 0 00000004:00080000:1.0:1789429741.256425:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f4:0x0], index 0: 0 00000004:00080000:1.0:1789429741.265557:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f1:0x0], index 1: 0 00000004:00080000:1.0:1789429741.287179:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f5:0x0], index 0: 0 00000004:00080000:1.0:1789429741.303827:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f2:0x0], index 1: 0 00002000:00080000:3.0:1789429741.310647:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1538 00000004:00080000:0.0:1789429741.321564:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x5f2:0x0]-[0x280000400:0x621:0x0] 00000004:00080000:3.0:1789429741.328308:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f6:0x0], index 0: 0 00000004:00080000:1.0:1789429741.346516:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f3:0x0], index 1: 0 00000004:00080000:2.0:1789429741.357678:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f7:0x0], index 0: 0 00000004:00080000:2.0:1789429741.375262:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f4:0x0], index 1: 0 00000004:00080000:0.0:1789429741.387068:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f8:0x0], index 0: 0 00000004:00080000:0.0:1789429741.396631:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f5:0x0], index 1: 0 00000004:00080000:2.0:1789429741.408280:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f9:0x0], index 0: 0 00000004:00080000:2.0:1789429741.420065:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f6:0x0], index 1: 0 00000004:00080000:2.0:1789429741.434846:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5fa:0x0], index 0: 0 00000004:00080000:1.0:1789429741.448310:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f7:0x0], index 1: 0 00000004:00080000:0.0:1789429741.454832:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5fb:0x0], index 0: 0 00000004:00080000:0.0:1789429741.470759:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f8:0x0], index 1: 0 00000004:00080000:2.0:1789429741.483506:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5fc:0x0], index 0: 0 00000004:00080000:2.0:1789429741.510001:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f9:0x0], index 1: 0 00000004:00080000:1.0:1789429741.541728:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5fd:0x0], index 0: 0 00000004:00080000:0.0:1789429741.560571:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5fa:0x0], index 1: 0 00000004:00080000:3.0:1789429741.586393:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5fe:0x0], index 0: 0 00000004:00080000:2.0:1789429741.615785:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5fb:0x0], index 1: 0 00000004:00080000:3.0:1789429741.644327:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ff:0x0], index 0: 0 00000004:00080000:2.0:1789429741.676551:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5fc:0x0], index 1: 0 00000004:00080000:3.0:1789429741.692441:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x600:0x0], index 0: 0 00000004:00080000:3.0:1789429741.706269:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5fd:0x0], index 1: 0 00000004:00080000:0.0:1789429741.714701:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x601:0x0], index 0: 0 00000004:00080000:3.0:1789429741.732813:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5fe:0x0], index 1: 0 00000004:00080000:2.0:1789429741.744901:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x602:0x0], index 0: 0 00000004:00080000:0.0:1789429741.758137:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ff:0x0], index 1: 0 00000004:00080000:2.0:1789429741.775154:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x603:0x0], index 0: 0 00000004:00080000:1.0:1789429741.792517:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x600:0x0], index 1: 0 00000004:00080000:0.0:1789429741.810987:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x604:0x0], index 0: 0 00000004:00080000:2.0:1789429741.826189:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x601:0x0], index 1: 0 00000004:00080000:2.0:1789429741.845476:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x605:0x0], index 0: 0 00000004:00080000:0.0:1789429741.878292:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x602:0x0], index 1: 0 00000004:00080000:3.0:1789429741.901328:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x606:0x0], index 0: 0 00000004:00080000:0.0:1789429741.916239:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x603:0x0], index 1: 0 00000004:00080000:2.0:1789429741.933158:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x607:0x0], index 0: 0 00000004:00080000:0.0:1789429741.957992:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x604:0x0], index 1: 0 00000004:00080000:1.0:1789429741.972005:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x608:0x0], index 0: 0 00000004:00080000:0.0:1789429741.988937:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x605:0x0], index 1: 0 00000004:00080000:3.0:1789429741.998319:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x609:0x0], index 0: 0 00000100:00080000:1.0:1789429742.002165:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429742.020816:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x606:0x0], index 1: 0 00000004:00080000:1.0:1789429742.047892:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60a:0x0], index 0: 0 00000004:00080000:1.0:1789429742.056374:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x607:0x0], index 1: 0 00000004:00080000:0.0:1789429742.073170:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60b:0x0], index 0: 0 00000004:00080000:1.0:1789429742.099798:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x608:0x0], index 1: 0 00000004:00080000:0.0:1789429742.122050:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60c:0x0], index 0: 0 00000004:00080000:3.0:1789429742.133421:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x609:0x0], index 1: 0 00000004:00080000:2.0:1789429742.153504:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60d:0x0], index 0: 0 00000004:00080000:0.0:1789429742.171221:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60a:0x0], index 1: 0 00000004:00080000:2.0:1789429742.201798:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60e:0x0], index 0: 0 00000004:00080000:0.0:1789429742.222277:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60b:0x0], index 1: 0 00000004:00080000:0.0:1789429742.232428:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60f:0x0], index 0: 0 00000004:00080000:2.0:1789429742.244144:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60c:0x0], index 1: 0 00000004:00080000:0.0:1789429742.262668:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x610:0x0], index 0: 0 00000004:00080000:2.0:1789429742.276459:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60d:0x0], index 1: 0 00000004:00080000:2.0:1789429742.289004:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x611:0x0], index 0: 0 00000004:00080000:0.0:1789429742.299064:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60e:0x0], index 1: 0 00000004:00080000:0.0:1789429742.311544:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x612:0x0], index 0: 0 00002000:00080000:3.0:1789429742.312300:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1570 00000004:00080000:3.0:1789429742.319410:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x612:0x0]-[0x240000400:0x641:0x0] 00000004:00080000:0.0:1789429742.322262:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60f:0x0], index 1: 0 00000004:00080000:2.0:1789429742.338403:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x613:0x0], index 0: 0 00000004:00080000:2.0:1789429742.350072:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x610:0x0], index 1: 0 00000004:00080000:2.0:1789429742.367302:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x614:0x0], index 0: 0 00000004:00080000:0.0:1789429742.387291:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x611:0x0], index 1: 0 00000004:00080000:0.0:1789429742.402737:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x615:0x0], index 0: 0 00000004:00080000:2.0:1789429742.423228:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x612:0x0], index 1: 0 00002000:00080000:0.0:1789429742.423788:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1570 00000004:00080000:0.0:1789429742.432475:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x612:0x0]-[0x280000400:0x641:0x0] 00000004:00080000:2.0:1789429742.447588:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x616:0x0], index 0: 0 00000004:00080000:1.0:1789429742.458044:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x613:0x0], index 1: 0 00000004:00080000:2.0:1789429742.476421:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x617:0x0], index 0: 0 00000004:00080000:1.0:1789429742.492029:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x614:0x0], index 1: 0 00000004:00080000:2.0:1789429742.501349:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x618:0x0], index 0: 0 00000004:00080000:2.0:1789429742.517695:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x615:0x0], index 1: 0 00000004:00080000:3.0:1789429742.528755:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x619:0x0], index 0: 0 00000004:00080000:1.0:1789429742.545142:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x616:0x0], index 1: 0 00000004:00080000:0.0:1789429742.559007:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x61a:0x0], index 0: 0 00000004:00080000:0.0:1789429742.576089:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x617:0x0], index 1: 0 00000004:00080000:2.0:1789429742.606019:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x61b:0x0], index 0: 0 00000004:00080000:0.0:1789429742.620783:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x618:0x0], index 1: 0 00000004:00080000:2.0:1789429742.640153:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x61c:0x0], index 0: 0 00000004:00080000:0.0:1789429742.658676:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x619:0x0], index 1: 0 00000004:00080000:2.0:1789429742.674192:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x61d:0x0], index 0: 0 00000004:00080000:2.0:1789429742.685390:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x61a:0x0], index 1: 0 00000004:00080000:2.0:1789429742.704278:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x61e:0x0], index 0: 0 00000004:00080000:1.0:1789429742.717194:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x61b:0x0], index 1: 0 00000004:00080000:3.0:1789429742.733550:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x61f:0x0], index 0: 0 00000004:00080000:1.0:1789429742.744181:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x61c:0x0], index 1: 0 00000004:00080000:1.0:1789429742.757072:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x620:0x0], index 0: 0 00000004:00080000:0.0:1789429742.771640:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x61d:0x0], index 1: 0 00000004:00080000:0.0:1789429742.784978:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x621:0x0], index 0: 0 00000004:00080000:2.0:1789429742.799185:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x61e:0x0], index 1: 0 00000004:00080000:0.0:1789429742.810290:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x622:0x0], index 0: 0 00000004:00080000:1.0:1789429742.820913:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x61f:0x0], index 1: 0 00000004:00080000:2.0:1789429742.830394:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x623:0x0], index 0: 0 00000004:00080000:3.0:1789429742.845117:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x620:0x0], index 1: 0 00000004:00080000:1.0:1789429742.854114:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x624:0x0], index 0: 0 00000004:00080000:2.0:1789429742.864452:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x621:0x0], index 1: 0 00000004:00080000:3.0:1789429742.874896:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x625:0x0], index 0: 0 00000004:00080000:2.0:1789429742.884848:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x622:0x0], index 1: 0 00000004:00080000:1.0:1789429742.893886:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x626:0x0], index 0: 0 00000004:00080000:1.0:1789429742.906885:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x623:0x0], index 1: 0 00000004:00080000:1.0:1789429742.940245:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x627:0x0], index 0: 0 00000004:00080000:2.0:1789429742.964887:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x624:0x0], index 1: 0 00000004:00080000:2.0:1789429742.976516:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x628:0x0], index 0: 0 00000004:00080000:1.0:1789429742.996520:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x625:0x0], index 1: 0 00000004:00080000:1.0:1789429743.027833:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x629:0x0], index 0: 0 00000004:00080000:1.0:1789429743.042138:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x626:0x0], index 1: 0 00000004:00080000:2.0:1789429743.050871:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x62a:0x0], index 0: 0 00000004:00080000:0.0:1789429743.065262:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x627:0x0], index 1: 0 00000004:00080000:0.0:1789429743.080479:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x62b:0x0], index 0: 0 00000004:00080000:1.0:1789429743.091693:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x628:0x0], index 1: 0 00000004:00080000:1.0:1789429743.107380:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x62c:0x0], index 0: 0 00000004:00080000:2.0:1789429743.121597:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x629:0x0], index 1: 0 00000004:00080000:1.0:1789429743.139000:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x62d:0x0], index 0: 0 00000004:00080000:0.0:1789429743.153690:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x62a:0x0], index 1: 0 00000004:00080000:1.0:1789429743.166609:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x62e:0x0], index 0: 0 00000004:00080000:1.0:1789429743.180639:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x62b:0x0], index 1: 0 00000004:00080000:1.0:1789429743.219531:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x62f:0x0], index 0: 0 00000004:00080000:2.0:1789429743.231438:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x62c:0x0], index 1: 0 00000004:00080000:3.0:1789429743.258088:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x630:0x0], index 0: 0 00000004:00080000:2.0:1789429743.275057:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x62d:0x0], index 1: 0 00000004:00080000:1.0:1789429743.304467:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x631:0x0], index 0: 0 00000004:00080000:3.0:1789429743.338222:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x62e:0x0], index 1: 0 00000001:00080000:1.0:1789429743.358606:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969655 is committed 00000004:00080000:2.0:1789429743.360494:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x632:0x0], index 0: 0 00002000:00080000:2.0:1789429743.361932:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1602 00000100:00080000:1.0:1789429743.366068:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789429743.367643:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x632:0x0]-[0x240000400:0x661:0x0] 00000004:00080000:2.0:1789429743.374167:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x62f:0x0], index 1: 0 00000004:00080000:2.0:1789429743.386884:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x633:0x0], index 0: 0 00000004:00080000:1.0:1789429743.405889:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x630:0x0], index 1: 0 00000004:00080000:3.0:1789429743.422381:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x634:0x0], index 0: 0 00000004:00080000:2.0:1789429743.451052:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x631:0x0], index 1: 0 00000004:00080000:2.0:1789429743.462420:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x635:0x0], index 0: 0 00000004:00080000:2.0:1789429743.485614:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x632:0x0], index 1: 0 00002000:00080000:3.0:1789429743.486867:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1602 00000100:00080000:0.0:1789429743.487124:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429743.519936:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x636:0x0], index 0: 0 00000004:00080000:0.0:1789429743.527686:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x632:0x0]-[0x280000400:0x661:0x0] 00000004:00080000:0.0:1789429743.550964:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x633:0x0], index 1: 0 00000004:00080000:2.0:1789429743.577799:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x637:0x0], index 0: 0 00000004:00080000:2.0:1789429743.597506:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x634:0x0], index 1: 0 00000004:00080000:0.0:1789429743.609299:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x638:0x0], index 0: 0 00000004:00080000:0.0:1789429743.622380:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x635:0x0], index 1: 0 00000004:00080000:1.0:1789429743.634544:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x639:0x0], index 0: 0 00000004:00080000:2.0:1789429743.647026:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x636:0x0], index 1: 0 00000004:00080000:2.0:1789429743.661559:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x63a:0x0], index 0: 0 00000004:00080000:1.0:1789429743.674906:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x637:0x0], index 1: 0 00000004:00080000:0.0:1789429743.685037:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x63b:0x0], index 0: 0 00000004:00080000:0.0:1789429743.697689:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x638:0x0], index 1: 0 00000004:00080000:1.0:1789429743.706079:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x63c:0x0], index 0: 0 00000004:00080000:2.0:1789429743.715977:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x639:0x0], index 1: 0 00000004:00080000:2.0:1789429743.726371:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x63d:0x0], index 0: 0 00000004:00080000:1.0:1789429743.739401:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x63a:0x0], index 1: 0 00000004:00080000:1.0:1789429743.749515:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x63e:0x0], index 0: 0 00000004:00080000:1.0:1789429743.759712:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x63b:0x0], index 1: 0 00000004:00080000:2.0:1789429743.776291:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x63f:0x0], index 0: 0 00000004:00080000:2.0:1789429743.788108:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x63c:0x0], index 1: 0 00000004:00080000:0.0:1789429743.805461:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x640:0x0], index 0: 0 00000004:00080000:2.0:1789429743.816153:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x63d:0x0], index 1: 0 00000004:00080000:1.0:1789429743.827399:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x641:0x0], index 0: 0 00000004:00080000:2.0:1789429743.850627:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x63e:0x0], index 1: 0 00000004:00080000:1.0:1789429743.868528:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x642:0x0], index 0: 0 00000004:00080000:0.0:1789429743.885865:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x63f:0x0], index 1: 0 00000004:00080000:1.0:1789429743.898871:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x643:0x0], index 0: 0 00000004:00080000:1.0:1789429743.918064:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x640:0x0], index 1: 0 00000004:00080000:0.0:1789429743.950264:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x644:0x0], index 0: 0 00000004:00080000:1.0:1789429743.976555:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x641:0x0], index 1: 0 00000004:00080000:1.0:1789429743.984377:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x645:0x0], index 0: 0 00000004:00080000:3.0:1789429744.003337:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x642:0x0], index 1: 0 00000100:00080000:0.0:1789429744.003803:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429744.011759:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x646:0x0], index 0: 0 00000004:00080000:0.0:1789429744.029825:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x643:0x0], index 1: 0 00000004:00080000:1.0:1789429744.039913:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x647:0x0], index 0: 0 00000004:00080000:1.0:1789429744.048277:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x644:0x0], index 1: 0 00000004:00080000:2.0:1789429744.058130:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x648:0x0], index 0: 0 00000004:00080000:0.0:1789429744.067699:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x645:0x0], index 1: 0 00000004:00080000:0.0:1789429744.081707:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x649:0x0], index 0: 0 00000004:00080000:1.0:1789429744.109265:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x646:0x0], index 1: 0 00000004:00080000:0.0:1789429744.130577:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x64a:0x0], index 0: 0 00000004:00080000:2.0:1789429744.139035:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x647:0x0], index 1: 0 00000004:00080000:1.0:1789429744.161969:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x64b:0x0], index 0: 0 00000004:00080000:1.0:1789429744.189163:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x648:0x0], index 1: 0 00000004:00080000:1.0:1789429744.200249:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x64c:0x0], index 0: 0 00000004:00080000:3.0:1789429744.213103:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x649:0x0], index 1: 0 00000004:00080000:1.0:1789429744.229322:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x64d:0x0], index 0: 0 00000004:00080000:0.0:1789429744.245445:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x64a:0x0], index 1: 0 00000004:00080000:1.0:1789429744.262442:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x64e:0x0], index 0: 0 00000004:00080000:1.0:1789429744.275493:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x64b:0x0], index 1: 0 00000004:00080000:1.0:1789429744.282393:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x64f:0x0], index 0: 0 00000004:00080000:1.0:1789429744.297024:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x64c:0x0], index 1: 0 00000004:00080000:2.0:1789429744.309326:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x650:0x0], index 0: 0 00000004:00080000:1.0:1789429744.348576:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x64d:0x0], index 1: 0 00000004:00080000:1.0:1789429744.368350:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x651:0x0], index 0: 0 00000004:00080000:2.0:1789429744.389897:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x64e:0x0], index 1: 0 00000004:00080000:2.0:1789429744.412105:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x652:0x0], index 0: 0 00002000:00080000:2.0:1789429744.412675:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1634 00000004:00080000:3.0:1789429744.421098:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x652:0x0]-[0x240000400:0x681:0x0] 00000001:00080000:2.0:1789429744.422193:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294983500 is committed 00000004:00080000:2.0:1789429744.434381:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x64f:0x0], index 1: 0 00000004:00080000:1.0:1789429744.447272:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x653:0x0], index 0: 0 00000004:00080000:1.0:1789429744.458339:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x650:0x0], index 1: 0 00000004:00080000:3.0:1789429744.468494:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x654:0x0], index 0: 0 00000004:00080000:2.0:1789429744.478383:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x651:0x0], index 1: 0 00000004:00080000:2.0:1789429744.491745:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x655:0x0], index 0: 0 00000004:00080000:1.0:1789429744.506769:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x652:0x0], index 1: 0 00002000:00080000:0.0:1789429744.507385:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1634 00000004:00080000:1.0:1789429744.516691:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x652:0x0]-[0x280000400:0x681:0x0] 00000004:00080000:2.0:1789429744.522110:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x656:0x0], index 0: 0 00000004:00080000:3.0:1789429744.533309:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x653:0x0], index 1: 0 00000004:00080000:2.0:1789429744.544864:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x657:0x0], index 0: 0 00000004:00080000:3.0:1789429744.555894:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x654:0x0], index 1: 0 00000004:00080000:2.0:1789429744.572669:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x658:0x0], index 0: 0 00000004:00080000:2.0:1789429744.584712:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x655:0x0], index 1: 0 00000004:00080000:1.0:1789429744.598811:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x659:0x0], index 0: 0 00000004:00080000:2.0:1789429744.617763:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x656:0x0], index 1: 0 00000004:00080000:3.0:1789429744.636852:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x65a:0x0], index 0: 0 00000004:00080000:1.0:1789429744.646766:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x657:0x0], index 1: 0 00000004:00080000:0.0:1789429744.655355:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x65b:0x0], index 0: 0 00000004:00080000:0.0:1789429744.672897:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x658:0x0], index 1: 0 00000004:00080000:0.0:1789429744.687074:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x65c:0x0], index 0: 0 00000004:00080000:1.0:1789429744.702118:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x659:0x0], index 1: 0 00000004:00080000:1.0:1789429744.716621:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x65d:0x0], index 0: 0 00000004:00080000:0.0:1789429744.731945:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x65a:0x0], index 1: 0 00000004:00080000:0.0:1789429744.746021:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x65e:0x0], index 0: 0 00000004:00080000:0.0:1789429744.760683:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x65b:0x0], index 1: 0 00000004:00080000:2.0:1789429744.785685:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x65f:0x0], index 0: 0 00000004:00080000:1.0:1789429744.793960:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x65c:0x0], index 1: 0 00000004:00080000:0.0:1789429744.818031:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x660:0x0], index 0: 0 00000004:00080000:1.0:1789429744.836822:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x65d:0x0], index 1: 0 00000004:00080000:1.0:1789429744.851314:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x661:0x0], index 0: 0 00000004:00080000:3.0:1789429744.870288:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x65e:0x0], index 1: 0 00000004:00080000:1.0:1789429744.892234:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x662:0x0], index 0: 0 00000004:00080000:0.0:1789429744.900154:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x65f:0x0], index 1: 0 00000001:00080000:2.0:1789429744.907184:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969632 is committed 00000004:00080000:1.0:1789429744.920700:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x663:0x0], index 0: 0 00000004:00080000:2.0:1789429744.939801:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x660:0x0], index 1: 0 00000004:00080000:3.0:1789429744.957263:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x664:0x0], index 0: 0 00000004:00080000:2.0:1789429744.968916:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x661:0x0], index 1: 0 00000004:00080000:0.0:1789429744.987648:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x665:0x0], index 0: 0 00000004:00080000:1.0:1789429745.009953:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x662:0x0], index 1: 0 00000004:00080000:2.0:1789429745.030013:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x666:0x0], index 0: 0 00000004:00080000:3.0:1789429745.044328:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x663:0x0], index 1: 0 00000004:00080000:3.0:1789429745.053753:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x667:0x0], index 0: 0 00000004:00080000:2.0:1789429745.072578:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x664:0x0], index 1: 0 00000004:00080000:1.0:1789429745.102341:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x668:0x0], index 0: 0 00000004:00080000:0.0:1789429745.120011:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x665:0x0], index 1: 0 00000004:00080000:2.0:1789429745.156918:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x669:0x0], index 0: 0 00000004:00080000:2.0:1789429745.174573:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x666:0x0], index 1: 0 00000004:00080000:2.0:1789429745.189015:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x66a:0x0], index 0: 0 00000004:00080000:1.0:1789429745.202156:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x667:0x0], index 1: 0 00000004:00080000:0.0:1789429745.214118:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x66b:0x0], index 0: 0 00000004:00080000:2.0:1789429745.225158:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x668:0x0], index 1: 0 00000004:00080000:2.0:1789429745.233944:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x66c:0x0], index 0: 0 00000004:00080000:0.0:1789429745.246493:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x669:0x0], index 1: 0 00000004:00080000:2.0:1789429745.255320:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x66d:0x0], index 0: 0 00000004:00080000:2.0:1789429745.275353:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x66a:0x0], index 1: 0 00000004:00080000:0.0:1789429745.287966:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x66e:0x0], index 0: 0 00000004:00080000:1.0:1789429745.304780:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x66b:0x0], index 1: 0 00000004:00080000:0.0:1789429745.330628:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x66f:0x0], index 0: 0 00000004:00080000:2.0:1789429745.347784:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x66c:0x0], index 1: 0 00000004:00080000:1.0:1789429745.378411:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x670:0x0], index 0: 0 00000004:00080000:0.0:1789429745.407677:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x66d:0x0], index 1: 0 00000004:00080000:1.0:1789429745.422751:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x671:0x0], index 0: 0 00000100:00080000:1.0:1789429745.430550:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429745.435830:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429745.442810:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x66e:0x0], index 1: 0 00000004:00080000:0.0:1789429745.458510:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x672:0x0], index 0: 0 00002000:00080000:1.0:1789429745.462735:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1666 00000100:00080000:3.0:1789429745.468009:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429745.472839:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x66f:0x0], index 1: 0 00000004:00080000:1.0:1789429745.491893:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x673:0x0], index 0: 0 00000004:00080000:3.0:1789429745.493509:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x673:0x0]-[0x240000400:0x6a1:0x0] 00000004:00080000:2.0:1789429745.505877:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x670:0x0], index 1: 0 00000004:00080000:2.0:1789429745.515891:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x674:0x0], index 0: 0 00000004:00080000:0.0:1789429745.529058:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x671:0x0], index 1: 0 00000004:00080000:0.0:1789429745.542962:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x675:0x0], index 0: 0 00000004:00080000:0.0:1789429745.550547:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x672:0x0], index 1: 0 00002000:00080000:3.0:1789429745.550649:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1666 00000100:00080000:1.0:1789429745.551569:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789429745.558288:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x672:0x0]-[0x280000400:0x6a1:0x0] 00000004:00080000:2.0:1789429745.561076:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x676:0x0], index 0: 0 00000004:00080000:2.0:1789429745.581624:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x673:0x0], index 1: 0 00010000:00080000:2.0:1789429745.588900:0:26938:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000004:00080000:2.0:1789429745.592970:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x677:0x0], index 0: 0 00000004:00080000:0.0:1789429745.603021:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x674:0x0], index 1: 0 00000004:00080000:1.0:1789429745.613996:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x678:0x0], index 0: 0 00000004:00080000:0.0:1789429745.623111:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x675:0x0], index 1: 0 00000004:00080000:2.0:1789429745.634132:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x679:0x0], index 0: 0 00000004:00080000:0.0:1789429745.653157:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x676:0x0], index 1: 0 00000004:00080000:0.0:1789429745.668885:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x67a:0x0], index 0: 0 00000004:00080000:0.0:1789429745.682024:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x677:0x0], index 1: 0 00000004:00080000:0.0:1789429745.704809:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x67b:0x0], index 0: 0 00000004:00080000:2.0:1789429745.728156:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x678:0x0], index 1: 0 00000004:00080000:1.0:1789429745.755131:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x67c:0x0], index 0: 0 00000004:00080000:1.0:1789429745.779168:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x679:0x0], index 1: 0 00000004:00080000:2.0:1789429745.792789:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x67d:0x0], index 0: 0 00000004:00080000:2.0:1789429745.811321:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x67a:0x0], index 1: 0 00000004:00080000:2.0:1789429745.825116:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x67e:0x0], index 0: 0 00000100:00080000:3.0:1789429745.831259:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429745.849255:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x67b:0x0], index 1: 0 00000004:00080000:2.0:1789429745.884864:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x67f:0x0], index 0: 0 00000004:00080000:0.0:1789429745.916531:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x67c:0x0], index 1: 0 00000004:00080000:0.0:1789429745.932594:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x680:0x0], index 0: 0 00000004:00080000:0.0:1789429745.945570:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x67d:0x0], index 1: 0 00000004:00080000:0.0:1789429745.969134:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x681:0x0], index 0: 0 00000004:00080000:1.0:1789429745.982050:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x67e:0x0], index 1: 0 00000004:00080000:0.0:1789429745.992922:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x682:0x0], index 0: 0 00000100:00080000:3.0:1789429746.001184:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429746.008653:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x67f:0x0], index 1: 0 00000004:00080000:2.0:1789429746.024062:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x683:0x0], index 0: 0 00000004:00080000:0.0:1789429746.038062:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x680:0x0], index 1: 0 00000004:00080000:1.0:1789429746.052383:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x684:0x0], index 0: 0 00000004:00080000:0.0:1789429746.067087:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x681:0x0], index 1: 0 00000004:00080000:0.0:1789429746.081017:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x685:0x0], index 0: 0 00000004:00080000:2.0:1789429746.094327:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x682:0x0], index 1: 0 00000004:00080000:0.0:1789429746.107541:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x686:0x0], index 0: 0 00000004:00080000:2.0:1789429746.124514:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x683:0x0], index 1: 0 00000004:00080000:0.0:1789429746.136939:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x687:0x0], index 0: 0 00000004:00080000:0.0:1789429746.146162:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x684:0x0], index 1: 0 00000004:00080000:2.0:1789429746.157271:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x688:0x0], index 0: 0 00000004:00080000:1.0:1789429746.166695:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x685:0x0], index 1: 0 00000004:00080000:3.0:1789429746.175896:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x689:0x0], index 0: 0 00000004:00080000:2.0:1789429746.187865:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x686:0x0], index 1: 0 00000004:00080000:1.0:1789429746.199934:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x68a:0x0], index 0: 0 00000004:00080000:0.0:1789429746.209398:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x687:0x0], index 1: 0 00000004:00080000:1.0:1789429746.219400:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x68b:0x0], index 0: 0 00000004:00080000:1.0:1789429746.235188:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x688:0x0], index 1: 0 00000004:00080000:0.0:1789429746.248498:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x68c:0x0], index 0: 0 00000004:00080000:1.0:1789429746.261725:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x689:0x0], index 1: 0 00000004:00080000:0.0:1789429746.278418:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x68d:0x0], index 0: 0 00000004:00080000:1.0:1789429746.296911:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x68a:0x0], index 1: 0 00000004:00080000:1.0:1789429746.337349:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x68e:0x0], index 0: 0 00000004:00080000:2.0:1789429746.365884:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x68b:0x0], index 1: 0 00000004:00080000:1.0:1789429746.382054:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x68f:0x0], index 0: 0 00000004:00080000:0.0:1789429746.395375:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x68c:0x0], index 1: 0 00000004:00080000:1.0:1789429746.405240:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x690:0x0], index 0: 0 00000004:00080000:1.0:1789429746.417967:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x68d:0x0], index 1: 0 00000004:00080000:2.0:1789429746.434915:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x691:0x0], index 0: 0 00000004:00080000:3.0:1789429746.458326:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x68e:0x0], index 1: 0 00000004:00080000:3.0:1789429746.470853:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x692:0x0], index 0: 0 00002000:00080000:1.0:1789429746.484123:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1698 00000004:00080000:0.0:1789429746.489846:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x68f:0x0], index 1: 0 00000004:00080000:2.0:1789429746.509091:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x692:0x0]-[0x240000400:0x6c1:0x0] 00000004:00080000:1.0:1789429746.511505:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x693:0x0], index 0: 0 00000004:00080000:0.0:1789429746.527917:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x690:0x0], index 1: 0 00000004:00080000:1.0:1789429746.541447:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x694:0x0], index 0: 0 00000004:00080000:3.0:1789429746.561860:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x691:0x0], index 1: 0 00000004:00080000:0.0:1789429746.568940:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x695:0x0], index 0: 0 00000004:00080000:1.0:1789429746.580860:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x692:0x0], index 1: 0 00002000:00080000:3.0:1789429746.581491:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1698 00000004:00080000:0.0:1789429746.584374:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x692:0x0]-[0x280000400:0x6c1:0x0] 00000004:00080000:1.0:1789429746.597418:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x696:0x0], index 0: 0 00000004:00080000:1.0:1789429746.605129:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x693:0x0], index 1: 0 00000004:00080000:3.0:1789429746.621279:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x697:0x0], index 0: 0 00000004:00080000:2.0:1789429746.639454:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x694:0x0], index 1: 0 00000004:00080000:1.0:1789429746.653616:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x698:0x0], index 0: 0 00000004:00080000:3.0:1789429746.665861:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x695:0x0], index 1: 0 00000004:00080000:2.0:1789429746.678865:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x699:0x0], index 0: 0 00000004:00080000:0.0:1789429746.693233:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x696:0x0], index 1: 0 00000004:00080000:2.0:1789429746.707312:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x69a:0x0], index 0: 0 00000004:00080000:1.0:1789429746.720254:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x697:0x0], index 1: 0 00000004:00080000:2.0:1789429746.729913:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x69b:0x0], index 0: 0 00000004:00080000:2.0:1789429746.743375:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x698:0x0], index 1: 0 00000004:00080000:0.0:1789429746.751790:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x69c:0x0], index 0: 0 00000004:00080000:2.0:1789429746.772760:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x699:0x0], index 1: 0 00000004:00080000:1.0:1789429746.792598:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x69d:0x0], index 0: 0 00000004:00080000:0.0:1789429746.801028:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x69a:0x0], index 1: 0 00000004:00080000:3.0:1789429746.813908:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x69e:0x0], index 0: 0 00000004:00080000:2.0:1789429746.825151:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x69b:0x0], index 1: 0 00000004:00080000:2.0:1789429746.835985:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x69f:0x0], index 0: 0 00000004:00080000:1.0:1789429746.857345:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x69c:0x0], index 1: 0 00000004:00080000:2.0:1789429746.867879:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6a0:0x0], index 0: 0 00000004:00080000:2.0:1789429746.879900:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x69d:0x0], index 1: 0 00000004:00080000:0.0:1789429746.891484:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6a1:0x0], index 0: 0 00000004:00080000:2.0:1789429746.903079:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x69e:0x0], index 1: 0 00000004:00080000:2.0:1789429746.925459:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6a2:0x0], index 0: 0 00000004:00080000:0.0:1789429746.941612:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x69f:0x0], index 1: 0 00000004:00080000:2.0:1789429746.959489:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6a3:0x0], index 0: 0 00000004:00080000:2.0:1789429746.973352:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6a0:0x0], index 1: 0 00000004:00080000:0.0:1789429746.994832:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6a4:0x0], index 0: 0 00000004:00080000:2.0:1789429747.008946:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6a1:0x0], index 1: 0 00000004:00080000:0.0:1789429747.020279:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6a5:0x0], index 0: 0 00000004:00080000:2.0:1789429747.042828:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6a2:0x0], index 1: 0 00000004:00080000:2.0:1789429747.056901:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6a6:0x0], index 0: 0 00000004:00080000:2.0:1789429747.066983:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6a3:0x0], index 1: 0 00000004:00080000:2.0:1789429747.079733:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6a7:0x0], index 0: 0 00000004:00080000:2.0:1789429747.100286:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6a4:0x0], index 1: 0 00000004:00080000:2.0:1789429747.126830:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6a8:0x0], index 0: 0 00000004:00080000:0.0:1789429747.142639:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6a5:0x0], index 1: 0 00000004:00080000:2.0:1789429747.159370:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6a9:0x0], index 0: 0 00000004:00080000:3.0:1789429747.167687:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6a6:0x0], index 1: 0 00000004:00080000:1.0:1789429747.190625:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6aa:0x0], index 0: 0 00000004:00080000:2.0:1789429747.203140:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6a7:0x0], index 1: 0 00000004:00080000:2.0:1789429747.229970:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ab:0x0], index 0: 0 00000004:00080000:1.0:1789429747.247051:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6a8:0x0], index 1: 0 00000004:00080000:2.0:1789429747.264312:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ac:0x0], index 0: 0 00000004:00080000:1.0:1789429747.279273:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6a9:0x0], index 1: 0 00000004:00080000:0.0:1789429747.295052:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ad:0x0], index 0: 0 00000004:00080000:2.0:1789429747.308436:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6aa:0x0], index 1: 0 00000004:00080000:2.0:1789429747.328037:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ae:0x0], index 0: 0 00000004:00080000:2.0:1789429747.343668:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ab:0x0], index 1: 0 00000004:00080000:1.0:1789429747.358107:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6af:0x0], index 0: 0 00000004:00080000:2.0:1789429747.371436:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ac:0x0], index 1: 0 00000004:00080000:2.0:1789429747.383636:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6b0:0x0], index 0: 0 00000004:00080000:2.0:1789429747.400134:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ad:0x0], index 1: 0 00000004:00080000:2.0:1789429747.414156:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6b1:0x0], index 0: 0 00000004:00080000:1.0:1789429747.424958:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ae:0x0], index 1: 0 00002000:00080000:3.0:1789429747.439060:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1730 00000100:00080000:0.0:1789429747.439160:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429747.443436:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6b2:0x0], index 0: 0 00000004:00080000:1.0:1789429747.444000:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x6b2:0x0]-[0x240000400:0x6e1:0x0] 00000004:00080000:1.0:1789429747.453322:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6af:0x0], index 1: 0 00000004:00080000:2.0:1789429747.469493:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6b3:0x0], index 0: 0 00000004:00080000:0.0:1789429747.477299:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6b0:0x0], index 1: 0 00000004:00080000:1.0:1789429747.485466:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6b4:0x0], index 0: 0 00000004:00080000:0.0:1789429747.506165:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6b1:0x0], index 1: 0 00000004:00080000:2.0:1789429747.527493:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6b5:0x0], index 0: 0 00000004:00080000:1.0:1789429747.543961:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6b2:0x0], index 1: 0 00002000:00080000:1.0:1789429747.545193:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1730 00000100:00080000:3.0:1789429747.545658:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429747.549184:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x6b2:0x0]-[0x280000400:0x6e1:0x0] 00000004:00080000:2.0:1789429747.557572:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6b6:0x0], index 0: 0 00000004:00080000:1.0:1789429747.566423:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6b3:0x0], index 1: 0 00000004:00080000:2.0:1789429747.575965:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6b7:0x0], index 0: 0 00000004:00080000:2.0:1789429747.584046:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6b4:0x0], index 1: 0 00000004:00080000:1.0:1789429747.593585:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6b8:0x0], index 0: 0 00000004:00080000:2.0:1789429747.607170:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6b5:0x0], index 1: 0 00000004:00080000:1.0:1789429747.621298:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6b9:0x0], index 0: 0 00000004:00080000:2.0:1789429747.629413:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6b6:0x0], index 1: 0 00000004:00080000:2.0:1789429747.639044:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ba:0x0], index 0: 0 00000004:00080000:1.0:1789429747.651036:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6b7:0x0], index 1: 0 00000004:00080000:2.0:1789429747.661312:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6bb:0x0], index 0: 0 00000004:00080000:2.0:1789429747.671274:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6b8:0x0], index 1: 0 00000004:00080000:1.0:1789429747.683342:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6bc:0x0], index 0: 0 00000004:00080000:1.0:1789429747.695243:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6b9:0x0], index 1: 0 00000004:00080000:0.0:1789429747.707940:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6bd:0x0], index 0: 0 00000004:00080000:3.0:1789429747.715646:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ba:0x0], index 1: 0 00000004:00080000:2.0:1789429747.724152:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6be:0x0], index 0: 0 00000004:00080000:0.0:1789429747.737840:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6bb:0x0], index 1: 0 00000004:00080000:1.0:1789429747.749975:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6bf:0x0], index 0: 0 00000004:00080000:0.0:1789429747.762988:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6bc:0x0], index 1: 0 00000004:00080000:2.0:1789429747.776398:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6c0:0x0], index 0: 0 00000004:00080000:0.0:1789429747.788130:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6bd:0x0], index 1: 0 00000004:00080000:2.0:1789429747.798299:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6c1:0x0], index 0: 0 00000004:00080000:1.0:1789429747.813406:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6be:0x0], index 1: 0 00000004:00080000:3.0:1789429747.821926:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6c2:0x0], index 0: 0 00000004:00080000:1.0:1789429747.830940:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6bf:0x0], index 1: 0 00000004:00080000:1.0:1789429747.840302:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6c3:0x0], index 0: 0 00000004:00080000:0.0:1789429747.850511:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6c0:0x0], index 1: 0 00000004:00080000:1.0:1789429747.865372:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6c4:0x0], index 0: 0 00000004:00080000:3.0:1789429747.884049:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6c1:0x0], index 1: 0 00000004:00080000:0.0:1789429747.896855:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6c5:0x0], index 0: 0 00000004:00080000:1.0:1789429747.906601:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6c2:0x0], index 1: 0 00000004:00080000:3.0:1789429747.924340:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6c6:0x0], index 0: 0 00000004:00080000:0.0:1789429747.932969:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6c3:0x0], index 1: 0 00000004:00080000:1.0:1789429747.942899:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6c7:0x0], index 0: 0 00000004:00080000:1.0:1789429747.952970:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6c4:0x0], index 1: 0 00000004:00080000:1.0:1789429747.971157:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6c8:0x0], index 0: 0 00000004:00080000:3.0:1789429747.995890:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6c5:0x0], index 1: 0 00000004:00080000:0.0:1789429748.004659:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6c9:0x0], index 0: 0 00000100:00080000:3.0:1789429748.006046:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429748.019192:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6c6:0x0], index 1: 0 00000004:00080000:1.0:1789429748.028294:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ca:0x0], index 0: 0 00000004:00080000:0.0:1789429748.043858:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6c7:0x0], index 1: 0 00000004:00080000:3.0:1789429748.069714:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6cb:0x0], index 0: 0 00000004:00080000:2.0:1789429748.082582:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6c8:0x0], index 1: 0 00000004:00080000:0.0:1789429748.094508:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6cc:0x0], index 0: 0 00000004:00080000:1.0:1789429748.105348:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6c9:0x0], index 1: 0 00000004:00080000:2.0:1789429748.120964:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6cd:0x0], index 0: 0 00000004:00080000:3.0:1789429748.136895:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ca:0x0], index 1: 0 00000004:00080000:0.0:1789429748.159731:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ce:0x0], index 0: 0 00000004:00080000:0.0:1789429748.173454:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6cb:0x0], index 1: 0 00000004:00080000:1.0:1789429748.194736:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6cf:0x0], index 0: 0 00000004:00080000:0.0:1789429748.211942:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6cc:0x0], index 1: 0 00000004:00080000:1.0:1789429748.223926:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6d0:0x0], index 0: 0 00000004:00080000:0.0:1789429748.236894:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6cd:0x0], index 1: 0 00000004:00080000:0.0:1789429748.245954:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6d1:0x0], index 0: 0 00000004:00080000:1.0:1789429748.260987:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ce:0x0], index 1: 0 00002000:00080000:3.0:1789429748.270673:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1762 00000004:00080000:0.0:1789429748.270892:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6d2:0x0], index 0: 0 00000004:00080000:1.0:1789429748.278728:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x6d2:0x0]-[0x240000400:0x701:0x0] 00000004:00080000:0.0:1789429748.282128:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6cf:0x0], index 1: 0 00000004:00080000:0.0:1789429748.296841:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6d3:0x0], index 0: 0 00000004:00080000:2.0:1789429748.309083:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6d0:0x0], index 1: 0 00000004:00080000:1.0:1789429748.319384:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6d4:0x0], index 0: 0 00000004:00080000:3.0:1789429748.340990:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6d1:0x0], index 1: 0 00000004:00080000:0.0:1789429748.361156:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6d5:0x0], index 0: 0 00000004:00080000:2.0:1789429748.373039:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6d2:0x0], index 1: 0 00002000:00080000:3.0:1789429748.373851:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1762 00000004:00080000:2.0:1789429748.385141:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6d6:0x0], index 0: 0 00000004:00080000:0.0:1789429748.389239:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x6d2:0x0]-[0x280000400:0x701:0x0] 00000004:00080000:3.0:1789429748.409042:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6d3:0x0], index 1: 0 00000004:00080000:0.0:1789429748.420419:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6d7:0x0], index 0: 0 00000004:00080000:1.0:1789429748.434978:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6d4:0x0], index 1: 0 00000004:00080000:2.0:1789429748.447389:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6d8:0x0], index 0: 0 00000004:00080000:2.0:1789429748.455974:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6d5:0x0], index 1: 0 00000001:00080000:0.0:1789429748.456300:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969657 is committed 00000001:00080000:0.0:1789429748.458401:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969660 is committed 00000001:00080000:0.0:1789429748.458420:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969661 is committed 00000004:00080000:3.0:1789429748.465309:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6d9:0x0], index 0: 0 00000004:00080000:2.0:1789429748.476852:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6d6:0x0], index 1: 0 00000004:00080000:1.0:1789429748.486253:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6da:0x0], index 0: 0 00000004:00080000:2.0:1789429748.503491:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6d7:0x0], index 1: 0 00000004:00080000:2.0:1789429748.527977:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6db:0x0], index 0: 0 00000004:00080000:3.0:1789429748.543661:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6d8:0x0], index 1: 0 00000004:00080000:2.0:1789429748.574911:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6dc:0x0], index 0: 0 00000004:00080000:1.0:1789429748.600442:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6d9:0x0], index 1: 0 00000004:00080000:3.0:1789429748.625338:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6dd:0x0], index 0: 0 00000004:00080000:2.0:1789429748.635511:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6da:0x0], index 1: 0 00000004:00080000:0.0:1789429748.652955:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6de:0x0], index 0: 0 00000004:00080000:2.0:1789429748.670515:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6db:0x0], index 1: 0 00000004:00080000:2.0:1789429748.691154:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6df:0x0], index 0: 0 00000004:00080000:0.0:1789429748.707706:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6dc:0x0], index 1: 0 00000004:00080000:2.0:1789429748.730971:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6e0:0x0], index 0: 0 00000004:00080000:1.0:1789429748.764180:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6dd:0x0], index 1: 0 00000004:00080000:1.0:1789429748.776195:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6e1:0x0], index 0: 0 00000004:00080000:0.0:1789429748.792805:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6de:0x0], index 1: 0 00000004:00080000:0.0:1789429748.810010:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6e2:0x0], index 0: 0 00000004:00080000:2.0:1789429748.822024:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6df:0x0], index 1: 0 00000004:00080000:3.0:1789429748.834666:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6e3:0x0], index 0: 0 00000004:00080000:1.0:1789429748.852385:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6e0:0x0], index 1: 0 00000004:00080000:3.0:1789429748.870335:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6e4:0x0], index 0: 0 00000004:00080000:0.0:1789429748.882651:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6e1:0x0], index 1: 0 00000004:00080000:1.0:1789429748.894961:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6e5:0x0], index 0: 0 00000004:00080000:0.0:1789429748.905955:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6e2:0x0], index 1: 0 00000004:00080000:0.0:1789429748.915945:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6e6:0x0], index 0: 0 00000004:00080000:3.0:1789429748.927033:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6e3:0x0], index 1: 0 00000004:00080000:1.0:1789429748.938360:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6e7:0x0], index 0: 0 00000004:00080000:3.0:1789429748.948289:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6e4:0x0], index 1: 0 00000004:00080000:2.0:1789429748.964005:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6e8:0x0], index 0: 0 00000004:00080000:0.0:1789429748.974505:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6e5:0x0], index 1: 0 00000004:00080000:0.0:1789429748.983048:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6e9:0x0], index 0: 0 00000004:00080000:1.0:1789429748.997012:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6e6:0x0], index 1: 0 00000004:00080000:3.0:1789429749.006981:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ea:0x0], index 0: 0 00000004:00080000:2.0:1789429749.015132:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6e7:0x0], index 1: 0 00000004:00080000:3.0:1789429749.024490:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6eb:0x0], index 0: 0 00000004:00080000:2.0:1789429749.036685:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6e8:0x0], index 1: 0 00000004:00080000:1.0:1789429749.049121:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ec:0x0], index 0: 0 00000004:00080000:2.0:1789429749.063090:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6e9:0x0], index 1: 0 00000004:00080000:2.0:1789429749.074076:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ed:0x0], index 0: 0 00000004:00080000:0.0:1789429749.085438:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ea:0x0], index 1: 0 00000004:00080000:1.0:1789429749.094602:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ee:0x0], index 0: 0 00000004:00080000:2.0:1789429749.106436:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6eb:0x0], index 1: 0 00000004:00080000:2.0:1789429749.116629:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ef:0x0], index 0: 0 00000004:00080000:2.0:1789429749.126485:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ec:0x0], index 1: 0 00000004:00080000:2.0:1789429749.137374:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6f0:0x0], index 0: 0 00000004:00080000:2.0:1789429749.149236:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ed:0x0], index 1: 0 00000004:00080000:2.0:1789429749.161752:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6f1:0x0], index 0: 0 00000004:00080000:2.0:1789429749.175615:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ee:0x0], index 1: 0 00000004:00080000:2.0:1789429749.186191:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6f2:0x0], index 0: 0 00002000:00080000:3.0:1789429749.188389:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1794 00000100:00080000:2.0:1789429749.190115:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429749.199265:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x6f2:0x0]-[0x240000400:0x721:0x0] 00000004:00080000:3.0:1789429749.205300:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ef:0x0], index 1: 0 00000004:00080000:2.0:1789429749.214487:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6f3:0x0], index 0: 0 00000004:00080000:2.0:1789429749.225783:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6f0:0x0], index 1: 0 00000004:00080000:2.0:1789429749.237086:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6f4:0x0], index 0: 0 00000004:00080000:1.0:1789429749.255043:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6f1:0x0], index 1: 0 00000004:00080000:3.0:1789429749.265560:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6f5:0x0], index 0: 0 00000004:00080000:1.0:1789429749.276890:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6f2:0x0], index 1: 0 00002000:00080000:2.0:1789429749.286108:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1794 00000100:00080000:3.0:1789429749.286446:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789429749.290464:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6f6:0x0], index 0: 0 00000004:00080000:0.0:1789429749.304933:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6f3:0x0], index 1: 0 00000004:00080000:0.0:1789429749.311250:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x6f3:0x0]-[0x280000400:0x721:0x0] 00000004:00080000:1.0:1789429749.318631:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6f7:0x0], index 0: 0 00000004:00080000:3.0:1789429749.334603:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6f4:0x0], index 1: 0 00000004:00080000:0.0:1789429749.365770:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6f8:0x0], index 0: 0 00000004:00080000:3.0:1789429749.374402:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6f5:0x0], index 1: 0 00000004:00080000:1.0:1789429749.386067:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6f9:0x0], index 0: 0 00000004:00080000:1.0:1789429749.396061:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6f6:0x0], index 1: 0 00000004:00080000:2.0:1789429749.407441:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6fa:0x0], index 0: 0 00000004:00080000:0.0:1789429749.438311:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6f7:0x0], index 1: 0 00000004:00080000:3.0:1789429749.461673:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6fb:0x0], index 0: 0 00000004:00080000:0.0:1789429749.472324:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6f8:0x0], index 1: 0 00000004:00080000:2.0:1789429749.486945:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6fc:0x0], index 0: 0 00000004:00080000:0.0:1789429749.504157:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6f9:0x0], index 1: 0 00000001:00080000:3.0:1789429749.521378:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984182 is committed 00000001:00080000:3.0:1789429749.522148:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984183 is committed 00000004:00080000:0.0:1789429749.544029:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6fd:0x0], index 0: 0 00000004:00080000:0.0:1789429749.559316:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6fa:0x0], index 1: 0 00000004:00080000:2.0:1789429749.576246:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6fe:0x0], index 0: 0 00000004:00080000:2.0:1789429749.585069:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6fb:0x0], index 1: 0 00000004:00080000:1.0:1789429749.601774:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6ff:0x0], index 0: 0 00000004:00080000:3.0:1789429749.631717:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6fc:0x0], index 1: 0 00000004:00080000:2.0:1789429749.644631:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x700:0x0], index 0: 0 00000004:00080000:2.0:1789429749.659965:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6fd:0x0], index 1: 0 00000004:00080000:2.0:1789429749.677699:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x701:0x0], index 0: 0 00000004:00080000:1.0:1789429749.693485:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6fe:0x0], index 1: 0 00000004:00080000:2.0:1789429749.707128:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x702:0x0], index 0: 0 00000004:00080000:2.0:1789429749.716357:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6ff:0x0], index 1: 0 00000004:00080000:1.0:1789429749.729057:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x703:0x0], index 0: 0 00000004:00080000:0.0:1789429749.750047:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x700:0x0], index 1: 0 00000004:00080000:0.0:1789429749.762633:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x704:0x0], index 0: 0 00000004:00080000:0.0:1789429749.779888:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x701:0x0], index 1: 0 00000004:00080000:0.0:1789429749.796261:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x705:0x0], index 0: 0 00000004:00080000:1.0:1789429749.823086:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x702:0x0], index 1: 0 00000004:00080000:1.0:1789429749.848146:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x706:0x0], index 0: 0 00000004:00080000:0.0:1789429749.865192:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x703:0x0], index 1: 0 00000004:00080000:2.0:1789429749.881567:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x707:0x0], index 0: 0 00000004:00080000:0.0:1789429749.894801:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x704:0x0], index 1: 0 00000004:00080000:2.0:1789429749.904020:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x708:0x0], index 0: 0 00000004:00080000:0.0:1789429749.913502:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x705:0x0], index 1: 0 00000004:00080000:0.0:1789429749.923449:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x709:0x0], index 0: 0 00000004:00080000:2.0:1789429749.965719:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x706:0x0], index 1: 0 00000004:00080000:1.0:1789429749.994754:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x70a:0x0], index 0: 0 00000100:00080000:3.0:1789429750.011711:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429750.022389:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x707:0x0], index 1: 0 00000004:00080000:1.0:1789429750.043975:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x70b:0x0], index 0: 0 00000004:00080000:1.0:1789429750.061479:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x708:0x0], index 1: 0 00000001:00080000:3.0:1789429750.068221:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969634 is committed 00000001:00080000:3.0:1789429750.068284:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969637 is committed 00000004:00080000:3.0:1789429750.083120:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x70c:0x0], index 0: 0 00000004:00080000:0.0:1789429750.100866:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x709:0x0], index 1: 0 00000004:00080000:2.0:1789429750.128991:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x70d:0x0], index 0: 0 00000004:00080000:1.0:1789429750.148953:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x70a:0x0], index 1: 0 00000004:00080000:1.0:1789429750.166674:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x70e:0x0], index 0: 0 00000004:00080000:0.0:1789429750.182871:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x70b:0x0], index 1: 0 00000004:00080000:0.0:1789429750.197935:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x70f:0x0], index 0: 0 00000004:00080000:0.0:1789429750.209519:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x70c:0x0], index 1: 0 00000004:00080000:1.0:1789429750.221124:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x710:0x0], index 0: 0 00000004:00080000:0.0:1789429750.236027:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x70d:0x0], index 1: 0 00000004:00080000:0.0:1789429750.252247:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x711:0x0], index 0: 0 00000004:00080000:2.0:1789429750.262151:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x70e:0x0], index 1: 0 00000004:00080000:0.0:1789429750.272423:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x712:0x0], index 0: 0 00002000:00080000:0.0:1789429750.273779:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1826 00000004:00080000:2.0:1789429750.290927:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x70f:0x0], index 1: 0 00000004:00080000:2.0:1789429750.294495:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x712:0x0]-[0x240000400:0x741:0x0] 00000004:00080000:0.0:1789429750.310159:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x713:0x0], index 0: 0 00000004:00080000:2.0:1789429750.327716:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x710:0x0], index 1: 0 00000004:00080000:3.0:1789429750.353155:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x714:0x0], index 0: 0 00000004:00080000:2.0:1789429750.371863:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x711:0x0], index 1: 0 00000004:00080000:2.0:1789429750.387790:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x715:0x0], index 0: 0 00000004:00080000:1.0:1789429750.404880:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x712:0x0], index 1: 0 00002000:00080000:2.0:1789429750.405422:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1826 00000004:00080000:0.0:1789429750.409527:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x712:0x0]-[0x280000400:0x741:0x0] 00000004:00080000:2.0:1789429750.425022:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x716:0x0], index 0: 0 00000004:00080000:3.0:1789429750.437442:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x713:0x0], index 1: 0 00000004:00080000:2.0:1789429750.465170:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x717:0x0], index 0: 0 00000004:00080000:2.0:1789429750.476958:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x714:0x0], index 1: 0 00000004:00080000:0.0:1789429750.490561:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x718:0x0], index 0: 0 00000004:00080000:2.0:1789429750.502862:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x715:0x0], index 1: 0 00000004:00080000:2.0:1789429750.512183:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x719:0x0], index 0: 0 00000004:00080000:0.0:1789429750.521374:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x716:0x0], index 1: 0 00000004:00080000:2.0:1789429750.535072:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x71a:0x0], index 0: 0 00000004:00080000:2.0:1789429750.546920:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x717:0x0], index 1: 0 00000100:00080000:2.0:1789429750.566344:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429750.566361:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429750.569101:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x71b:0x0], index 0: 0 00000004:00080000:2.0:1789429750.578401:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x718:0x0], index 1: 0 00000004:00080000:2.0:1789429750.587354:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x71c:0x0], index 0: 0 00000004:00080000:0.0:1789429750.605020:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x719:0x0], index 1: 0 00000004:00080000:1.0:1789429750.615161:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x71d:0x0], index 0: 0 00000004:00080000:3.0:1789429750.631608:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71a:0x0], index 1: 0 00000004:00080000:1.0:1789429750.655134:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x71e:0x0], index 0: 0 00000004:00080000:1.0:1789429750.671874:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71b:0x0], index 1: 0 00000004:00080000:0.0:1789429750.686124:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x71f:0x0], index 0: 0 00000004:00080000:1.0:1789429750.703354:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71c:0x0], index 1: 0 00000004:00080000:2.0:1789429750.721801:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x720:0x0], index 0: 0 00000004:00080000:1.0:1789429750.740489:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71d:0x0], index 1: 0 00000004:00080000:1.0:1789429750.760619:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x721:0x0], index 0: 0 00000004:00080000:0.0:1789429750.782309:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71e:0x0], index 1: 0 00000004:00080000:2.0:1789429750.798450:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x722:0x0], index 0: 0 00000004:00080000:3.0:1789429750.823353:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x71f:0x0], index 1: 0 00000004:00080000:2.0:1789429750.836182:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x723:0x0], index 0: 0 00000004:00080000:2.0:1789429750.844952:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x720:0x0], index 1: 0 00000004:00080000:2.0:1789429750.854841:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x724:0x0], index 0: 0 00000004:00080000:2.0:1789429750.869843:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x721:0x0], index 1: 0 00000004:00080000:3.0:1789429750.878436:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x725:0x0], index 0: 0 00000004:00080000:1.0:1789429750.888035:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x722:0x0], index 1: 0 00000004:00080000:2.0:1789429750.905862:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x726:0x0], index 0: 0 00000004:00080000:2.0:1789429750.917862:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x723:0x0], index 1: 0 00000004:00080000:2.0:1789429750.931041:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x727:0x0], index 0: 0 00000004:00080000:1.0:1789429750.938921:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x724:0x0], index 1: 0 00000004:00080000:1.0:1789429750.948925:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x728:0x0], index 0: 0 00000100:00080000:3.0:1789429750.950352:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429750.951156:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429750.959145:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x725:0x0], index 1: 0 00000004:00080000:1.0:1789429750.968935:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x729:0x0], index 0: 0 00000004:00080000:3.0:1789429750.978645:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x726:0x0], index 1: 0 00000004:00080000:0.0:1789429750.992376:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x72a:0x0], index 0: 0 00000004:00080000:0.0:1789429751.004941:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x727:0x0], index 1: 0 00000004:00080000:0.0:1789429751.016427:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x72b:0x0], index 0: 0 00000004:00080000:1.0:1789429751.030082:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x728:0x0], index 1: 0 00000004:00080000:2.0:1789429751.046120:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x72c:0x0], index 0: 0 00000004:00080000:0.0:1789429751.073380:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x729:0x0], index 1: 0 00000004:00080000:0.0:1789429751.106181:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x72d:0x0], index 0: 0 00000004:00080000:2.0:1789429751.133313:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x72a:0x0], index 1: 0 00000004:00080000:2.0:1789429751.152011:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x72e:0x0], index 0: 0 00000004:00080000:2.0:1789429751.163125:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x72b:0x0], index 1: 0 00000004:00080000:0.0:1789429751.177448:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x72f:0x0], index 0: 0 00000004:00080000:1.0:1789429751.189040:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x72c:0x0], index 1: 0 00000004:00080000:0.0:1789429751.207817:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x730:0x0], index 0: 0 00000004:00080000:1.0:1789429751.230143:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x72d:0x0], index 1: 0 00000004:00080000:0.0:1789429751.248027:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x731:0x0], index 0: 0 00000004:00080000:0.0:1789429751.257849:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x72e:0x0], index 1: 0 00000004:00080000:1.0:1789429751.271001:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x732:0x0], index 0: 0 00002000:00080000:1.0:1789429751.271729:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1858 00000100:00080000:0.0:1789429751.274335:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429751.278185:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x732:0x0]-[0x240000400:0x761:0x0] 00000004:00080000:0.0:1789429751.285008:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x72f:0x0], index 1: 0 00000004:00080000:1.0:1789429751.296163:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x733:0x0], index 0: 0 00000004:00080000:2.0:1789429751.308130:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x730:0x0], index 1: 0 00000004:00080000:0.0:1789429751.335695:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x734:0x0], index 0: 0 00000004:00080000:3.0:1789429751.352074:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x731:0x0], index 1: 0 00000004:00080000:0.0:1789429751.374504:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x735:0x0], index 0: 0 00002000:00080000:3.0:1789429751.401837:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1858 00000100:00080000:1.0:1789429751.403967:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429751.404575:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x732:0x0], index 1: 0 00000004:00080000:1.0:1789429751.416929:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x736:0x0], index 0: 0 00000004:00080000:0.0:1789429751.421631:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x732:0x0]-[0x280000400:0x761:0x0] 00000004:00080000:2.0:1789429751.428264:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x733:0x0], index 1: 0 00000004:00080000:1.0:1789429751.452854:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x737:0x0], index 0: 0 00000004:00080000:1.0:1789429751.467062:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x734:0x0], index 1: 0 00000004:00080000:2.0:1789429751.474956:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x738:0x0], index 0: 0 00000004:00080000:2.0:1789429751.486013:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x735:0x0], index 1: 0 00000004:00080000:0.0:1789429751.499152:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x739:0x0], index 0: 0 00000004:00080000:3.0:1789429751.510156:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x736:0x0], index 1: 0 00000004:00080000:1.0:1789429751.521351:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73a:0x0], index 0: 0 00000004:00080000:3.0:1789429751.533338:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x737:0x0], index 1: 0 00000004:00080000:1.0:1789429751.543896:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73b:0x0], index 0: 0 00000004:00080000:0.0:1789429751.554847:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x738:0x0], index 1: 0 00000004:00080000:2.0:1789429751.566190:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73c:0x0], index 0: 0 00000004:00080000:0.0:1789429751.577907:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x739:0x0], index 1: 0 00000004:00080000:0.0:1789429751.592868:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73d:0x0], index 0: 0 00000004:00080000:0.0:1789429751.604669:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x73a:0x0], index 1: 0 00000004:00080000:0.0:1789429751.615965:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73e:0x0], index 0: 0 00000004:00080000:2.0:1789429751.637817:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x73b:0x0], index 1: 0 00000004:00080000:2.0:1789429751.650047:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x73f:0x0], index 0: 0 00000004:00080000:3.0:1789429751.659138:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x73c:0x0], index 1: 0 00000004:00080000:1.0:1789429751.667575:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x740:0x0], index 0: 0 00000004:00080000:2.0:1789429751.682883:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x73d:0x0], index 1: 0 00000004:00080000:0.0:1789429751.704341:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x741:0x0], index 0: 0 00000004:00080000:1.0:1789429751.723167:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x73e:0x0], index 1: 0 00000004:00080000:0.0:1789429751.752071:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x742:0x0], index 0: 0 00000004:00080000:3.0:1789429751.767353:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x73f:0x0], index 1: 0 00000004:00080000:1.0:1789429751.793472:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x743:0x0], index 0: 0 00000004:00080000:1.0:1789429751.807000:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x740:0x0], index 1: 0 00000004:00080000:1.0:1789429751.819700:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x744:0x0], index 0: 0 00000004:00080000:0.0:1789429751.835929:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x741:0x0], index 1: 0 00000004:00080000:2.0:1789429751.850090:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x745:0x0], index 0: 0 00000004:00080000:1.0:1789429751.870095:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x742:0x0], index 1: 0 00000004:00080000:2.0:1789429751.883029:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x746:0x0], index 0: 0 00000004:00080000:2.0:1789429751.896570:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x743:0x0], index 1: 0 00000004:00080000:3.0:1789429751.922130:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x747:0x0], index 0: 0 00000004:00080000:1.0:1789429751.934614:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x744:0x0], index 1: 0 00000004:00080000:3.0:1789429751.955528:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x748:0x0], index 0: 0 00000004:00080000:2.0:1789429751.975863:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x745:0x0], index 1: 0 00000004:00080000:2.0:1789429751.993691:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x749:0x0], index 0: 0 00000004:00080000:2.0:1789429752.006492:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x746:0x0], index 1: 0 00000100:00080000:1.0:1789429752.007366:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429752.018182:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x74a:0x0], index 0: 0 00000004:00080000:3.0:1789429752.032758:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x747:0x0], index 1: 0 00000004:00080000:2.0:1789429752.046108:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x74b:0x0], index 0: 0 00000004:00080000:2.0:1789429752.057028:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x748:0x0], index 1: 0 00000004:00080000:2.0:1789429752.068460:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x74c:0x0], index 0: 0 00000004:00080000:2.0:1789429752.078820:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x749:0x0], index 1: 0 00000004:00080000:2.0:1789429752.088925:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x74d:0x0], index 0: 0 00000004:00080000:2.0:1789429752.102167:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x74a:0x0], index 1: 0 00000004:00080000:2.0:1789429752.114146:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x74e:0x0], index 0: 0 00000004:00080000:3.0:1789429752.123771:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x74b:0x0], index 1: 0 00000004:00080000:0.0:1789429752.154395:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x74f:0x0], index 0: 0 00000004:00080000:2.0:1789429752.168795:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x74c:0x0], index 1: 0 00000004:00080000:2.0:1789429752.186651:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x750:0x0], index 0: 0 00000004:00080000:2.0:1789429752.198368:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x74d:0x0], index 1: 0 00000004:00080000:1.0:1789429752.215392:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x751:0x0], index 0: 0 00000004:00080000:2.0:1789429752.227172:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x74e:0x0], index 1: 0 00000004:00080000:2.0:1789429752.237560:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x752:0x0], index 0: 0 00002000:00080000:3.0:1789429752.239648:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1890 00000004:00080000:1.0:1789429752.251409:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x752:0x0]-[0x240000400:0x781:0x0] 00000004:00080000:2.0:1789429752.253269:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x74f:0x0], index 1: 0 00000004:00080000:1.0:1789429752.267144:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x753:0x0], index 0: 0 00000004:00080000:1.0:1789429752.280585:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x750:0x0], index 1: 0 00000004:00080000:1.0:1789429752.292074:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x754:0x0], index 0: 0 00000004:00080000:2.0:1789429752.310696:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x751:0x0], index 1: 0 00000004:00080000:0.0:1789429752.337850:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x755:0x0], index 0: 0 00002000:00080000:0.0:1789429752.354346:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1890 00000004:00080000:2.0:1789429752.358727:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x752:0x0], index 1: 0 00000004:00080000:2.0:1789429752.372657:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x752:0x0]-[0x280000400:0x781:0x0] 00000004:00080000:1.0:1789429752.378090:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x756:0x0], index 0: 0 00000004:00080000:2.0:1789429752.403977:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x753:0x0], index 1: 0 00000004:00080000:0.0:1789429752.416842:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x757:0x0], index 0: 0 00000004:00080000:0.0:1789429752.425828:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x754:0x0], index 1: 0 00000004:00080000:2.0:1789429752.436053:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x758:0x0], index 0: 0 00000004:00080000:3.0:1789429752.446956:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x755:0x0], index 1: 0 00000004:00080000:2.0:1789429752.456108:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x759:0x0], index 0: 0 00000004:00080000:0.0:1789429752.470000:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x756:0x0], index 1: 0 00000004:00080000:2.0:1789429752.495923:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x75a:0x0], index 0: 0 00000004:00080000:2.0:1789429752.511746:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x757:0x0], index 1: 0 00000004:00080000:1.0:1789429752.523127:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x75b:0x0], index 0: 0 00000004:00080000:2.0:1789429752.534500:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x758:0x0], index 1: 0 00000004:00080000:0.0:1789429752.552302:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x75c:0x0], index 0: 0 00000004:00080000:2.0:1789429752.580257:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x759:0x0], index 1: 0 00000004:00080000:1.0:1789429752.604013:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x75d:0x0], index 0: 0 00000004:00080000:2.0:1789429752.639914:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x75a:0x0], index 1: 0 00000004:00080000:2.0:1789429752.677476:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x75e:0x0], index 0: 0 00000004:00080000:3.0:1789429752.693434:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x75b:0x0], index 1: 0 00000004:00080000:0.0:1789429752.710525:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x75f:0x0], index 0: 0 00000004:00080000:1.0:1789429752.738121:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x75c:0x0], index 1: 0 00000004:00080000:2.0:1789429752.751847:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x760:0x0], index 0: 0 00000004:00080000:3.0:1789429752.765413:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x75d:0x0], index 1: 0 00000004:00080000:2.0:1789429752.791359:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x761:0x0], index 0: 0 00000004:00080000:0.0:1789429752.816913:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x75e:0x0], index 1: 0 00000004:00080000:0.0:1789429752.840786:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x762:0x0], index 0: 0 00000004:00080000:2.0:1789429752.858928:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x75f:0x0], index 1: 0 00000004:00080000:3.0:1789429752.874454:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x763:0x0], index 0: 0 00000004:00080000:2.0:1789429752.906453:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x760:0x0], index 1: 0 00000004:00080000:0.0:1789429752.925116:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x764:0x0], index 0: 0 00000004:00080000:2.0:1789429752.953619:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x761:0x0], index 1: 0 00000004:00080000:3.0:1789429752.976641:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x765:0x0], index 0: 0 00000004:00080000:3.0:1789429752.992588:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x762:0x0], index 1: 0 00000004:00080000:2.0:1789429753.012077:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x766:0x0], index 0: 0 00000004:00080000:3.0:1789429753.036770:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x763:0x0], index 1: 0 00000004:00080000:0.0:1789429753.072518:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x767:0x0], index 0: 0 00000004:00080000:3.0:1789429753.096538:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x764:0x0], index 1: 0 00000004:00080000:3.0:1789429753.117427:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x768:0x0], index 0: 0 00000004:00080000:2.0:1789429753.144070:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x765:0x0], index 1: 0 00000004:00080000:2.0:1789429753.175084:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x769:0x0], index 0: 0 00000004:00080000:2.0:1789429753.199104:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x766:0x0], index 1: 0 00000004:00080000:3.0:1789429753.210860:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x76a:0x0], index 0: 0 00000004:00080000:2.0:1789429753.221169:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x767:0x0], index 1: 0 00000004:00080000:2.0:1789429753.230094:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x76b:0x0], index 0: 0 00000004:00080000:2.0:1789429753.241540:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x768:0x0], index 1: 0 00000004:00080000:3.0:1789429753.249132:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x76c:0x0], index 0: 0 00000004:00080000:3.0:1789429753.258615:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x769:0x0], index 1: 0 00000004:00080000:2.0:1789429753.267649:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x76d:0x0], index 0: 0 00000004:00080000:2.0:1789429753.276496:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x76a:0x0], index 1: 0 00000004:00080000:2.0:1789429753.285188:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x76e:0x0], index 0: 0 00000004:00080000:2.0:1789429753.293007:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x76b:0x0], index 1: 0 00000004:00080000:0.0:1789429753.300473:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x76f:0x0], index 0: 0 00000004:00080000:3.0:1789429753.312308:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x76c:0x0], index 1: 0 00000004:00080000:0.0:1789429753.319582:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x770:0x0], index 0: 0 00000004:00080000:2.0:1789429753.327845:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x76d:0x0], index 1: 0 00000004:00080000:1.0:1789429753.336126:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x771:0x0], index 0: 0 00000004:00080000:0.0:1789429753.347464:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x76e:0x0], index 1: 0 00000004:00080000:0.0:1789429753.356185:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x772:0x0], index 0: 0 00002000:00080000:0.0:1789429753.358118:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1922 00000100:00080000:1.0:1789429753.359285:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429753.367645:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x772:0x0]-[0x240000400:0x7a1:0x0] 00000004:00080000:3.0:1789429753.370621:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x76f:0x0], index 1: 0 00000004:00080000:2.0:1789429753.381272:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x773:0x0], index 0: 0 00000004:00080000:0.0:1789429753.389747:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x770:0x0], index 1: 0 00000004:00080000:2.0:1789429753.398005:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x774:0x0], index 0: 0 00000004:00080000:0.0:1789429753.406700:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x771:0x0], index 1: 0 00000004:00080000:1.0:1789429753.417352:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x775:0x0], index 0: 0 00000004:00080000:2.0:1789429753.424453:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x772:0x0], index 1: 0 00002000:00080000:0.0:1789429753.425307:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1922 00000100:00080000:2.0:1789429753.430218:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789429753.431488:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x772:0x0]-[0x280000400:0x7a1:0x0] 00000004:00080000:1.0:1789429753.436130:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x776:0x0], index 0: 0 00000004:00080000:2.0:1789429753.443629:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x773:0x0], index 1: 0 00000004:00080000:0.0:1789429753.451975:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x777:0x0], index 0: 0 00000004:00080000:1.0:1789429753.463713:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x774:0x0], index 1: 0 00000004:00080000:1.0:1789429753.478575:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x778:0x0], index 0: 0 00000004:00080000:2.0:1789429753.500118:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x775:0x0], index 1: 0 00000004:00080000:0.0:1789429753.520384:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x779:0x0], index 0: 0 00000004:00080000:1.0:1789429753.553299:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x776:0x0], index 1: 0 00000004:00080000:1.0:1789429753.575921:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x77a:0x0], index 0: 0 00000004:00080000:3.0:1789429753.597677:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x777:0x0], index 1: 0 00000001:00080000:2.0:1789429753.609339:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969666 is committed 00000004:00080000:3.0:1789429753.614908:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x77b:0x0], index 0: 0 00000004:00080000:2.0:1789429753.628123:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x778:0x0], index 1: 0 00000004:00080000:1.0:1789429753.647153:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x77c:0x0], index 0: 0 00000004:00080000:2.0:1789429753.664477:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x779:0x0], index 1: 0 00000004:00080000:2.0:1789429753.689560:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x77d:0x0], index 0: 0 00000004:00080000:3.0:1789429753.718117:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x77a:0x0], index 1: 0 00000004:00080000:0.0:1789429753.749639:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x77e:0x0], index 0: 0 00000004:00080000:0.0:1789429753.757123:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x77b:0x0], index 1: 0 00000004:00080000:1.0:1789429753.767000:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x77f:0x0], index 0: 0 00000004:00080000:2.0:1789429753.779906:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x77c:0x0], index 1: 0 00000004:00080000:3.0:1789429753.792998:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x780:0x0], index 0: 0 00000004:00080000:2.0:1789429753.806541:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x77d:0x0], index 1: 0 00000004:00080000:0.0:1789429753.816800:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x781:0x0], index 0: 0 00000004:00080000:0.0:1789429753.826638:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x77e:0x0], index 1: 0 00000004:00080000:1.0:1789429753.841325:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x782:0x0], index 0: 0 00000004:00080000:3.0:1789429753.854416:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x77f:0x0], index 1: 0 00000004:00080000:3.0:1789429753.863898:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x783:0x0], index 0: 0 00000004:00080000:1.0:1789429753.873573:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x780:0x0], index 1: 0 00000004:00080000:3.0:1789429753.882862:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x784:0x0], index 0: 0 00000004:00080000:1.0:1789429753.898110:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x781:0x0], index 1: 0 00000004:00080000:0.0:1789429753.910485:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x785:0x0], index 0: 0 00000004:00080000:2.0:1789429753.937460:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x782:0x0], index 1: 0 00000004:00080000:0.0:1789429753.951437:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x786:0x0], index 0: 0 00000004:00080000:1.0:1789429753.963409:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x783:0x0], index 1: 0 00000004:00080000:1.0:1789429753.981398:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x787:0x0], index 0: 0 00000004:00080000:2.0:1789429753.995291:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x784:0x0], index 1: 0 00000100:00080000:3.0:1789429754.010090:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429754.019107:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x788:0x0], index 0: 0 00000004:00080000:1.0:1789429754.038366:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x785:0x0], index 1: 0 00000004:00080000:1.0:1789429754.049781:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x789:0x0], index 0: 0 00000004:00080000:1.0:1789429754.067259:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x786:0x0], index 1: 0 00000004:00080000:2.0:1789429754.093262:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x78a:0x0], index 0: 0 00000004:00080000:1.0:1789429754.103336:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x787:0x0], index 1: 0 00000004:00080000:2.0:1789429754.122574:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x78b:0x0], index 0: 0 00000004:00080000:1.0:1789429754.149258:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x788:0x0], index 1: 0 00000004:00080000:0.0:1789429754.157178:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x78c:0x0], index 0: 0 00000004:00080000:0.0:1789429754.167973:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x789:0x0], index 1: 0 00000004:00080000:0.0:1789429754.182267:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x78d:0x0], index 0: 0 00000004:00080000:0.0:1789429754.204150:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x78a:0x0], index 1: 0 00000004:00080000:1.0:1789429754.233089:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x78e:0x0], index 0: 0 00000004:00080000:0.0:1789429754.249575:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x78b:0x0], index 1: 0 00000004:00080000:0.0:1789429754.280796:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x78f:0x0], index 0: 0 00000004:00080000:0.0:1789429754.310183:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x78c:0x0], index 1: 0 00000004:00080000:0.0:1789429754.334044:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x790:0x0], index 0: 0 00000004:00080000:2.0:1789429754.349788:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x78d:0x0], index 1: 0 00000004:00080000:2.0:1789429754.371065:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x791:0x0], index 0: 0 00000004:00080000:0.0:1789429754.407185:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x78e:0x0], index 1: 0 00000004:00080000:1.0:1789429754.418147:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x792:0x0], index 0: 0 00002000:00080000:3.0:1789429754.418397:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1954 00000004:00080000:2.0:1789429754.432818:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x792:0x0]-[0x240000400:0x7c1:0x0] 00000004:00080000:0.0:1789429754.437515:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x78f:0x0], index 1: 0 00000004:00080000:2.0:1789429754.460234:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x793:0x0], index 0: 0 00000004:00080000:2.0:1789429754.473933:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x790:0x0], index 1: 0 00000004:00080000:2.0:1789429754.503744:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x794:0x0], index 0: 0 00000004:00080000:1.0:1789429754.517248:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x791:0x0], index 1: 0 00000004:00080000:3.0:1789429754.557064:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x795:0x0], index 0: 0 00000004:00080000:2.0:1789429754.627087:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x792:0x0], index 1: 0 00002000:00080000:3.0:1789429754.634608:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1954 00000004:00080000:0.0:1789429754.661990:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x796:0x0], index 0: 0 00000004:00080000:2.0:1789429754.670104:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x792:0x0]-[0x280000400:0x7c1:0x0] 00000004:00080000:0.0:1789429754.683191:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x793:0x0], index 1: 0 00000004:00080000:2.0:1789429754.692139:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x797:0x0], index 0: 0 00000004:00080000:3.0:1789429754.727189:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x794:0x0], index 1: 0 00000004:00080000:1.0:1789429754.742323:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x798:0x0], index 0: 0 00000001:00080000:2.0:1789429754.752868:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984801 is committed 00000001:00080000:2.0:1789429754.753777:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294984802 is committed 00000004:00080000:1.0:1789429754.763795:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x795:0x0], index 1: 0 00000004:00080000:0.0:1789429754.772171:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x799:0x0], index 0: 0 00000004:00080000:3.0:1789429754.782057:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x796:0x0], index 1: 0 00000004:00080000:3.0:1789429754.794568:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x79a:0x0], index 0: 0 00000004:00080000:1.0:1789429754.804310:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x797:0x0], index 1: 0 00000004:00080000:3.0:1789429754.820522:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x79b:0x0], index 0: 0 00000004:00080000:0.0:1789429754.835288:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x798:0x0], index 1: 0 00000004:00080000:2.0:1789429754.850896:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x79c:0x0], index 0: 0 00000004:00080000:3.0:1789429754.863950:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x799:0x0], index 1: 0 00000004:00080000:0.0:1789429754.879067:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x79d:0x0], index 0: 0 00000004:00080000:2.0:1789429754.901795:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x79a:0x0], index 1: 0 00000004:00080000:0.0:1789429754.912323:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x79e:0x0], index 0: 0 00000004:00080000:3.0:1789429754.928190:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x79b:0x0], index 1: 0 00000004:00080000:2.0:1789429754.940962:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x79f:0x0], index 0: 0 00000004:00080000:3.0:1789429754.953255:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x79c:0x0], index 1: 0 00000004:00080000:2.0:1789429754.966313:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7a0:0x0], index 0: 0 00000004:00080000:1.0:1789429754.979397:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x79d:0x0], index 1: 0 00000004:00080000:2.0:1789429754.990559:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7a1:0x0], index 0: 0 00000004:00080000:2.0:1789429755.001701:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x79e:0x0], index 1: 0 00000004:00080000:0.0:1789429755.016062:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7a2:0x0], index 0: 0 00000004:00080000:3.0:1789429755.027616:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x79f:0x0], index 1: 0 00000004:00080000:1.0:1789429755.041313:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7a3:0x0], index 0: 0 00000004:00080000:1.0:1789429755.070523:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7a0:0x0], index 1: 0 00000004:00080000:1.0:1789429755.104605:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7a4:0x0], index 0: 0 00000004:00080000:0.0:1789429755.126041:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7a1:0x0], index 1: 0 00000004:00080000:1.0:1789429755.149167:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7a5:0x0], index 0: 0 00000004:00080000:0.0:1789429755.172065:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7a2:0x0], index 1: 0 00000001:00080000:3.0:1789429755.191980:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969641 is committed 00000001:00080000:3.0:1789429755.192024:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969642 is committed 00000004:00080000:3.0:1789429755.198363:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7a6:0x0], index 0: 0 00000004:00080000:1.0:1789429755.210564:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7a3:0x0], index 1: 0 00000004:00080000:2.0:1789429755.226351:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7a7:0x0], index 0: 0 00000004:00080000:1.0:1789429755.244081:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7a4:0x0], index 1: 0 00000004:00080000:2.0:1789429755.259276:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7a8:0x0], index 0: 0 00000004:00080000:3.0:1789429755.275831:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7a5:0x0], index 1: 0 00000004:00080000:2.0:1789429755.284963:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7a9:0x0], index 0: 0 00000004:00080000:0.0:1789429755.303296:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7a6:0x0], index 1: 0 00000004:00080000:1.0:1789429755.314790:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7aa:0x0], index 0: 0 00000004:00080000:2.0:1789429755.343167:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7a7:0x0], index 1: 0 00000004:00080000:3.0:1789429755.360859:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ab:0x0], index 0: 0 00000004:00080000:0.0:1789429755.380091:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7a8:0x0], index 1: 0 00000004:00080000:0.0:1789429755.392395:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ac:0x0], index 0: 0 00000004:00080000:0.0:1789429755.408818:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7a9:0x0], index 1: 0 00000004:00080000:2.0:1789429755.420347:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ad:0x0], index 0: 0 00000004:00080000:2.0:1789429755.433298:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7aa:0x0], index 1: 0 00000004:00080000:0.0:1789429755.443923:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ae:0x0], index 0: 0 00000004:00080000:1.0:1789429755.455750:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ab:0x0], index 1: 0 00000004:00080000:0.0:1789429755.466874:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7af:0x0], index 0: 0 00000004:00080000:2.0:1789429755.488744:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ac:0x0], index 1: 0 00000004:00080000:2.0:1789429755.500859:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7b0:0x0], index 0: 0 00000004:00080000:0.0:1789429755.513432:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ad:0x0], index 1: 0 00000004:00080000:2.0:1789429755.530014:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7b1:0x0], index 0: 0 00000004:00080000:2.0:1789429755.540030:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ae:0x0], index 1: 0 00000004:00080000:2.0:1789429755.549715:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7b2:0x0], index 0: 0 00002000:00080000:2.0:1789429755.550963:0:20986:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1986 00000100:00080000:3.0:1789429755.555531:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789429755.579033:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x7b2:0x0]-[0x240000400:0x7e1:0x0] 00000004:00080000:0.0:1789429755.583114:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7af:0x0], index 1: 0 00000004:00080000:0.0:1789429755.598499:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7b3:0x0], index 0: 0 00000004:00080000:2.0:1789429755.613492:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7b0:0x0], index 1: 0 00000004:00080000:0.0:1789429755.621486:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7b4:0x0], index 0: 0 00000004:00080000:0.0:1789429755.638122:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7b1:0x0], index 1: 0 00000004:00080000:0.0:1789429755.652412:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7b5:0x0], index 0: 0 00000004:00080000:1.0:1789429755.665427:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7b2:0x0], index 1: 0 00002000:00080000:3.0:1789429755.666766:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 1986 00000100:00080000:2.0:1789429755.667686:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429755.678891:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429755.678902:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789429755.691463:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7b6:0x0], index 0: 0 00000004:00080000:1.0:1789429755.705102:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7b3:0x0], index 1: 0 00000004:00080000:0.0:1789429755.711431:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x7b3:0x0]-[0x280000400:0x7e1:0x0] 00000004:00080000:0.0:1789429755.726168:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7b7:0x0], index 0: 0 00000004:00080000:1.0:1789429755.738848:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7b4:0x0], index 1: 0 00000004:00080000:0.0:1789429755.757106:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7b8:0x0], index 0: 0 00000004:00080000:3.0:1789429755.768119:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7b5:0x0], index 1: 0 00000004:00080000:2.0:1789429755.790170:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7b9:0x0], index 0: 0 00000004:00080000:1.0:1789429755.802123:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7b6:0x0], index 1: 0 00000004:00080000:1.0:1789429755.815982:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ba:0x0], index 0: 0 00000004:00080000:1.0:1789429755.827698:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7b7:0x0], index 1: 0 00000004:00080000:1.0:1789429755.839601:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7bb:0x0], index 0: 0 00000004:00080000:0.0:1789429755.853242:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7b8:0x0], index 1: 0 00000004:00080000:1.0:1789429755.864679:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7bc:0x0], index 0: 0 00000004:00080000:2.0:1789429755.876374:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7b9:0x0], index 1: 0 00000004:00080000:1.0:1789429755.898035:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7bd:0x0], index 0: 0 00000004:00080000:0.0:1789429755.917850:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ba:0x0], index 1: 0 00000004:00080000:1.0:1789429755.928341:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7be:0x0], index 0: 0 00000004:00080000:0.0:1789429755.949097:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7bb:0x0], index 1: 0 00000004:00080000:2.0:1789429755.975955:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7bf:0x0], index 0: 0 00000004:00080000:1.0:1789429755.998121:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7bc:0x0], index 1: 0 00000100:00080000:3.0:1789429756.015549:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429756.022541:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7c0:0x0], index 0: 0 00000004:00080000:1.0:1789429756.043836:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7bd:0x0], index 1: 0 00000004:00080000:0.0:1789429756.060134:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7c1:0x0], index 0: 0 00000100:00080000:2.0:1789429756.069334:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429756.077330:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429756.112830:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7be:0x0], index 1: 0 00000004:00080000:2.0:1789429756.160670:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7c2:0x0], index 0: 0 00000004:00080000:1.0:1789429756.196124:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7bf:0x0], index 1: 0 00000004:00080000:3.0:1789429756.223557:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7c3:0x0], index 0: 0 00000004:00080000:3.0:1789429756.264939:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7c0:0x0], index 1: 0 00000004:00080000:1.0:1789429756.288253:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7c4:0x0], index 0: 0 00000004:00080000:1.0:1789429756.316730:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7c1:0x0], index 1: 0 00000004:00080000:3.0:1789429756.326816:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7c5:0x0], index 0: 0 00000004:00080000:1.0:1789429756.373271:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7c2:0x0], index 1: 0 00000004:00080000:2.0:1789429756.419019:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7c6:0x0], index 0: 0 00000004:00080000:1.0:1789429756.440095:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7c3:0x0], index 1: 0 00000004:00080000:1.0:1789429756.460999:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7c7:0x0], index 0: 0 00000004:00080000:2.0:1789429756.488501:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7c4:0x0], index 1: 0 00000004:00080000:1.0:1789429756.504915:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7c8:0x0], index 0: 0 00000004:00080000:1.0:1789429756.540395:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7c5:0x0], index 1: 0 00000004:00080000:2.0:1789429756.550071:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7c9:0x0], index 0: 0 00000004:00080000:3.0:1789429756.570900:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7c6:0x0], index 1: 0 00000004:00080000:3.0:1789429756.594559:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ca:0x0], index 0: 0 00000004:00080000:2.0:1789429756.618173:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7c7:0x0], index 1: 0 00000004:00080000:1.0:1789429756.637394:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7cb:0x0], index 0: 0 00000004:00080000:2.0:1789429756.654295:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7c8:0x0], index 1: 0 00000004:00080000:1.0:1789429756.682706:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7cc:0x0], index 0: 0 00000004:00080000:0.0:1789429756.721346:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7c9:0x0], index 1: 0 00000004:00080000:0.0:1789429756.741308:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7cd:0x0], index 0: 0 00000004:00080000:2.0:1789429756.772048:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ca:0x0], index 1: 0 00000004:00080000:1.0:1789429756.802280:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ce:0x0], index 0: 0 00000004:00080000:1.0:1789429756.826056:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7cb:0x0], index 1: 0 00000004:00080000:0.0:1789429756.855537:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7cf:0x0], index 0: 0 00000004:00080000:2.0:1789429756.891115:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7cc:0x0], index 1: 0 00000004:00080000:2.0:1789429756.909028:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7d0:0x0], index 0: 0 00000004:00080000:1.0:1789429756.942919:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7cd:0x0], index 1: 0 00000004:00080000:3.0:1789429756.976105:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7d1:0x0], index 0: 0 00000004:00080000:3.0:1789429757.010487:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ce:0x0], index 1: 0 00000004:00080000:2.0:1789429757.023497:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7d2:0x0], index 0: 0 00002000:00080000:1.0:1789429757.024162:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2018 00000100:00080000:2.0:1789429757.026959:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429757.028447:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x7d2:0x0]-[0x240000400:0x801:0x0] 00000004:00080000:2.0:1789429757.046678:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7cf:0x0], index 1: 0 00000004:00080000:3.0:1789429757.071837:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7d3:0x0], index 0: 0 00000004:00080000:0.0:1789429757.094167:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7d0:0x0], index 1: 0 00000004:00080000:3.0:1789429757.111644:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7d4:0x0], index 0: 0 00000004:00080000:0.0:1789429757.121712:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7d1:0x0], index 1: 0 00000004:00080000:1.0:1789429757.142462:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7d5:0x0], index 0: 0 00000004:00080000:3.0:1789429757.191373:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7d2:0x0], index 1: 0 00002000:00080000:3.0:1789429757.192569:0:20745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2018 00000100:00080000:0.0:1789429757.197728:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789429757.200646:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x7d2:0x0]-[0x280000400:0x801:0x0] 00000004:00080000:0.0:1789429757.201736:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7d6:0x0], index 0: 0 00000004:00080000:3.0:1789429757.222343:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7d3:0x0], index 1: 0 00000004:00080000:1.0:1789429757.254623:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7d7:0x0], index 0: 0 00000004:00080000:2.0:1789429757.277301:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7d4:0x0], index 1: 0 00000004:00080000:3.0:1789429757.299721:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7d8:0x0], index 0: 0 00000004:00080000:1.0:1789429757.324568:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7d5:0x0], index 1: 0 00000004:00080000:2.0:1789429757.339603:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7d9:0x0], index 0: 0 00000004:00080000:0.0:1789429757.362337:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7d6:0x0], index 1: 0 00000004:00080000:3.0:1789429757.382071:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7da:0x0], index 0: 0 00000004:00080000:2.0:1789429757.414884:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7d7:0x0], index 1: 0 00000004:00080000:3.0:1789429757.437458:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7db:0x0], index 0: 0 00000004:00080000:0.0:1789429757.455305:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7d8:0x0], index 1: 0 00000004:00080000:1.0:1789429757.474426:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7dc:0x0], index 0: 0 00000004:00080000:3.0:1789429757.485352:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7d9:0x0], index 1: 0 00000004:00080000:3.0:1789429757.500477:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7dd:0x0], index 0: 0 00000004:00080000:0.0:1789429757.515962:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7da:0x0], index 1: 0 00000004:00080000:2.0:1789429757.547544:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7de:0x0], index 0: 0 00000004:00080000:2.0:1789429757.572775:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7db:0x0], index 1: 0 00000004:00080000:2.0:1789429757.588474:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7df:0x0], index 0: 0 00000004:00080000:3.0:1789429757.607473:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7dc:0x0], index 1: 0 00000004:00080000:3.0:1789429757.623956:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7e0:0x0], index 0: 0 00000004:00080000:0.0:1789429757.658985:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7dd:0x0], index 1: 0 00000004:00080000:2.0:1789429757.687367:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7e1:0x0], index 0: 0 00000004:00080000:3.0:1789429757.722891:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7de:0x0], index 1: 0 00000004:00080000:3.0:1789429757.736309:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7e2:0x0], index 0: 0 00000004:00080000:1.0:1789429757.762389:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7df:0x0], index 1: 0 00000004:00080000:1.0:1789429757.789129:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7e3:0x0], index 0: 0 00000004:00080000:1.0:1789429757.804664:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7e0:0x0], index 1: 0 00000004:00080000:3.0:1789429757.817046:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7e4:0x0], index 0: 0 00000004:00080000:2.0:1789429757.847945:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7e1:0x0], index 1: 0 00000004:00080000:2.0:1789429757.858165:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7e5:0x0], index 0: 0 00000004:00080000:0.0:1789429757.870745:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7e2:0x0], index 1: 0 00000004:00080000:0.0:1789429757.894243:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7e6:0x0], index 0: 0 00000004:00080000:3.0:1789429757.910602:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7e3:0x0], index 1: 0 00000004:00080000:2.0:1789429757.934907:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7e7:0x0], index 0: 0 00000004:00080000:2.0:1789429757.958924:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7e4:0x0], index 1: 0 00000004:00080000:1.0:1789429757.976960:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7e8:0x0], index 0: 0 00000004:00080000:3.0:1789429758.003683:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7e5:0x0], index 1: 0 00000100:00080000:0.0:1789429758.006790:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429758.019148:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7e9:0x0], index 0: 0 00000004:00080000:2.0:1789429758.039069:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7e6:0x0], index 1: 0 00000004:00080000:3.0:1789429758.049103:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ea:0x0], index 0: 0 00000004:00080000:0.0:1789429758.061963:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7e7:0x0], index 1: 0 00000004:00080000:2.0:1789429758.082784:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7eb:0x0], index 0: 0 00000004:00080000:3.0:1789429758.100612:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7e8:0x0], index 1: 0 00000004:00080000:2.0:1789429758.114110:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ec:0x0], index 0: 0 00000004:00080000:3.0:1789429758.132036:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7e9:0x0], index 1: 0 00000004:00080000:2.0:1789429758.175040:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ed:0x0], index 0: 0 00000004:00080000:2.0:1789429758.189883:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ea:0x0], index 1: 0 00000004:00080000:3.0:1789429758.209089:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ee:0x0], index 0: 0 00000004:00080000:3.0:1789429758.225587:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7eb:0x0], index 1: 0 00000004:00080000:1.0:1789429758.250127:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ef:0x0], index 0: 0 00000004:00080000:0.0:1789429758.270154:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ec:0x0], index 1: 0 00000004:00080000:0.0:1789429758.283280:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7f0:0x0], index 0: 0 00000004:00080000:0.0:1789429758.307700:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ed:0x0], index 1: 0 00000004:00080000:3.0:1789429758.331783:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7f1:0x0], index 0: 0 00000004:00080000:3.0:1789429758.347762:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ee:0x0], index 1: 0 00000004:00080000:3.0:1789429758.376691:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7f2:0x0], index 0: 0 00002000:00080000:0.0:1789429758.377756:0:27100:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2050 00000004:00080000:1.0:1789429758.385090:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x7f2:0x0]-[0x240000400:0x821:0x0] 00000004:00080000:2.0:1789429758.390406:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ef:0x0], index 1: 0 00000004:00080000:1.0:1789429758.408833:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7f3:0x0], index 0: 0 00000004:00080000:0.0:1789429758.427343:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7f0:0x0], index 1: 0 00000004:00080000:3.0:1789429758.443185:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7f4:0x0], index 0: 0 00000004:00080000:1.0:1789429758.470463:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7f1:0x0], index 1: 0 00000004:00080000:2.0:1789429758.487302:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7f5:0x0], index 0: 0 00000004:00080000:0.0:1789429758.499501:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7f2:0x0], index 1: 0 00002000:00080000:2.0:1789429758.499787:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2050 00000004:00080000:3.0:1789429758.508543:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x7f2:0x0]-[0x280000400:0x821:0x0] 00000004:00080000:3.0:1789429758.513476:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7f6:0x0], index 0: 0 00000004:00080000:3.0:1789429758.530335:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7f3:0x0], index 1: 0 00000004:00080000:3.0:1789429758.563780:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7f7:0x0], index 0: 0 00000004:00080000:2.0:1789429758.580143:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7f4:0x0], index 1: 0 00000004:00080000:0.0:1789429758.611311:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7f8:0x0], index 0: 0 00000004:00080000:3.0:1789429758.685674:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7f5:0x0], index 1: 0 00000004:00080000:1.0:1789429758.709333:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7f9:0x0], index 0: 0 00000004:00080000:3.0:1789429758.732595:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7f6:0x0], index 1: 0 00000001:00080000:2.0:1789429758.738012:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969667 is committed 00000001:00080000:2.0:1789429758.738041:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969670 is committed 00000004:00080000:2.0:1789429758.766103:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7fa:0x0], index 0: 0 00000004:00080000:1.0:1789429758.791129:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7f7:0x0], index 1: 0 00000004:00080000:3.0:1789429758.821615:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7fb:0x0], index 0: 0 00000004:00080000:1.0:1789429758.849305:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7f8:0x0], index 1: 0 00000004:00080000:0.0:1789429758.866503:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7fc:0x0], index 0: 0 00000004:00080000:1.0:1789429758.905258:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7f9:0x0], index 1: 0 00000004:00080000:2.0:1789429758.930379:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7fd:0x0], index 0: 0 00000004:00080000:2.0:1789429758.953566:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7fa:0x0], index 1: 0 00000004:00080000:1.0:1789429758.977873:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7fe:0x0], index 0: 0 00000004:00080000:1.0:1789429759.007049:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7fb:0x0], index 1: 0 00000004:00080000:1.0:1789429759.033179:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x7ff:0x0], index 0: 0 00000004:00080000:1.0:1789429759.063705:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7fc:0x0], index 1: 0 00000004:00080000:2.0:1789429759.076848:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x800:0x0], index 0: 0 00000004:00080000:1.0:1789429759.101768:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7fd:0x0], index 1: 0 00000004:00080000:1.0:1789429759.125040:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x801:0x0], index 0: 0 00000004:00080000:1.0:1789429759.146127:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7fe:0x0], index 1: 0 00000004:00080000:1.0:1789429759.163697:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x802:0x0], index 0: 0 00000004:00080000:2.0:1789429759.183011:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x7ff:0x0], index 1: 0 00000004:00080000:3.0:1789429759.203765:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x803:0x0], index 0: 0 00000004:00080000:1.0:1789429759.220029:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x800:0x0], index 1: 0 00000004:00080000:1.0:1789429759.232166:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x804:0x0], index 0: 0 00000004:00080000:2.0:1789429759.254426:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x801:0x0], index 1: 0 00000004:00080000:2.0:1789429759.272159:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x805:0x0], index 0: 0 00000004:00080000:1.0:1789429759.298063:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x802:0x0], index 1: 0 00000004:00080000:2.0:1789429759.319848:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x806:0x0], index 0: 0 00000004:00080000:1.0:1789429759.341113:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x803:0x0], index 1: 0 00000004:00080000:0.0:1789429759.371157:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x807:0x0], index 0: 0 00000004:00080000:3.0:1789429759.402398:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x804:0x0], index 1: 0 00000004:00080000:1.0:1789429759.422021:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x808:0x0], index 0: 0 00000004:00080000:2.0:1789429759.444560:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x805:0x0], index 1: 0 00000004:00080000:2.0:1789429759.476275:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x809:0x0], index 0: 0 00000004:00080000:3.0:1789429759.486391:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x806:0x0], index 1: 0 00000004:00080000:2.0:1789429759.514043:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x80a:0x0], index 0: 0 00000001:00080000:2.0:1789429759.778054:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985266 is committed 00000001:00080000:2.0:1789429759.779302:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985272 is committed 00000001:00080000:3.0:1789429760.232472:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969645 is committed 00000100:00080000:2.0:1789429760.789701:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429760.789710:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429761.192386:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429761.192392:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429761.192395:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1789429763.866964:0:29582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 36: handle ESTALE/open-unlink correctly == 19:49:22 (1789429762) 00000100:00080000:2.0:1789429764.041388:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429764.060242:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789429764.849860:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985275 is committed 00000001:00080000:2.0:1789429764.849879:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985276 is committed 00000100:00080000:2.0:1789429765.918904:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429766.310382:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429766.310391:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429766.310393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429766.311192:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429771.029496:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429771.029503:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429771.432742:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429771.432752:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429771.432755:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789429771.773091:0:20745:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t4294969583 exp 0000000000000000 cur 1469 last 0 00002000:00080000:2.0:1789429771.773312:0:20745:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789429771.773342:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946f11a08000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789429771.778318:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789429771.796691:0:27100:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t0 exp 0000000000000000 cur 1469 last 0 00002000:00080000:3.0:1789429771.796985:0:27100:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789429771.797016:0:27100:0:(import.c:65:import_set_state_nolock()) ffff946e0268e800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789429771.806296:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789429771.862802:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x80b:0x0], index 0: 0 00000004:00080000:0.0:1789429771.862817:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x807:0x0], index 1: 0 00000001:00080000:1.0:1789429772.666770:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294985278 00000020:00080000:1.0:1789429772.667117:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1789429774.179545:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985279 is committed 00000004:00080000:2.0:1789429775.413961:0:29834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1473393757712ns, next at 1234790573273ns, rc = 0 00000004:00080000:2.0:1789429775.414427:0:29834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1473394226321ns, next at 1299736618989ns, rc = 0 00000004:00080000:3.0:1789429775.417007:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 44 committed 00000004:00080000:3.0:1789429775.417027:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 37 committed 00000100:00080000:2.0:1789429776.149451:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429776.149459:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429776.149462:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429776.556178:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429776.556720:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429776.561584:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429776.565422:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789429776.700560:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969670 is committed 00000001:00080000:1.0:1789429776.700637:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969671 is committed 00000001:00080000:2.0:1789429776.811373:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969689 is committed 00000001:00080000:2.0:1789429776.811412:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969694 is committed 00000100:00080000:2.0:1789429778.923056:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429778.933108:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429778.943435:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429779.004980:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429779.054967:0:5840:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x93:0x0] is inserted into orphan list, open count = 1 00010000:00080000:0.0:1789429779.180401:0:20745:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1477 last 0 00002000:00080000:0.0:1789429779.180618:0:20745:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789429779.180646:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946f05ac4000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789429779.180907:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429779.189957:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429779.723561:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x93:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789429779.724523:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].27, 64 off9920 00000004:00080000:1.0:1789429779.724543:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1477704342427ns, next at 1478704338610ns, rc = 0 00000040:00080000:1.0:1789429779.724706:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].30, 64 off10112 00000004:00080000:1.0:1789429779.724714:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1477704513584ns, next at 1478704511850ns, rc = 0 00000001:00080000:0.0:1789429780.691030:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985282 is committed 00000004:00080000:0.0:1789429780.691043:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 45 committed 00000001:00080000:2.0:1789429780.691656:0:29897:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985281 is committed 00000004:00080000:0.0:1789429780.691965:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 38 committed 00000100:00080000:3.0:1789429780.692529:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429780.692535:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1789429780.692583:0:13238:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2055 count 1 00002000:00080000:0.0:1789429780.692640:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2059 count 1 00000004:00080000:2.0:1789429780.694293:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f3b321500/2, rc 0, transno 4294969695 00000004:00080000:3.0:1789429780.718123:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f3f2e3480/2, rc 0, transno 4294969672 00000100:00080000:3.0:1789429781.275496:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429781.275507:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429781.275511:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429781.695671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429781.704385:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429782.181867:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429782.182715:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789429782.263113:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969695 is committed 00000001:00080000:1.0:1789429782.306143:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969672 is committed 00000004:00080000:2.0:1789429783.888728:0:29986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1481868523468ns, next at 1478704338610ns, rc = 0 00000004:00080000:2.0:1789429783.888863:0:29986:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1481868662546ns, next at 1478704511850ns, rc = 0 00000004:00080000:2.0:1789429783.896735:0:29897:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 46 committed 00000004:00080000:2.0:1789429783.896763:0:29897:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 39 committed 00000100:00080000:1.0:1789429786.401475:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429786.401485:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429786.401489:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429786.789535:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429786.789542:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429786.789577:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f3b321500, transno 4294969695 00000100:00080000:0.0:1789429786.790296:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429786.790300:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429786.790315:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f3f2e3480, transno 4294969672 00000100:00080000:0.0:1789429791.514011:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429791.514021:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429791.514023:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429791.915857:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429791.915867:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429791.919193:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429791.919229:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429796.631167:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429796.631175:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429796.631177:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429797.028488:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429797.031133:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429797.032899:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429801.268623:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429801.273252:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429801.290604:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429801.414620:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x808:0x0], index 1: 0 00000004:00080000:2.0:1789429801.414634:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x80c:0x0], index 0: 0 00000001:00080000:3.0:1789429801.606118:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969696 is committed 00000001:00080000:1.0:1789429801.706462:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969699 is committed 00000001:00080000:0.0:1789429801.760280:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969673 is committed 00000001:00080000:0.0:1789429801.760325:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969674 is committed 00000100:00080000:2.0:1789429801.781856:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429801.781865:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429801.798735:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946f05ac4000 : changing import state from FULL to CLOSED 00000001:00080000:1.0:1789429801.799957:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969703 is committed 00000100:00080000:3.0:1789429801.801920:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789429801.846477:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969679 is committed 00000001:00080000:0.0:1789429801.846507:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969680 is committed 00000001:00080000:0.0:1789429801.861057:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969704 is committed 00000001:00080000:0.0:1789429801.861078:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969705 is committed 00000001:00080000:2.0:1789429801.935988:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969707 is committed 00000001:00080000:1.0:1789429801.983665:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969681 is committed 00000001:00080000:1.0:1789429801.983687:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969682 is committed 00000001:00080000:0.0:1789429802.059635:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969709 is committed 00000001:00080000:0.0:1789429802.059655:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969711 is committed 00000001:00080000:1.0:1789429802.081647:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969684 is committed 00000100:00080000:1.0:1789429802.151293:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429802.151308:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429802.151310:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789429802.155394:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969713 is committed 00000001:00080000:2.0:1789429802.203071:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969685 is committed 00000001:00080000:2.0:1789429802.203094:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969686 is committed 00000001:00080000:2.0:1789429802.203101:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969689 is committed 00000001:00080000:2.0:1789429802.232825:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969714 is committed 00000001:00080000:2.0:1789429802.232854:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969715 is committed 00000001:00080000:3.0:1789429802.269952:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294985284 00000020:00080000:3.0:1789429802.270066:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1789429802.296866:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969690 is committed 00000001:00080000:1.0:1789429802.296888:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969691 is committed 00000001:00080000:1.0:1789429802.296894:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969692 is committed 00000001:00080000:2.0:1789429802.304887:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969716 is committed 00000001:00080000:2.0:1789429802.304915:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969717 is committed 00000001:00080000:2.0:1789429802.304929:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969719 is committed 00000001:00080000:0.0:1789429802.336878:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969693 is committed 00000001:00080000:0.0:1789429802.336901:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969694 is committed 00000001:00080000:0.0:1789429802.339424:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969696 is committed 00000001:00080000:2.0:1789429802.359743:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969721 is committed 00000001:00080000:2.0:1789429803.709004:0:29897:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985283 is committed 00000001:00080000:1.0:1789429803.710017:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985285 is committed 00000004:00080000:0.0:1789429805.077942:0:30360:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1503057738453ns, next at 1478704338610ns, rc = 0 00000004:00080000:0.0:1789429805.081701:0:30360:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1503061497230ns, next at 1478704511850ns, rc = 0 00000004:00080000:2.0:1789429805.090075:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 47 committed 00000004:00080000:2.0:1789429805.090345:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 40 committed 00000100:00080000:0.0:1789429806.878309:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429806.878318:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429806.878321:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429807.269220:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429807.269229:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429807.269231:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429808.481990:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429808.490010:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429808.496497:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429808.543021:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429808.587085:0:26936:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x94:0x0] is inserted into orphan list, open count = 1 00010000:00080000:0.0:1789429808.742195:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1506 last 0 00000100:00080000:3.0:1789429808.742451:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1789429808.742471:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789429808.742509:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946f05ac0800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789429808.750023:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789429809.224012:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x94:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789429809.224403:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].31, 64 off10176 00000004:00080000:3.0:1789429809.224419:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1507204217743ns, next at 1508204214160ns, rc = 0 00000040:00080000:3.0:1789429809.224575:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].28, 64 off9984 00000004:00080000:3.0:1789429809.224583:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1507204383063ns, next at 1508204381754ns, rc = 0 00000001:00080000:2.0:1789429810.405018:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985287 is committed 00000001:00080000:1.0:1789429810.405900:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985286 is committed 00000001:00080000:1.0:1789429810.407640:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985288 is committed 00000004:00080000:1.0:1789429810.407658:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 41 committed 00000004:00080000:1.0:1789429810.407678:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 48 committed 00002000:00080000:3.0:1789429810.408309:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2060 count 1 00002000:00080000:0.0:1789429810.408533:0:27100:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2056 count 1 00000100:00080000:3.0:1789429810.409178:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429810.409183:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429810.410779:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e05f6b800/2, rc 0, transno 4294969697 00000100:00080000:3.0:1789429810.412842:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789429810.415674:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f054d6a00/2, rc 0, transno 4294969722 00000001:00080000:0.0:1789429811.988571:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969697 is committed 00000100:00080000:2.0:1789429811.994982:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429811.994993:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429811.994997:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789429811.995737:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969722 is committed 00000100:00080000:1.0:1789429812.395286:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429812.401139:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429812.401150:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429812.401635:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f054d6a00, transno 4294969722 00000004:00080000:0.0:1789429812.402546:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e05f6b800, transno 4294969697 00000004:00080000:0.0:1789429813.422105:0:30510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1511401831638ns, next at 1508204381754ns, rc = 0 00000004:00080000:0.0:1789429813.422382:0:30510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1511402180042ns, next at 1508204214160ns, rc = 0 00000004:00080000:3.0:1789429813.453431:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 49 committed 00000004:00080000:3.0:1789429813.453464:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 42 committed 00000100:00080000:0.0:1789429817.117454:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429817.117462:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429817.117466:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429817.513649:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429817.513660:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429817.513663:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429822.230578:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429822.230591:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429822.231763:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429822.237908:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429822.237916:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429822.241436:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429822.633950:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429822.636170:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429822.637705:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429822.637711:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429827.358452:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429827.361269:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429827.361277:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429827.750268:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429827.750276:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429827.750279:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429827.761603:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x80d:0x0], index 0: 0 00000004:00080000:0.0:1789429827.761615:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x809:0x0], index 1: 0 00000001:00080000:3.0:1789429827.908863:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969698 is committed 00000001:00080000:1.0:1789429827.971417:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969700 is committed 00000001:00080000:1.0:1789429827.971460:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969701 is committed 00000001:00080000:2.0:1789429828.020010:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969726 is committed 00000001:00080000:1.0:1789429828.041263:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969703 is committed 00000001:00080000:3.0:1789429828.101478:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969727 is committed 00000001:00080000:0.0:1789429828.119663:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969705 is committed 00000001:00080000:0.0:1789429828.179702:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969729 is committed 00000001:00080000:0.0:1789429828.179725:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969730 is committed 00000001:00080000:1.0:1789429828.201684:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969709 is committed 00000001:00080000:0.0:1789429828.238891:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969733 is committed 00000001:00080000:2.0:1789429828.271595:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969710 is committed 00000001:00080000:2.0:1789429828.271614:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969711 is committed 00000001:00080000:0.0:1789429828.317806:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969734 is committed 00000001:00080000:1.0:1789429828.329251:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969712 is committed 00000001:00080000:2.0:1789429828.473243:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969713 is committed 00000001:00080000:0.0:1789429828.477010:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969736 is committed 00000001:00080000:0.0:1789429828.554943:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969742 is committed 00000001:00080000:2.0:1789429828.578014:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969720 is committed 00000001:00080000:2.0:1789429828.578069:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969721 is committed 00000001:00080000:0.0:1789429828.604475:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969745 is committed 00000001:00080000:0.0:1789429828.604509:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969746 is committed 00000001:00080000:2.0:1789429828.622361:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969723 is committed 00000001:00080000:0.0:1789429828.859575:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985289 is committed 00000001:00080000:0.0:1789429828.859611:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985290 is committed 00000004:00080000:1.0:1789429830.952451:0:30830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1528932247143ns, next at 1508204381754ns, rc = 0 00000004:00080000:1.0:1789429830.952645:0:30830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1528932444157ns, next at 1508204214160ns, rc = 0 00000004:00080000:2.0:1789429830.957895:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 50 committed 00000004:00080000:2.0:1789429830.957929:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 43 committed 00000100:00080000:3.0:1789429832.475535:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429832.475543:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429832.479964:0:20986:0:(import.c:65:import_set_state_nolock()) ffff946f05ac0800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789429832.480524:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429832.480529:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429832.869672:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429832.869681:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429832.869683:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429834.208179:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429834.212355:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429834.218631:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429834.281484:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429834.319856:0:15669:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x95:0x0] is inserted into orphan list, open count = 1 00010000:00080000:2.0:1789429834.489175:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1532 last 0 00002000:00080000:2.0:1789429834.490840:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789429834.491136:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946e0268d000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789429834.498405:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429834.504868:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429835.078671:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x95:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789429835.079894:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].29, 64 off10048 00000004:00080000:1.0:1789429835.079911:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1533059710724ns, next at 1534059707359ns, rc = 0 00000040:00080000:1.0:1789429835.080067:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].32, 64 off10240 00000004:00080000:1.0:1789429835.080075:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1533059874602ns, next at 1534059873330ns, rc = 0 00000001:00080000:2.0:1789429836.559128:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985293 is committed 00000004:00080000:2.0:1789429836.559141:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 51 committed 00000004:00080000:2.0:1789429836.559158:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 44 committed 00000001:00080000:2.0:1789429836.559178:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985292 is committed 00000100:00080000:2.0:1789429836.559817:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1789429836.559986:0:20745:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2057 count 1 00002000:00080000:3.0:1789429836.560351:0:20986:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2061 count 1 00000100:00080000:3.0:1789429836.560456:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789429836.563161:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f18398380/2, rc 0, transno 4294969747 00000100:00080000:3.0:1789429836.566147:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789429836.593563:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e0aca4000/2, rc 0, transno 4294969724 00000001:00080000:1.0:1789429837.560232:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969747 is committed 00000100:00080000:0.0:1789429837.590445:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429837.590457:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429837.590461:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789429837.612699:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969724 is committed 00000100:00080000:3.0:1789429837.987883:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429837.988562:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429837.988582:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e0aca4000, transno 4294969724 00000004:00080000:1.0:1789429837.990213:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f18398380, transno 4294969747 00000100:00080000:0.0:1789429838.500050:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429838.501195:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429842.709547:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429842.709556:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429842.709559:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429842.710515:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429842.712426:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429842.721328:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429843.110549:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429843.111169:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429843.111173:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429843.111175:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429846.529817:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429846.537873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429846.541275:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429846.647548:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x80a:0x0], index 1: 0 00000004:00080000:2.0:1789429846.647566:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x80e:0x0], index 0: 0 00000001:00080000:1.0:1789429846.808361:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985294 is committed 00000001:00080000:1.0:1789429846.879461:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969749 is committed 00000001:00080000:1.0:1789429847.009904:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969751 is committed 00000001:00080000:1.0:1789429847.038522:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969725 is committed 00000001:00080000:1.0:1789429847.038540:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969726 is committed 00000001:00080000:1.0:1789429847.038547:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969727 is committed 00000001:00080000:1.0:1789429847.135321:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969752 is committed 00000001:00080000:1.0:1789429847.135344:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969753 is committed 00000001:00080000:1.0:1789429847.135353:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969754 is committed 00000001:00080000:1.0:1789429847.135363:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969755 is committed 00000001:00080000:1.0:1789429847.171626:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969732 is committed 00000001:00080000:1.0:1789429847.237222:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969759 is committed 00000001:00080000:1.0:1789429847.237245:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969760 is committed 00000001:00080000:1.0:1789429847.237264:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969761 is committed 00000001:00080000:2.0:1789429847.250543:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969733 is committed 00000001:00080000:2.0:1789429847.250569:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969736 is committed 00000001:00080000:2.0:1789429847.325220:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969762 is committed 00000001:00080000:2.0:1789429847.325245:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969763 is committed 00000001:00080000:2.0:1789429847.331319:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969739 is committed 00000001:00080000:2.0:1789429847.331348:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969740 is committed 00000001:00080000:2.0:1789429847.434945:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969764 is committed 00000001:00080000:2.0:1789429847.434981:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969767 is committed 00000001:00080000:1.0:1789429847.444692:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969744 is committed 00000001:00080000:1.0:1789429847.487067:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969772 is committed 00000001:00080000:1.0:1789429847.487104:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969773 is committed 00000001:00080000:1.0:1789429847.498804:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969746 is committed 00000001:00080000:1.0:1789429847.498825:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969748 is committed 00000100:00080000:0.0:1789429847.840319:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429847.840327:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429847.840330:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429848.228539:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429848.229441:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429848.230055:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429848.237536:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789429848.575741:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985295 is committed 00000004:00080000:2.0:1789429849.734233:0:31182:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1547714030242ns, next at 1534059707359ns, rc = 0 00000004:00080000:2.0:1789429849.734347:0:31182:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1547714146310ns, next at 1534059873330ns, rc = 0 00000004:00080000:1.0:1789429849.743501:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 45 committed 00000004:00080000:1.0:1789429849.744497:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 52 committed 00000100:00080000:0.0:1789429852.950877:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429852.950888:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429852.950892:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429852.957338:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429852.957353:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429853.124730:0:6704:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x96:0x0] is inserted into orphan list, open count = 1 00000100:00080000:2.0:1789429853.358371:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429853.358384:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429853.359144:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429853.868998:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x96:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789429853.869292:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].33, 64 off10304 00000004:00080000:0.0:1789429853.869306:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1551849104888ns, next at 1552849101868ns, rc = 0 00000040:00080000:0.0:1789429853.873790:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].30, 64 off10112 00000004:00080000:0.0:1789429853.873814:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1551853613239ns, next at 1552853608587ns, rc = 0 00000001:00080000:1.0:1789429854.960405:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985298 is committed 00000004:00080000:1.0:1789429854.960419:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 46 committed 00000004:00080000:1.0:1789429854.960437:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 53 committed 00000001:00080000:1.0:1789429854.960455:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985297 is committed 00002000:00080000:2.0:1789429854.960832:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2058 count 1 00002000:00080000:0.0:1789429854.961261:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2062 count 1 00000004:00080000:1.0:1789429854.962166:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e10340380/2, rc 0, transno 4294969749 00000100:00080000:3.0:1789429854.970515:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429854.971478:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e11b4ca80/2, rc 0, transno 4294969774 00000001:00080000:1.0:1789429855.981952:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969749 is committed 00000001:00080000:1.0:1789429856.558930:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969774 is committed 00000004:00080000:0.0:1789429857.953799:0:31330:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1555933595865ns, next at 1552853608587ns, rc = 0 00000004:00080000:0.0:1789429857.953985:0:31330:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1555933783631ns, next at 1552849101868ns, rc = 0 00000004:00080000:2.0:1789429857.959906:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 54 committed 00000004:00080000:2.0:1789429857.959926:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 47 committed 00000100:00080000:3.0:1789429858.074516:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429858.074523:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429858.074526:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429858.479445:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429858.479456:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429858.479674:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789429858.479753:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e11b4ca80, transno 4294969774 00000004:00080000:3.0:1789429858.479872:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e10340380, transno 4294969749 00000100:00080000:2.0:1789429863.192086:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429863.200475:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429863.200483:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429863.202397:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429863.202886:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429863.202890:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429863.588789:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429863.591048:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429863.591056:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429868.310672:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429868.310692:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429868.310693:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429868.708070:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429868.708187:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429868.710046:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429868.710053:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429872.352971:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429872.365259:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429872.369373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789429872.477099:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x80f:0x0], index 0: 0 00000004:00080000:3.0:1789429872.477114:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x80b:0x0], index 1: 0 00000001:00080000:1.0:1789429872.658409:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969751 is committed 00000001:00080000:1.0:1789429872.658448:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969752 is committed 00000001:00080000:1.0:1789429872.727821:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969775 is committed 00000001:00080000:1.0:1789429872.761560:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969753 is committed 00000001:00080000:1.0:1789429872.854148:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969779 is committed 00000001:00080000:1.0:1789429872.854191:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969782 is committed 00000001:00080000:1.0:1789429872.869637:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969760 is committed 00000001:00080000:2.0:1789429872.919386:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969763 is committed 00000001:00080000:0.0:1789429872.920446:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969785 is committed 00000001:00080000:0.0:1789429872.920465:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969786 is committed 00000001:00080000:0.0:1789429872.992961:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969764 is committed 00000001:00080000:0.0:1789429872.992990:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969765 is committed 00000001:00080000:1.0:1789429873.025327:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294985300 00000020:00080000:1.0:1789429873.025467:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:0.0:1789429873.048571:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969788 is committed 00000001:00080000:0.0:1789429873.048605:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969789 is committed 00000001:00080000:1.0:1789429873.103713:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969768 is committed 00000001:00080000:0.0:1789429873.104236:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969793 is committed 00000001:00080000:0.0:1789429873.104260:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969794 is committed 00000001:00080000:2.0:1789429873.165504:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969795 is committed 00000001:00080000:2.0:1789429873.166486:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969798 is committed 00000001:00080000:1.0:1789429873.173945:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969773 is committed 00000001:00080000:1.0:1789429873.173995:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969774 is committed 00000001:00080000:1.0:1789429873.174005:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969775 is committed 00000001:00080000:1.0:1789429873.347140:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985301 is committed 00000100:00080000:0.0:1789429873.448408:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429873.448421:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429873.448654:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429873.828580:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429873.831992:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429873.832006:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789429875.398826:0:31654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1573378621412ns, next at 1552853608587ns, rc = 0 00000004:00080000:0.0:1789429875.398943:0:31654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1573378741591ns, next at 1552849101868ns, rc = 0 00000004:00080000:3.0:1789429875.401351:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 55 committed 00000004:00080000:3.0:1789429875.401387:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 48 committed 00000100:00080000:1.0:1789429878.556978:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946e0268d000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789429878.557696:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429878.558109:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429878.558670:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429878.559853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429878.566988:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429878.570816:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429878.898437:0:5841:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x97:0x0] is inserted into orphan list, open count = 1 00000100:00080000:2.0:1789429878.948599:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429878.948605:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429878.948607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789429879.106901:0:27100:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1577 last 0 00002000:00080000:0.0:1789429879.107033:0:27100:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789429879.109162:0:27100:0:(import.c:65:import_set_state_nolock()) ffff946e01c1b000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789429879.122025:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429879.667123:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x97:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789429879.667469:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].31, 64 off10176 00000004:00080000:1.0:1789429879.667483:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1577647281989ns, next at 1578647278810ns, rc = 0 00000040:00080000:1.0:1789429879.667849:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].34, 64 off10368 00000004:00080000:1.0:1789429879.667859:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1577647658141ns, next at 1578647656079ns, rc = 0 00000001:00080000:3.0:1789429880.548146:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985304 is committed 00000004:00080000:3.0:1789429880.548157:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 56 committed 00000004:00080000:3.0:1789429880.548174:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 49 committed 00000001:00080000:3.0:1789429880.548193:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985303 is committed 00002000:00080000:3.0:1789429880.548650:0:20745:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2059 count 1 00000004:00080000:3.0:1789429880.549380:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e01bffb80/2, rc 0, transno 4294969799 00000100:00080000:2.0:1789429880.549610:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1789429880.550189:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2063 count 1 00000100:00080000:2.0:1789429880.550469:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429880.557510:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429880.559664:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e08944700/2, rc 0, transno 4294969776 00000001:00080000:2.0:1789429882.080315:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969799 is committed 00000001:00080000:1.0:1789429882.121045:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969776 is committed 00000100:00080000:3.0:1789429883.671024:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429883.671036:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429883.671040:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429883.711920:0:31801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1581691715216ns, next at 1578647278810ns, rc = 0 00000004:00080000:0.0:1789429883.712082:0:31801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1581691881583ns, next at 1578647656079ns, rc = 0 00000004:00080000:3.0:1789429883.715615:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 57 committed 00000004:00080000:3.0:1789429883.715654:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 50 committed 00000100:00080000:1.0:1789429884.068480:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429884.074096:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789429884.085194:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e01bffb80, transno 4294969799 00000004:00080000:0.0:1789429884.085660:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e08944700, transno 4294969776 00000100:00080000:3.0:1789429884.086518:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429884.086526:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429888.796055:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429888.796066:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429888.796931:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429888.796936:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429888.796939:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429889.190118:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429889.190126:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429889.190129:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429893.914915:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429893.916164:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429893.916174:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429893.916177:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429894.309190:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429894.309224:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429894.311552:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429894.311566:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429897.812002:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429897.825405:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429897.840496:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789429897.973712:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x80c:0x0], index 1: 0 00000004:00080000:3.0:1789429897.973725:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x810:0x0], index 0: 0 00000001:00080000:1.0:1789429898.111505:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969777 is committed 00000001:00080000:2.0:1789429898.189546:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969803 is committed 00000001:00080000:1.0:1789429898.227789:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969778 is committed 00000001:00080000:1.0:1789429898.282534:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969806 is committed 00000001:00080000:1.0:1789429898.282569:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969807 is committed 00000001:00080000:3.0:1789429898.365177:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969779 is committed 00000001:00080000:3.0:1789429898.365216:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969784 is committed 00000001:00080000:1.0:1789429898.366477:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969810 is committed 00000001:00080000:1.0:1789429898.366503:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969811 is committed 00000001:00080000:1.0:1789429898.458707:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969788 is committed 00000001:00080000:1.0:1789429898.473878:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969812 is committed 00000001:00080000:1.0:1789429898.473898:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969813 is committed 00000001:00080000:1.0:1789429898.514077:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969793 is committed 00000001:00080000:0.0:1789429898.522330:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969818 is committed 00000001:00080000:0.0:1789429898.522357:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969819 is committed 00000001:00080000:1.0:1789429898.613120:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969795 is committed 00000001:00080000:2.0:1789429898.631288:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969820 is committed 00000001:00080000:2.0:1789429898.678610:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969825 is committed 00000001:00080000:1.0:1789429898.682264:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969800 is committed 00000100:00080000:3.0:1789429899.040365:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429899.040686:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429899.041549:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429899.429821:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429899.429828:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429899.429830:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789429899.480298:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985306 is committed 00000004:00080000:2.0:1789429900.927893:0:32127:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1598907690281ns, next at 1578647278810ns, rc = 0 00000004:00080000:2.0:1789429900.929244:0:32127:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1598909041912ns, next at 1578647656079ns, rc = 0 00000004:00080000:3.0:1789429900.932378:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 58 committed 00000004:00080000:3.0:1789429900.932405:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 51 committed 00000100:00080000:2.0:1789429904.153008:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946e01c1b000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789429904.153327:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429904.153331:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429904.154335:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789429904.479115:0:26938:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x98:0x0] is inserted into orphan list, open count = 1 00000100:00080000:0.0:1789429904.548131:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429904.548271:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429904.550387:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429904.550394:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789429904.660908:0:20986:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1602 last 0 00002000:00080000:2.0:1789429904.661041:0:20986:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789429904.661069:0:20986:0:(import.c:65:import_set_state_nolock()) ffff946f06fa8800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789429904.667678:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789429905.246820:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x98:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789429905.247105:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].35, 64 off10432 00000004:00080000:1.0:1789429905.247116:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1603226915353ns, next at 1604226913317ns, rc = 0 00000040:00080000:1.0:1789429905.247298:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].32, 64 off10240 00000004:00080000:1.0:1789429905.247307:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1603227106535ns, next at 1604227103352ns, rc = 0 00000001:00080000:3.0:1789429906.143116:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985309 is committed 00000004:00080000:3.0:1789429906.143127:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 52 committed 00000004:00080000:3.0:1789429906.143153:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 59 committed 00000001:00080000:3.0:1789429906.143178:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985308 is committed 00000100:00080000:2.0:1789429906.143944:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429906.143949:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1789429906.143955:0:20986:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2060 count 1 00002000:00080000:0.0:1789429906.144010:0:8085:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2064 count 1 00000004:00080000:1.0:1789429906.145860:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e020b7100/2, rc 0, transno 4294969801 00000100:00080000:3.0:1789429906.154315:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429906.155615:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f07393b80/2, rc 0, transno 4294969826 00000001:00080000:3.0:1789429907.725441:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969826 is committed 00000001:00080000:1.0:1789429907.726854:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969801 is committed 00000100:00080000:2.0:1789429909.277166:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429909.277174:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429909.277176:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429909.661090:0:32275:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1607640887416ns, next at 1604227103352ns, rc = 0 00000004:00080000:2.0:1789429909.661293:0:32275:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1607641091878ns, next at 1604226913317ns, rc = 0 00000004:00080000:3.0:1789429909.666259:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 60 committed 00000004:00080000:3.0:1789429909.666282:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 53 committed 00000004:00080000:3.0:1789429909.675887:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e020b7100, transno 4294969801 00000004:00080000:3.0:1789429909.676030:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f07393b80, transno 4294969826 00000100:00080000:3.0:1789429909.677939:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429909.677947:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429909.677950:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429914.393920:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429914.393929:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429914.394462:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429914.791299:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429914.791307:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429914.791310:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429919.511622:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429919.511630:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429919.511987:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429919.908884:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429919.912712:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429919.912718:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429924.084841:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429924.104696:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429924.108996:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429924.268559:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x811:0x0], index 0: 0 00000004:00080000:2.0:1789429924.268572:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x80d:0x0], index 1: 0 00000001:00080000:0.0:1789429924.501009:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969802 is committed 00000001:00080000:0.0:1789429924.501031:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969803 is committed 00000001:00080000:0.0:1789429924.501038:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969804 is committed 00000001:00080000:2.0:1789429924.575940:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969828 is committed 00000001:00080000:2.0:1789429924.575957:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969829 is committed 00000001:00080000:0.0:1789429924.600024:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969807 is committed 00000100:00080000:1.0:1789429924.662735:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429924.662745:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429924.662748:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789429924.704404:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969810 is committed 00000001:00080000:1.0:1789429924.710732:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969833 is committed 00000001:00080000:1.0:1789429924.789246:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969811 is committed 00000001:00080000:1.0:1789429924.789268:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969813 is committed 00000001:00080000:0.0:1789429924.823804:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969835 is committed 00000001:00080000:0.0:1789429924.823829:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969836 is committed 00000001:00080000:0.0:1789429924.823839:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969837 is committed 00000001:00080000:0.0:1789429924.823849:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969838 is committed 00000001:00080000:1.0:1789429924.863557:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969816 is committed 00000001:00080000:1.0:1789429924.863667:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969817 is committed 00000001:00080000:0.0:1789429924.907352:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969842 is committed 00000001:00080000:1.0:1789429924.941397:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969819 is committed 00000001:00080000:1.0:1789429924.941430:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969821 is committed 00000001:00080000:0.0:1789429924.970395:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969844 is committed 00000001:00080000:0.0:1789429924.970428:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969846 is committed 00000001:00080000:2.0:1789429925.012913:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294985311 00000020:00080000:2.0:1789429925.013027:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:1.0:1789429925.036250:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969823 is committed 00000100:00080000:0.0:1789429925.036798:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429925.036804:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429925.037527:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429925.037766:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789429925.055098:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969847 is committed 00000001:00080000:2.0:1789429925.079989:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985312 is committed 00000001:00080000:1.0:1789429925.118943:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969827 is committed 00000001:00080000:1.0:1789429925.126553:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969850 is committed 00000004:00080000:3.0:1789429927.530457:0:32595:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1625510253838ns, next at 1604227103352ns, rc = 0 00000004:00080000:3.0:1789429927.530555:0:32595:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1625510353554ns, next at 1604226913317ns, rc = 0 00000004:00080000:2.0:1789429927.533968:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 61 committed 00000004:00080000:2.0:1789429927.533993:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 54 committed 00000100:00080000:3.0:1789429929.750786:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429929.750796:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429929.751115:0:13238:0:(import.c:65:import_set_state_nolock()) ffff946f06fa8800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789429929.751131:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429929.751134:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429929.751135:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429930.153783:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429930.159678:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429930.159687:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429930.162453:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429930.864436:0:15669:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x99:0x0] is inserted into orphan list, open count = 1 00000100:00080000:3.0:1789429931.012456:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789429931.017339:0:20745:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1628 last 0 00002000:00080000:1.0:1789429931.017495:0:20745:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789429931.017521:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946f416d9800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789429931.017656:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429931.025911:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429931.053043:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429931.096257:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789429931.463330:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x99:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789429931.463623:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].33, 64 off10304 00000004:00080000:0.0:1789429931.463640:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1629443439232ns, next at 1630443436724ns, rc = 0 00000040:00080000:0.0:1789429931.464123:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].36, 64 off10496 00000004:00080000:0.0:1789429931.464132:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1629443931181ns, next at 1630443929849ns, rc = 0 00000001:00080000:2.0:1789429932.759537:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985315 is committed 00000004:00080000:2.0:1789429932.759549:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 62 committed 00000004:00080000:2.0:1789429932.759562:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 55 committed 00000001:00080000:2.0:1789429932.759583:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985314 is committed 00002000:00080000:2.0:1789429932.760088:0:20745:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2065 count 1 00000100:00080000:2.0:1789429932.760259:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1789429932.760826:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2061 count 1 00000100:00080000:2.0:1789429932.761968:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429932.762003:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f0545ed80/2, rc 0, transno 4294969851 00000004:00080000:2.0:1789429932.770760:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f0962ad80/2, rc 0, transno 4294969828 00000001:00080000:1.0:1789429933.786288:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969851 is committed 00000001:00080000:2.0:1789429933.787942:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969828 is committed 00000100:00080000:2.0:1789429934.878794:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429934.881446:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429934.881454:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429934.882848:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429934.882853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429934.882856:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429935.271978:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789429935.272016:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f0962ad80, transno 4294969828 00000100:00080000:3.0:1789429935.272165:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429935.273412:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429935.274286:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789429935.274493:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f0545ed80, transno 4294969851 00000004:00080000:1.0:1789429935.577867:0:32744:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1633557663988ns, next at 1630443436724ns, rc = 0 00000004:00080000:1.0:1789429935.578117:0:32744:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1633557915421ns, next at 1630443929849ns, rc = 0 00000004:00080000:0.0:1789429935.639648:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 63 committed 00000004:00080000:0.0:1789429935.639674:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 56 committed 00000100:00080000:0.0:1789429939.994258:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429939.994267:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429939.994270:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429940.387926:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429940.393630:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429940.393640:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429940.406041:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429945.109435:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429945.110360:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429945.113846:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429945.113854:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429945.513525:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429945.513540:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429945.513548:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429949.693726:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429949.703678:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429949.713772:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429949.843178:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x80e:0x0], index 1: 0 00000004:00080000:2.0:1789429949.843191:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x812:0x0], index 0: 0 00002000:00080000:2.0:1789429949.845643:0:13238:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2082 00000100:00080000:3.0:1789429949.845700:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789429949.875018:0:6898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x812:0x0]-[0x240000400:0x841:0x0] 00000001:00080000:1.0:1789429950.015809:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969852 is committed 00000001:00080000:1.0:1789429950.015829:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969853 is committed 00000001:00080000:1.0:1789429950.015838:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969854 is committed 00000001:00080000:2.0:1789429950.017164:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969829 is committed 00000001:00080000:2.0:1789429950.083074:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969831 is committed 00000001:00080000:2.0:1789429950.083098:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969833 is committed 00000001:00080000:1.0:1789429950.093949:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969855 is committed 00000001:00080000:1.0:1789429950.150451:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969834 is committed 00000001:00080000:1.0:1789429950.194194:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969858 is committed 00000001:00080000:1.0:1789429950.194261:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969859 is committed 00000001:00080000:1.0:1789429950.219303:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969836 is committed 00000001:00080000:1.0:1789429950.219324:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969837 is committed 00000100:00080000:2.0:1789429950.268631:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429950.268639:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429950.272322:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789429950.283855:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969841 is committed 00000001:00080000:3.0:1789429950.293447:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969860 is committed 00000001:00080000:3.0:1789429950.293464:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969863 is committed 00000001:00080000:3.0:1789429950.366896:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969865 is committed 00000001:00080000:3.0:1789429950.366916:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969867 is committed 00000001:00080000:3.0:1789429950.433469:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969870 is committed 00000001:00080000:3.0:1789429950.433503:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969871 is committed 00000001:00080000:1.0:1789429950.436772:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969842 is committed 00000001:00080000:1.0:1789429950.436791:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969843 is committed 00000001:00080000:1.0:1789429950.436798:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969845 is committed 00000001:00080000:1.0:1789429950.508612:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969873 is committed 00000001:00080000:1.0:1789429950.508631:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969874 is committed 00000001:00080000:0.0:1789429950.528519:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969849 is committed 00000001:00080000:1.0:1789429950.574482:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969877 is committed 00000001:00080000:1.0:1789429950.587700:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969853 is committed 00000100:00080000:3.0:1789429950.634132:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429950.634140:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429951.139830:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789429951.165798:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985316 is committed 00000001:00080000:0.0:1789429951.165814:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985317 is committed 00000004:00080000:1.0:1789429952.787093:0:33065:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1650766889647ns, next at 1630443436724ns, rc = 0 00000004:00080000:1.0:1789429952.787302:0:33065:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1650767100783ns, next at 1630443929849ns, rc = 0 00000004:00080000:0.0:1789429952.791592:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 64 committed 00000004:00080000:0.0:1789429952.791612:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 57 committed 00000100:00080000:3.0:1789429955.355228:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429955.355236:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429955.355239:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429955.358994:0:6680:0:(import.c:65:import_set_state_nolock()) ffff946f416d9800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789429955.361117:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429955.749961:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429955.750049:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429955.754883:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429955.754987:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429956.132850:0:26936:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x9a:0x0] is inserted into orphan list, open count = 1 00010000:00080000:1.0:1789429956.241754:0:20986:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1654 last 0 00002000:00080000:1.0:1789429956.241905:0:20986:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789429956.241939:0:20986:0:(import.c:65:import_set_state_nolock()) ffff946f11a0c000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789429956.254873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789429956.811171:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789429956.813571:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].37, 64 off10560 00000004:00080000:1.0:1789429956.813591:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1654793390002ns, next at 1655793386260ns, rc = 0 00000040:00080000:1.0:1789429956.813740:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].34, 64 off10368 00000004:00080000:1.0:1789429956.813748:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1654793548077ns, next at 1655793546443ns, rc = 0 00000001:00080000:2.0:1789429957.836191:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985319 is committed 00000001:00080000:2.0:1789429957.836229:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985320 is committed 00000004:00080000:2.0:1789429957.836234:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 58 committed 00000004:00080000:2.0:1789429957.836245:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 65 committed 00002000:00080000:0.0:1789429957.836719:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2062 count 1 00002000:00080000:3.0:1789429957.836920:0:20986:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2066 count 1 00000100:00080000:0.0:1789429957.836992:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429957.836996:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429957.839093:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f1830d500/2, rc 0, transno 4294969854 00000004:00080000:2.0:1789429957.843934:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f3f1c6300/2, rc 0, transno 4294969878 00000001:00080000:3.0:1789429959.399067:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969854 is committed 00000001:00080000:2.0:1789429959.429051:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969878 is committed 00000100:00080000:1.0:1789429960.471169:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429960.471178:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429960.472154:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429960.472159:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789429960.715897:0:33215:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1658695694134ns, next at 1655793546443ns, rc = 0 00000004:00080000:1.0:1789429960.716612:0:33215:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1658696411422ns, next at 1655793386260ns, rc = 0 00000004:00080000:1.0:1789429960.739805:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 66 committed 00000004:00080000:1.0:1789429960.739824:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 59 committed 00000004:00080000:1.0:1789429960.868786:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f1830d500, transno 4294969854 00000100:00080000:2.0:1789429960.869590:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429960.869596:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429960.869598:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429960.871445:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f3f1c6300, transno 4294969878 00000100:00080000:1.0:1789429965.592863:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429965.592872:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429965.592875:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429965.994067:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429965.994074:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429965.994077:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429966.000832:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429970.713481:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429970.713489:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429970.713491:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429971.117505:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429971.117734:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429971.124186:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429971.130578:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429975.200943:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429975.218382:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429975.220556:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789429975.364853:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x813:0x0], index 0: 0 00000004:00080000:3.0:1789429975.364869:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x80f:0x0], index 1: 0 00000001:00080000:1.0:1789429975.521252:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969855 is committed 00000001:00080000:1.0:1789429975.630723:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969857 is committed 00000001:00080000:1.0:1789429975.630755:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969858 is committed 00000001:00080000:2.0:1789429975.645964:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969879 is committed 00000001:00080000:2.0:1789429975.645987:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969881 is committed 00000001:00080000:2.0:1789429975.698831:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969860 is committed 00000001:00080000:2.0:1789429975.698854:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969862 is committed 00000001:00080000:2.0:1789429975.722399:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969882 is committed 00000001:00080000:2.0:1789429975.722420:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969884 is committed 00000001:00080000:0.0:1789429975.788351:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969863 is committed 00000001:00080000:0.0:1789429975.788377:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969864 is committed 00000001:00080000:2.0:1789429975.834286:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969886 is committed 00000100:00080000:1.0:1789429975.845298:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429975.845308:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429975.845311:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789429975.865598:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969866 is committed 00000001:00080000:0.0:1789429975.982677:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969887 is committed 00000001:00080000:0.0:1789429975.982697:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969891 is committed 00000001:00080000:1.0:1789429975.998973:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969869 is committed 00000001:00080000:1.0:1789429975.998996:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969870 is committed 00000001:00080000:3.0:1789429976.062307:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969894 is committed 00000001:00080000:3.0:1789429976.062328:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969895 is committed 00000001:00080000:3.0:1789429976.062337:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969896 is committed 00000001:00080000:1.0:1789429976.100864:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969874 is committed 00000001:00080000:0.0:1789429976.126504:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294985322 00000020:00080000:0.0:1789429976.126578:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1789429976.139678:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969898 is committed 00000001:00080000:3.0:1789429976.155334:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969878 is committed 00000001:00080000:2.0:1789429976.193572:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969900 is committed 00000001:00080000:2.0:1789429976.193595:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969902 is committed 00000001:00080000:3.0:1789429976.213149:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969880 is committed 00000100:00080000:0.0:1789429976.228802:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429976.229161:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429976.229166:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789429976.275629:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985323 is committed 00000004:00080000:1.0:1789429978.559943:0:33535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1676539740017ns, next at 1655793546443ns, rc = 0 00000004:00080000:1.0:1789429978.563192:0:33535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1676542988738ns, next at 1655793386260ns, rc = 0 00000004:00080000:2.0:1789429978.574642:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 67 committed 00000004:00080000:2.0:1789429978.574675:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 60 committed 00000100:00080000:0.0:1789429980.952546:0:27100:0:(import.c:65:import_set_state_nolock()) ffff946f11a0c000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789429980.954712:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429980.960214:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789429980.962748:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429980.966776:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429980.971581:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429980.971590:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429981.354768:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429981.354774:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429981.354776:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429982.139426:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789429982.143218:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429982.153445:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429982.189366:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789429982.222168:0:26937:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x9b:0x0] is inserted into orphan list, open count = 1 00000100:00080000:1.0:1789429982.383140:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789429982.394499:0:8085:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1680 last 0 00002000:00080000:0.0:1789429982.394637:0:8085:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789429982.394666:0:8085:0:(import.c:65:import_set_state_nolock()) ffff946e05d28000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789429982.397853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429983.032254:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789429983.032618:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].35, 64 off10432 00000004:00080000:2.0:1789429983.032633:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1681012432424ns, next at 1682012428454ns, rc = 0 00000040:00080000:2.0:1789429983.032802:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].38, 64 off10624 00000004:00080000:2.0:1789429983.032810:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1681012609632ns, next at 1682012608014ns, rc = 0 00000001:00080000:3.0:1789429983.989172:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985325 is committed 00000001:00080000:3.0:1789429983.992904:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985326 is committed 00000004:00080000:3.0:1789429983.992919:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 68 committed 00000004:00080000:3.0:1789429983.992938:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 61 committed 00002000:00080000:2.0:1789429983.993463:0:20986:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2063 count 1 00002000:00080000:2.0:1789429983.994113:0:20986:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2067 count 1 00000100:00080000:2.0:1789429983.994244:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429983.994248:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789429983.994310:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e0ee55180/2, rc 0, transno 4294969903 00000004:00080000:3.0:1789429983.999866:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f096adc00/2, rc 0, transno 4294969881 00000001:00080000:1.0:1789429985.571524:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969881 is committed 00000001:00080000:3.0:1789429985.573355:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969903 is committed 00000100:00080000:2.0:1789429986.081715:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429986.081727:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429986.081730:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429986.478272:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789429986.478285:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789429986.478289:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789429986.481544:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e0ee55180, transno 4294969903 00000004:00080000:1.0:1789429986.482255:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f096adc00, transno 4294969881 00000004:00080000:2.0:1789429987.680059:0:33684:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1685659854852ns, next at 1682012428454ns, rc = 0 00000004:00080000:2.0:1789429987.680194:0:33684:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1685659992676ns, next at 1682012608014ns, rc = 0 00000004:00080000:0.0:1789429987.748857:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 69 committed 00000004:00080000:0.0:1789429987.748887:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 62 committed 00000100:00080000:0.0:1789429991.190257:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429991.190265:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429991.190766:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429991.589492:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789429991.589501:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789429991.589503:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789429996.309918:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789429996.317781:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789429996.317790:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789429996.708010:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789429996.708697:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789429996.708702:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430001.441452:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430001.441460:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430001.441463:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430001.827873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430001.827881:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430001.828358:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430001.828361:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430003.042023:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430003.045455:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430003.060366:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789430003.213545:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x810:0x0], index 1: 0 00000004:00080000:0.0:1789430003.213559:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x814:0x0], index 0: 0 00000001:00080000:0.0:1789430003.439939:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969905 is committed 00000001:00080000:0.0:1789430003.439969:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969906 is committed 00000001:00080000:0.0:1789430003.447475:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985327 is committed 00000001:00080000:1.0:1789430003.499708:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969885 is committed 00000001:00080000:1.0:1789430003.533387:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969909 is committed 00000001:00080000:1.0:1789430003.533407:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969910 is committed 00000001:00080000:1.0:1789430003.533417:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969911 is committed 00000001:00080000:1.0:1789430003.592083:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969887 is committed 00000001:00080000:1.0:1789430003.592113:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969889 is committed 00000001:00080000:1.0:1789430003.649105:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969915 is committed 00000001:00080000:1.0:1789430003.702903:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969891 is committed 00000001:00080000:1.0:1789430003.702930:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969892 is committed 00000001:00080000:1.0:1789430003.702947:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969893 is committed 00000001:00080000:1.0:1789430003.798777:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969918 is committed 00000001:00080000:1.0:1789430003.798890:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969919 is committed 00000001:00080000:0.0:1789430003.805004:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969894 is committed 00000001:00080000:0.0:1789430003.805034:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969897 is committed 00000001:00080000:1.0:1789430003.862165:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969922 is committed 00000001:00080000:1.0:1789430003.862190:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969923 is committed 00000001:00080000:0.0:1789430003.904066:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969899 is committed 00000001:00080000:0.0:1789430003.904092:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969900 is committed 00000001:00080000:1.0:1789430003.919517:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294985328 00000020:00080000:1.0:1789430003.919706:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1789430003.940148:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969924 is committed 00000001:00080000:2.0:1789430003.940428:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969925 is committed 00000001:00080000:2.0:1789430003.940439:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969927 is committed 00000001:00080000:2.0:1789430003.976407:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969901 is committed 00000001:00080000:0.0:1789430003.998167:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969929 is committed 00000001:00080000:3.0:1789430004.015509:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969903 is committed 00000001:00080000:3.0:1789430004.015537:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969905 is committed 00000001:00080000:2.0:1789430005.305711:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985329 is committed 00000100:00080000:2.0:1789430006.551469:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946e05d28000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789430006.551735:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430006.551740:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430006.551743:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789430006.748346:0:34004:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1704728142897ns, next at 1682012428454ns, rc = 0 00000004:00080000:0.0:1789430006.748448:0:34004:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1704728247484ns, next at 1682012608014ns, rc = 0 00000004:00080000:3.0:1789430006.753317:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 70 committed 00000004:00080000:3.0:1789430006.753342:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 63 committed 00000100:00080000:2.0:1789430006.961459:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430006.961466:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430006.961469:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430010.438054:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430010.443964:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430010.449805:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430010.496118:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789430010.536116:0:15700:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x9c:0x0] is inserted into orphan list, open count = 1 00000100:00080000:0.0:1789430010.665590:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789430010.665733:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1708 last 0 00002000:00080000:0.0:1789430010.666008:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789430010.666045:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946e02639000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789430010.673689:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789430011.084639:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789430011.084928:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].39, 64 off10688 00000004:00080000:1.0:1789430011.084941:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1709064740730ns, next at 1710064737093ns, rc = 0 00000040:00080000:1.0:1789430011.085092:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].36, 64 off10496 00000004:00080000:1.0:1789430011.085100:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1709064899500ns, next at 1710064897730ns, rc = 0 00000100:00080000:3.0:1789430012.084328:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430012.084991:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430012.084997:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789430012.137191:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985331 is committed 00000001:00080000:2.0:1789430012.137876:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985332 is committed 00000004:00080000:2.0:1789430012.137882:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 64 committed 00000004:00080000:2.0:1789430012.137900:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 71 committed 00002000:00080000:3.0:1789430012.138452:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2068 count 1 00000004:00080000:2.0:1789430012.139885:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e15c04e00/2, rc 0, transno 4294969906 00002000:00080000:3.0:1789430012.140056:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2064 count 1 00000100:00080000:0.0:1789430012.149242:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789430012.153311:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f3f2e3100/2, rc 0, transno 4294969930 00000001:00080000:1.0:1789430013.682768:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969930 is committed 00000001:00080000:2.0:1789430013.728978:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969906 is committed 00000004:00080000:0.0:1789430014.983780:0:34155:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1712963577582ns, next at 1710064897730ns, rc = 0 00000004:00080000:0.0:1789430014.985290:0:34155:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1712965087578ns, next at 1710064737093ns, rc = 0 00000004:00080000:3.0:1789430014.996015:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 72 committed 00000004:00080000:3.0:1789430014.996036:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 65 committed 00000100:00080000:0.0:1789430016.794661:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430016.794669:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430016.794671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430017.189328:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430017.189335:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430017.189338:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789430017.189372:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e15c04e00, transno 4294969906 00000004:00080000:1.0:1789430017.190521:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f3f2e3100, transno 4294969930 00000100:00080000:3.0:1789430021.912705:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430021.912722:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430021.915555:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430021.918334:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430022.308013:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430022.308019:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430022.308061:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430022.308164:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430027.033312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430027.033321:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430027.033324:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430027.427953:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430027.427959:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430027.428611:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430027.428824:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430031.127049:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430031.159291:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430031.169550:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789430031.332463:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x815:0x0], index 0: 0 00000004:00080000:3.0:1789430031.333000:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x811:0x0], index 1: 0 00000001:00080000:1.0:1789430031.657062:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969910 is committed 00000001:00080000:1.0:1789430031.691980:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969932 is committed 00000001:00080000:1.0:1789430031.737631:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969938 is committed 00000001:00080000:2.0:1789430031.759373:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969911 is committed 00000001:00080000:2.0:1789430031.759393:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969915 is committed 00000001:00080000:0.0:1789430031.832384:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969917 is committed 00000001:00080000:2.0:1789430031.895473:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969940 is committed 00000001:00080000:0.0:1789430031.946143:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969918 is committed 00000001:00080000:0.0:1789430031.946171:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969919 is committed 00000001:00080000:2.0:1789430032.035470:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969924 is committed 00000001:00080000:2.0:1789430032.041417:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969945 is committed 00000001:00080000:2.0:1789430032.041455:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969946 is committed 00000001:00080000:0.0:1789430032.102904:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294985334 00000020:00080000:0.0:1789430032.103015:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1789430032.150532:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430032.150544:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430032.156450:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946e02639000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789430032.156525:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789430032.160034:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969928 is committed 00000001:00080000:2.0:1789430032.180250:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969947 is committed 00000001:00080000:2.0:1789430032.180279:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969950 is committed 00000001:00080000:2.0:1789430032.235378:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969932 is committed 00000001:00080000:2.0:1789430032.286701:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969954 is committed 00000100:00080000:3.0:1789430032.553048:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430032.553061:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430032.553352:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430033.849546:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985335 is committed 00000004:00080000:2.0:1789430035.174947:0:34527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1733154743658ns, next at 1710064897730ns, rc = 0 00000004:00080000:2.0:1789430035.175058:0:34527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1733154857062ns, next at 1710064737093ns, rc = 0 00000004:00080000:1.0:1789430035.188911:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 73 committed 00000004:00080000:1.0:1789430035.188939:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 66 committed 00000100:00080000:1.0:1789430037.270151:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430037.270162:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430037.270165:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430037.681045:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430037.681055:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430037.681301:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430037.693895:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789430038.838039:0:26936:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000401:0x9d:0x0] is inserted into orphan list, open count = 1 00000100:00080000:1.0:1789430039.007173:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789430039.013380:0:20745:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1736 last 0 00002000:00080000:2.0:1789430039.013621:0:20745:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789430039.013650:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946e01093800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789430039.014362:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430039.022066:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430039.057188:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430039.083595:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789430039.427197:0:5843:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789430039.427493:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].37, 64 off10560 00000004:00080000:3.0:1789430039.427506:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1737407305228ns, next at 1738407302672ns, rc = 0 00000040:00080000:3.0:1789430039.427657:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].40, 64 off10752 00000004:00080000:3.0:1789430039.427665:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1737407464764ns, next at 1738407462982ns, rc = 0 00000001:00080000:1.0:1789430040.266048:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985338 is committed 00000004:00080000:1.0:1789430040.266058:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 74 committed 00000004:00080000:1.0:1789430040.266074:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 67 committed 00000001:00080000:1.0:1789430040.266093:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985337 is committed 00002000:00080000:3.0:1789430040.266507:0:13238:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2069 count 1 00000100:00080000:3.0:1789430040.266639:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789430040.271261:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e089a9880/2, rc 0, transno 4294969933 00000100:00080000:0.0:1789430040.272935:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1789430040.277177:0:27100:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2065 count 1 00000004:00080000:1.0:1789430040.283328:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e15c06d80/2, rc 0, transno 4294969955 00000001:00080000:0.0:1789430041.858826:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969955 is committed 00000001:00080000:2.0:1789430041.895700:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969933 is committed 00000100:00080000:1.0:1789430042.392079:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430042.392088:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430042.392092:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430042.394319:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430042.394327:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430042.394330:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430042.787912:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430042.787919:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430042.787923:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789430042.787960:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e089a9880, transno 4294969933 00000004:00080000:1.0:1789430042.788047:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e15c06d80, transno 4294969955 00000004:00080000:0.0:1789430043.551125:0:34679:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1741530921974ns, next at 1738407302672ns, rc = 0 00000004:00080000:0.0:1789430043.551777:0:34679:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1741531575762ns, next at 1738407462982ns, rc = 0 00000004:00080000:2.0:1789430043.582317:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 68 committed 00000004:00080000:1.0:1789430043.588220:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 75 committed 00000100:00080000:1.0:1789430047.511954:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430047.511965:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430047.511968:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430047.910875:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430047.911069:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430047.919757:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430047.919765:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430052.631474:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430052.631483:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430052.631486:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430053.028194:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430053.028225:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430053.028228:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430057.768112:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430057.768876:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430057.768882:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430058.149354:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430058.149360:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430058.149364:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430059.454738:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430059.465530:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430059.485623:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430062.878076:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430062.878083:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430062.878086:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430062.904315:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430062.904504:0:6680:0:(import.c:65:import_set_state_nolock()) ffff946e01093800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789430063.275905:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430063.276656:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430063.280275:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430063.283396:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1789430067.946725:0:35096:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 19:54:26 (1789430066) 00000100:00080000:0.0:1789430067.996043:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430067.996052:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430067.996056:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430068.389266:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430068.390005:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430068.390010:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430069.464994:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985340 is committed 00000100:00080000:0.0:1789430070.751930:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430072.008644:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430073.117226:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430073.117234:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430073.119877:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430073.508984:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430073.517250:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430073.517259:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430074.007842:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430074.781238:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985727 is committed 00000001:00080000:1.0:1789430074.781588:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985728 is committed 00000001:00080000:1.0:1789430074.781816:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985729 is committed 00000100:00080000:3.0:1789430076.010671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430078.002249:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430078.233438:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430078.238645:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430078.247553:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430078.628926:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430078.628932:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430078.629110:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430079.738407:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986306 is committed 00000001:00080000:2.0:1789430079.739021:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986307 is committed 00000100:00080000:2.0:1789430080.005376:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430082.002732:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430083.357192:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430083.359252:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430083.359355:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946f11a08000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789430083.359664:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946e0268e800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789430083.361789:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430083.361799:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430083.747796:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430083.748980:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430083.748986:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430084.004568:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430084.986627:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986949 is committed 00000001:00080000:2.0:1789430084.986904:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986952 is committed 00000100:00080000:1.0:1789430086.009185:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430088.006615:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430088.475306:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430088.475315:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430088.869963:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430088.869971:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430088.869973:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430090.018890:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430090.238528:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987551 is committed 00000001:00080000:1.0:1789430090.239884:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987553 is committed 00000100:00080000:3.0:1789430092.000680:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430093.594774:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430093.594782:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430093.987987:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430093.990335:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430093.997055:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430093.999071:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430094.005754:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430095.314701:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294988193 is committed 00000001:00080000:0.0:1789430095.316548:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294988196 is committed 00000100:00080000:1.0:1789430096.001264:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430098.010841:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430098.715535:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430098.715548:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430099.110025:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430099.113340:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430099.113353:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430100.008829:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430100.392879:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294988783 is committed 00000001:00080000:3.0:1789430100.393275:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294988785 is committed 00000001:00080000:3.0:1789430100.393601:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294988786 is committed 00000100:00080000:3.0:1789430102.008844:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430103.843021:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430103.843039:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430104.002971:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430104.229653:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430104.236274:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430104.236283:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430105.474627:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294989406 is committed 00000001:00080000:0.0:1789430105.474949:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294989411 is committed 00000100:00080000:0.0:1789430106.003667:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430108.011738:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430108.955196:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430108.955419:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430109.348768:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430109.348875:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430109.349483:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430109.349614:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430110.002616:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430110.690286:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294990036 is committed 00000001:00080000:3.0:1789430110.690695:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294990038 is committed 00000100:00080000:2.0:1789430112.001815:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430114.006952:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430114.069172:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430114.069799:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430114.476021:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430114.476059:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430114.477337:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430114.484752:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430115.735898:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294990704 is committed 00000001:00080000:0.0:1789430115.736275:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294990709 is committed 00000100:00080000:0.0:1789430116.011798:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430118.002987:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430119.201556:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430119.201687:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430119.589147:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430119.589155:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430119.590284:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430119.590292:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430120.006722:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430121.048991:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294991304 is committed 00000001:00080000:0.0:1789430121.049700:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294991306 is committed 00000001:00080000:0.0:1789430121.053449:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294991308 is committed 00000100:00080000:1.0:1789430122.005435:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430124.005703:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430124.309622:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430124.309874:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789430124.332853:0:26936:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00080000:0.0:1789430124.708352:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430124.708361:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430124.708473:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789430125.992990:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294991905 is committed 00000001:00080000:0.0:1789430125.993281:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294991915 is committed 00000001:00080000:0.0:1789430125.993538:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294991917 is committed 00000100:00080000:0.0:1789430126.005767:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430128.006633:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430129.432662:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430129.436067:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430129.838955:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430129.838963:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430129.838965:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430130.008711:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430131.110300:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294992556 is committed 00000001:00080000:2.0:1789430131.110854:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294992559 is committed 00000100:00080000:3.0:1789430132.007231:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430134.002078:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430134.551345:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430134.555221:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430134.950665:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430134.951357:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430134.953894:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430134.954051:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430136.013097:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430136.229100:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294993249 is committed 00000100:00080000:3.0:1789430138.006953:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430139.669406:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430139.669416:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430140.005587:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430140.069531:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430140.069537:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430140.069539:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789430141.340902:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294993913 is committed 00000001:00080000:3.0:1789430141.341557:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294993915 is committed 00000100:00080000:0.0:1789430142.004641:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430144.011095:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430144.795679:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430144.799099:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430145.188783:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430145.189564:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430145.189569:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430145.190851:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430146.003557:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430146.482475:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294994567 is committed 00000001:00080000:3.0:1789430146.483154:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294994568 is committed 00000100:00080000:2.0:1789430148.002044:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430149.914697:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430149.916471:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430150.003102:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430150.312902:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430150.312917:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430150.317296:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430150.318005:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430151.632991:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995211 is committed 00000001:00080000:2.0:1789430151.633315:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995212 is committed 00000100:00080000:1.0:1789430152.001785:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430154.293161:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430154.301872:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789430154.499124:0:5840:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff946e0885ca80 x1876351640056704/t0(0) o101->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:135/0 lens 656/3488 e 0 to 0 dl 1789430165 ref 1 fl Interpret:H/602/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00000400:2.0:1789430154.499139:0:5840:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff946e0885ca80 x1876351640056704/t4294995344(0) o101->12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp:135/0 lens 656/3488 e 0 to 0 dl 1789430165 ref 1 fl Interpret:H/602/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00080000:3.0:1789430155.031148:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430155.429773:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430155.429780:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430155.429782:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789430156.583854:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995335 is committed 00000001:00080000:0.0:1789430156.583908:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995336 is committed 00000001:00080000:0.0:1789430156.584061:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995346 is committed 00000001:00080000:0.0:1789430156.584072:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995341 is committed 00000100:00080000:3.0:1789430160.150688:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430160.150696:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430160.549276:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430160.550297:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430160.550575:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789430161.363898:0:35483:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 39a: file mtime does not change after rename ========================================================== 19:56:00 (1789430160) 00000004:00080000:3.0:1789430161.575658:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x816:0x0], index 0: 0 00010000:00080000:2.0:1789430161.600160:0:6681:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t4294969583 exp 0000000000000000 cur 1859 last 0 00002000:00080000:2.0:1789430161.600391:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789430161.600422:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946f06fbf000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789430161.604542:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789430161.663158:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969934 is committed 00000100:00080000:2.0:1789430162.019816:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430162.350669:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430165.285381:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430165.285394:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430165.669562:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430165.669571:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430165.669574:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430166.740887:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969935 is committed 00000001:00080000:2.0:1789430166.740923:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969936 is committed 00000001:00080000:0.0:1789430166.768518:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995353 is committed 00000001:00080000:0.0:1789430166.768629:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995354 is committed 00000001:00080000:0.0:1789430166.768739:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995355 is committed 00000001:02000400:3.0:1789430168.872408:0:35684:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 19:56:07 (1789430167) 00000100:00080000:0.0:1789430168.933107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:0.0:1789430168.935008:0:8085:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2082 00000100:00080000:1.0:1789430168.936810:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789430168.940040:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x812:0x0], index 1: 0 00010000:00080000:0.0:1789430168.977514:0:13238:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t0 exp 0000000000000000 cur 1866 last 0 00002000:00080000:0.0:1789430168.977874:0:13238:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789430168.977918:0:13238:0:(import.c:65:import_set_state_nolock()) ffff946e05d2d800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789430168.982462:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789430168.987889:0:8083:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x812:0x0]-[0x280000400:0x841:0x0] 00000001:00080000:1.0:1789430169.103255:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969956 is committed 00000001:00080000:1.0:1789430169.103305:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969957 is committed 00000100:00080000:3.0:1789430170.224369:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430170.239245:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430170.390160:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430170.391001:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430170.788251:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430170.788259:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430170.788261:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789430171.915103:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995360 is committed 00000001:00080000:0.0:1789430171.915142:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995361 is committed 00000001:00080000:0.0:1789430174.506509:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969958 is committed 00000100:00080000:1.0:1789430175.550510:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430175.550518:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430175.550521:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430175.911277:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430175.911285:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430175.911288:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1789430177.314478:0:35884:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 39c: check truncate mtime update ================================================================================ 19:56:15 (1789430175) 00000004:00080000:3.0:1789430177.401485:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x817:0x0], index 0: 0 00000100:00080000:1.0:1789430177.402189:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430177.415950:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789430178.615193:0:26938:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294995364 00000020:00080000:3.0:1789430178.615391:0:26938:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789430180.641019:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430180.641030:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430180.641033:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430181.031620:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430181.031629:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430181.032738:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430181.032745:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430182.133031:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995363 is committed 00000001:00080000:0.0:1789430182.133054:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995365 is committed 00000001:00080000:0.0:1789430182.136361:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969937 is committed 00000001:00080000:0.0:1789430182.136391:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969938 is committed 00000100:00080000:1.0:1789430185.758652:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430185.758665:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430185.758789:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1789430185.760577:0:36082:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 39d: sync write should update mtime ====== 19:56:24 (1789430184) 00000100:00080000:0.0:1789430185.764334:0:8085:0:(import.c:65:import_set_state_nolock()) ffff946f416dc000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789430185.768011:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789430185.829276:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x813:0x0], index 1: 0 00010000:00080000:0.0:1789430185.964765:0:27100:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1883 last 0 00002000:00080000:0.0:1789430185.964981:0:27100:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789430185.965020:0:27100:0:(import.c:65:import_set_state_nolock()) ffff946f3f330000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789430185.969914:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430186.155762:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430186.155774:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430186.158474:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430186.158857:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430186.182403:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969959 is committed 00000001:00080000:0.0:1789430186.182424:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969960 is committed 00000001:00080000:0.0:1789430186.182437:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969961 is committed 00000001:00080000:1.0:1789430187.274153:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995372 is committed 00000001:00080000:1.0:1789430187.274178:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995373 is committed 00000100:00080000:2.0:1789430190.876334:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430190.876343:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430190.876345:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430191.270619:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430191.270626:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430191.274445:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430191.274454:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1789430192.620398:0:36280:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_40a skipping ALWAYS excluded test 40a 00000001:02000400:3.0:1789430194.559701:0:36328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 40b: pdirops: open|create and others ======================================================================== 19:56:33 (1789430193) 00000100:00080000:2.0:1789430195.056805:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430195.062656:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430195.995794:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430195.995802:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430196.394094:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430196.394300:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430196.400807:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789430197.450762:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995374 is committed 00000100:00080000:2.0:1789430199.560120:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789430199.582405:0:15700:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:2.0:1789430200.077545:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789430200.089080:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x818:0x0], index 0: 0 00010000:00080000:2.0:1789430200.111705:0:6681:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 1898 last 0 00002000:00080000:2.0:1789430200.111877:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789430200.111903:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946e0bc7a800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789430200.118077:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789430200.172982:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969939 is committed 00000100:00080000:2.0:1789430201.115565:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430201.125085:0:20986:0:(import.c:65:import_set_state_nolock()) ffff946f06fbf000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789430201.125546:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430201.125551:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430201.127909:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430201.520120:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430201.520460:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430201.527128:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430201.528308:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430202.156385:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430202.609636:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995379 is committed 00000001:00080000:1.0:1789430202.609826:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995380 is committed 00000100:00080000:3.0:1789430202.870526:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789430203.504119:0:26937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].38, 64 off10624 00000004:00080000:2.0:1789430203.504133:0:26937:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1901483931843ns, next at 1902483929576ns, rc = 0 00000001:00020000:3.0:1789430205.772984:0:15700:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000004:00080000:2.0:1789430205.782918:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x814:0x0], index 1: 0 00000100:00080000:1.0:1789430205.787186:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430205.804713:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789430205.893930:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].41, 64 off10816 00000004:00080000:2.0:1789430205.893951:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1903873749454ns, next at 1904873744928ns, rc = 0 00000100:00080000:1.0:1789430205.918769:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430206.231357:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430206.231373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430206.630240:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430206.630250:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430206.630614:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430206.639354:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430206.688562:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969962 is committed 00000004:00080000:3.0:1789430207.139408:0:6898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1905119205144ns, next at 1906119202762ns, rc = 0 00000004:00080000:1.0:1789430207.139507:0:8083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1905119306140ns, next at 1906119304700ns, rc = 0 00000004:00080000:1.0:1789430207.722623:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 77 committed 00000001:00080000:1.0:1789430207.722656:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995390 is committed 00000004:00080000:1.0:1789430207.722661:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 76 committed 00000001:00080000:1.0:1789430207.722671:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995382 is committed 00000004:00080000:1.0:1789430207.722674:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 69 committed 00000004:00080000:1.0:1789430207.722690:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 70 committed 00000001:00080000:1.0:1789430207.722694:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995392 is committed 00000001:00080000:1.0:1789430207.722709:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995383 is committed 00002000:00080000:3.0:1789430207.723091:0:27100:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2072 count 1 00002000:00080000:2.0:1789430207.723823:0:20986:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2068 count 1 00000004:00080000:1.0:1789430207.724897:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f073cfb80/2, rc 0, transno 4294969963 00000004:00080000:3.0:1789430207.747512:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f0822a680/2, rc 0, transno 4294969940 00000001:00080000:0.0:1789430210.779961:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969940 is committed 00000100:00080000:1.0:1789430211.351782:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430211.351794:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430211.351796:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430211.751754:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430211.751762:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430211.751765:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789430211.753766:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f0822a680, transno 4294969940 00000001:00080000:0.0:1789430211.807600:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969963 is committed 00000001:02000400:0.0:1789430211.974116:0:36728:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 40c: pdirops: link and others ======================================================================== 19:56:50 (1789430210) 00000004:00080000:2.0:1789430212.260932:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f073cfb80, transno 4294969963 00000001:00080000:1.0:1789430212.859642:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995393 is committed 00000100:00080000:3.0:1789430214.658386:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789430214.680848:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x819:0x0], index 0: 0 00010000:00080000:0.0:1789430214.698498:0:13238:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t4294969583 exp 0000000000000000 cur 1912 last 0 00002000:00080000:0.0:1789430214.698772:0:13238:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789430214.698813:0:13238:0:(import.c:65:import_set_state_nolock()) ffff946f05ac5000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789430214.703484:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789430214.778966:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969941 is committed 00000001:00020000:2.0:1789430215.874409:0:26938:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:3.0:1789430216.396869:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789430216.407921:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x815:0x0], index 1: 0 00000100:00080000:0.0:1789430216.421130:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430216.471269:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430216.471277:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430216.471862:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430216.871666:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430216.871674:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430216.871677:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789430216.908288:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969964 is committed 00000001:00080000:1.0:1789430217.959063:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995400 is committed 00000001:00080000:1.0:1789430217.959097:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995395 is committed 00000001:00080000:1.0:1789430217.959118:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995401 is committed 00000001:00080000:1.0:1789430217.959130:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995396 is committed 00000100:00080000:1.0:1789430218.199754:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430218.869581:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1789430219.478664:0:15669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].42, 64 off10880 00000004:00080000:3.0:1789430219.478684:0:15669:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1917458482628ns, next at 1918458479308ns, rc = 0 00000100:00080000:3.0:1789430221.596485:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430221.602192:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430221.602225:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430221.603421:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430221.603427:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789430221.819275:0:26938:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000040:00080000:2.0:1789430221.960951:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].39, 64 off10688 00000004:00080000:2.0:1789430221.960974:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1919940772700ns, next at 1920940766987ns, rc = 0 00000100:00080000:2.0:1789430221.991912:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430221.991923:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430221.991926:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789430222.499736:0:8083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1920479532215ns, next at 1921479528782ns, rc = 0 00000001:00080000:1.0:1789430223.126363:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995413 is committed 00000004:00080000:1.0:1789430223.126399:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 79 committed 00000001:00080000:1.0:1789430223.126569:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995405 is committed 00000004:00080000:1.0:1789430223.126581:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 71 committed 00000004:00080000:1.0:1789430223.126604:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 78 committed 00000100:00080000:1.0:1789430223.128095:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430223.128103:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1789430223.128185:0:13238:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2073 count 1 00002000:00080000:2.0:1789430223.129873:0:13238:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2069 count 1 00000004:00080000:1.0:1789430223.130869:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f08229f80/2, rc 0, transno 4294969942 00000100:00080000:3.0:1789430223.140036:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789430223.140715:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e0ad16680/2, rc 0, transno 4294969965 00000001:00080000:0.0:1789430225.145903:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969942 is committed 00000100:00080000:2.0:1789430226.713130:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946e05d2d800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789430226.713792:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430226.713799:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430226.713802:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430227.113820:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430227.115439:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430227.115447:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789430227.115476:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f08229f80, transno 4294969942 00000001:00080000:0.0:1789430227.214100:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969965 is committed 00000004:00080000:3.0:1789430227.624405:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e0ad16680, transno 4294969965 00000001:02000400:0.0:1789430228.747928:0:37129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 40d: pdirops: unlink and others ======================================================================== 19:57:07 (1789430227) 00000100:00080000:2.0:1789430229.067585:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430229.082065:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430231.467139:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789430231.498533:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81a:0x0], index 0: 0 00000100:00080000:3.0:1789430231.530962:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430231.833137:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430231.833148:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430231.834433:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430231.845231:0:13238:0:(import.c:65:import_set_state_nolock()) ffff946e0bc7a800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789430232.229241:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430232.229250:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430232.229613:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430232.229788:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430233.169183:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430233.179623:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:1.0:1789430233.196094:0:5840:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000001:00080000:2.0:1789430233.325359:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995417 is committed 00000001:00080000:2.0:1789430233.325395:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995414 is committed 00000100:00080000:2.0:1789430233.662343:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789430233.682402:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x816:0x0], index 1: 0 00000100:00080000:2.0:1789430233.711701:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789430235.363011:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969943 is committed 00000100:00080000:2.0:1789430235.640873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430236.346469:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430236.951564:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430236.951587:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789430237.005577:0:15700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].43, 64 off10944 00000004:00080000:2.0:1789430237.005591:0:15700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1934985390536ns, next at 1935985386608ns, rc = 0 00000100:00080000:3.0:1789430237.006788:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430237.356583:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430237.356596:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430237.370863:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430237.370978:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430237.409409:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969966 is committed 00000001:00080000:1.0:1789430238.485349:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995422 is committed 00000001:00080000:1.0:1789430238.485377:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995426 is committed 00000004:00080000:1.0:1789430238.485395:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 80 committed 00002000:00080000:2.0:1789430238.486240:0:27100:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2070 count 1 00000100:00080000:1.0:1789430238.492873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789430238.494961:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e094d9880/2, rc 0, transno 4294969967 00000001:00020000:0.0:1789430239.277156:0:5840:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000040:00080000:0.0:1789430239.300668:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].40, 64 off10752 00000004:00080000:0.0:1789430239.300683:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1937280481987ns, next at 1938280479017ns, rc = 0 00000100:00080000:1.0:1789430242.079419:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430242.079430:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430242.079960:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430242.473738:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430242.473748:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430242.473751:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430242.474168:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430242.560964:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969967 is committed 00000004:00080000:0.0:1789430242.979548:0:6898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1940959344284ns, next at 1941959341004ns, rc = 0 00000004:00080000:0.0:1789430242.981534:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e094d9880, transno 4294969967 00000004:00080000:3.0:1789430243.575610:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 73 committed 00000001:00080000:3.0:1789430243.575639:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995427 is committed 00000004:00080000:3.0:1789430243.575645:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 72 committed 00002000:00080000:1.0:1789430243.577841:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2074 count 1 00000004:00080000:2.0:1789430243.592448:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f3f2e1180/2, rc 0, transno 4294969944 00000001:02000400:1.0:1789430245.487357:0:37529:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 40e: pdirops: rename and others ======================================================================== 19:57:24 (1789430244) 00000001:00080000:0.0:1789430245.607443:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969944 is committed 00000100:00080000:0.0:1789430245.983784:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430245.998045:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430247.194759:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430247.195154:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430247.195158:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430247.195736:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430247.588652:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430247.588659:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430247.588661:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789430247.588696:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f3f2e1180, transno 4294969944 00000004:00080000:2.0:1789430248.259550:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81b:0x0], index 0: 0 00000001:00080000:1.0:1789430248.685597:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995428 is committed 00000001:00080000:1.0:1789430248.685857:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995431 is committed 00000100:00080000:3.0:1789430249.513678:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789430249.544133:0:5852:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:3.0:1789430250.028672:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789430250.046499:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x817:0x0], index 1: 0 00000100:00080000:2.0:1789430250.089156:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789430250.710221:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969945 is committed 00000100:00080000:2.0:1789430252.033681:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430252.054683:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430252.318489:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430252.320500:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430252.710155:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430252.712169:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430252.714599:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430252.720791:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1789430252.762456:0:15669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].44, 64 off11008 00000004:00080000:3.0:1789430252.762472:0:15669:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1950742270666ns, next at 1951742268008ns, rc = 0 00000001:00080000:0.0:1789430252.805773:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969968 is committed 00000001:00080000:2.0:1789430253.802291:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995436 is committed 00000001:00080000:2.0:1789430253.802317:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995437 is committed 00000001:00080000:2.0:1789430253.802331:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995439 is committed 00000004:00080000:2.0:1789430253.802337:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 81 committed 00002000:00080000:0.0:1789430253.803015:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2071 count 1 00000004:00080000:0.0:1789430253.811765:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f340ced80/2, rc 0, transno 4294969969 00000001:00020000:0.0:1789430255.155404:0:5852:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000100:00080000:1.0:1789430255.183063:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789430255.219548:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].41, 64 off10816 00000004:00080000:2.0:1789430255.219561:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1953199359414ns, next at 1954199357075ns, rc = 0 00000100:00080000:2.0:1789430255.229667:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430257.441650:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430257.445991:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430257.446004:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430257.848170:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430257.848180:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430257.848183:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789430257.937889:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969969 is committed 00000004:00080000:2.0:1789430258.339736:0:6898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1956319533301ns, next at 1957319531193ns, rc = 0 00000004:00080000:2.0:1789430258.341410:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f340ced80, transno 4294969969 00000001:00080000:2.0:1789430258.926341:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995445 is committed 00000004:00080000:2.0:1789430258.926374:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 75 committed 00000004:00080000:2.0:1789430258.926394:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 74 committed 00000001:00080000:2.0:1789430258.926402:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995446 is committed 00002000:00080000:1.0:1789430258.927102:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2075 count 1 00000004:00080000:2.0:1789430258.928255:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e02df3100/2, rc 0, transno 4294969946 00000001:00080000:1.0:1789430260.997341:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969946 is committed 00000001:02000400:0.0:1789430261.800427:0:37927:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 19:57:40 (1789430260) 00000100:00080000:0.0:1789430262.560519:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430262.560527:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430262.560529:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430262.949288:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430262.952169:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430262.952177:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789430262.964366:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e02df3100, transno 4294969946 00000100:00080000:2.0:1789430266.290149:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789430266.295444:0:5841:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:2.0:1789430266.816981:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430267.670825:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430267.672312:0:20986:0:(import.c:65:import_set_state_nolock()) ffff946f05ac5000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789430267.673312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430268.073820:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430268.073826:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430268.073829:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789430268.623588:0:5841:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000004:00080000:3.0:1789430268.641653:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81c:0x0], index 0: 0 00000100:00080000:1.0:1789430268.646936:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430268.657592:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430269.165523:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995448 is committed 00010000:00080000:2.0:1789430269.178591:0:13238:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t4294969583 exp 0000000000000000 cur 1967 last 0 00002000:00080000:2.0:1789430269.178755:0:13238:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789430269.178785:0:13238:0:(import.c:65:import_set_state_nolock()) ffff946e0bc79800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789430269.190621:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789430269.211255:0:26936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].42, 64 off10880 00000004:00080000:0.0:1789430269.211275:0:26936:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1967191073730ns, next at 1968191068776ns, rc = 0 00000100:00080000:0.0:1789430272.799124:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430272.799135:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430272.799137:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430273.188872:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430273.188879:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430273.188881:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789430273.700554:0:6898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1971680340789ns, next at 1972680337396ns, rc = 0 00000001:00080000:1.0:1789430274.304553:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995449 is committed 00000004:00080000:1.0:1789430274.304569:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 76 committed 00000004:00080000:1.0:1789430274.304606:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 77 committed 00002000:00080000:3.0:1789430274.305121:0:20745:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2076 count 1 00000100:00080000:2.0:1789430274.318933:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789430274.320064:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e0d364e00/2, rc 0, transno 4294969947 00000001:02000400:0.0:1789430275.831596:0:38323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 41b: pdirops: create vs create ======================================================================== 19:57:54 (1789430274) 00000001:00080000:1.0:1789430276.334746:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969947 is committed 00000100:00080000:1.0:1789430277.919179:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430277.919275:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430277.919279:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430278.309958:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430278.309964:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789430278.310519:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e0d364e00, transno 4294969947 00000100:00080000:3.0:1789430278.310921:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430278.310925:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430279.598734:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789430279.612218:0:6704:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:3.0:1789430280.112223:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789430281.692357:0:6704:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000004:00080000:2.0:1789430281.705875:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x818:0x0], index 1: 0 00000100:00080000:0.0:1789430281.717620:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789430282.344309:0:8085:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t0 exp 0000000000000000 cur 1980 last 0 00002000:00080000:2.0:1789430282.345049:0:8085:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789430282.345083:0:8085:0:(import.c:65:import_set_state_nolock()) ffff946e0bc7a000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1789430282.354784:0:15669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].45, 64 off11072 00000004:00080000:2.0:1789430282.354799:0:15669:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1980334597956ns, next at 1981334594500ns, rc = 0 00000100:00080000:0.0:1789430282.356138:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430283.036344:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430283.036352:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430283.045430:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430283.432173:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430283.432434:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430283.432437:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789430283.939369:0:8083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1981919165986ns, next at 1982919163828ns, rc = 0 00000004:00080000:1.0:1789430284.549097:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 83 committed 00000001:00080000:1.0:1789430284.549130:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995451 is committed 00000001:00080000:1.0:1789430284.549139:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995452 is committed 00000004:00080000:1.0:1789430284.549142:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 82 committed 00002000:00080000:2.0:1789430284.549725:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2072 count 1 00000100:00080000:3.0:1789430284.553292:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789430284.555323:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e0ad15500/2, rc 0, transno 4294969970 00000100:00080000:2.0:1789430288.160751:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430288.165316:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430288.165325:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430288.175639:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430288.548349:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430288.548357:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430288.548786:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430288.552522:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430288.636279:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969970 is committed 00000004:00080000:1.0:1789430289.061508:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e0ad15500, transno 4294969970 00000001:02000400:1.0:1789430289.360527:0:38721:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 41c: pdirops: create vs link ======================================================================== 19:58:08 (1789430288) 00000100:00080000:0.0:1789430292.261720:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789430292.273115:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81d:0x0], index 0: 0 00000100:00080000:3.0:1789430292.310638:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430293.298863:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430293.298873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:3.0:1789430293.547180:0:15700:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:2.0:1789430293.668853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430293.668860:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430293.668863:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789430294.768243:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995454 is committed 00000001:00080000:1.0:1789430294.768265:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995455 is committed 00000001:00020000:2.0:1789430295.636301:0:15700:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000004:00080000:2.0:1789430295.637097:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x819:0x0], index 1: 0 00000100:00080000:1.0:1789430295.647156:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430295.651554:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430296.237001:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789430296.241996:0:26938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].46, 64 off11136 00000004:00080000:1.0:1789430296.242011:0:26938:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1994221809769ns, next at 1995221806583ns, rc = 0 00000100:00080000:0.0:1789430296.260815:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789430296.273182:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].43, 64 off10944 00000004:00080000:3.0:1789430296.273197:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1994252995945ns, next at 1995252993040ns, rc = 0 00000001:00080000:1.0:1789430296.793069:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969948 is committed 00000100:00080000:3.0:1789430298.396607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430298.396903:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430298.396906:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430298.790775:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430298.790782:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430298.792668:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430298.792676:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789430299.299607:0:8083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1997279403850ns, next at 1998279401398ns, rc = 0 00000004:00080000:1.0:1789430299.300330:0:6898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1997280128176ns, next at 1998280126608ns, rc = 0 00000004:00080000:1.0:1789430299.883043:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 85 committed 00000004:00080000:1.0:1789430299.883080:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 79 committed 00000001:00080000:1.0:1789430299.883114:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995458 is committed 00000004:00080000:1.0:1789430299.883119:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 84 committed 00000001:00080000:1.0:1789430299.883130:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995459 is committed 00000004:00080000:1.0:1789430299.883133:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 78 committed 00002000:00080000:2.0:1789430299.883862:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2073 count 1 00002000:00080000:2.0:1789430299.886284:0:27100:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2077 count 1 00000004:00080000:3.0:1789430299.898797:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f073cd180/2, rc 0, transno 4294969949 00000004:00080000:3.0:1789430299.900355:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e0265f800/2, rc 0, transno 4294969971 00000001:00080000:3.0:1789430301.928251:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969949 is committed 00000001:02000400:3.0:1789430302.551987:0:39119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 41d: pdirops: create vs unlink ======================================================================== 19:58:21 (1789430301) 00000100:00080000:0.0:1789430303.514533:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430303.514542:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430303.514545:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430303.908297:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430303.908304:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430303.908306:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789430303.908344:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f073cd180, transno 4294969949 00000001:00080000:0.0:1789430303.960680:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969971 is committed 00000004:00080000:0.0:1789430304.430882:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e0265f800, transno 4294969971 00000100:00080000:3.0:1789430306.137967:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:1.0:1789430306.141516:0:26938:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:3.0:1789430306.646313:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789430308.021271:0:26938:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000004:00080000:1.0:1789430308.052690:0:26938:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81e:0x0], index 0: 0 00000100:00080000:0.0:1789430308.071637:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430308.072067:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789430308.081686:0:6682:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 2006 last 0 00002000:00080000:1.0:1789430308.081887:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789430308.081923:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946e012ad000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789430308.094997:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1789430308.105756:0:15700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].44, 64 off11008 00000004:00080000:1.0:1789430308.105770:0:15700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2006085568978ns, next at 2007085566540ns, rc = 0 00000100:00080000:2.0:1789430308.629804:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430308.629813:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430308.635552:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430309.028410:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430309.028416:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430309.028419:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430309.032393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789430309.541180:0:6898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2007520976938ns, next at 2008520973421ns, rc = 0 00000004:00080000:0.0:1789430310.137270:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 81 committed 00000001:00080000:0.0:1789430310.137305:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995462 is committed 00000004:00080000:0.0:1789430310.137311:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 80 committed 00000001:00080000:0.0:1789430310.137317:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995460 is committed 00000001:00080000:0.0:1789430310.137324:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995461 is committed 00002000:00080000:1.0:1789430310.137784:0:13238:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2078 count 1 00000100:00080000:2.0:1789430310.160162:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789430310.163305:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e15c04000/2, rc 0, transno 4294969950 00000001:00080000:1.0:1789430312.138632:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969950 is committed 00000100:00080000:3.0:1789430313.755862:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430313.755870:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430313.756386:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1789430313.838449:0:39516:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 19:58:32 (1789430312) 00000100:00080000:0.0:1789430314.148182:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430314.148190:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430314.148574:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789430314.148604:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e15c04000, transno 4294969950 00000100:00080000:1.0:1789430316.214785:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789430316.226119:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x81a:0x0], index 1: 0 00000100:00080000:1.0:1789430316.269547:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00020000:1.0:1789430317.558384:0:15669:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:1.0:1789430318.083316:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430318.873431:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430318.873439:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430318.873441:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430319.270063:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430319.279819:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430319.279829:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789430319.329760:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969972 is committed 00000001:00020000:0.0:1789430319.451274:0:15669:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000004:00080000:0.0:1789430319.451800:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x81f:0x0], index 0: 0 00000040:00080000:1.0:1789430319.498388:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].45, 64 off11072 00000004:00080000:1.0:1789430319.498402:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2017478201706ns, next at 2018478198848ns, rc = 0 00000100:00080000:0.0:1789430320.047557:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430320.079859:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789430320.086428:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].47, 64 off11200 00000004:00080000:1.0:1789430320.086441:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2018066240315ns, next at 2019066237820ns, rc = 0 00000001:00080000:3.0:1789430320.334834:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995466 is committed 00000001:00080000:3.0:1789430320.334856:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995469 is committed 00000004:00080000:3.0:1789430320.334861:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 86 committed 00000001:00080000:3.0:1789430320.334882:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995468 is committed 00000004:00080000:3.0:1789430320.334885:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 82 committed 00002000:00080000:0.0:1789430320.335374:0:8085:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2079 count 1 00002000:00080000:2.0:1789430320.336682:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2074 count 1 00000100:00080000:0.0:1789430320.340815:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430320.340825:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789430320.344494:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f34022300/2, rc 0, transno 4294969951 00000004:00080000:0.0:1789430320.346463:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e1004ce00/2, rc 0, transno 4294969973 00000001:00080000:2.0:1789430322.409383:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969951 is committed 00000100:00080000:2.0:1789430323.994607:0:20986:0:(import.c:65:import_set_state_nolock()) ffff946e0bc79800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789430323.994889:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430323.994894:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430323.994896:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430323.995781:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430324.393539:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430324.393549:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430324.394011:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789430324.394039:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f34022300, transno 4294969951 00000001:00080000:0.0:1789430324.458909:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969973 is committed 00000004:00080000:0.0:1789430324.899889:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e1004ce00, transno 4294969973 00000001:02000400:0.0:1789430326.004085:0:39914:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 19:58:44 (1789430324) 00000100:00080000:1.0:1789430329.112225:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430329.112233:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430329.112235:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789430329.296712:0:26936:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:1.0:1789430329.508096:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430329.508103:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430329.508105:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430329.508107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789430331.501612:0:26936:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000004:00080000:2.0:1789430331.504002:0:26936:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x81b:0x0], index 1: 0 00000100:00080000:2.0:1789430331.517822:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430331.524004:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430332.067838:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789430332.071486:0:26937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].48, 64 off11264 00000004:00080000:2.0:1789430332.071504:0:26937:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2030051303293ns, next at 2031051299545ns, rc = 0 00000100:00080000:3.0:1789430334.233820:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430334.233831:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430334.234032:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430334.633523:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430334.633535:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430334.633540:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789430335.140606:0:8083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2033120402283ns, next at 2034120397745ns, rc = 0 00000004:00080000:0.0:1789430335.726707:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 88 committed 00000001:00080000:0.0:1789430335.726781:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995473 is committed 00000004:00080000:0.0:1789430335.726787:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 87 committed 00000001:00080000:0.0:1789430335.727070:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995472 is committed 00002000:00080000:1.0:1789430335.728231:0:27100:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2075 count 1 00000004:00080000:3.0:1789430335.740389:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e159dea00/2, rc 0, transno 4294969974 00000001:02000400:2.0:1789430337.713132:0:40307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 41g: pdirops: create vs getattr ======================================================================== 19:58:56 (1789430336) 00000100:00080000:3.0:1789430339.358058:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430339.358069:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430339.358071:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430339.750403:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430339.750414:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430339.750417:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430339.792968:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969974 is committed 00000004:00080000:1.0:1789430340.263132:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e159dea00, transno 4294969974 00000100:00080000:3.0:1789430341.356187:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789430341.360805:0:15700:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:3.0:1789430341.880763:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789430343.459741:0:15700:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000004:00080000:1.0:1789430343.482630:0:15700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x820:0x0], index 0: 0 00000100:00080000:1.0:1789430343.490824:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430343.491391:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430343.506754:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789430344.081759:0:20986:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t4294969583 exp 0000000000000000 cur 2042 last 0 00002000:00080000:3.0:1789430344.082049:0:20986:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789430344.082094:0:20986:0:(import.c:65:import_set_state_nolock()) ffff946e0263a000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789430344.085434:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789430344.100755:0:15669:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].46, 64 off11136 00000004:00080000:0.0:1789430344.100772:0:15669:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2042080571075ns, next at 2043080568555ns, rc = 0 00000100:00080000:0.0:1789430344.477528:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430344.481523:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430344.868479:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430344.870778:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430344.870788:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430344.870791:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789430345.380705:0:6898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2043360500935ns, next at 2044360497708ns, rc = 0 00000001:00080000:0.0:1789430346.001494:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995476 is committed 00000004:00080000:0.0:1789430346.001516:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 83 committed 00000004:00080000:0.0:1789430346.001553:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 84 committed 00002000:00080000:1.0:1789430346.002313:0:20745:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2080 count 1 00000100:00080000:0.0:1789430346.006606:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430346.014066:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789430346.015017:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f054b6a00/2, rc 0, transno 4294969952 00000001:00080000:2.0:1789430348.050078:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969952 is committed 00000100:00080000:2.0:1789430349.593847:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430349.594051:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430349.594054:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430349.595472:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430349.988374:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789430349.988402:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f054b6a00, transno 4294969952 00000100:00080000:2.0:1789430349.990099:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430349.990105:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789430350.466926:0:40706:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 41h: pdirops: create vs readdir ======================================================================== 19:59:09 (1789430349) 00000100:00080000:2.0:1789430354.290192:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789430354.298567:0:15669:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:2.0:1789430354.723123:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430354.723134:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430354.724520:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430355.113543:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430355.113556:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430355.113561:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789430356.411170:0:15669:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000004:00080000:1.0:1789430356.413079:0:15669:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x81c:0x0], index 1: 0 00000100:00080000:1.0:1789430356.418698:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430356.422913:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430356.479294:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430356.536131:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430357.321045:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1789430357.337667:0:26938:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].49, 64 off11328 00000004:00080000:2.0:1789430357.337681:0:26938:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2055317480272ns, next at 2056317477438ns, rc = 0 00000100:00080000:1.0:1789430359.835330:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430359.835339:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430359.835342:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430360.231462:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430360.231469:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430360.231471:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789430360.740176:0:8083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2058719973410ns, next at 2059719971253ns, rc = 0 00000001:00080000:1.0:1789430361.321362:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995477 is committed 00000001:00080000:1.0:1789430361.321385:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995479 is committed 00000004:00080000:1.0:1789430361.321390:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 89 committed 00000004:00080000:1.0:1789430361.321406:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 90 committed 00002000:00080000:1.0:1789430361.321819:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2076 count 1 00000100:00080000:1.0:1789430361.332095:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430361.341260:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789430361.341610:0:3299:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946f1c348000/2, rc 0, transno 4294969975 00000001:02000400:3.0:1789430363.484570:0:41099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 41i: reint_open: create vs create ======== 19:59:22 (1789430362) 00000100:00080000:2.0:1789430364.645817:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430364.652260:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430364.873729:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430364.882966:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430364.890430:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4768 00000100:00080000:0.0:1789430364.950024:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430364.950033:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430365.348386:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430365.348393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430365.352829:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430365.352838:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430365.402836:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969975 is committed 00000004:00080000:0.0:1789430365.874012:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946f1c348000, transno 4294969975 00000001:00080000:3.0:1789430366.440850:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995482 is committed 00000001:00080000:3.0:1789430366.440862:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995480 is committed 00000001:00080000:3.0:1789430366.440867:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995481 is committed 00000100:00080000:1.0:1789430367.301094:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430367.308574:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430367.493312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430367.496726:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430367.517883:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4810 00000100:00080000:0.0:1789430370.070301:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430370.084678:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430370.084687:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430370.085363:0:13238:0:(import.c:65:import_set_state_nolock()) ffff946e0263a000 : changing import state from FULL to CLOSED 00000004:00020000:0.0:1789430370.086002:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430370.089252:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:2.0:1789430370.287603:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430370.303351:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4788 00000100:00080000:1.0:1789430370.469351:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430370.469825:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430370.469984:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430370.472827:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430371.602866:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995487 is committed 00000001:00080000:3.0:1789430371.602894:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995485 is committed 00000001:00080000:3.0:1789430371.602907:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995488 is committed 00000100:00080000:1.0:1789430372.635733:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430372.644326:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430372.881573:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430372.887076:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430372.897726:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4752 00000100:00080000:0.0:1789430375.191967:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430375.191975:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430375.191978:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:1.0:1789430375.305540:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:3.0:1789430375.518446:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430375.519384:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4777 00000100:00080000:3.0:1789430375.593159:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430375.593701:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430375.594868:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430375.594874:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430376.705322:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995490 is committed 00000001:00080000:2.0:1789430376.705350:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995491 is committed 00000001:00080000:2.0:1789430376.705360:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995493 is committed 00000100:00080000:0.0:1789430377.882398:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430377.896591:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430378.108321:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430378.112454:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430378.133031:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4779 00000100:00080000:1.0:1789430379.000968:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430380.153197:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430380.310966:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430380.311927:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430380.313904:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430380.313911:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:1.0:1789430380.341919:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430380.343411:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4809 00000100:00080000:3.0:1789430380.711322:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430380.711330:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430380.711333:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430381.320961:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430381.762786:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995500 is committed 00000001:00080000:1.0:1789430381.762889:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995498 is committed 00000001:00080000:1.0:1789430381.763081:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995499 is committed 00000004:00020000:2.0:1789430382.458945:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430382.682903:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430382.687831:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430382.688362:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4770 00000100:00080000:1.0:1789430383.601555:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430384.800625:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430384.985388:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430384.992409:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430384.993988:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4807 00000100:00080000:0.0:1789430385.431596:0:6682:0:(import.c:65:import_set_state_nolock()) ffff946e0bc7a000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789430385.431978:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430385.431983:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430385.431986:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430385.828183:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430385.828192:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430385.829381:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430385.829388:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430386.070003:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430386.907315:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995504 is committed 00000001:00080000:1.0:1789430386.907344:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995506 is committed 00000001:00080000:1.0:1789430386.907352:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995505 is committed 00000100:00080000:2.0:1789430387.183117:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430387.190470:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:3.0:1789430387.411595:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430387.424074:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4783 00000100:00080000:1.0:1789430388.384061:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430389.472055:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430389.476436:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:3.0:1789430389.691268:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430389.691334:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4785 00000100:00080000:0.0:1789430390.555419:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430390.555428:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430390.558281:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430390.948250:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430390.948258:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430390.948485:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430391.813366:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430391.826673:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000001:00080000:1.0:1789430392.005837:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995511 is committed 00000001:00080000:1.0:1789430392.005860:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995509 is committed 00000001:00080000:1.0:1789430392.005867:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995512 is committed 00000100:00080000:2.0:1789430392.021073:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430392.024767:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430392.024917:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4802 00000100:00080000:1.0:1789430393.029986:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430394.288719:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430394.513402:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430394.514408:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430394.514458:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4773 00000100:00080000:1.0:1789430395.569035:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430395.676356:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430395.676365:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430396.069502:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430396.069512:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430396.069515:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430396.830401:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430397.016653:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430397.030032:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430397.034745:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4800 00000001:00080000:3.0:1789430397.156741:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995516 is committed 00000001:00080000:3.0:1789430397.156761:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995520 is committed 00000001:00080000:3.0:1789430397.156766:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995518 is committed 00000100:00080000:2.0:1789430398.054804:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430399.221511:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430399.431008:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430399.433830:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430399.434969:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4787 00000100:00080000:0.0:1789430400.446393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430400.797813:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430400.797838:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430401.190104:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430401.190111:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430401.190427:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430401.190722:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430401.577636:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430401.796249:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430401.802086:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430401.803808:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4774 00000001:00080000:3.0:1789430402.289050:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995526 is committed 00000001:00080000:3.0:1789430402.289071:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995524 is committed 00000100:00080000:1.0:1789430402.836793:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430403.991729:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430404.200916:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430404.206272:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430404.230170:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4775 00000100:00080000:2.0:1789430405.217288:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430405.912681:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430405.912694:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:2.0:1789430406.306446:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430406.308143:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430406.308148:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430406.308150:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430406.509354:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430406.512678:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430406.515321:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4790 00000001:00080000:3.0:1789430407.399833:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995529 is committed 00000001:00080000:3.0:1789430407.399863:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995530 is committed 00000001:00080000:3.0:1789430407.399877:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995532 is committed 00000100:00080000:1.0:1789430407.564180:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430408.705765:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430408.903765:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430408.909551:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430408.909810:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4796 00000100:00080000:2.0:1789430409.808757:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430410.949066:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430411.034825:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430411.034835:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430411.040037:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430411.135357:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430411.136252:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4812 00000100:00080000:2.0:1789430411.429936:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430411.429958:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430411.430389:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430412.025122:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430412.514888:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995538 is committed 00000001:00080000:2.0:1789430412.514909:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995536 is committed 00000001:00080000:2.0:1789430412.514924:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995539 is committed 00000004:00020000:0.0:1789430413.317381:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430413.515307:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430413.523525:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430413.524431:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4792 00000100:00080000:0.0:1789430414.697297:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430416.158464:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430416.158472:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430416.158475:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430416.341588:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:0.0:1789430416.531005:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430416.531816:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4810 00000100:00080000:3.0:1789430416.548132:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430416.548138:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430416.558164:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789430417.659481:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995543 is committed 00000001:00080000:2.0:1789430417.659511:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995542 is committed 00000001:00080000:2.0:1789430417.659531:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995544 is committed 00000100:00080000:0.0:1789430419.102973:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430419.110435:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430419.321400:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430419.326713:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430419.332196:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4779 00000100:00080000:3.0:1789430421.279462:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430421.279469:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430421.279472:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:2.0:1789430421.467498:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430421.668270:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430421.668430:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430421.669448:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430421.669453:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:2.0:1789430421.677950:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430421.678159:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4790 00000001:00080000:2.0:1789430422.758361:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995550 is committed 00000001:00080000:2.0:1789430422.758381:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995546 is committed 00000001:00080000:2.0:1789430422.758387:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995547 is committed 00000100:00080000:2.0:1789430423.955404:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430423.968294:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430424.177172:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430424.183764:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430424.192546:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4784 00000100:00080000:0.0:1789430425.138971:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430426.396626:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430426.396634:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430426.396636:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430426.444804:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:0.0:1789430426.635560:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430426.635971:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4809 00000100:00080000:1.0:1789430426.791928:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430426.791935:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430426.793859:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430426.796223:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430427.854414:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430427.923916:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995556 is committed 00000001:00080000:0.0:1789430427.923932:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995551 is committed 00000001:00080000:0.0:1789430427.923950:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995554 is committed 00000100:00080000:2.0:1789430429.304473:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430429.323045:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430429.515891:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430429.523154:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430429.524169:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4799 00000100:00080000:0.0:1789430431.510329:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430431.510337:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430431.511093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430431.512150:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:3.0:1789430431.769040:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430431.907849:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430431.908438:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430431.908443:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430432.003417:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430432.003576:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4765 00000001:00080000:0.0:1789430432.987312:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995562 is committed 00000001:00080000:0.0:1789430432.987335:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995557 is committed 00000001:00080000:0.0:1789430432.987350:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995560 is committed 00000100:00080000:0.0:1789430433.182782:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430433.205895:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430434.509009:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:3.0:1789430434.748795:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430434.748936:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4760 00000100:00080000:3.0:1789430435.785126:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430436.634676:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430436.634683:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430436.638930:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430437.031016:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430437.031023:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430437.031025:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430437.072591:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430437.086984:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:3.0:1789430437.314878:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430437.343036:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4764 00000001:00080000:3.0:1789430438.085574:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995568 is committed 00000001:00080000:3.0:1789430438.085589:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995564 is committed 00000001:00080000:3.0:1789430438.085679:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995565 is committed 00000001:00080000:3.0:1789430438.085777:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995566 is committed 00000100:00080000:1.0:1789430438.554967:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430439.957882:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430439.966785:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430440.157979:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430440.169688:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430440.176750:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4797 00000100:00080000:1.0:1789430441.252569:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430441.751992:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430441.752000:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430442.156234:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430442.156243:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430442.156246:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430442.529012:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430442.728170:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430442.734084:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430442.739044:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4790 00000001:00080000:1.0:1789430443.244876:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995572 is committed 00000001:00080000:1.0:1789430443.244918:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995574 is committed 00000100:00080000:1.0:1789430444.063272:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430444.085311:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430445.426914:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:3.0:1789430445.630023:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430445.631831:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4795 00000100:00080000:1.0:1789430446.706586:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430446.748555:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430446.870752:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430446.870758:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430447.269664:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430447.269671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430447.270615:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430447.270620:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430448.175961:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430448.182143:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000001:00080000:1.0:1789430448.358273:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995578 is committed 00000001:00080000:1.0:1789430448.358294:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995577 is committed 00000100:00080000:0.0:1789430448.399622:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430448.401658:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430448.403913:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4778 00000100:00080000:0.0:1789430450.740992:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430450.745599:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430450.958850:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430450.964052:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430450.964670:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4780 00000100:00080000:2.0:1789430451.995122:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430451.995130:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430452.076303:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430452.108605:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430452.390542:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430452.390553:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430452.390557:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430453.508165:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995584 is committed 00000001:00080000:2.0:1789430453.508180:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995582 is committed 00000001:00080000:2.0:1789430453.508194:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995583 is committed 00000004:00020000:3.0:1789430453.602936:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:0.0:1789430453.837312:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430453.838584:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4764 00000100:00080000:0.0:1789430454.892102:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430454.918593:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430456.297054:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430456.306657:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430456.516505:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430456.529887:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430456.530662:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4776 00000100:00080000:3.0:1789430457.111768:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430457.126316:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430457.513866:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430457.513873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430457.513876:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430457.522087:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430458.579604:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995590 is committed 00000001:00080000:3.0:1789430458.579623:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995586 is committed 00000001:00080000:3.0:1789430458.579633:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995588 is committed 00000001:00080000:3.0:1789430458.579641:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995589 is committed 00000100:00080000:2.0:1789430458.897483:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430458.907955:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430459.112816:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430459.122530:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430459.123885:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4784 00000100:00080000:3.0:1789430460.309593:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430461.876147:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430462.083905:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430462.089977:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430462.090766:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4786 00000100:00080000:0.0:1789430462.243607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430462.248007:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430462.632097:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430462.632110:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430462.632114:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430463.272611:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430463.757095:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995595 is committed 00000001:00080000:1.0:1789430463.757136:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995593 is committed 00000001:00080000:1.0:1789430463.757145:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995596 is committed 00000004:00020000:2.0:1789430464.885515:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430465.107847:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430465.115575:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430465.117045:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4768 00000100:00080000:0.0:1789430466.088011:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430467.349865:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430467.349879:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430467.349886:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430467.636563:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430467.758795:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430467.760304:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430467.760313:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:1.0:1789430467.862657:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430467.863961:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4773 00000001:00080000:0.0:1789430468.854654:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995598 is committed 00000001:00080000:0.0:1789430468.854680:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995600 is committed 00000001:00080000:0.0:1789430468.854696:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995599 is committed 00000001:00080000:0.0:1789430468.854706:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995601 is committed 00000100:00080000:0.0:1789430469.072730:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430469.108951:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430470.269005:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:3.0:1789430470.476462:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430470.477408:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4791 00000100:00080000:0.0:1789430471.569108:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430471.607542:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430472.471504:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430472.471515:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430472.873551:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430472.873561:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430472.873564:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430473.006025:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430473.015533:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430473.214517:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430473.224984:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430473.225052:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4791 00000001:00080000:1.0:1789430473.938474:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995607 is committed 00000001:00080000:1.0:1789430473.938499:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995605 is committed 00000100:00080000:3.0:1789430475.504506:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430475.510187:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430475.728568:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430475.739091:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430475.739997:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4770 00000100:00080000:2.0:1789430477.590843:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430477.590850:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430477.590852:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430477.992999:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430477.993006:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430477.993009:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430478.023594:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:2.0:1789430478.233347:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430478.236949:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4786 00000001:00080000:2.0:1789430479.071582:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995610 is committed 00000001:00080000:2.0:1789430479.071602:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995608 is committed 00000001:00080000:2.0:1789430479.071610:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995613 is committed 00000001:00080000:2.0:1789430479.071619:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995611 is committed 00000100:00080000:0.0:1789430479.209070:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430479.251049:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430480.696056:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:1.0:1789430480.913555:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430480.914384:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4781 00000100:00080000:2.0:1789430482.206932:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430482.228115:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430482.713797:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430482.715317:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430483.107961:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430483.108115:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430483.115675:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:1.0:1789430483.737316:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:2.0:1789430483.937746:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430483.947508:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4799 00000001:00080000:1.0:1789430484.201695:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995617 is committed 00000001:00080000:1.0:1789430484.201714:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995615 is committed 00000001:00080000:1.0:1789430484.201725:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995619 is committed 00000100:00080000:1.0:1789430485.086119:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430485.115344:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430486.724133:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:1.0:1789430486.929758:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430486.929801:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4794 00000100:00080000:3.0:1789430487.832363:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430487.832370:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430487.832373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430488.228386:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430488.228393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430488.228395:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430489.337295:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995623 is committed 00000001:00080000:2.0:1789430489.337331:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995621 is committed 00000001:00080000:2.0:1789430489.337341:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995622 is committed 00000100:00080000:2.0:1789430489.507912:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430489.514794:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430489.727948:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430489.730812:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430489.741511:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4784 00000100:00080000:0.0:1789430491.000996:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430491.036862:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430492.483081:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:3.0:1789430492.739910:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430492.740679:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4742 00000100:00080000:0.0:1789430492.956533:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430492.956541:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430493.350977:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430493.351134:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430493.351137:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430493.351265:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430493.903182:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430493.928890:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430494.433188:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995625 is committed 00000001:00080000:2.0:1789430494.433248:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995628 is committed 00000001:00080000:2.0:1789430494.433254:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995626 is committed 00000001:00080000:2.0:1789430494.433259:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995629 is committed 00000100:00080000:2.0:1789430495.450514:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430495.460031:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430495.664124:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430495.678563:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430495.678809:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4781 00000100:00080000:1.0:1789430498.072073:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430498.072081:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430498.073607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430498.073962:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430498.244677:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:1.0:1789430498.448617:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430498.448884:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4796 00000100:00080000:3.0:1789430498.478684:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430498.482135:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430498.482141:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430498.484082:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430499.538912:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995634 is committed 00000001:00080000:3.0:1789430499.538936:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995632 is committed 00000001:00080000:3.0:1789430499.538942:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995635 is committed 00000100:00080000:3.0:1789430500.631725:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430500.650711:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430500.658488:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430500.855248:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430500.861076:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430500.861940:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4796 00000100:00080000:2.0:1789430503.191662:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430503.191669:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430503.191671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430503.332753:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:1.0:1789430503.534010:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430503.552477:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4794 00000100:00080000:2.0:1789430503.592732:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430503.593222:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430503.593226:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430503.594544:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430504.699294:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995640 is committed 00000001:00080000:3.0:1789430504.699317:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995638 is committed 00000100:00080000:3.0:1789430506.194534:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430506.202221:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430506.435775:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430506.444673:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430506.446735:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4757 00000100:00080000:1.0:1789430508.321878:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430508.321887:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430508.321889:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430508.711726:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430508.711732:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430508.712747:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430508.729640:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:3.0:1789430508.951617:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430508.953588:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4776 00000001:00080000:3.0:1789430509.827987:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995643 is committed 00000001:00080000:3.0:1789430509.828010:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995644 is committed 00000001:00080000:3.0:1789430509.828028:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995646 is committed 00000100:00080000:0.0:1789430510.043148:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430510.078031:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430511.600873:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:1.0:1789430511.808835:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430511.809983:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4791 00000100:00080000:3.0:1789430512.821380:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430512.832589:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430513.443565:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430513.443574:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430513.833299:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430513.833306:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430513.833453:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430514.093843:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430514.100679:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430514.295094:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430514.311073:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430514.312647:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4788 00000001:00080000:3.0:1789430514.912700:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995647 is committed 00000001:00080000:3.0:1789430514.912717:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995651 is committed 00000001:00080000:3.0:1789430514.912728:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995652 is committed 00000001:00080000:3.0:1789430514.912737:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995650 is committed 00000100:00080000:0.0:1789430516.819354:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430516.832877:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430517.059119:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430517.066634:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430517.066842:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4766 00000100:00080000:3.0:1789430518.052359:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430518.550734:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430518.550743:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430518.948603:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430518.948610:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430518.948703:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:2.0:1789430519.412500:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430519.628593:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430519.633996:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430519.634328:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4777 00000001:00080000:3.0:1789430520.025280:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995658 is committed 00000001:00080000:3.0:1789430520.025298:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995656 is committed 00000100:00080000:1.0:1789430520.665044:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430521.851195:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430522.069318:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430522.079340:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430522.081369:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4775 00000100:00080000:2.0:1789430523.188756:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430523.674389:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430523.674397:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430524.068356:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430524.068364:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430524.068366:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:3.0:1789430524.450150:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430524.653922:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430524.664427:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430524.668589:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4785 00000001:00080000:0.0:1789430525.174823:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995664 is committed 00000001:00080000:0.0:1789430525.174845:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995662 is committed 00000100:00080000:1.0:1789430525.841018:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430527.227968:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430527.239453:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430527.455435:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430527.463432:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430527.464720:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4774 00000100:00080000:3.0:1789430528.792682:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430528.792691:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430529.189031:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430529.189038:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430529.189864:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430529.189869:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430529.726102:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430529.732659:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430529.954071:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430529.959439:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430529.960389:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4772 00000001:00080000:3.0:1789430530.278563:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995668 is committed 00000001:00080000:3.0:1789430530.278580:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995667 is committed 00000001:00080000:3.0:1789430530.278589:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995670 is committed 00000100:00080000:3.0:1789430532.071041:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430532.080163:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430532.283784:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430532.295333:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430532.296013:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4784 00000100:00080000:2.0:1789430533.912733:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430533.912742:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430534.315242:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430534.317346:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430534.322777:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430534.626508:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430534.637915:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430534.856047:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430534.860852:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430534.861142:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4777 00000001:00080000:3.0:1789430535.409075:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995673 is committed 00000001:00080000:3.0:1789430535.409091:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995671 is committed 00000001:00080000:3.0:1789430535.409098:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995674 is committed 00000001:00080000:3.0:1789430535.409114:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995676 is committed 00000100:00080000:2.0:1789430536.061612:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430536.079841:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430537.421411:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:0.0:1789430537.627476:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430537.627724:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4794 00000100:00080000:3.0:1789430538.829835:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430538.871888:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430539.041834:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430539.041845:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430539.436830:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430539.437287:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430539.437392:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430539.437395:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430540.265331:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430540.282516:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430540.500072:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430540.515960:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430540.516732:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4761 00000001:00080000:1.0:1789430540.547314:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995678 is committed 00000001:00080000:1.0:1789430540.547340:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995680 is committed 00000001:00080000:1.0:1789430540.547357:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995679 is committed 00000100:00080000:2.0:1789430543.003813:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430543.010452:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430543.214734:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430543.223955:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430543.225477:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4786 00000100:00080000:2.0:1789430544.149688:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430544.149700:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430544.549347:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430544.549356:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430544.549358:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430545.475874:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430545.485029:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000001:00080000:1.0:1789430545.649221:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995682 is committed 00000001:00080000:1.0:1789430545.649241:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995686 is committed 00000001:00080000:1.0:1789430545.649252:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995685 is committed 00000100:00080000:1.0:1789430545.698945:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430545.705560:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430545.706764:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4778 00000100:00080000:1.0:1789430547.951919:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430547.960263:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430548.158787:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430548.163876:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430548.164885:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4796 00000100:00080000:0.0:1789430549.028003:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430549.269556:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430549.269564:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430549.672014:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430549.672021:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430549.672023:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430550.038152:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430550.263642:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430550.264556:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430550.265639:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4772 00000001:00080000:1.0:1789430550.720382:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995693 is committed 00000001:00080000:1.0:1789430550.720421:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995694 is committed 00000001:00080000:1.0:1789430550.720436:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995689 is committed 00000001:00080000:1.0:1789430550.720447:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995692 is committed 00000100:00080000:3.0:1789430551.031929:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430552.050424:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430552.261233:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430552.266377:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430552.268974:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4782 00000100:00080000:3.0:1789430553.192646:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430554.202668:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430554.389374:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430554.389383:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430554.390265:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430554.424441:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430554.424705:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4778 00000100:00080000:3.0:1789430554.788296:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430554.788303:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430554.788305:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430555.131150:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430555.854246:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995700 is committed 00000001:00080000:3.0:1789430555.854262:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995698 is committed 00000001:00080000:3.0:1789430555.854273:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995701 is committed 00000004:00020000:1.0:1789430556.126972:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430556.330774:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430556.333579:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430556.334797:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4792 00000100:00080000:0.0:1789430557.124972:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430558.224310:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430558.433320:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430558.439750:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430558.439806:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4783 00000100:00080000:1.0:1789430559.449277:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430559.517481:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430559.517493:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430559.914973:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430559.914980:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430559.914983:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430560.544529:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430560.755874:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430560.769703:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430560.770077:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4774 00000001:00080000:3.0:1789430561.023746:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995707 is committed 00000001:00080000:3.0:1789430561.023764:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995702 is committed 00000001:00080000:3.0:1789430561.023775:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995709 is committed 00000100:00080000:1.0:1789430561.813423:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430563.084837:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430563.088842:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430563.303366:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430563.311484:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430563.312591:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4776 00000100:00080000:2.0:1789430564.641677:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430564.641697:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430565.028856:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430565.028862:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430565.028864:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430565.455171:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430565.457110:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430565.688237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430565.695511:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430565.696096:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4761 00000001:00080000:3.0:1789430566.135780:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995712 is committed 00000001:00080000:3.0:1789430566.135814:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995714 is committed 00000001:00080000:3.0:1789430566.135827:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995713 is committed 00000001:00080000:3.0:1789430566.135833:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995715 is committed 00000100:00080000:3.0:1789430568.032789:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430568.045813:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430568.290837:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430568.297620:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430568.297897:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4748 00000100:00080000:0.0:1789430569.751329:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430569.751341:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430570.157592:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430570.157606:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430570.157610:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430570.525579:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430570.530683:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430570.741256:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430570.747003:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430570.747126:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4784 00000001:00080000:3.0:1789430571.211153:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995717 is committed 00000001:00080000:3.0:1789430571.211404:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995718 is committed 00000001:00080000:3.0:1789430571.211420:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995716 is committed 00000001:00080000:3.0:1789430571.211561:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995720 is committed 00000001:00080000:3.0:1789430571.211676:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995721 is committed 00000001:00080000:3.0:1789430571.211683:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995719 is committed 00000100:00080000:1.0:1789430572.946545:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430572.950256:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430573.146605:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430573.149131:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430573.149362:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4801 00000100:00080000:3.0:1789430574.334758:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430574.876874:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430574.876885:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430575.281101:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430575.281113:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430575.281120:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430575.714081:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430575.911291:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430575.918233:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430575.922431:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4791 00000001:00080000:3.0:1789430576.336940:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995725 is committed 00000001:00080000:3.0:1789430576.336965:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995724 is committed 00000001:00080000:3.0:1789430576.336975:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995727 is committed 00000100:00080000:0.0:1789430577.064954:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430577.088707:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430578.438012:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:3.0:1789430578.653168:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430578.653296:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4784 00000100:00080000:0.0:1789430579.663464:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430579.994700:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430579.994712:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430579.994715:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430580.388991:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430580.405634:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430580.405644:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:2.0:1789430580.876152:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430581.085734:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430581.091156:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430581.093613:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4784 00000001:00080000:1.0:1789430581.464809:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995731 is committed 00000001:00080000:1.0:1789430581.464895:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995733 is committed 00000100:00080000:0.0:1789430582.162294:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430583.420369:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:2.0:1789430583.615924:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430583.619900:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430583.621267:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4798 00000100:00080000:2.0:1789430584.559332:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430585.113152:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430585.117708:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430585.117716:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430585.512996:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430585.521057:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430585.523872:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:3.0:1789430585.717393:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:1.0:1789430585.938734:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430585.939458:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4778 00000001:00080000:1.0:1789430586.619935:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995739 is committed 00000001:00080000:1.0:1789430586.619960:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995734 is committed 00000001:00080000:1.0:1789430586.619967:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995737 is committed 00000100:00080000:1.0:1789430586.988719:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430587.014607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430588.062780:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430588.069109:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000004:00020000:3.0:1789430588.320702:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430588.321760:0:5841:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4747 00000100:00080000:3.0:1789430589.407861:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430590.237047:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430590.237055:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430590.237058:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430590.601252:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430590.628101:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430590.628109:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430590.628111:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:1.0:1789430590.805106:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430590.807541:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4796 00000001:00080000:1.0:1789430591.720776:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995744 is committed 00000001:00080000:1.0:1789430591.720802:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995740 is committed 00000001:00080000:1.0:1789430591.720812:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995745 is committed 00000001:00080000:1.0:1789430591.720820:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995743 is committed 00000100:00080000:0.0:1789430591.931591:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430593.244418:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430593.256369:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430593.465225:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430593.469679:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430593.469923:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4787 00000100:00080000:1.0:1789430595.273481:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430595.283018:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430595.352288:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430595.352294:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430595.352297:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430595.489354:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:2.0:1789430595.491173:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4793 00000100:00080000:1.0:1789430595.747867:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430595.748781:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430595.748787:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430596.857129:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995750 is committed 00000001:00080000:2.0:1789430596.857149:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995751 is committed 00000001:00080000:2.0:1789430596.857154:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995746 is committed 00000001:00080000:2.0:1789430596.857159:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995752 is committed 00000100:00080000:1.0:1789430597.361047:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430597.364601:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430597.588940:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430597.597240:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430597.599312:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4765 00000100:00080000:1.0:1789430599.309874:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430599.322464:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430599.520497:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430599.523927:0:5840:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430599.525152:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4797 00000100:00080000:0.0:1789430600.474242:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430600.474249:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430600.871769:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430600.871776:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430600.872090:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430600.872093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430601.712571:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430601.716761:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430601.920367:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430601.924230:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430601.927314:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4789 00000001:00080000:2.0:1789430601.937727:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995754 is committed 00000001:00080000:2.0:1789430601.937743:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995757 is committed 00000001:00080000:2.0:1789430601.937751:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995758 is committed 00000100:00080000:0.0:1789430604.185059:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430604.188606:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430604.418835:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430604.427306:0:26937:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430604.429919:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4760 00000100:00080000:0.0:1789430605.601873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430605.601883:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430605.991888:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430605.991898:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430605.991901:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430606.830512:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430606.838766:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430607.047009:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430607.058134:0:5839:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430607.058938:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4781 00000001:00080000:2.0:1789430607.102775:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995760 is committed 00000001:00080000:2.0:1789430607.102793:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995764 is committed 00000001:00080000:2.0:1789430607.102804:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995763 is committed 00000100:00080000:0.0:1789430608.327674:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430609.820737:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430610.043364:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430610.052676:0:6704:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:1.0:1789430610.054061:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4767 00000100:00080000:2.0:1789430610.709930:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430610.709939:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430610.709941:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430611.112186:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430611.112192:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430611.112195:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430612.209533:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995768 is committed 00000001:00080000:2.0:1789430612.209552:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995767 is committed 00000001:00080000:2.0:1789430612.209567:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995770 is committed 00000001:00080000:2.0:1789430612.209574:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995769 is committed 00000100:00080000:3.0:1789430612.901576:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430612.917057:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:3.0:1789430613.115155:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430613.127818:0:15669:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430613.127934:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4785 00000100:00080000:2.0:1789430614.295121:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430615.637533:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:0.0:1789430615.831244:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430615.833061:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430615.833067:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:3.0:1789430615.869964:0:26936:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:0.0:1789430615.870231:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4766 00000100:00080000:0.0:1789430616.228499:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430616.230675:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430616.230682:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430617.279383:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430617.304143:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430617.306736:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995775 is committed 00000001:00080000:2.0:1789430617.306763:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995773 is committed 00000004:00020000:3.0:1789430618.936091:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_race id 169 sleeping 00000100:00080000:1.0:1789430619.143060:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430619.153785:0:15700:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 waking 00000004:00020000:3.0:1789430619.155368:0:26938:0:(mdt_open.c:1567:mdt_reint_open()) cfs_fail_race id 169 awake: rc=4780 00000100:00080000:1.0:1789430620.459550:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430620.957579:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430620.957587:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430621.350431:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430621.350438:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430621.350440:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430622.146762:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430622.161631:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789430622.379557:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430622.451029:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995779 is committed 00000001:00080000:0.0:1789430622.451051:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995777 is committed 00000001:00080000:0.0:1789430622.451066:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995778 is committed 00000100:00080000:2.0:1789430626.070596:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430626.070607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430626.070610:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430626.473565:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430626.475092:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430626.475101:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430627.491504:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789430627.499653:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430628.590452:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430629.940509:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430630.136504:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430631.190844:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430631.190856:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430631.190859:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430631.588769:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430631.588780:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430631.588783:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430632.672761:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995781 is committed 00000001:00080000:1.0:1789430632.672783:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995782 is committed 00000004:00020000:3.0:1789430635.171408:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789430635.188506:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430635.191109:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430635.196257:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430636.312660:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430636.312669:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430636.710544:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430636.710551:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430636.710553:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430637.104904:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430637.110491:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430637.306604:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430637.781313:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995784 is committed 00000001:00080000:1.0:1789430637.781343:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995785 is committed 00000100:00080000:3.0:1789430641.441152:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430641.441160:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430641.441162:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430641.828676:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430641.828682:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430641.828766:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430641.828902:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430642.340037:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789430642.359343:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:2.0:1789430642.945572:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995786 is committed 00000001:00080000:2.0:1789430642.945593:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995787 is committed 00000100:00080000:3.0:1789430643.333123:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430644.480078:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789430644.680819:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430646.553349:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430646.553368:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430646.553404:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430646.553423:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430646.948132:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430646.948839:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430646.948845:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430646.948846:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789430648.058083:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995788 is committed 00000004:00020000:3.0:1789430649.507364:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789430649.516086:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430649.519643:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789430649.520429:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430651.501863:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430651.510954:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789430651.676494:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430651.676505:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430651.679234:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430652.072129:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430652.072137:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430652.072140:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430653.122817:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995790 is committed 00000001:00080000:0.0:1789430653.123060:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995791 is committed 00000004:00020000:0.0:1789430656.675372:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789430656.685447:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430656.685628:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430656.791478:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430656.791485:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430657.190033:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430657.190042:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430657.190047:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430658.260624:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995792 is committed 00000001:00080000:0.0:1789430658.260639:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995794 is committed 00000100:00080000:3.0:1789430658.554509:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430658.564513:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789430658.762852:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430661.910480:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430661.910832:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430661.910838:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430662.313607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430662.314127:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430662.314130:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430662.316229:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430663.844123:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789430663.859298:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430663.861036:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430666.110657:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430666.130999:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430666.372927:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430667.044171:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430667.044186:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430667.431123:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430667.431129:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430667.431132:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430668.556906:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995796 is committed 00000001:00080000:0.0:1789430668.556933:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995797 is committed 00000004:00020000:3.0:1789430671.523382:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:3.0:1789430671.539813:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789430671.540666:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430672.158724:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430672.158748:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430672.549232:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430672.549244:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430672.549248:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430673.679382:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995799 is committed 00000001:00080000:1.0:1789430673.679402:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995800 is committed 00000100:00080000:3.0:1789430674.474619:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430674.491664:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430674.652523:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430677.270133:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430677.271382:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430677.274134:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430677.672446:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430677.672712:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430677.672899:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430677.677955:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430679.715993:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789430679.730639:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430679.731197:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430679.737089:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430681.108673:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430682.399773:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430682.401892:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430682.401896:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430682.789461:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430682.791438:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430682.791445:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430682.890085:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:2.0:1789430683.910957:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995803 is committed 00000100:00080000:2.0:1789430687.512891:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430687.520161:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430687.521083:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:2.0:1789430687.907350:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789430687.910676:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430687.910682:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430687.913861:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430687.913870:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430687.923512:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:1.0:1789430689.015886:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995805 is committed 00000100:00080000:1.0:1789430689.057233:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430690.353149:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789430690.582680:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430692.633592:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430692.633604:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430692.636805:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430693.031671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430693.031680:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430693.032144:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430693.032344:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789430694.178190:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995806 is committed 00000004:00020000:3.0:1789430695.587323:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:0.0:1789430695.615377:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430695.624877:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430695.625375:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430697.753823:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430697.753830:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430697.753833:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430698.119059:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789430698.153080:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430698.153087:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430698.154091:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430698.156816:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789430699.263916:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995809 is committed 00000100:00080000:3.0:1789430702.869643:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430702.869790:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430702.874929:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:3.0:1789430703.267349:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789430703.269048:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430703.269055:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430703.269061:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:1.0:1789430703.288468:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430704.360282:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430704.375358:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995811 is committed 00000004:00020000:1.0:1789430705.563196:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430705.784242:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430708.003109:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430708.004850:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430708.006356:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430708.006364:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430708.389412:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430708.390105:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430708.390460:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430708.392380:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789430709.490471:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995812 is committed 00000004:00020000:1.0:1789430710.948162:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789430710.959970:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430710.961133:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430710.969449:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430713.119147:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430713.119606:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430713.119611:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430713.146089:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430713.509228:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430713.509234:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430713.509237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430714.587847:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995814 is committed 00000001:00080000:2.0:1789430714.587871:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995815 is committed 00000100:00080000:0.0:1789430718.232745:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430718.237180:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430718.239189:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430718.630099:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:0.0:1789430718.631677:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430718.631684:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430718.631687:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430718.650522:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:3.0:1789430719.733448:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995818 is committed 00000100:00080000:3.0:1789430720.682897:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430720.686801:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430720.886172:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430723.353472:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430723.353481:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430723.353484:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430723.749860:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430723.749869:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430723.749872:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430725.796065:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:0.0:1789430725.816893:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430725.824926:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789430725.825125:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430725.928959:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430727.189992:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430728.479438:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430728.479450:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430728.479453:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:0.0:1789430728.673042:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789430728.868420:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430728.870313:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430728.870320:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430728.870323:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430729.957054:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995820 is committed 00000001:00080000:0.0:1789430729.957083:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995821 is committed 00000100:00080000:3.0:1789430733.589942:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430733.590238:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430733.590242:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:0.0:1789430733.987395:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789430733.988179:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430733.990694:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430733.990703:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430733.993027:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:2.0:1789430733.998364:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:0.0:1789430735.063782:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995822 is committed 00000001:00080000:0.0:1789430735.063798:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995824 is committed 00000100:00080000:3.0:1789430736.022180:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430736.033001:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430736.237867:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430738.712161:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430738.712168:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430738.713519:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430739.113142:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430739.113737:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430739.115533:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:3.0:1789430741.155397:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789430741.167242:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430741.171782:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430743.395290:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430743.401562:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430743.622863:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430743.830003:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430743.830281:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430744.228794:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430744.229119:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430744.229581:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430744.229585:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430745.331383:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995826 is committed 00000001:00080000:3.0:1789430745.331403:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995827 is committed 00000004:00020000:0.0:1789430748.835354:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789430748.845345:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789430748.845851:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430748.849863:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430748.956861:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430748.956869:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430749.354675:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430749.354681:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430749.354683:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430750.401982:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995830 is committed 00000100:00080000:0.0:1789430750.874426:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430750.881599:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430751.086953:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430754.075935:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430754.075943:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430754.075945:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430754.468625:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430754.471315:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430754.476360:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430754.476368:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:1.0:1789430756.007419:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789430756.023465:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430756.023905:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430758.437990:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430758.443519:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430758.649221:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430759.205376:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430759.209085:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430759.587962:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430759.588966:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430759.589150:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430759.589487:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789430760.633988:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995831 is committed 00000001:00080000:0.0:1789430760.634009:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995832 is committed 00000001:00080000:0.0:1789430760.634016:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995833 is committed 00000004:00020000:2.0:1789430763.684465:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789430763.698846:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430763.702407:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789430764.310456:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430764.312985:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430764.708292:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430764.708298:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430764.708301:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430765.697675:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430765.706950:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:0.0:1789430765.767529:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995835 is committed 00000001:00080000:0.0:1789430765.767547:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995836 is committed 00000100:00080000:2.0:1789430765.914787:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430769.436417:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430769.436426:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430769.436429:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430769.844093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430769.844105:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430769.844110:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430770.852183:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789430770.859773:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:2.0:1789430770.931886:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995838 is committed 00000100:00080000:3.0:1789430772.120047:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430773.700894:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789430773.906118:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430774.549914:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430774.549925:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430774.549927:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430774.952175:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430774.956835:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430774.956848:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789430776.066185:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995839 is committed 00000004:00020000:2.0:1789430779.043306:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789430779.054888:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430779.056787:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430779.057241:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430779.676039:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430779.676048:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430780.070517:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430780.071250:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430780.071256:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789430781.162034:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995842 is committed 00000100:00080000:1.0:1789430781.593984:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430781.599606:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789430781.805435:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430784.795777:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430784.797168:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430784.799371:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430784.801083:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430785.188653:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430785.188659:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430785.189661:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430785.189666:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430786.724044:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789430786.750092:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430786.750725:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430789.379671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430789.385918:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789430789.597870:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430789.911850:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430789.912810:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430790.311454:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430790.311467:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430790.311471:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430791.437722:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995844 is committed 00000001:00080000:3.0:1789430791.437764:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995845 is committed 00000004:00020000:3.0:1789430794.403314:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:0.0:1789430794.409409:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430794.409936:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430794.410413:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430795.039815:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430795.039823:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430795.430348:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430795.430353:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430795.430355:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789430796.478297:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995848 is committed 00000100:00080000:1.0:1789430797.002739:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430797.015581:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789430797.243622:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430800.151082:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430800.151596:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430800.151600:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430800.550149:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430800.550598:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430800.550994:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430800.551516:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:3.0:1789430802.083368:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:3.0:1789430802.100652:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789430802.101974:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430804.160674:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430804.185496:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430804.357242:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430805.270747:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430805.270756:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430805.668579:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430805.669652:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430805.670992:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430805.670999:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789430806.726091:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995851 is committed 00000004:00020000:1.0:1789430809.252184:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789430809.262391:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430809.265990:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430809.266192:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430810.392380:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430810.392387:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430810.788457:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430810.788464:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430810.789116:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430811.704632:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430811.713346:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:2.0:1789430811.863075:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995854 is committed 00000100:00080000:3.0:1789430811.939005:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430815.513837:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430815.513853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430815.513856:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430815.916379:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430815.919013:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430815.922646:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:2.0:1789430816.931316:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789430816.936464:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:3.0:1789430816.978698:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995855 is committed 00000100:00080000:2.0:1789430818.135931:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430819.511949:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789430819.718412:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430820.634797:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430820.634816:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430820.634819:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430821.031532:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430821.031540:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430821.031544:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430822.110741:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995856 is committed 00000001:00080000:3.0:1789430822.110763:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995857 is committed 00000004:00020000:3.0:1789430824.611323:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789430824.620158:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430824.623072:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430824.624376:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430825.753005:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430825.753012:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430826.149958:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430826.159757:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430826.160023:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430826.163223:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430827.051032:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430827.055040:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:1.0:1789430827.243256:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995859 is committed 00000001:00080000:1.0:1789430827.243282:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995860 is committed 00000100:00080000:1.0:1789430827.268726:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430830.870379:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430830.870389:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430830.870595:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430831.268642:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430831.268652:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430831.268654:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430831.269556:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430832.292738:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789430832.306525:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430832.312967:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430832.317331:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430834.761301:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430834.768356:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789430834.975806:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430835.990247:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430835.990257:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430836.393104:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430836.393445:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430836.393449:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430836.395830:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430837.490998:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995861 is committed 00000001:00080000:1.0:1789430837.491393:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995862 is committed 00000001:00080000:1.0:1789430837.495020:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995863 is committed 00000004:00020000:2.0:1789430839.972509:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789430839.983469:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430839.988514:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430839.989237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430841.073157:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430841.109237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430841.109245:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430841.109704:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430841.515159:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430841.515169:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430841.527512:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430841.534943:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430842.420741:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:1.0:1789430842.572538:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995865 is committed 00000001:00080000:1.0:1789430842.572558:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995866 is committed 00000100:00080000:0.0:1789430846.232189:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430846.233418:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430846.233427:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430846.634393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430846.635266:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430846.635270:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430846.636918:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430847.651553:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789430847.672109:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430848.624153:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430849.874556:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430850.083601:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430851.351637:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430851.353016:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430851.353024:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430851.749623:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430851.749933:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430851.751270:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430851.751276:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789430852.808236:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995869 is committed 00000004:00020000:3.0:1789430855.331303:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789430855.339589:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430855.339939:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789430855.340521:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430856.482548:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430856.483083:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430856.869805:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430856.869811:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430856.870261:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430856.870265:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430857.390032:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430857.391090:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789430857.598764:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789430857.941052:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995872 is committed 00000100:00080000:1.0:1789430861.591186:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430861.591194:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430861.591197:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430861.993171:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430861.993179:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430861.993181:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:3.0:1789430862.499443:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:3.0:1789430862.522956:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:2.0:1789430863.041366:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995874 is committed 00000100:00080000:0.0:1789430863.540547:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430864.734031:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789430864.955513:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430866.718097:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430866.718105:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430866.718107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430867.111620:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430867.113668:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430867.119140:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430867.119151:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789430868.218990:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995875 is committed 00000004:00020000:2.0:1789430870.179311:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:0.0:1789430870.195805:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430870.196004:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430870.204709:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430871.837070:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430871.837078:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430872.229934:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430872.229942:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430872.229944:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430872.904862:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430872.906617:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789430873.134849:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430873.344365:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995878 is committed 00000100:00080000:3.0:1789430876.952194:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430876.952235:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430876.952238:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430877.360049:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430877.360059:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430877.360063:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430878.371428:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789430878.411328:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430878.411654:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430878.416534:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430878.474543:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995879 is committed 00000100:00080000:2.0:1789430881.421466:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430881.429937:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789430881.614520:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430882.069922:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430882.069935:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430882.469419:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430882.469429:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430882.471273:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430882.471413:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789430883.627154:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995881 is committed 00000004:00020000:1.0:1789430886.564799:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789430886.577101:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430886.580816:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430886.581424:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430887.194864:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430887.194872:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430887.588157:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430887.588164:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430887.588166:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789430888.679185:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995883 is committed 00000001:00080000:2.0:1789430888.679234:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995884 is committed 00000004:00080000:0.0:1789430889.210540:0:5839:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 510us 00000100:00080000:3.0:1789430889.213372:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430889.240192:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789430889.411807:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430892.314246:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430892.315562:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430892.318904:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430892.708752:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430892.708760:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430892.711083:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430892.712060:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:3.0:1789430894.244131:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789430894.282799:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430894.286705:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789430894.289367:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430896.338093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430896.347218:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789430896.553349:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430897.432064:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430897.432072:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430897.828381:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430897.828388:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430897.828392:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430898.920496:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995886 is committed 00000001:00080000:3.0:1789430898.920645:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995887 is committed 00000004:00020000:3.0:1789430901.412677:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789430901.440588:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430901.440923:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789430901.446352:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430902.555595:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430902.555602:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430902.948080:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430902.948086:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430902.948090:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430903.731544:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430903.737737:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789430903.937779:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430904.041408:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995890 is committed 00000100:00080000:1.0:1789430907.680454:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430907.681187:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430907.681193:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430908.067928:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430908.069418:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430908.069667:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430908.070155:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:1.0:1789430909.091314:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789430909.111393:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789430909.112059:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430909.116389:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430911.339183:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430911.356791:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789430911.557036:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430912.793692:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430912.793701:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430913.188804:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430913.188812:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430913.188814:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430914.293293:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995891 is committed 00000001:00080000:1.0:1789430914.293508:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995893 is committed 00000004:00020000:0.0:1789430916.771317:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789430916.776398:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430916.789318:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430916.789587:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430917.915350:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430917.915358:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430918.312833:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430918.312842:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430918.313460:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430919.184725:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430919.191474:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:1.0:1789430919.365018:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995896 is committed 00000100:00080000:0.0:1789430919.400548:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430923.029655:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430923.029851:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430923.057178:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430923.057190:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430923.432964:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430923.432970:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430923.432973:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430923.433484:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430924.451348:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:3.0:1789430924.479567:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:1.0:1789430924.499652:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995897 is committed 00000100:00080000:0.0:1789430925.550822:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430926.928049:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789430927.165669:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430928.151133:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430928.152131:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430928.152136:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430928.550283:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430928.550677:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430928.550681:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430928.554743:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789430929.632020:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995898 is committed 00000001:00080000:1.0:1789430929.632444:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995899 is committed 00000004:00020000:3.0:1789430932.131387:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789430932.149572:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430932.149848:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430933.277280:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430933.286623:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430933.671867:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430933.671879:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430933.676803:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789430934.773811:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995901 is committed 00000001:00080000:1.0:1789430934.773836:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995902 is committed 00000100:00080000:2.0:1789430934.869971:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430934.877137:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789430935.069058:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430938.402301:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789430938.402313:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430938.405219:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430938.791929:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430938.791947:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430938.791950:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430938.800642:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430940.323488:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789430940.345850:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430940.347671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430943.005603:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430943.353093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430943.379147:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789430943.519308:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430943.519316:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430943.908366:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430943.913635:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430943.913646:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789430944.994296:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995903 is committed 00000001:00080000:1.0:1789430944.994319:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995905 is committed 00000004:00020000:2.0:1789430948.516534:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789430948.534987:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430948.535145:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430948.545736:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430948.630511:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430948.630519:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430949.030830:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430949.030838:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430949.031179:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430949.032535:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430950.088157:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995907 is committed 00000001:00080000:1.0:1789430950.088380:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995908 is committed 00000100:00080000:2.0:1789430950.969881:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430950.973504:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789430951.182619:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430953.749559:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430953.749975:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430953.750463:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430953.753494:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430954.158930:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430954.158938:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430954.158941:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:3.0:1789430956.196132:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789430956.201622:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430956.202150:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430956.203946:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430958.504982:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430958.509885:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430958.735297:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430958.870399:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430958.875360:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430959.277908:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430959.277916:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430959.278012:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430959.280194:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430960.356455:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995911 is committed 00000004:00020000:3.0:1789430963.875432:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789430963.890126:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430963.892520:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430963.892865:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789430963.989638:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430963.989646:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430964.388653:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430964.388660:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430964.388662:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430965.015704:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789430965.455174:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995913 is committed 00000001:00080000:2.0:1789430965.455195:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995914 is committed 00000004:00020000:2.0:1789430966.296310:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430966.484052:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430969.108858:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430969.109529:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430969.111655:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430969.112220:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430969.513631:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789430969.513894:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789430969.517099:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430969.520038:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:2.0:1789430971.555315:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:0.0:1789430971.567577:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430971.572746:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789430971.572773:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789430974.231358:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430974.231364:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430974.231367:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789430974.264547:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789430974.636481:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430974.636490:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430974.636493:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789430975.691237:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995917 is committed 00000100:00080000:3.0:1789430979.355401:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430979.402437:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946e012ad000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789430979.405321:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430979.405732:0:20745:0:(import.c:65:import_set_state_nolock()) ffff946f3f330000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789430979.406573:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:1.0:1789430979.747317:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789430979.750379:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789430979.750390:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430979.753842:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789430979.753854:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430979.767243:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:0.0:1789430980.857526:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995918 is committed 00000001:00080000:0.0:1789430980.857548:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995919 is committed 00000100:00080000:3.0:1789430982.020557:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430982.024230:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789430982.226300:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430984.482842:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430984.878012:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789430984.878021:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430984.882830:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789430984.882839:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430985.926757:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995920 is committed 00000004:00020000:3.0:1789430987.427337:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789430987.447146:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430987.450884:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430987.451065:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789430989.589337:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430989.988788:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430989.988795:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789430989.989756:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789430989.989761:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:3.0:1789430990.022517:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:1.0:1789430991.069730:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995922 is committed 00000001:00080000:1.0:1789430991.069752:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995923 is committed 00000100:00080000:3.0:1789430994.715513:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789430995.108100:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789430995.112321:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789430995.112328:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789430995.112331:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789430995.118485:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789430996.121934:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789430996.193308:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995926 is committed 00000004:00020000:0.0:1789430997.533741:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789430997.755333:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789430999.832643:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431000.229144:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431000.229156:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431000.229158:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:0.0:1789431002.787322:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789431002.804837:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431002.811385:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789431002.812675:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431004.952149:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431005.058503:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789431005.348264:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431005.348397:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431005.351928:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431006.454789:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995927 is committed 00000001:00080000:0.0:1789431006.454817:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995929 is committed 00000100:00080000:3.0:1789431010.070080:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431010.467346:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:0.0:1789431010.476397:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431010.476419:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431010.478469:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431010.485404:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431010.498380:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:3.0:1789431011.632748:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995931 is committed 00000100:00080000:2.0:1789431012.994493:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431013.001452:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789431013.199167:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431015.193473:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431015.590531:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431015.591644:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431015.597992:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431015.598006:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431016.688319:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995932 is committed 00000004:00020000:3.0:1789431018.147304:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789431018.153917:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431018.157515:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789431018.158895:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431020.323489:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431020.546500:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789431020.714081:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431020.715007:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431020.717971:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431020.718297:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431021.824594:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995935 is committed 00000100:00080000:2.0:1789431025.429702:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431025.828678:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789431025.830473:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431025.830786:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431025.835032:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431025.835039:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:3.0:1789431025.837436:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:3.0:1789431026.900705:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995938 is committed 00000100:00080000:0.0:1789431027.891016:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431027.902711:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789431028.100314:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431030.590973:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431030.591872:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431030.950372:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431030.951039:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431030.951044:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431032.995457:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789431033.011219:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431033.016721:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431033.017096:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789431035.429173:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431035.435043:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789431035.655507:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431036.068939:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431036.068946:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431036.068949:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789431037.150241:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995941 is committed 00000004:00020000:3.0:1789431040.676245:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789431040.699783:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431040.707267:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431040.707777:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789431041.191532:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431041.191543:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431041.191546:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431042.296664:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995944 is committed 00000100:00080000:0.0:1789431043.091503:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431043.093672:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789431043.289592:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431045.911652:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431046.309234:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431046.309245:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431046.309247:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:3.0:1789431048.355551:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789431048.364048:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431048.380022:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789431048.380359:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431050.716247:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431050.727390:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789431050.935167:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431051.435635:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431051.435644:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431051.435648:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431051.440683:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431052.551053:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995947 is committed 00000004:00020000:0.0:1789431056.036367:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789431056.046009:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431056.055718:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789431056.549178:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431056.549186:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431056.549189:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431056.550078:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431057.623272:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995948 is committed 00000001:00080000:0.0:1789431057.623294:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995949 is committed 00000001:00080000:0.0:1789431057.623300:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995950 is committed 00000100:00080000:2.0:1789431058.395653:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431058.410872:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789431058.621762:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431061.280947:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431061.287394:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431061.669601:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431061.669742:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431061.672383:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431061.676426:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431063.715355:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789431063.736452:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431063.738294:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789431063.738586:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431065.933912:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431065.954425:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789431066.140448:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431066.789402:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431066.790785:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431066.790793:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431067.902830:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995951 is committed 00000001:00080000:0.0:1789431067.902866:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995953 is committed 00000004:00020000:2.0:1789431071.396892:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789431071.408462:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431071.416247:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431071.416599:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789431071.912407:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431071.912419:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431071.914146:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789431072.988506:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995956 is committed 00000100:00080000:1.0:1789431073.814056:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431073.822355:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789431074.039609:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431076.631909:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431077.034547:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431077.035342:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431077.039607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431077.041833:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:3.0:1789431079.075376:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:0.0:1789431079.086097:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431079.087626:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431079.094566:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789431081.504834:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431081.518024:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789431081.726969:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431082.149850:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431082.149858:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431082.149860:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789431083.264154:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995958 is committed 00000001:00080000:3.0:1789431083.264329:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995959 is committed 00000004:00020000:2.0:1789431086.755332:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:3.0:1789431086.766963:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789431086.767448:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431087.271592:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431087.271598:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431087.271601:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789431088.355959:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995961 is committed 00000001:00080000:3.0:1789431088.355979:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995962 is committed 00000100:00080000:2.0:1789431089.267495:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431089.270018:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789431089.498507:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431091.996151:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431092.391458:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431092.391468:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431092.391472:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431092.396423:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431094.435390:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789431094.447175:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431094.448557:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789431094.448597:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431097.113381:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431097.114367:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431097.337055:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789431097.507997:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431097.508005:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431097.510295:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789431098.612094:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995965 is committed 00000100:00080000:0.0:1789431102.236631:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431102.628290:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789431102.632073:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431102.632083:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431102.632085:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431102.660277:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:0.0:1789431103.750034:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995967 is committed 00000100:00080000:3.0:1789431105.350504:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431105.364555:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789431105.590909:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431107.353869:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431107.755546:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431107.755555:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431107.766664:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789431108.826510:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995968 is committed 00000004:00020000:3.0:1789431110.820443:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789431110.834921:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431110.848704:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789431110.852527:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431112.471997:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431112.868837:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431112.868843:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431112.869748:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431112.869753:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:2.0:1789431112.874180:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:1.0:1789431113.943643:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995970 is committed 00000001:00080000:1.0:1789431113.943681:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995971 is committed 00000100:00080000:1.0:1789431117.592277:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431117.987389:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789431117.989854:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431117.995002:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:1.0:1789431117.998376:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789431118.003059:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431119.017431:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431119.114377:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995972 is committed 00000001:00080000:0.0:1789431119.114401:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995973 is committed 00000004:00020000:1.0:1789431120.400109:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789431120.597038:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431122.711447:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431122.713110:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431123.109959:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431123.109967:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431123.109969:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431124.210414:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995974 is committed 00000004:00020000:1.0:1789431125.668230:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789431125.681465:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431125.683866:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789431127.838646:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431127.969196:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789431128.230247:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431128.230253:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431128.231017:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789431129.297853:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995975 is committed 00000001:00080000:0.0:1789431129.297884:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995976 is committed 00000001:00080000:0.0:1789431129.297891:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995977 is committed 00000100:00080000:1.0:1789431132.958381:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431133.349367:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431133.349379:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431133.349383:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431133.349439:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789431133.367037:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:0.0:1789431134.414892:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995979 is committed 00000100:00080000:1.0:1789431134.744240:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431136.333263:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431136.340621:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789431136.545893:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431138.077446:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431138.468887:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431138.468895:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431138.495351:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431138.496287:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431139.567313:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995980 is committed 00000004:00020000:0.0:1789431141.539442:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789431141.557772:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431141.558787:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789431141.559184:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431143.189568:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431143.591004:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431143.599261:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431143.599272:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:1.0:1789431143.990750:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:2.0:1789431144.673378:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995982 is committed 00000001:00080000:2.0:1789431144.673406:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995983 is committed 00000100:00080000:0.0:1789431148.309603:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431148.709945:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431148.709955:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431148.709958:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431148.710042:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431149.220370:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789431149.237546:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:2.0:1789431149.801890:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995984 is committed 00000001:00080000:2.0:1789431149.801931:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995985 is committed 00000100:00080000:2.0:1789431150.284906:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431151.573890:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789431151.785633:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431153.440097:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431153.829676:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431153.830228:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431153.830232:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431153.830648:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789431154.895475:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995986 is committed 00000004:00020000:2.0:1789431156.900296:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789431156.916585:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431156.924716:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789431156.925231:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431158.551542:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431158.947972:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431158.947980:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431158.947983:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431159.048518:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:2.0:1789431160.014905:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995987 is committed 00000001:00080000:2.0:1789431160.014933:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995989 is committed 00000100:00080000:3.0:1789431163.685226:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431164.068384:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:0.0:1789431164.072994:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431164.073004:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431164.073006:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:2.0:1789431164.076680:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789431165.159839:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789431165.189795:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995991 is committed 00000004:00020000:1.0:1789431166.409886:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789431166.625301:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431168.794537:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431169.191851:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431169.191863:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431169.191865:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789431170.284336:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995992 is committed 00000004:00020000:1.0:1789431171.749157:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789431171.756145:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789431171.756613:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431171.757171:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431173.912254:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431174.308672:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431174.308681:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431174.308684:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:3.0:1789431174.325635:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:1.0:1789431175.382818:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995993 is committed 00000001:00080000:1.0:1789431175.382929:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995995 is committed 00000100:00080000:2.0:1789431179.036713:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431179.427523:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789431179.435413:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431179.435942:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431179.435949:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431179.442334:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431179.475000:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:2.0:1789431180.529182:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995997 is committed 00000100:00080000:3.0:1789431182.334196:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431182.340109:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789431182.583446:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431184.149252:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431184.548986:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431184.548994:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431184.548997:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789431185.653733:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294995998 is committed 00000004:00020000:3.0:1789431187.620626:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:0.0:1789431187.637728:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431187.638477:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431187.638576:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789431189.272950:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431189.670426:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431189.670441:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431189.670445:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:3.0:1789431190.248091:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:1.0:1789431190.776528:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996001 is committed 00000100:00080000:0.0:1789431194.397792:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431194.789520:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431194.789529:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431194.789533:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431194.789932:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431195.299393:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789431195.328389:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:3.0:1789431195.868263:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996003 is committed 00000100:00080000:0.0:1789431196.526640:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431197.841952:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789431198.061749:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431199.512189:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431199.913630:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431199.913642:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431199.920329:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431199.927326:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789431201.030313:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996004 is committed 00000004:00020000:3.0:1789431202.981236:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789431203.000815:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431203.015877:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789431203.016091:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431204.139746:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431205.031363:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431205.032600:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431205.032607:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431205.032609:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431205.455817:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789431205.667052:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431206.087080:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996007 is committed 00000100:00080000:0.0:1789431209.750141:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431210.149575:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431210.150257:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431210.156197:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431210.158871:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431210.659674:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:0.0:1789431210.675902:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:2.0:1789431211.269958:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996008 is committed 00000001:00080000:2.0:1789431211.269977:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996009 is committed 00000100:00080000:0.0:1789431211.800034:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431213.118292:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431213.126984:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789431213.321131:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431215.271520:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431215.271531:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431215.271534:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431216.379565:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996010 is committed 00000004:00020000:2.0:1789431218.339703:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789431218.355178:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789431218.355609:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431218.359141:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431220.388293:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431220.388303:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431220.388306:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431221.010696:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431221.018160:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789431221.224389:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431221.504647:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996013 is committed 00000100:00080000:3.0:1789431225.111521:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431225.114108:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431225.519742:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431225.519755:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431225.519759:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:2.0:1789431226.020006:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789431226.029099:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:3.0:1789431226.581814:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996014 is committed 00000001:00080000:3.0:1789431226.581839:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996015 is committed 00000100:00080000:2.0:1789431227.143873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431228.666285:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789431228.861290:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431230.231010:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431230.631112:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431230.631125:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431230.631128:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789431231.714041:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996016 is committed 00000004:00020000:2.0:1789431233.699370:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789431233.713351:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431233.735532:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789431233.735887:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431235.355302:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431235.762804:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431235.769400:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431235.769413:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:0.0:1789431236.088788:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:3.0:1789431236.844676:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996019 is committed 00000100:00080000:2.0:1789431240.473406:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431240.873728:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431240.873737:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431240.874315:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431240.874319:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431241.380849:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789431241.404825:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:2.0:1789431241.986922:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996020 is committed 00000001:00080000:2.0:1789431241.986957:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996021 is committed 00000100:00080000:2.0:1789431242.514700:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431244.149289:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431244.153668:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789431244.356995:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431245.993393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431245.993848:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431245.993853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789431247.113506:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996022 is committed 00000004:00020000:0.0:1789431249.575240:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789431249.586329:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789431249.586612:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431249.590533:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431251.115373:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431251.117704:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431251.119302:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431251.123171:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431251.916329:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431251.920036:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789431252.156242:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789431252.197114:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996025 is committed 00000100:00080000:2.0:1789431255.829629:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431256.228187:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431256.228606:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431256.229085:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431256.235815:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:1.0:1789431257.254277:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789431257.261621:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431257.270142:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789431257.271236:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431259.602905:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431259.610169:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789431259.816948:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431261.349717:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431261.351490:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431261.351500:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789431262.474247:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996028 is committed 00000004:00020000:0.0:1789431264.931496:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789431264.945104:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431264.946094:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789431266.083808:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431266.469590:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431266.470556:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431266.470563:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431266.470566:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431267.082453:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431267.086453:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:1.0:1789431267.552995:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996031 is committed 00000100:00080000:2.0:1789431271.194263:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431271.588404:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431271.589562:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431271.590157:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431272.100346:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789431272.124679:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:1.0:1789431272.686947:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996032 is committed 00000001:00080000:1.0:1789431272.686989:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996033 is committed 00000100:00080000:0.0:1789431273.275184:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431274.713842:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789431274.905470:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431276.324493:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431276.712486:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431276.712501:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431276.712916:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789431277.785347:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996034 is committed 00000004:00020000:0.0:1789431279.784091:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789431279.796409:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789431279.797506:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431281.438441:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431281.831104:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431281.831115:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431281.831117:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431281.969650:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:0.0:1789431282.951889:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996035 is committed 00000001:00080000:0.0:1789431282.951929:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996037 is committed 00000100:00080000:1.0:1789431286.550834:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431286.957984:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431286.957994:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431286.958317:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431286.958321:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431287.460058:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789431287.471004:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:0.0:1789431288.089242:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996038 is committed 00000001:00080000:0.0:1789431288.089264:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996039 is committed 00000100:00080000:1.0:1789431288.696698:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431290.084285:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431290.092402:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789431290.277193:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431292.068464:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431292.068473:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431292.068772:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789431293.166034:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996040 is committed 00000004:00020000:0.0:1789431295.139380:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:3.0:1789431295.153581:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789431295.153853:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431295.160943:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431297.196218:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431297.196231:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431297.196234:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431297.693913:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431297.694389:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789431297.915876:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431298.277290:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996041 is committed 00000001:00080000:2.0:1789431298.277591:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996042 is committed 00000001:00080000:2.0:1789431298.279918:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996043 is committed 00000100:00080000:1.0:1789431301.910068:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431302.307954:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431302.308918:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431302.310162:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431302.310357:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00020000:1.0:1789431302.821005:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:3.0:1789431302.856711:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:2.0:1789431303.417962:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996044 is committed 00000001:00080000:2.0:1789431303.417990:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996045 is committed 00000100:00080000:0.0:1789431303.904060:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431305.191649:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431305.196294:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789431305.406950:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431307.034562:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431307.428346:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431307.428354:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431307.428357:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431308.504488:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996046 is committed 00000004:00020000:0.0:1789431310.501435:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:0.0:1789431310.519154:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431310.526521:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789431310.528410:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431312.163159:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431312.549545:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431312.549554:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431312.549557:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431313.124028:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:2.0:1789431313.622014:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996048 is committed 00000001:00080000:2.0:1789431313.624056:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996049 is committed 00000100:00080000:2.0:1789431317.283628:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431317.294516:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431317.676092:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431317.676100:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431317.676216:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:2.0:1789431318.180007:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:3.0:1789431318.203021:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:3.0:1789431318.784116:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996051 is committed 00000100:00080000:2.0:1789431319.297929:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431320.515149:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789431320.713957:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431322.404044:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431322.793132:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431322.793140:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431322.793143:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431323.852684:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996052 is committed 00000004:00020000:1.0:1789431325.859311:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789431325.867064:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431325.869733:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:2.0:1789431325.870312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431327.290947:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431327.509267:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431327.914992:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431327.914999:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431327.915002:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:1.0:1789431328.471249:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:3.0:1789431328.981951:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996053 is committed 00000001:00080000:3.0:1789431328.981972:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996055 is committed 00000100:00080000:0.0:1789431332.629705:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431332.630638:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431333.027991:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431333.027997:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431333.029862:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431333.029869:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:0.0:1789431333.540575:0:15700:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:1.0:1789431333.555036:0:5841:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:3.0:1789431334.102388:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996056 is committed 00000001:00080000:3.0:1789431334.102406:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996057 is committed 00000100:00080000:1.0:1789431334.500243:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431335.696046:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789431335.902699:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431337.751399:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431338.160774:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431338.160787:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431338.161237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789431339.241718:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996058 is committed 00000004:00020000:2.0:1789431340.707400:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789431340.717427:0:15669:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789431340.720326:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431340.728399:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431342.874665:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431343.264761:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:0.0:1789431343.271795:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431343.271801:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431343.272283:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431343.272287:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789431344.355327:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996060 is committed 00000001:00080000:2.0:1789431344.355359:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996061 is committed 00000100:00080000:3.0:1789431347.995159:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431348.388698:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:1.0:1789431348.389086:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431348.389091:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431348.389094:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00020000:0.0:1789431348.394428:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:2.0:1789431349.513940:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996063 is committed 00000100:00080000:1.0:1789431349.588936:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431350.770848:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:1.0:1789431350.999187:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431353.111510:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431353.511181:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431353.511193:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431353.514673:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431353.519916:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431354.586060:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996064 is committed 00000004:00020000:0.0:1789431356.067336:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:0.0:1789431356.081811:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431356.088994:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431356.089376:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:0.0:1789431358.231365:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431358.630935:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431358.630945:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431358.630948:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431358.676860:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000001:00080000:2.0:1789431359.708066:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996065 is committed 00000001:00080000:2.0:1789431359.708091:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996067 is committed 00000100:00080000:2.0:1789431363.352412:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431363.748547:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789431363.758303:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431363.758311:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431363.758315:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431363.758628:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431363.759346:0:5840:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:3.0:1789431364.846141:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996068 is committed 00000001:00080000:3.0:1789431364.846416:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996069 is committed 00000100:00080000:3.0:1789431366.128993:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431366.132985:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789431366.357478:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431368.472251:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431368.473125:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431368.869366:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431368.869505:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431368.876998:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431368.881224:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789431369.968178:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996070 is committed 00000004:00020000:3.0:1789431371.427266:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000004:00020000:2.0:1789431371.441972:0:6704:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:1.0:1789431371.442252:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431373.593998:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431373.595597:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:0.0:1789431373.782869:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:3.0:1789431373.988615:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431373.988621:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431373.989957:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789431375.055275:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996072 is committed 00000001:00080000:3.0:1789431375.055292:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996073 is committed 00000100:00080000:0.0:1789431378.711589:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:2.0:1789431379.111239:0:26937:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:3.0:1789431379.112423:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431379.112430:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431379.112433:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:3.0:1789431379.135091:0:26938:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000001:00080000:3.0:1789431380.177799:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996075 is committed 00000100:00080000:2.0:1789431380.293751:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431381.574063:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_race id 16a sleeping 00000100:00080000:2.0:1789431381.779360:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431383.829093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431384.229403:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431384.229410:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431384.229413:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789431385.309710:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996076 is committed 00000004:00020000:1.0:1789431386.787543:0:26936:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a awake: rc=0 00000100:00080000:2.0:1789431386.800943:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431386.802130:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00020000:1.0:1789431386.802416:0:5839:0:(mdt_open.c:1594:mdt_reint_open()) cfs_fail_race id 16a waking 00000100:00080000:3.0:1789431388.951833:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431389.350533:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431389.355400:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431389.360315:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431389.360623:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789431390.442062:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996079 is committed 00000100:00080000:3.0:1789431394.073825:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431394.074059:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431394.469261:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431394.469282:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431394.469285:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1789431395.904003:0:61319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 20:16:34 (1789431394) 00000100:00080000:2.0:1789431399.196974:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431399.595211:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431399.595223:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431399.596290:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431399.596297:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431401.496671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789431401.507188:0:6704:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:0.0:1789431402.008706:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789431403.742900:0:6704:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000100:00080000:3.0:1789431404.319586:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431404.709194:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431404.709392:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431404.709541:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431404.709736:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431405.763137:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996083 is committed 00000100:00080000:2.0:1789431409.430106:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431409.828393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431409.828400:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431409.830732:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431409.830970:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1789431411.753045:0:61710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 20:16:50 (1789431410) 00000100:00080000:1.0:1789431414.552452:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431414.949800:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431414.949809:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431414.949812:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:1.0:1789431415.584997:0:6704:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:1.0:1789431416.108964:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789431417.693126:0:6704:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000100:00080000:1.0:1789431418.379954:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431419.689402:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431420.068733:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431420.068740:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431420.068743:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431421.171837:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996087 is committed 00000100:00080000:3.0:1789431424.790443:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431425.202867:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431425.202877:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431425.202880:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789431425.270766:0:62105:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 20:17:04 (1789431424) 00000100:00080000:0.0:1789431428.235485:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789431428.252478:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x821:0x0], index 0: 0 00010000:00080000:3.0:1789431428.291282:0:27100:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t4294969583 exp 0000000000000000 cur 3126 last 0 00002000:00080000:3.0:1789431428.291686:0:27100:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789431428.291725:0:27100:0:(import.c:65:import_set_state_nolock()) ffff946e02638800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789431428.297661:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789431428.385272:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969953 is committed 00000100:00080000:1.0:1789431429.919400:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789431429.950602:0:5839:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:1.0:1789431430.308898:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431430.308908:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431430.308911:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431431.446453:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996088 is committed 00000001:00080000:2.0:1789431431.446493:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996090 is committed 00000001:00020000:3.0:1789431432.363770:0:5839:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000100:00080000:2.0:1789431432.375876:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431432.988074:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431433.074107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1789431433.078969:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].47, 64 off11200 00000004:00080000:0.0:1789431433.078982:0:6704:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3131058781126ns, next at 3132058778558ns, rc = 0 00000100:00080000:2.0:1789431435.033828:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431435.037866:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431435.428972:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431435.428981:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431435.428984:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789431435.941640:0:6898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3133921437311ns, next at 3134921435032ns, rc = 0 00000001:00080000:0.0:1789431436.564710:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996095 is committed 00000004:00080000:0.0:1789431436.564724:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 85 committed 00000004:00080000:0.0:1789431436.564757:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 86 committed 00002000:00080000:0.0:1789431436.565632:0:13238:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2081 count 1 00000004:00080000:1.0:1789431436.581676:0:3298:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e09117480/2, rc 0, transno 4294969954 00000001:00080000:3.0:1789431438.606135:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294969954 is committed 00000001:02000400:3.0:1789431439.789926:0:62501:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 20:17:18 (1789431438) 00000100:00080000:0.0:1789431440.159946:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431440.160189:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431440.549557:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431440.549571:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431440.549575:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789431440.559489:0:3299:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e09117480, transno 4294969954 00000100:00080000:3.0:1789431444.485621:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:1.0:1789431444.490934:0:26938:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:3.0:1789431444.997733:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431445.272651:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431445.680516:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431445.680530:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431445.689969:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789431446.734256:0:26938:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000100:00080000:1.0:1789431446.777162:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431447.299391:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431450.400588:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431450.401703:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431450.788538:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431450.788545:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431450.788548:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789431451.909969:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996097 is committed 00000001:00080000:1.0:1789431451.909999:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996096 is committed 00000001:02000400:2.0:1789431455.392007:0:62894:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 20:17:34 (1789431454) 00000100:00080000:0.0:1789431455.514091:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431455.514725:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431455.908454:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431455.908792:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431455.908795:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431459.011826:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789431459.030112:0:26937:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x81d:0x0], index 1: 0 00010000:00080000:2.0:1789431459.061952:0:6681:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 12e09781-3d24-4c67-9972-bb781900e20d@192.168.203.39@tcp t0 exp 0000000000000000 cur 3157 last 0 00002000:00080000:2.0:1789431459.062377:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789431459.062424:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946e0bc7d800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789431459.072734:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789431459.142628:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969976 is committed 00000100:00080000:2.0:1789431460.636753:0:8085:0:(import.c:65:import_set_state_nolock()) ffff946e02638800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789431460.637025:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431460.637471:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:3.0:1789431460.667742:0:26936:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:3.0:1789431461.028812:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431461.028823:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431461.028828:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431462.153260:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996098 is committed 00000001:00080000:0.0:1789431462.153294:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996100 is committed 00000001:00020000:3.0:1789431462.996372:0:26936:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000100:00080000:2.0:1789431463.017838:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789431463.038862:0:8085:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 3161 last 0 00002000:00080000:2.0:1789431463.040111:0:8085:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789431463.040159:0:8085:0:(import.c:65:import_set_state_nolock()) ffff946e0bc79000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789431463.049145:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431463.622334:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431463.767787:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789431463.783889:0:26936:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].50, 64 off11392 00000004:00080000:1.0:1789431463.783901:0:26936:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3161763700446ns, next at 3162763698064ns, rc = 0 00000100:00080000:2.0:1789431465.755453:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431465.756431:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431466.151095:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431466.153092:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431466.154760:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431466.160193:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789431466.661947:0:8083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3164641742978ns, next at 3165641739587ns, rc = 0 00000004:00080000:0.0:1789431467.301918:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 92 committed 00000001:00080000:0.0:1789431467.301956:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996105 is committed 00000004:00080000:0.0:1789431467.301963:0:5861:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 91 committed 00002000:00080000:3.0:1789431467.306738:0:20745:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2077 count 1 00000100:00080000:3.0:1789431467.326917:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789431467.338119:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946e0fc8d880/2, rc 0, transno 4294969977 00000001:00080000:0.0:1789431469.330688:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969977 is committed 00000100:00080000:2.0:1789431470.876298:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431470.876312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1789431471.253486:0:63296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 20:17:49 (1789431469) 00000100:00080000:2.0:1789431471.268119:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431471.268789:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431471.268795:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431471.268797:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789431471.268846:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946e0fc8d880, transno 4294969977 00000100:00080000:1.0:1789431475.467487:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:2.0:1789431475.489063:0:26938:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:0.0:1789431475.999875:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431475.999883:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431476.390709:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431476.391994:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431476.395672:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431476.396096:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789431477.683322:0:26938:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000100:00080000:0.0:1789431477.707117:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431478.241031:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431481.117299:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431481.117858:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431481.523118:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431481.523126:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431481.523128:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431481.524073:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431482.649617:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996110 is committed 00000001:00080000:2.0:1789431482.649654:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996107 is committed 00000001:02000400:1.0:1789431485.284079:0:63691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 20:18:04 (1789431484) 00000100:00080000:1.0:1789431485.340045:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431486.235471:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431486.239580:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431486.628843:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431486.628887:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431486.629652:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431486.629657:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431487.722611:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996111 is committed 00000100:00080000:0.0:1789431488.974269:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789431488.982479:0:5839:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000100:00080000:0.0:1789431489.490792:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00020000:0.0:1789431491.083291:0:5839:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000100:00080000:3.0:1789431491.351843:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946e0bc7d800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789431491.352184:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431491.353504:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431491.353707:0:13238:0:(import.c:65:import_set_state_nolock()) ffff946e0bc79000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1789431491.353970:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431491.667474:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431491.749593:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431491.750304:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431491.750801:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431491.750805:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431492.882623:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996116 is committed 00000001:00080000:0.0:1789431492.882638:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996119 is committed 00000001:00080000:0.0:1789431492.882656:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996120 is committed 00000100:00080000:1.0:1789431496.477648:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431496.868173:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431496.868183:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431496.868813:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431496.869837:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1789431498.198346:0:64087:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 20:18:17 (1789431497) 00000100:00080000:2.0:1789431501.593301:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431501.997039:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431501.997048:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431501.997051:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:2.0:1789431502.362477:0:5840:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout id 145 sleeping for 15000ms 00000001:00020000:3.0:1789431504.459392:0:5840:0:(mdt_handler.c:4172:mdt_object_pdo_lock()) cfs_fail_timeout interrupted 00000100:00080000:0.0:1789431504.480560:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789431504.520875:0:6681:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 3202 last 0 00002000:00080000:0.0:1789431504.524228:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789431504.524299:0:6681:0:(import.c:65:import_set_state_nolock()) ffff946f05ac4000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789431504.530081:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789431504.642399:0:6680:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 217af837-ec0e-4ad4-94fa-9fc2e0e9f711@192.168.203.39@tcp t0 exp 0000000000000000 cur 3202 last 0 00002000:00080000:1.0:1789431504.642886:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789431504.642920:0:6680:0:(import.c:65:import_set_state_nolock()) ffff946e012ad800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789431504.651534:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431505.520655:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431506.709748:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431506.709762:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431506.709767:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431507.109061:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431507.109068:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431507.110032:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431507.110038:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789431508.229357:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996123 is committed 00000001:00080000:3.0:1789431508.230143:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996124 is committed 00000100:00080000:0.0:1789431511.840696:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431511.840705:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431511.840709:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1789431512.192722:0:64483:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 20:18:31 (1789431511) 00000100:00080000:1.0:1789431512.236433:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431512.236442:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431512.236445:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431513.018443:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431513.035085:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431513.330913:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996152 is committed 00000001:00080000:0.0:1789431513.330948:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996147 is committed 00000001:00080000:0.0:1789431513.330982:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996153 is committed 00000001:00080000:0.0:1789431513.331008:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996154 is committed 00000100:00080000:0.0:1789431515.024956:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431515.049692:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431516.952142:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431516.952150:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431517.001865:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431517.017188:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431517.349135:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431517.349891:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431517.352239:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431517.352251:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789431518.480612:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996321 is committed 00000001:00080000:0.0:1789431518.480638:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996318 is committed 00000001:00080000:0.0:1789431518.480811:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996323 is committed 00000001:00080000:0.0:1789431518.480816:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996320 is committed 00000001:00080000:0.0:1789431518.481031:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996322 is committed 00000100:00080000:0.0:1789431519.011140:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431519.041618:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431521.010347:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431521.042769:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431522.073586:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431522.073596:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431522.470570:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431522.470580:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431522.470583:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431523.031024:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431523.067719:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431523.548534:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996486 is committed 00000001:00080000:2.0:1789431523.548566:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996469 is committed 00000001:00080000:2.0:1789431523.548723:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996477 is committed 00000001:00080000:2.0:1789431523.548864:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996487 is committed 00000001:00080000:2.0:1789431523.548988:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996489 is committed 00000001:00080000:2.0:1789431523.548995:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996488 is committed 00000100:00080000:3.0:1789431525.008102:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431525.024876:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431527.003599:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431527.021807:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431527.194236:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431527.194247:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431527.592594:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431527.592873:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431527.593118:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431527.593122:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789431528.710165:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996651 is committed 00000001:00080000:0.0:1789431528.710185:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996648 is committed 00000001:00080000:0.0:1789431528.710585:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996652 is committed 00000001:00080000:0.0:1789431528.710774:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996654 is committed 00000001:00080000:0.0:1789431528.710781:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996653 is committed 00000100:00080000:0.0:1789431529.008428:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431529.046282:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431531.002129:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431531.035126:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431532.311660:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431532.311667:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431532.708070:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431532.708154:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431532.708785:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431532.717707:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431533.009408:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431533.021066:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789431533.794149:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996815 is committed 00000001:00080000:2.0:1789431533.794185:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996808 is committed 00000001:00080000:2.0:1789431533.794463:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996814 is committed 00000001:00080000:2.0:1789431533.794604:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996816 is committed 00000100:00080000:2.0:1789431535.032857:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431535.057231:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431537.007943:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431537.030914:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431537.429849:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431537.429860:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431537.827642:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431537.827692:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431537.827861:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431537.827865:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789431538.916224:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996987 is committed 00000001:00080000:2.0:1789431538.916264:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996972 is committed 00000001:00080000:2.0:1789431538.916342:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996984 is committed 00000001:00080000:2.0:1789431538.916611:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996986 is committed 00000100:00080000:1.0:1789431539.017623:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431539.041164:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431541.001513:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431541.015654:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431542.551572:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431542.558310:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431542.948170:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431542.948177:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431542.948281:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431542.948443:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431543.006393:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431543.043696:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789431544.067147:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997136 is committed 00000001:00080000:3.0:1789431544.067168:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997133 is committed 00000001:00080000:3.0:1789431544.067378:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997139 is committed 00000001:00080000:3.0:1789431544.067526:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997142 is committed 00000001:00080000:3.0:1789431544.067544:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997141 is committed 00000100:00080000:2.0:1789431545.002315:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431545.045237:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431547.006830:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431547.049922:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431547.669874:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431547.669886:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431548.074631:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431548.074647:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431548.074651:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431549.039487:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431549.085845:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789431549.235706:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997303 is committed 00000001:00080000:1.0:1789431549.235732:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997300 is committed 00000001:00080000:1.0:1789431549.235809:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997304 is committed 00000001:00080000:1.0:1789431549.235930:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997305 is committed 00000100:00080000:3.0:1789431551.007324:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431551.029324:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431552.791677:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431552.791686:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789431553.000827:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431553.034090:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431553.190004:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431553.191701:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789431553.193749:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431553.199715:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789431554.296710:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997466 is committed 00000001:00080000:1.0:1789431554.296735:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997457 is committed 00000001:00080000:1.0:1789431554.296834:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997465 is committed 00000100:00080000:2.0:1789431555.005107:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431555.028090:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431557.015385:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431557.045334:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431557.911522:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431557.913800:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789431558.319257:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431558.319267:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431558.320063:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431559.015671:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431559.044293:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789431559.443876:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997623 is committed 00000001:00080000:0.0:1789431559.443896:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997616 is committed 00000001:00080000:0.0:1789431559.444094:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997620 is committed 00000001:00080000:0.0:1789431559.444438:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997624 is committed 00000100:00080000:1.0:1789431561.005077:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431561.025739:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431563.025991:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431563.036655:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789431563.036666:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431563.079093:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431563.428637:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431563.428647:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431563.428748:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431563.428796:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789431564.527523:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997770 is committed 00000001:00080000:1.0:1789431564.527574:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997767 is committed 00000001:00080000:1.0:1789431564.527737:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997779 is committed 00000001:00080000:1.0:1789431564.527896:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997780 is committed 00000100:00080000:3.0:1789431565.003421:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431565.019911:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431567.001143:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431567.022113:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789431568.149822:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789431568.152302:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431568.549312:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431568.549321:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431568.549323:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431569.017287:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431569.064048:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789431569.664072:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997950 is committed 00000001:00080000:3.0:1789431569.664098:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997947 is committed 00000001:00080000:3.0:1789431569.664281:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997954 is committed 00000001:00080000:3.0:1789431569.664295:0:5861:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294997953 is committed 00000100:00080000:3.0:1789431571.002573:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431571.034177:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431573.004685:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789431573.021386:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789431573.273313:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789431573.273320:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431573.670644:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789431573.670650:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789431573.670744:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789431573.670885:0:5835:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 Debug log: 71763 lines, 71763 kept, 0 dropped, 0 bad.